2024-12-17T10:59:22,932 Created temporary directory: /tmp/pip-build-tracker-v_j8oion 2024-12-17T10:59:22,933 Initialized build tracking at /tmp/pip-build-tracker-v_j8oion 2024-12-17T10:59:22,934 Created build tracker: /tmp/pip-build-tracker-v_j8oion 2024-12-17T10:59:22,934 Entered build tracker: /tmp/pip-build-tracker-v_j8oion 2024-12-17T10:59:22,935 Created temporary directory: /tmp/pip-wheel-fycsc461 2024-12-17T10:59:22,939 Created temporary directory: /tmp/pip-ephem-wheel-cache-uprp6irc 2024-12-17T10:59:22,982 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-12-17T10:59:22,984 2 location(s) to search for versions of lm-eval: 2024-12-17T10:59:22,984 * https://pypi.org/simple/lm-eval/ 2024-12-17T10:59:22,984 * https://www.piwheels.org/simple/lm-eval/ 2024-12-17T10:59:22,985 Fetching project page and analyzing links: https://pypi.org/simple/lm-eval/ 2024-12-17T10:59:22,986 Getting page https://pypi.org/simple/lm-eval/ 2024-12-17T10:59:22,987 Found index url https://pypi.org/simple/ 2024-12-17T10:59:23,132 Fetched page https://pypi.org/simple/lm-eval/ as application/vnd.pypi.simple.v1+json 2024-12-17T10:59:23,136 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/1b/5f/7841febb99c12ffb453d33a67b9841e89dba18c388b644bf22b81d137fc4/lm_eval-0.0.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2024-12-17T10:59:23,137 Found link https://files.pythonhosted.org/packages/21/5a/feb5ff3a1591ca963c54873d39116b0e6a4f80e493e961ac08569709c5d7/lm_eval-0.0.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.0.1 2024-12-17T10:59:23,138 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/f3/a7/63cbce8b51de25fabb1c49f3a3fd1704faaacadb5ed816401f800e4d2dbd/lm_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2024-12-17T10:59:23,139 Found link https://files.pythonhosted.org/packages/c5/fd/edd21b0f258b4ec0260f99f5b2ac3864f7cddc8fb7c83bbb2379a6aab975/lm_eval-0.2.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.2.0 2024-12-17T10:59:23,140 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/61/c5/bff92e6b61fc2b0c1b7ac769633731910152e5176a404912ce7c07329ba0/lm_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2024-12-17T10:59:23,140 Found link https://files.pythonhosted.org/packages/c4/f8/58abc65390a758c8c2e5f1d8bb9b58d7885d02535d5f48de27006453d07e/lm_eval-0.3.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.3.0 2024-12-17T10:59:23,141 Found link https://files.pythonhosted.org/packages/45/e0/05001c2e56e2f8f793189442176432ddb89a2f1f1ef00ea154d0bc00fe37/lm_eval-0.4.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.0 2024-12-17T10:59:23,142 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/49/2d/39f7a25ab663cb45cfc7773b85980f01df44853cc427d00dce94c90b43e6/lm_eval-0.4.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2024-12-17T10:59:23,143 Found link https://files.pythonhosted.org/packages/5a/02/1c7f1ac2f139f4c05af5b94e2c4f88a70404fa0b0c22a5fb04dec0216b03/lm_eval-0.4.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.1 2024-12-17T10:59:23,144 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/0c/5a/64cf703b62ac7ada09a514c16c7136bb4ea7ef3030eb4c3d780900a5a634/lm_eval-0.4.2-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2024-12-17T10:59:23,145 Found link https://files.pythonhosted.org/packages/75/ca/18814743ba3b42d19d8524a4f771e9c3a7aa02cd4c579747a0f513907205/lm_eval-0.4.2.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.2 2024-12-17T10:59:23,145 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/39/2b/eb15fb57ba48b3cebfd302713d680d9917101867e2b5fbfd266e88b89ff3/lm_eval-0.4.3-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2024-12-17T10:59:23,146 Found link https://files.pythonhosted.org/packages/2e/69/dbff28f17e17521735460b25645479e85b58d8ad7ea8488e4672ab52b58b/lm_eval-0.4.3.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.3 2024-12-17T10:59:23,147 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/ad/e1/ac8d7d26b4d6a9eea8859d438691b5d8209a37be2117b3e61f247de2d9e7/lm_eval-0.4.4-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2024-12-17T10:59:23,148 Found link https://files.pythonhosted.org/packages/c6/a8/4dcffd9ad0ddb6c479f93d8316a108a6f9b4d81756c892f150b6c307e8d4/lm_eval-0.4.4.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.4 2024-12-17T10:59:23,148 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/c1/78/fb3ea82c77ccc4dbbd6cafceb15ca01c1cd4d778217d572d65c919b0643f/lm_eval-0.4.5-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2024-12-17T10:59:23,149 Found link https://files.pythonhosted.org/packages/68/7a/cb1993a8d217a5b4c6e52f612a677c4f02c3412d2e3093ecbf6f6413136c/lm_eval-0.4.5.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.5 2024-12-17T10:59:23,150 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/45/b9/1b4e3268b590d9ff16e087685d9526455bb677c3e4d0caeba4451f20c586/lm_eval-0.4.7-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8) 2024-12-17T10:59:23,151 Found link https://files.pythonhosted.org/packages/53/c9/b5d03d5b2bf6819008e377844999fbd04ab00dff0c43728957f1c90a53c5/lm_eval-0.4.7.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.8), version: 0.4.7 2024-12-17T10:59:23,151 Fetching project page and analyzing links: https://www.piwheels.org/simple/lm-eval/ 2024-12-17T10:59:23,152 Getting page https://www.piwheels.org/simple/lm-eval/ 2024-12-17T10:59:23,154 Found index url https://www.piwheels.org/simple/ 2024-12-17T10:59:23,323 Fetched page https://www.piwheels.org/simple/lm-eval/ as text/html 2024-12-17T10:59:23,326 Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.4.5-py3-none-any.whl#sha256=c1292031153f79a22db4193ed91074a1c57ffaec3d9768215a455efd53ff5f02 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2024-12-17T10:59:23,327 Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.4.4-py3-none-any.whl#sha256=1a6e6b514b470ad4c795439aa4cf9cb88b1360d915c7b3108ae5b47e3f7b36fc (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2024-12-17T10:59:23,328 Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.4.3-py3-none-any.whl#sha256=7f4cb7cbd7ea20f2624f1315e69dfbc884cc187749c85760f9b4ec03e7efe491 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2024-12-17T10:59:23,328 Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.4.2-py3-none-any.whl#sha256=a0bcaff492a09947d8a2b80400f224113b1e313da6a688084711130da18e1af7 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2024-12-17T10:59:23,329 Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.4.1-py3-none-any.whl#sha256=796615edf52f5673187a884a9d77c7d755fe95ca2d16fe77a1f042730eb957b3 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2024-12-17T10:59:23,329 Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.4.0-py3-none-any.whl#sha256=1a863b5f478f2e66e921dbbf2e4dcda06a923021763f01b59c5b03bdd3af01c2 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.8) 2024-12-17T10:59:23,330 Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.3.0-py3-none-any.whl#sha256=498b8b8954c1f9c17f46e3ec096e9be6b9c96ee70560ee613a4eb9c7b9d31644 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2024-12-17T10:59:23,331 Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.2.0-py3-none-any.whl#sha256=e06d3d7b6016be832e6889cbc9c4787b99156ba57f8feb31d3aeb27304c6558c (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2024-12-17T10:59:23,331 Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.0.1-py3-none-any.whl#sha256=0afc289f69286f71017fb9811dfea6cda7c703bf693ad43106fbbff1f164cf14 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6) 2024-12-17T10:59:23,332 Skipping link: not a file: https://www.piwheels.org/simple/lm-eval/ 2024-12-17T10:59:23,332 Skipping link: not a file: https://pypi.org/simple/lm-eval/ 2024-12-17T10:59:23,351 Given no hashes to check 1 links for project 'lm-eval': discarding no candidates 2024-12-17T10:59:23,353 Collecting lm-eval==0.4.7 2024-12-17T10:59:23,355 Created temporary directory: /tmp/pip-unpack-cwiz846y 2024-12-17T10:59:23,606 Downloading lm_eval-0.4.7.tar.gz (1.1 MB) 2024-12-17T10:59:30,329 Added lm-eval==0.4.7 from https://files.pythonhosted.org/packages/53/c9/b5d03d5b2bf6819008e377844999fbd04ab00dff0c43728957f1c90a53c5/lm_eval-0.4.7.tar.gz to build tracker '/tmp/pip-build-tracker-v_j8oion' 2024-12-17T10:59:30,334 Created temporary directory: /tmp/pip-build-env-qxfn50b7 2024-12-17T10:59:30,339 Installing build dependencies: started 2024-12-17T10:59:30,340 Running command pip subprocess to install build dependencies 2024-12-17T10:59:31,694 Using pip 24.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-12-17T10:59:31,695 Non-user install by explicit request 2024-12-17T10:59:32,375 Created build tracker: /tmp/pip-build-tracker-v_j8oion 2024-12-17T10:59:32,376 Entered build tracker: /tmp/pip-build-tracker-v_j8oion 2024-12-17T10:59:32,379 Created temporary directory: /tmp/pip-install-shy53zd0 2024-12-17T10:59:32,383 Created temporary directory: /tmp/pip-ephem-wheel-cache-f1s92vmt 2024-12-17T10:59:32,427 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-12-17T10:59:32,429 2 location(s) to search for versions of setuptools: 2024-12-17T10:59:32,430 * https://pypi.org/simple/setuptools/ 2024-12-17T10:59:32,430 * https://www.piwheels.org/simple/setuptools/ 2024-12-17T10:59:32,431 Fetching project page and analyzing links: https://pypi.org/simple/setuptools/ 2024-12-17T10:59:32,432 Getting page https://pypi.org/simple/setuptools/ 2024-12-17T10:59:32,433 Found index url https://pypi.org/simple/ 2024-12-17T10:59:32,436 Looking up "https://pypi.org/simple/setuptools/" in the cache 2024-12-17T10:59:32,437 Request header has "max_age" as 0, cache bypassed 2024-12-17T10:59:32,441 Starting new HTTPS connection (1): pypi.org:443 2024-12-17T10:59:32,583 https://pypi.org:443 "GET /simple/setuptools/ HTTP/1.1" 304 0 2024-12-17T10:59:32,601 Fetched page https://pypi.org/simple/setuptools/ as application/vnd.pypi.simple.v1+json 2024-12-17T10:59:32,896 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/77/38/90cae8fd99c5dc402d25930e1c91f5fcf6de5c8e982fd152a5a061e3df56/setuptools-0.6b1-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,897 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/1f/ab/1ed6131b5112d1d47cb89e1cbea08f783f0ed49d6fc795ed2ff63f84d20c/setuptools-0.6b1-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,898 Found link https://files.pythonhosted.org/packages/82/cb/906d051fdf1c8b7703d288d3cc44ff32746090378f7f8539c8476a21ce9a/setuptools-0.6b1.zip (from https://pypi.org/simple/setuptools/), version: 0.6b1 2024-12-17T10:59:32,899 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/61/52/c84d22f3669ea8d4e54126f6241d7ed9828e3a382596f170043dfdaddbcc/setuptools-0.6b2-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,900 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/9b/87/48c155a10c4561fe9b8a83dcf9361ddb9cc9ab5c3ed1b504ac12ab11ed6a/setuptools-0.6b2-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,901 Found link https://files.pythonhosted.org/packages/0e/3b/53daeaf6623a2bab3d3c40b19a35ff5bd7c4e1fbad2f537a61c1fe8c5069/setuptools-0.6b2.zip (from https://pypi.org/simple/setuptools/), version: 0.6b2 2024-12-17T10:59:32,902 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/c3/13/a3129905c118a7004e4bbc6db2c24d73de9e15960fd749a61e16fb114f30/setuptools-0.6b3-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,903 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/10/b3/7166e400d3b953fa4714f97806f077a3f7791cd48ea71df708814234283a/setuptools-0.6b3-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,904 Found link https://files.pythonhosted.org/packages/ff/33/635de67bf3010651ba8db9d8064721274bfb6fbb778a110089f34beabaf2/setuptools-0.6b3.zip (from https://pypi.org/simple/setuptools/), version: 0.6b3 2024-12-17T10:59:32,905 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/1c/d7/6927233caddaa4f466a8b957c94be00810e751edb2655283c04fc3b680f2/setuptools-0.6b4-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,906 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/b3/79/8c94b6c99192df5f5d900ce17405cb5cfcdab8643d2e4aaf6ce1ee948576/setuptools-0.6b4-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,906 Found link https://files.pythonhosted.org/packages/82/be/b2e51157a4debc4ebcab179aeb839948a0f02ce06cbc7749c8ab866c0aa9/setuptools-0.6b4.zip (from https://pypi.org/simple/setuptools/), version: 0.6b4 2024-12-17T10:59:32,908 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/54/f7/6f443db0df0a1706d8af3a8fa7d18528e5557f588cbddce7f7b47ff08ba5/setuptools-0.6c1-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,908 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/59/61/1ab6a87cec11ffb403280338aacc2c7a1e44eff0d7e431076fba1e61895e/setuptools-0.6c1-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,909 Found link https://files.pythonhosted.org/packages/4e/2d/555dc3106b42c977a2f7c7e6f28e5b3104c9bd9306005d304d2ddc1c6587/setuptools-0.6c1.zip (from https://pypi.org/simple/setuptools/), version: 0.6c1 2024-12-17T10:59:32,910 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/24/01/51f2d3ede491f51990b99ab0bfc5bad473c9b45fcf9b1c7b8c7bc3ff0e14/setuptools-0.6c2-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,911 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/64/c4/cb2718f8851517aba754c4f25d79f2a65430d4a4979375d78ea51f217123/setuptools-0.6c2-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,912 Found link https://files.pythonhosted.org/packages/e3/dd/5ccc0dd99d67675bda31bfb1e5be1460f908b9e3e475660bdcb98aea5f36/setuptools-0.6c2.zip (from https://pypi.org/simple/setuptools/), version: 0.6c2 2024-12-17T10:59:32,913 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/21/56/b48e6f7fa5a58e87a3b0761af2bedf2a6668c553ab4c39ee2646ef9597f7/setuptools-0.6c3-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,914 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/73/0d/239e2877d84df3231b5da63ff7358871f66eeab89458574247ebe7c427c7/setuptools-0.6c3-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,915 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/20/22/7e414402a50a263f15d1d7f0a469ba63aa1f2fb79e653a64732b3b18af48/setuptools-0.6c3-py2.5.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,916 Found link https://files.pythonhosted.org/packages/01/21/d4c5b856d702d0c6e3a615061d0b6e7101c375ceb664126583de863b4181/setuptools-0.6c3.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c3 2024-12-17T10:59:32,917 Found link https://files.pythonhosted.org/packages/69/d7/a22dd38ff4811beaaa7089825dc38a34f47818f25c7025b1caab4e67b54b/setuptools-0.6c3.zip (from https://pypi.org/simple/setuptools/), version: 0.6c3 2024-12-17T10:59:32,918 Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/4b/02/33240ac22d7dc895c5d18119a7a4b7b97ca45f7436c2633840287c2c7a4e/setuptools-0.6c4-1.src.rpm (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,919 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/35/b8/00453469271120ea64d3c4da218dd83565f5b1d3e848371c13afa43bb58c/setuptools-0.6c4-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,920 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/00/5c/53f6b2cbe1f8344695eeb166e1906d573146fcb9f9f9ad116b7c4cf907ca/setuptools-0.6c4-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,921 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/ad/67/6764874b7091d4b5902de113b30ffc40713c3176908177c53c0ae3129fb9/setuptools-0.6c4-py2.5.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,922 Found link https://files.pythonhosted.org/packages/73/57/a910b32ea2131b5d8f7a2ff106e5a1c47b0cad4baed171ca12ffa5613c39/setuptools-0.6c4.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c4 2024-12-17T10:59:32,923 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/f4/d2/2be204269d952f712b433e9c27dc76b54dd2c3fcc38a085b561614d4a0bd/setuptools-0.6c4.win32-py2.3.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,924 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/3f/ee/f64f590be21ae82c6de485751596c540c24b218804fe19c1a936109bfec5/setuptools-0.6c4.win32-py2.4.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,925 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/b3/ee/650a6df344eb5cba091c2729764f44c7fa9309f2421c9518c8509a0b76f8/setuptools-0.6c4.win32-py2.5.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,926 Found link https://files.pythonhosted.org/packages/7e/2d/926f4536e819fa93d7a4aeb0910849387c1234b865310aee40289e457012/setuptools-0.6c4.zip (from https://pypi.org/simple/setuptools/), version: 0.6c4 2024-12-17T10:59:32,926 Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/c1/11/efc7f5f5d5d0d7b77030753469ab3173b41d7e92de9de9c384f0f9a3e95d/setuptools-0.6c5-1.src.rpm (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,927 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/b9/32/3797469c91a78e329cb2f73bedddd3a70cf688a91f484f35f65553ae853f/setuptools-0.6c5-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,928 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/e9/24/31abf427add2d867e16164ac0215f079f8d2a9a3f5fe9153906425b94fc2/setuptools-0.6c5-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,929 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/73/df/f68a5c3acd5e7f813d56cd147d713720ceb4ef7a2064c927c9d77fba2d61/setuptools-0.6c5-py2.5.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,930 Found link https://files.pythonhosted.org/packages/ba/1b/1480b6fef57c0ac946942731467d4d0590b305c4808e0be1b17fd3f5a8c8/setuptools-0.6c5.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c5 2024-12-17T10:59:32,931 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/90/0a/43530fce7c099634d23b29735a590bb38635e97a069493b76d64ad476a7f/setuptools-0.6c5.win32-py2.3.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,932 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/84/cf/c588fd4bc0310edaf8e9a026447fa4a7210b5079f87aaf753cbe3be15b90/setuptools-0.6c5.win32-py2.4.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,933 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/06/5f/1f915846c47f2bdc62f96965af5ac5900e1280864c758f3cd64b1dcac58b/setuptools-0.6c5.win32-py2.5.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,934 Found link https://files.pythonhosted.org/packages/bb/55/371d4c3a5b9c696c93746f295dddf43a536c42b32f0df52ee0b2a67f9e1e/setuptools-0.6c5.zip (from https://pypi.org/simple/setuptools/), version: 0.6c5 2024-12-17T10:59:32,935 Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/5a/ee/8d3bbe7e760fa9759183ad8b56b8b92b573c5111639e0e740e0e1fd6e20f/setuptools-0.6c6-1.src.rpm (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,936 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/a1/d4/150ef1cb7fdf2f636e9c7847fd38a7704facb9216821bdd697c72573f065/setuptools-0.6c6-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,937 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/8c/80/0fdac5b7b6c17c5b347250798689e600111895017e3855e0db7238bcb7bc/setuptools-0.6c6-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,938 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/95/e6/98322b7ac8f1879196d4327a1a2d352802e6635d72496e6c4b4a2204f93e/setuptools-0.6c6-py2.5.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,939 Found link https://files.pythonhosted.org/packages/c8/d1/23a9b039d7962a211b759c48571d2ffe041fbc0ba6d8732d46ddd899beef/setuptools-0.6c6.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c6 2024-12-17T10:59:32,940 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/5b/13/459677b0ec718a3f5706d1e8175d4856f1bbadaa627628679d8a79e6db8c/setuptools-0.6c6.win32-py2.3.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,941 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/42/a9/dab94b4f97a399a4226414d48e4a39410c682578b97a3032bf9b81f079ce/setuptools-0.6c6.win32-py2.4.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,942 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/4c/c0/2ba74e7430d76ee173c9cda0711af98064a9fdbd558e14432f800e92e373/setuptools-0.6c6.win32-py2.5.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,942 Found link https://files.pythonhosted.org/packages/b0/8f/7fb7b87601dfd654e6d4dbe2dd2f61d029dc0037cc5b6fe6caebf3e5dac0/setuptools-0.6c6.zip (from https://pypi.org/simple/setuptools/), version: 0.6c6 2024-12-17T10:59:32,944 Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/16/47/b2f6126fc281f9822bf41a23f5dfbd8fc95d027ba5949ac2089e26ea2414/setuptools-0.6c7-1.src.rpm (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,944 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/99/7a/816dba79270f752523617b31f8d91d25df2a02ced79caa52a812e567817d/setuptools-0.6c7-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,945 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/25/98/dbfc23715d073aa65014e219b078c885ee478ee8266f37cf5beef2220434/setuptools-0.6c7-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,946 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/84/22/4aa617d74f0e3f320b651d04f0ea2468cac03daa5aab296888c5a36ed459/setuptools-0.6c7-py2.5.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,948 Found link https://files.pythonhosted.org/packages/74/4f/8f72fc07063c2a8c60821f69761cbca236af346bdbc61ec2f6cf30fe79e8/setuptools-0.6c7.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c7 2024-12-17T10:59:32,949 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/0b/1b/2298438741c10969a34ea3523e8a009dccb4cbf9ed16ed6678eaf0043303/setuptools-0.6c7.win32-py2.3.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,950 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/c4/48/fc36c7b5e987b989ec3af3c4f741a9c2927e68020d4a71d7cbafea414bd7/setuptools-0.6c7.win32-py2.4.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,951 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/9a/e1/4858e7839df23e373b3b39a45f17f01f3a41c35c034cd8059124641a2a23/setuptools-0.6c7.win32-py2.5.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,952 Found link https://files.pythonhosted.org/packages/55/10/c08016fc0855ebe88f6711e198e8e3ac9a1bae62effacc51bcb5c0b90d22/setuptools-0.6c7.zip (from https://pypi.org/simple/setuptools/), version: 0.6c7 2024-12-17T10:59:32,953 Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/b8/ac/75799ee665da8f826c4b494d46765f76a1c963fde9eb5dede05c2caccf38/setuptools-0.6c8-1.src.rpm (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,954 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/ae/d4/740611a1e12211e37eb235f8ff5913cd14e8573b2e1c2586a623ad405ad9/setuptools-0.6c8-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,955 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/8e/6b/c1cd58d373ce4d3c8d4cb61e2185c0b0ec58911eb742c0dca026ff1450ed/setuptools-0.6c8-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,956 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/b9/4c/1ccb5022fb94f3f8d5c90d2931e34d4208ea3aa0e7c4927d49c9e060e568/setuptools-0.6c8-py2.5.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,957 Found link https://files.pythonhosted.org/packages/29/17/f98a2cb39bb5b40357fd54fba1dd105e224a447a91867ac5c4ef6f8f0191/setuptools-0.6c8.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c8 2024-12-17T10:59:32,958 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/da/1d/ec8ecc71d817000bfc86eaafe2af7984fe8a5c61c86abaf663bbef1ac7fa/setuptools-0.6c8.win32-py2.3.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,959 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/fa/f1/c2553c8095a7d430b39669081acfa8afecff686682e9fec8df3403495cd3/setuptools-0.6c8.win32-py2.4.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,960 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/2a/f9/359b6a4b6eafa7323522dd89e3765e2ea191a37d3a349d8363e6f49205b8/setuptools-0.6c8.win32-py2.5.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,961 Found link https://files.pythonhosted.org/packages/65/99/1f95f6996022c7d5e00b18b5a47813c888b12d6837071f1978280801d9ad/setuptools-0.6c8.zip (from https://pypi.org/simple/setuptools/), version: 0.6c8 2024-12-17T10:59:32,962 Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/36/8a/c70262c0c8f1c0e321f626fec1865ad2714f28cc3302aaa2c0588e89d866/setuptools-0.6c9-1.src.rpm (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,964 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/aa/6f/8a4d13d6d98c6b66fb675282be930e0f742565f5972701ff74a321b5d190/setuptools-0.6c9-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,965 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/fc/bf/4f539489c61c543752a4e738b818f8e8463c8d3771ad134e66f35c43d03f/setuptools-0.6c9-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,966 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/04/53/b56373f85a56ddc68e0c9177fdd2a88e87b37d91e636e09dbdfb958cc858/setuptools-0.6c9-py2.5.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,967 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/0c/e8/10eed514d71c6f57d9d0eab2a8a7fc578fbcc4e8d464a19310857b93a97a/setuptools-0.6c9-py2.6.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,968 Found link https://files.pythonhosted.org/packages/5e/bc/70a3d8213cda12eac84c770895c54521d0d19847b512cef54d6c83b0ddcb/setuptools-0.6c9.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c9 2024-12-17T10:59:32,969 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/34/34/3fbaed52feeed2f3e50867d40826f1e3a2d6fe1cb57b5069e932153c8849/setuptools-0.6c9.win32-py2.3.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,970 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/e3/0c/c1d6f2f4784dd62e9dc725fd849bd2d66c147644b0713030a28b06351a0e/setuptools-0.6c9.win32-py2.4.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,971 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/e1/cd/d6bad589187cb0c95ce7e5471932004ed40d7001424db431b3ac950719d8/setuptools-0.6c9.win32-py2.5.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,972 Found link https://files.pythonhosted.org/packages/63/cd/163f3ecaf70c0c8406a6bccfea1b304e33b16a7e3dd1aac993561f0d0c9d/setuptools-0.6c9.zip (from https://pypi.org/simple/setuptools/), version: 0.6c9 2024-12-17T10:59:32,973 Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/58/24/429cfabb3bad49f4f4d4222de00767596449207d9a399dbd6377596f5c98/setuptools-0.6c10-1.src.rpm (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,974 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/d0/37/ec64b158f71fce356be64c9a4d72412035fd09d3454a45de9d43ce68a1eb/setuptools-0.6c10-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,975 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/60/6c/ca66c3554907381fab74cad8d22d6d64d03da23322ad0b0b21c8c83cbabf/setuptools-0.6c10-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,976 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/15/33/a63a84b00931607d96e0f383d2575e5826b18893ff19f1ab622f8f4e03e9/setuptools-0.6c10-py2.5.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,977 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/3c/93/52aa366f8341dbbcbf88f93bc253574ded15dfaec66fe9d5a5b57f0584b9/setuptools-0.6c10-py2.6.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,979 Found link https://files.pythonhosted.org/packages/c4/0c/aeca030b34c3db641ee5b9c82a06be9a9c2f683f7dc49a70603a3a61d758/setuptools-0.6c10.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c10 2024-12-17T10:59:32,980 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/09/a2/4d6d8597c939c46e5b5ad28c30cb555dea9fda539524116dbd7289cb37ec/setuptools-0.6c10.win32-py2.3.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,981 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/9d/e7/23646cf93d499043999e1847e7207623bea0faae8ffdf6cd4c0978622744/setuptools-0.6c10.win32-py2.4.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,982 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/63/41/a274e2ce80087f5a07bc48ea6dd3476d767c37fb9001f56400beb68c4ca2/setuptools-0.6c10.win32-py2.5.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,983 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/7f/ba/a094b22ecc74374f040d944aa770d74e81f835e5380b0b18898b7c0f995c/setuptools-0.6c10.win32-py2.6.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,984 Found link https://files.pythonhosted.org/packages/f9/71/ad34bdb9e742a8a78fc55acdc7904129d5865e765cbc3331e74e79db45f2/setuptools-0.6c10.zip (from https://pypi.org/simple/setuptools/), version: 0.6c10 2024-12-17T10:59:32,985 Skipping link: unsupported archive format: .rpm: https://files.pythonhosted.org/packages/1e/b7/a4639da3c762e3162b23b439ed8d91076499464dce2f35e4826d1e2b3559/setuptools-0.6c11-1.src.rpm (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,986 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/70/68/bbf97a2f73e8253a87ff7d1b73c94e1bf0bf1900ed8e5fd7bf98180f4483/setuptools-0.6c11-py2.3.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,987 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/f0/5d/2edc5f4af10151e80251678f7a7c5130578b16116e2f31e03bf75459bb7f/setuptools-0.6c11-py2.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,988 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/98/d3/ed3bc7e3f4b143092862dab99d984261ac4be6a40d4fb1e66d2a10e9ea99/setuptools-0.6c11-py2.5.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,989 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/53/36/970486f83d2fdcc1b5bac53f8aab5af71b81dcbf786d887e923a9962343f/setuptools-0.6c11-py2.6.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,990 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/25/5d/cc55d39ac39383dd6e04ae80501b9af3cc455be64740ad68a4e12ec81b00/setuptools-0.6c11-py2.7.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,991 Found link https://files.pythonhosted.org/packages/8b/62/baf1e2c2b02de7898dcacd1d1a41e323b79d25be5c88d2805c89fb424835/setuptools-0.6c11.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.6c11 2024-12-17T10:59:32,992 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/5a/2f/f77682b48b0b50274bd7ab826de90521c4b7e7d8479da06030d29e015205/setuptools-0.6c11.win32-py2.3.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,993 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/8c/28/f3ee69ca5cd4d243f592c6045f443743904e07e8f95d7d5948198149cbaa/setuptools-0.6c11.win32-py2.4.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,994 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/4c/29/23ecf8af775fa80bbc175c52e6bc4f79284579af37ac1692bbb5f8f2d61d/setuptools-0.6c11.win32-py2.5.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,995 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/69/dd/153cafc26d351949ca56ae0c9259b69eeeca8dac9a5aeabe7eef8f86a311/setuptools-0.6c11.win32-py2.6.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,996 Skipping link: unsupported archive format: .exe: https://files.pythonhosted.org/packages/1c/cd/e68c430415ab4baefb97dea7ba14eaa68eeb47d778456ffbc1f437229660/setuptools-0.6c11.win32-py2.7.exe (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:32,997 Found link https://files.pythonhosted.org/packages/61/f0/0cb5db3d39676f5b240d7bbda27da857d75d5334fb29624c9e3d52076d44/setuptools-0.6c11.zip (from https://pypi.org/simple/setuptools/), version: 0.6c11 2024-12-17T10:59:32,998 Found link https://files.pythonhosted.org/packages/82/bc/48dbb17f35116a6348197e249a2780b66d5d5d9ded73d7e56cb939e04bd5/setuptools-0.7.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.2 2024-12-17T10:59:33,000 Found link https://files.pythonhosted.org/packages/53/9c/bbd954749f472632069dcc4d23783513c70e8c535b0eaeee3546bcccd0ca/setuptools-0.7.2.zip (from https://pypi.org/simple/setuptools/), version: 0.7.2 2024-12-17T10:59:33,001 Found link https://files.pythonhosted.org/packages/22/5e/22d01d802d230e5be2abc943a4fe00e07d9335e7ede51e46de424aacab77/setuptools-0.7.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.3 2024-12-17T10:59:33,002 Found link https://files.pythonhosted.org/packages/14/83/7dc02a7d21a462dec824fa4624f9de834721ac61499c326a09b0e1245cd6/setuptools-0.7.3.zip (from https://pypi.org/simple/setuptools/), version: 0.7.3 2024-12-17T10:59:33,003 Found link https://files.pythonhosted.org/packages/54/d4/cadd20d2b2cf30746a59fd7feaa7c4280b62fa8916f7b4d6558831e10c35/setuptools-0.7.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.4 2024-12-17T10:59:33,004 Found link https://files.pythonhosted.org/packages/b0/d4/105445cfd654f7f0841bc2281f501608827e098f01f9b4525221af109ccc/setuptools-0.7.4.zip (from https://pypi.org/simple/setuptools/), version: 0.7.4 2024-12-17T10:59:33,005 Found link https://files.pythonhosted.org/packages/6d/f8/72cd7acc71922d36d8056b0a4314455944f22dd776fa5a0caf10b12d20cb/setuptools-0.7.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.5 2024-12-17T10:59:33,006 Found link https://files.pythonhosted.org/packages/cc/b8/c5b652eb51d99872fec912d64cb9d06104ebd59551ad2053aba96862b3c7/setuptools-0.7.5.zip (from https://pypi.org/simple/setuptools/), version: 0.7.5 2024-12-17T10:59:33,007 Found link https://files.pythonhosted.org/packages/d5/6c/096e2061e907d322b099769ea819d7c6bcf7ac7a3402bfa050d09de38a18/setuptools-0.7.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.6 2024-12-17T10:59:33,009 Found link https://files.pythonhosted.org/packages/3d/17/734a648686d4bc184857a3b0b69f407a0489f4c51b3c6abcce1f5c06841d/setuptools-0.7.6.zip (from https://pypi.org/simple/setuptools/), version: 0.7.6 2024-12-17T10:59:33,010 Found link https://files.pythonhosted.org/packages/a1/e9/ace7f7b52bd4a1ab36e39bcf7a9fe1ce20ccf1d6e6f6625fec718856434f/setuptools-0.7.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.7 2024-12-17T10:59:33,011 Found link https://files.pythonhosted.org/packages/9d/a5/9917277554697b42ca6e21996ede42519044f841e23f7489728b6eed98dd/setuptools-0.7.7.zip (from https://pypi.org/simple/setuptools/), version: 0.7.7 2024-12-17T10:59:33,012 Found link https://files.pythonhosted.org/packages/9d/2c/91dafba5f967f5dbcc0c51822af3a2b11b6f65cae7ef04fc285fb3771ca2/setuptools-0.7.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.7.8 2024-12-17T10:59:33,013 Found link https://files.pythonhosted.org/packages/18/22/444bcadc8b170024c439cf60e862571b9504a70bbc95848a11cf26361a22/setuptools-0.7.8.zip (from https://pypi.org/simple/setuptools/), version: 0.7.8 2024-12-17T10:59:33,014 Found link https://files.pythonhosted.org/packages/18/f5/4448556e66efd9e9d21804d3ef745783cff42abc7c39573343f0ba94fc82/setuptools-0.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.8 2024-12-17T10:59:33,015 Found link https://files.pythonhosted.org/packages/1a/b7/a64c73af31bc3dcce8b37005b638553605a572feb5169c4766a159996254/setuptools-0.8.zip (from https://pypi.org/simple/setuptools/), version: 0.8 2024-12-17T10:59:33,017 Found link https://files.pythonhosted.org/packages/3b/ac/2b61b9e6cbeba2764f31d744478b1ea46a476b3623cc12c559435c14a972/setuptools-0.9.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9 2024-12-17T10:59:33,018 Found link https://files.pythonhosted.org/packages/9f/a7/e459019b5871e7420ceccfb5dfde52def0ba8173406b441b8b6d314e50c1/setuptools-0.9.zip (from https://pypi.org/simple/setuptools/), version: 0.9 2024-12-17T10:59:33,019 Found link https://files.pythonhosted.org/packages/1a/52/645c11a1c57513a43a557cf752833c19223f365771e30c88637170026ef7/setuptools-0.9.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.1 2024-12-17T10:59:33,020 Found link https://files.pythonhosted.org/packages/9c/46/83b866faeab163db1c4a9fddf93e7d60e28ce2a97cf2669667551f496294/setuptools-0.9.1.zip (from https://pypi.org/simple/setuptools/), version: 0.9.1 2024-12-17T10:59:33,021 Found link https://files.pythonhosted.org/packages/2c/02/3e1e2e547114b6a659923c9d88fa74adec9aa46d46a48f70cd02b9fb4646/setuptools-0.9.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.2 2024-12-17T10:59:33,022 Found link https://files.pythonhosted.org/packages/4f/b3/51ef01e9af978f6ddc388754a201a5abb316fb8c84293901c92c52344b57/setuptools-0.9.2.zip (from https://pypi.org/simple/setuptools/), version: 0.9.2 2024-12-17T10:59:33,024 Found link https://files.pythonhosted.org/packages/70/43/f4c210d2d356312e197db577bc1ff250e1a1ce9d42cea53b0577f945e35d/setuptools-0.9.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.3 2024-12-17T10:59:33,025 Found link https://files.pythonhosted.org/packages/5b/01/7d51a958fc84528e6479bd94a902524f8008d07b152ca8d7385a76c05f45/setuptools-0.9.3.zip (from https://pypi.org/simple/setuptools/), version: 0.9.3 2024-12-17T10:59:33,026 Found link https://files.pythonhosted.org/packages/d8/00/37076fbd97e9c3505f5af64dce0cae55305e4a9efc05efe1468d2d3397b3/setuptools-0.9.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.4 2024-12-17T10:59:33,027 Found link https://files.pythonhosted.org/packages/f5/a8/4183275281748f649fb6023a33b2d3114acf6b88d6ad9e38d4ead96a570c/setuptools-0.9.4.zip (from https://pypi.org/simple/setuptools/), version: 0.9.4 2024-12-17T10:59:33,028 Found link https://files.pythonhosted.org/packages/ce/d8/bb3901aecd386dd5caa9fd05aaddd377bdbbd81ee32f7ce5ad6f9e70a479/setuptools-0.9.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.5 2024-12-17T10:59:33,030 Found link https://files.pythonhosted.org/packages/26/82/6c7fb9dc9191fc30bf071bec1b9096fdee6ece9e46de98fc17fcd9b6534c/setuptools-0.9.5.zip (from https://pypi.org/simple/setuptools/), version: 0.9.5 2024-12-17T10:59:33,031 Found link https://files.pythonhosted.org/packages/1a/49/db8869101a9ceb241f9c77f466a7eb5c0ca0c3c18cce7dcf536448ff9e2c/setuptools-0.9.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.6 2024-12-17T10:59:33,032 Found link https://files.pythonhosted.org/packages/e9/ce/1aa7d625015a5d39a44d42e743ed2ed35eb24d260e161f36dd7ee0fa0155/setuptools-0.9.6.zip (from https://pypi.org/simple/setuptools/), version: 0.9.6 2024-12-17T10:59:33,033 Found link https://files.pythonhosted.org/packages/ec/96/fed5a1a6633c296f9a8ff28070fc7578700e2cd30ec2d73e25ba42f14445/setuptools-0.9.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.7 2024-12-17T10:59:33,034 Found link https://files.pythonhosted.org/packages/34/c3/335e0706cce3dd8e0ca61d4a2b528c8803d6767711fd9a4e3a3f728167cb/setuptools-0.9.7.zip (from https://pypi.org/simple/setuptools/), version: 0.9.7 2024-12-17T10:59:33,052 Found link https://files.pythonhosted.org/packages/51/20/7b9e9cc363f176d9c3f1c4570e8ed8654ceba5cf3b0022d06add2f0e36ae/setuptools-0.9.8-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 0.9.8 2024-12-17T10:59:33,054 Found link https://files.pythonhosted.org/packages/58/61/b0af220037d130247dc90ca4bad813c12486f41f74d7d68467415a98a990/setuptools-0.9.8-py33-none-any.whl (from https://pypi.org/simple/setuptools/), version: 0.9.8 2024-12-17T10:59:33,055 Found link https://files.pythonhosted.org/packages/6a/a9/fe6661ade707a09c2a73b1a20e47f9e85fa1c1e1aec72e60b7d541550983/setuptools-0.9.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 0.9.8 2024-12-17T10:59:33,056 Found link https://files.pythonhosted.org/packages/0e/b7/591fbc0db1f45393629c73a3a0fc95656a8fd80ec24a7de27882613a4ce7/setuptools-0.9.8.zip (from https://pypi.org/simple/setuptools/), version: 0.9.8 2024-12-17T10:59:33,057 Found link https://files.pythonhosted.org/packages/08/3e/9d506abd494ae580528424201e28efcbb34d188848c547f7d30868c40192/setuptools-1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.0 2024-12-17T10:59:33,058 Found link https://files.pythonhosted.org/packages/ef/69/2e29f2ab36ad3240fe884a8593c2b779bce2733a88a948e744a0aeb7f244/setuptools-1.0.zip (from https://pypi.org/simple/setuptools/), version: 1.0 2024-12-17T10:59:33,059 Found link https://files.pythonhosted.org/packages/eb/5b/aa07261d384bc8313c24490bc132f618bbe6ab700f7b9ed8754406ac3fe7/setuptools-1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1 2024-12-17T10:59:33,060 Found link https://files.pythonhosted.org/packages/a5/19/a9df3825e341570356136041580bb639e96482e0dd74bb60fe1571816263/setuptools-1.1.zip (from https://pypi.org/simple/setuptools/), version: 1.1 2024-12-17T10:59:33,061 Found link https://files.pythonhosted.org/packages/36/b2/28079abead6cddc7bfbba67e1f6219b3f39b3d20319ebf1dc56060b7b43c/setuptools-1.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.1 2024-12-17T10:59:33,063 Found link https://files.pythonhosted.org/packages/11/7a/b673ff9e739ffeff49d725a6d4f871e7fb0c1e66bf1cd70d6e71111dd891/setuptools-1.1.1.zip (from https://pypi.org/simple/setuptools/), version: 1.1.1 2024-12-17T10:59:33,064 Found link https://files.pythonhosted.org/packages/08/b2/e8808bfc2fcf0c599ec283c3dd51f2ef75992230e31b5e0a4ebd0f18e71d/setuptools-1.1.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.2 2024-12-17T10:59:33,065 Found link https://files.pythonhosted.org/packages/4a/a3/5ae98420be50bcb7d20924c912801b0c0d3965ec016aa0dea16c12381374/setuptools-1.1.2.zip (from https://pypi.org/simple/setuptools/), version: 1.1.2 2024-12-17T10:59:33,066 Found link https://files.pythonhosted.org/packages/56/7a/543eee732d4276b7a144faa8ef0a30778ae972028e9f197c00201750cd9b/setuptools-1.1.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.3 2024-12-17T10:59:33,067 Found link https://files.pythonhosted.org/packages/02/a1/f027eae4df0a7010d280784d17f649ff5ee5a005a8d2267fa00dbc1cace4/setuptools-1.1.3.zip (from https://pypi.org/simple/setuptools/), version: 1.1.3 2024-12-17T10:59:33,069 Found link https://files.pythonhosted.org/packages/2d/cf/71fc10f49b6fefaa798ee98c61d31529191913cc10b86689ad71a25a9101/setuptools-1.1.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.4 2024-12-17T10:59:33,070 Found link https://files.pythonhosted.org/packages/71/91/78ffe076adeb872bbae3b42d31050fe351e5ac49206df0b9205516de3435/setuptools-1.1.4.zip (from https://pypi.org/simple/setuptools/), version: 1.1.4 2024-12-17T10:59:33,071 Found link https://files.pythonhosted.org/packages/af/d7/3d8d926fb42146c3398c5bae93e6dae73b62090c253a1d290bce50be9c22/setuptools-1.1.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.5 2024-12-17T10:59:33,072 Found link https://files.pythonhosted.org/packages/6f/50/89bc49d9e40692b58cfa998843908f1517e72c8d265e98df5a5277ad5699/setuptools-1.1.5.zip (from https://pypi.org/simple/setuptools/), version: 1.1.5 2024-12-17T10:59:33,074 Found link https://files.pythonhosted.org/packages/fc/66/4fddcb714c184020e08c84897587773540ccb684d7915049722b9542ceba/setuptools-1.1.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.1.6 2024-12-17T10:59:33,075 Found link https://files.pythonhosted.org/packages/f6/7c/f43c90d21e676d2738c81674a21fad63a8d5f71d6e39cd35966214b7ce6c/setuptools-1.1.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.6 2024-12-17T10:59:33,076 Found link https://files.pythonhosted.org/packages/cb/0f/14c41a82f571530a259d6961632a92327a6c84a7a802a03409e46325be99/setuptools-1.1.6.zip (from https://pypi.org/simple/setuptools/), version: 1.1.6 2024-12-17T10:59:33,077 Found link https://files.pythonhosted.org/packages/c5/60/8737de8ab391b813e5a28402787e1d24ed4848f20d4e72f75f4555f90f4d/setuptools-1.1.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.1.7 2024-12-17T10:59:33,078 Found link https://files.pythonhosted.org/packages/20/f2/8fee0aa139eff61a6bea83b8096d253724328263668a5cf986e9ab63d909/setuptools-1.1.7.zip (from https://pypi.org/simple/setuptools/), version: 1.1.7 2024-12-17T10:59:33,079 Found link https://files.pythonhosted.org/packages/bc/93/c68754a5e4ebfbf2de47759039731d31a2f35c8d14b41c8a76eaa73d7ed1/setuptools-1.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.2 2024-12-17T10:59:33,080 Found link https://files.pythonhosted.org/packages/16/e6/07e8e1b6da199c05dc4c24dd66d2bc5da369ce03ee43ffb6adda5022f4f4/setuptools-1.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.2 2024-12-17T10:59:33,081 Found link https://files.pythonhosted.org/packages/13/33/ab03685ecf08a0f5cbea3f95aeb416591054c16b2b9cf7a825bc225de16a/setuptools-1.2.zip (from https://pypi.org/simple/setuptools/), version: 1.2 2024-12-17T10:59:33,082 Found link https://files.pythonhosted.org/packages/25/0a/fda40660c3b2c3f04086c3a572abb5a8e6877862d0f95059536c2e8f49ec/setuptools-1.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.3 2024-12-17T10:59:33,083 Found link https://files.pythonhosted.org/packages/64/9f/3dcfa7d882676993843bf6e9ab9ef0afd4da7ca9710f3eaf46c0761f56a0/setuptools-1.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.3 2024-12-17T10:59:33,084 Found link https://files.pythonhosted.org/packages/0a/53/33a54f63b9a5f58b3a779d20b93e79e2a7e0c37fa66a2529398203f6dde4/setuptools-1.3.zip (from https://pypi.org/simple/setuptools/), version: 1.3 2024-12-17T10:59:33,085 Found link https://files.pythonhosted.org/packages/a9/6f/71cabadc24a7289dc73abb640a592a28a228de5b0ae7cf859891490def01/setuptools-1.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.3.1 2024-12-17T10:59:33,086 Found link https://files.pythonhosted.org/packages/4e/37/528fa652fb8eeb6b62971439984aea99a65da79942fdd048b97859795975/setuptools-1.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.3.1 2024-12-17T10:59:33,087 Found link https://files.pythonhosted.org/packages/40/bd/a254bcd3e69a2dbc2220e7dec0dbf85486ce801a17f4842076f4dbb46ad1/setuptools-1.3.1.zip (from https://pypi.org/simple/setuptools/), version: 1.3.1 2024-12-17T10:59:33,088 Found link https://files.pythonhosted.org/packages/dd/18/e6f368cbb1625be291261865c7b4b728b4c49ef4f30e1107eec297986fad/setuptools-1.3.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.3.2 2024-12-17T10:59:33,089 Found link https://files.pythonhosted.org/packages/23/fa/0eeee1f840b1e772fa1538fd58478fd2d4950445ab4cf748e5a497144af6/setuptools-1.3.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.3.2 2024-12-17T10:59:33,090 Found link https://files.pythonhosted.org/packages/43/36/fc62d4e0e6f74aa820c85ff42d5a1ca8168410c1d559d316c679fc7c679f/setuptools-1.3.2.zip (from https://pypi.org/simple/setuptools/), version: 1.3.2 2024-12-17T10:59:33,091 Found link https://files.pythonhosted.org/packages/4d/7f/24c0d76fba6848a8ab06d3d773566a2465c4f005e106b5cd0ff494af0531/setuptools-1.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.4 2024-12-17T10:59:33,092 Found link https://files.pythonhosted.org/packages/3a/ed/843ddb53f5d41fbe56f10918aa34f6a9ed568d453e5075a9c573424a14aa/setuptools-1.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.4 2024-12-17T10:59:33,093 Found link https://files.pythonhosted.org/packages/45/65/9af2a0de870b706c93788334e2e32f336f5c0a684342143f79a4b984d806/setuptools-1.4.zip (from https://pypi.org/simple/setuptools/), version: 1.4 2024-12-17T10:59:33,094 Found link https://files.pythonhosted.org/packages/b2/0f/d08477648a2d4458fe9a149d351665a1742020bc45b6b20eed808fee2f2f/setuptools-1.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.4.1 2024-12-17T10:59:33,095 Found link https://files.pythonhosted.org/packages/d3/ce/ad0b1ee5e072b0cc95b61010bf673c9e52a595492a512769c57e61986ca2/setuptools-1.4.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.4.1 2024-12-17T10:59:33,096 Found link https://files.pythonhosted.org/packages/51/25/f1fa20ee2d2f36ef1ed514ef706db566296bea64b5ff44334c69c6cf005c/setuptools-1.4.1.zip (from https://pypi.org/simple/setuptools/), version: 1.4.1 2024-12-17T10:59:33,098 Found link https://files.pythonhosted.org/packages/b0/a2/288b40338c0878526e2c6f05dfc707eda9d21c6868875e4c2cd5e6ec51c9/setuptools-1.4.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 1.4.2 2024-12-17T10:59:33,099 Found link https://files.pythonhosted.org/packages/61/3c/8d680267eda244ad6391fb8b211bd39d8b527f3b66207976ef9f2f106230/setuptools-1.4.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 1.4.2 2024-12-17T10:59:33,099 Found link https://files.pythonhosted.org/packages/be/1d/bcacf98d1ab9383e0aa6e16dc8b6fcb75b87c1d42287333dd3821e79f70b/setuptools-1.4.2.zip (from https://pypi.org/simple/setuptools/), version: 1.4.2 2024-12-17T10:59:33,100 Found link https://files.pythonhosted.org/packages/13/3f/3a3addddfff8e9a0880199c97b009203aea99c6e579c7b01d605094456f9/setuptools-2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 2.0 2024-12-17T10:59:33,101 Found link https://files.pythonhosted.org/packages/28/84/27df240f3f8f52511965979aad7c7b77606f8fe41d4c90f2449e02172bb1/setuptools-2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.0 2024-12-17T10:59:33,102 Found link https://files.pythonhosted.org/packages/7d/9a/ef929fd840f15be36daa94b35b2213bf257b2f511e2688875857d6391899/setuptools-2.0.zip (from https://pypi.org/simple/setuptools/), version: 2.0 2024-12-17T10:59:33,103 Found link https://files.pythonhosted.org/packages/04/c7/4937ce3aaf09cf5babd413866f4117d4d039560a6b80d7984ee78eee40af/setuptools-2.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 2.0.1 2024-12-17T10:59:33,104 Found link https://files.pythonhosted.org/packages/7d/73/2a886a194567bc5d5089b1727ea52611058bcb2c61bb1305e1d7e1ba1480/setuptools-2.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.0.1 2024-12-17T10:59:33,105 Found link https://files.pythonhosted.org/packages/0c/a1/df17fa54c78dcaec8f3e88f6c7a4986b73dac0f36deb318b41a5d4aa666d/setuptools-2.0.1.zip (from https://pypi.org/simple/setuptools/), version: 2.0.1 2024-12-17T10:59:33,107 Found link https://files.pythonhosted.org/packages/cc/fa/e73ed700bcaca3122f1dee7efd45a7af5d882b202a255c7a08416cd4680e/setuptools-2.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 2.0.2 2024-12-17T10:59:33,108 Found link https://files.pythonhosted.org/packages/b1/e4/5af6558ad5db8b9be7ac0be2f18282d538964b6ee423c73174a6d3ef50b5/setuptools-2.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.0.2 2024-12-17T10:59:33,109 Found link https://files.pythonhosted.org/packages/b0/8c/a9f4306b425b6652c9ce5a4d5c9670161455cb3bd7894e784c0fcaaef65d/setuptools-2.0.2.zip (from https://pypi.org/simple/setuptools/), version: 2.0.2 2024-12-17T10:59:33,110 Found link https://files.pythonhosted.org/packages/bc/bc/f67a89984bda6d3e3b446645d54d91a404154afa11aabc23135305f3646a/setuptools-2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 2.1 2024-12-17T10:59:33,111 Found link https://files.pythonhosted.org/packages/a1/ab/885e331ed2d49f16d40e2d75bdccccdbb318e5007d28d47d218438ee1175/setuptools-2.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.1 2024-12-17T10:59:33,112 Found link https://files.pythonhosted.org/packages/69/bd/f37a4f52937577291f0f18bc51161f3220f2ff815cc976c3f3097bf4a386/setuptools-2.1.zip (from https://pypi.org/simple/setuptools/), version: 2.1 2024-12-17T10:59:33,113 Found link https://files.pythonhosted.org/packages/ac/68/08fb37b00b139a397264472d3d39468e9e87e66df125f20b347a0bc91a13/setuptools-2.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.1.1 2024-12-17T10:59:33,114 Found link https://files.pythonhosted.org/packages/16/06/10511928cd6040cb8c42bc4d7f9b6dad486c2afdbf814b036a43540f512a/setuptools-2.1.1.zip (from https://pypi.org/simple/setuptools/), version: 2.1.1 2024-12-17T10:59:33,116 Found link https://files.pythonhosted.org/packages/b8/0e/dd4d92e799c77f14dd0dc3bb006d5f7a8e86fadac3e61944dd6dba823e13/setuptools-2.1.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 2.1.2 2024-12-17T10:59:33,117 Found link https://files.pythonhosted.org/packages/7e/24/e63ddeadfeb93c370c4eb3686628433510c80440b1dbca810e715c1bb622/setuptools-2.1.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.1.2 2024-12-17T10:59:33,118 Found link https://files.pythonhosted.org/packages/73/e5/61e83f356cb1a4d77ab5818827db929d6b368310e9ad9aff59a0e40b3fd5/setuptools-2.1.2.zip (from https://pypi.org/simple/setuptools/), version: 2.1.2 2024-12-17T10:59:33,119 Found link https://files.pythonhosted.org/packages/6a/67/4b82a4c0bf81a4f73b2a68be918d5ec9240c6e50fafe333d455683304321/setuptools-2.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 2.2 2024-12-17T10:59:33,120 Found link https://files.pythonhosted.org/packages/8b/62/6b730b1c56ecd6c515de8748acedb1ff88761634315ff575182e97afa1bf/setuptools-2.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 2.2 2024-12-17T10:59:33,121 Found link https://files.pythonhosted.org/packages/72/16/738ef65b2659b3a84573c51094afbfb0c263f7cd51911c3caf5e4f7b8c0b/setuptools-2.2.zip (from https://pypi.org/simple/setuptools/), version: 2.2 2024-12-17T10:59:33,122 Found link https://files.pythonhosted.org/packages/a8/42/177352d8b06614904c213ad1693370bd444585887e88697d28d0a6c1c913/setuptools-3.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.0 2024-12-17T10:59:33,123 Found link https://files.pythonhosted.org/packages/ea/db/383b4abaa84fab598e02c2019d531676ffd33617a8d8628c3724e7733921/setuptools-3.0.zip (from https://pypi.org/simple/setuptools/), version: 3.0 2024-12-17T10:59:33,124 Found link https://files.pythonhosted.org/packages/2d/ef/e4c40d37f9cb727bc35bd01ddaee847e22ceaf8e943414cc30d4a2222ced/setuptools-3.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.0.1 2024-12-17T10:59:33,125 Found link https://files.pythonhosted.org/packages/52/32/073e1c2325cb65425593cb99897aadb7715eb5ba664b5eb187477d8b6df6/setuptools-3.0.1.zip (from https://pypi.org/simple/setuptools/), version: 3.0.1 2024-12-17T10:59:33,126 Found link https://files.pythonhosted.org/packages/fe/cb/5c3ecf3866938e230be1b3d355ff9501f3f6b65ae5c583f88bf59855345f/setuptools-3.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.0.2 2024-12-17T10:59:33,127 Found link https://files.pythonhosted.org/packages/f1/ee/052f6fbd63664b9e8b8a5a1b6e667c078c54600319feafc7265e5a367cd2/setuptools-3.0.2.zip (from https://pypi.org/simple/setuptools/), version: 3.0.2 2024-12-17T10:59:33,128 Found link https://files.pythonhosted.org/packages/94/ee/d2326117a111fb978cb1d6f2e62e5cf8a63f057e828145506e7b4a32d3fe/setuptools-3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.1 2024-12-17T10:59:33,129 Found link https://files.pythonhosted.org/packages/9a/fc/46d5fa8dd1a60c0091a940d67724fd42b03a7866cde64ac921e2e2d7d6a6/setuptools-3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.1 2024-12-17T10:59:33,130 Found link https://files.pythonhosted.org/packages/96/c2/beaef5bdd2b706c6ffac24dd3be7e93f67733bfe4dff30372a0ac2b4de4e/setuptools-3.1.zip (from https://pypi.org/simple/setuptools/), version: 3.1 2024-12-17T10:59:33,131 Found link https://files.pythonhosted.org/packages/bd/1f/b0bade1b1e905ae7e259f576490753ca349be1496cefccc8f69c6423547e/setuptools-3.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.2 2024-12-17T10:59:33,132 Found link https://files.pythonhosted.org/packages/c4/98/b0aba9599fc1b410c84b77e9ea5710b76a3e4174c1849ac769670b77c0e1/setuptools-3.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.2 2024-12-17T10:59:33,133 Found link https://files.pythonhosted.org/packages/91/fd/e4acce69d20ee1c8e2a6bb3a5b83663949097ae58c30976ff09956b26597/setuptools-3.2.zip (from https://pypi.org/simple/setuptools/), version: 3.2 2024-12-17T10:59:33,134 Found link https://files.pythonhosted.org/packages/fc/20/0b304ea9830d53c9068e1e96bbf1ee529283f96ee0ee6ccaaa697f7b2383/setuptools-3.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.3 2024-12-17T10:59:33,135 Found link https://files.pythonhosted.org/packages/82/e6/049fc4474cf5cebab5748e886836af23b41436f8b069eac836c7231e7325/setuptools-3.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.3 2024-12-17T10:59:33,136 Found link https://files.pythonhosted.org/packages/24/52/857fd91f603207c941b6c6844ca0e2ebdb8d5621264c32188d098887588b/setuptools-3.3.zip (from https://pypi.org/simple/setuptools/), version: 3.3 2024-12-17T10:59:33,137 Found link https://files.pythonhosted.org/packages/13/62/1c94404356ae0ecebd6fba55898d7b3c385bdb5dc18558686495659355fd/setuptools-3.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.4 2024-12-17T10:59:33,138 Found link https://files.pythonhosted.org/packages/e1/78/91598beae5a49bb7f768ffea849f2a4b49f6e3fc0401ff9737d39cf35d29/setuptools-3.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.4 2024-12-17T10:59:33,139 Found link https://files.pythonhosted.org/packages/4c/1e/d0db812bfb6c3e798c382c7509fc8470ecd217f2e2eb597f9ebe035bd688/setuptools-3.4.zip (from https://pypi.org/simple/setuptools/), version: 3.4 2024-12-17T10:59:33,140 Found link https://files.pythonhosted.org/packages/d1/6c/37f126e8be2aad1550b2e93f339878b048aa83c2b4d8489a3be8fbee2a9d/setuptools-3.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.4.1 2024-12-17T10:59:33,141 Found link https://files.pythonhosted.org/packages/13/88/132500071ad154086bb14cda98703008326a3f0e3c488fa99f3c4241d7dd/setuptools-3.4.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.4.1 2024-12-17T10:59:33,142 Found link https://files.pythonhosted.org/packages/6c/09/46f4ae75d3503005347c62789594aadaad7d4109e8f33b03e7232fc441de/setuptools-3.4.1.zip (from https://pypi.org/simple/setuptools/), version: 3.4.1 2024-12-17T10:59:33,143 Found link https://files.pythonhosted.org/packages/46/0e/98de4d7f466603fe1fb9be7b602fed7c5e2dd55f25829c145f0041314917/setuptools-3.4.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.4.2 2024-12-17T10:59:33,144 Found link https://files.pythonhosted.org/packages/00/a0/f6089508f7f5f061329fc20bb3baf70e7891a0cf9a943f2208706aad353f/setuptools-3.4.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.4.2 2024-12-17T10:59:33,145 Found link https://files.pythonhosted.org/packages/72/8e/a216c7974627f4e393a28d517716102700b93af61b2b11372451393c4057/setuptools-3.4.2.zip (from https://pypi.org/simple/setuptools/), version: 3.4.2 2024-12-17T10:59:33,146 Found link https://files.pythonhosted.org/packages/03/e2/b8421d4ed72fa187b5ef696755f452df7e6cdc821ea119bd5dda3efc2f72/setuptools-3.4.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.4.3 2024-12-17T10:59:33,147 Found link https://files.pythonhosted.org/packages/f4/fe/aa9650b161dbf75ce5506dba83551de214fbcc1388297bd9f07b02913c53/setuptools-3.4.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.4.3 2024-12-17T10:59:33,148 Found link https://files.pythonhosted.org/packages/1a/a8/c5661640a25128d0a90ed98f624a7ee17b60d4f068bc5ba7a42f266f655a/setuptools-3.4.3.zip (from https://pypi.org/simple/setuptools/), version: 3.4.3 2024-12-17T10:59:33,150 Found link https://files.pythonhosted.org/packages/cc/f0/351de04af115d4c3595c0632d7ce619a49721c11364b48d8eace0db4c80c/setuptools-3.4.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.4.4 2024-12-17T10:59:33,151 Found link https://files.pythonhosted.org/packages/4a/e5/8316b07bab05ec87ff969841be6a3f18e30ca1ec3031e7d30ec7313aa04b/setuptools-3.4.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.4.4 2024-12-17T10:59:33,151 Found link https://files.pythonhosted.org/packages/47/48/92b82ea3022f734b4f72c52a2b614991aa3c430a713f575b540d34dfb87c/setuptools-3.4.4.zip (from https://pypi.org/simple/setuptools/), version: 3.4.4 2024-12-17T10:59:33,153 Found link https://files.pythonhosted.org/packages/5f/4a/fef43230b0a42c9945f6838b4bcb6e4abe2efc70a5cf0bb3162bd493194a/setuptools-3.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.5 2024-12-17T10:59:33,154 Found link https://files.pythonhosted.org/packages/e0/bf/207713b5cb61a756d3a02d843c8e96851c81fa2327ccb448f4bf35ec4c59/setuptools-3.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.5 2024-12-17T10:59:33,155 Found link https://files.pythonhosted.org/packages/8a/ab/db10e77928961439aa7460aeba9b64d685f8a4ad7444661a00f3175e5811/setuptools-3.5.zip (from https://pypi.org/simple/setuptools/), version: 3.5 2024-12-17T10:59:33,156 Found link https://files.pythonhosted.org/packages/9a/d3/22fcca731a7151fbd5ae5092b6a8cfa610db8fc649580267d0f4bb71de3b/setuptools-3.5.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.5.1 2024-12-17T10:59:33,157 Found link https://files.pythonhosted.org/packages/60/d3/b69a78ffbc4413bfb13d6a722daef01f2c89c4582b55c5516b58eb11274c/setuptools-3.5.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.5.1 2024-12-17T10:59:33,158 Found link https://files.pythonhosted.org/packages/6f/6f/c26e40e5ffa9aa4601d9fa27a7238ef38bf15d19e683a5edb2524cf156ab/setuptools-3.5.1.zip (from https://pypi.org/simple/setuptools/), version: 3.5.1 2024-12-17T10:59:33,159 Found link https://files.pythonhosted.org/packages/1c/2d/ea0834bcce178d3fc99b916211d969bf30e8955a303d5977881e2d5d9dd0/setuptools-3.5.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.5.2 2024-12-17T10:59:33,160 Found link https://files.pythonhosted.org/packages/22/de/75592eb307ed9bf573c73619229bae3babb6765977c3cfed3248075d8430/setuptools-3.5.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.5.2 2024-12-17T10:59:33,161 Found link https://files.pythonhosted.org/packages/a3/d7/1195e7435dfab3be42a1c30f24188387e08bee376888b5a5fe2ac8750501/setuptools-3.5.2.zip (from https://pypi.org/simple/setuptools/), version: 3.5.2 2024-12-17T10:59:33,162 Found link https://files.pythonhosted.org/packages/40/8f/cae21061a6871ca4624287b97711ea5747b24a937c18cd41b23c95b6062e/setuptools-3.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.6 2024-12-17T10:59:33,163 Found link https://files.pythonhosted.org/packages/d3/3e/e87db7dbf6e65b9b04bf2772197af77f711cfadb038ba76d2acfcc2efa72/setuptools-3.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.6 2024-12-17T10:59:33,164 Found link https://files.pythonhosted.org/packages/38/79/40acb2edbc4f7ff4f476b9c87a64d1095bbc0a6858545f791c740e155add/setuptools-3.6.zip (from https://pypi.org/simple/setuptools/), version: 3.6 2024-12-17T10:59:33,165 Found link https://files.pythonhosted.org/packages/a1/59/6a50e86731711ff2ac4c51c96e080c21cd9af81c46f388c63a5f358931e0/setuptools-3.7-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.7 2024-12-17T10:59:33,166 Found link https://files.pythonhosted.org/packages/2a/a3/4cc9d46ae7c5fdedd86a4332d73ddad458e20ab0feb7fda011b665c9d42c/setuptools-3.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.7 2024-12-17T10:59:33,167 Found link https://files.pythonhosted.org/packages/d4/d0/dfc40771bf97c7994df04f8c4846a26066ec9230d07d2dc44d83726ede23/setuptools-3.7.zip (from https://pypi.org/simple/setuptools/), version: 3.7 2024-12-17T10:59:33,168 Found link https://files.pythonhosted.org/packages/94/b7/0eb75451f3dfb14b41cfcb12e701128564c9526a8d38995d8f210be7ee00/setuptools-3.7.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.7.1 2024-12-17T10:59:33,169 Found link https://files.pythonhosted.org/packages/38/b8/007e39bf2d853ba3b930e7d48b3a767a94f3a3b96a99df6d09ac9ddb1038/setuptools-3.7.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.7.1 2024-12-17T10:59:33,170 Found link https://files.pythonhosted.org/packages/b3/97/a7507bf4e8c6b2f6b1f492e051530308912c7bffd8a3c5f41f42f57f04ec/setuptools-3.7.1.zip (from https://pypi.org/simple/setuptools/), version: 3.7.1 2024-12-17T10:59:33,171 Found link https://files.pythonhosted.org/packages/a5/22/3f6968082291391d668583b719f8b255e15ee6b7c583b7b6b7c05918e57a/setuptools-3.8-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.8 2024-12-17T10:59:33,172 Found link https://files.pythonhosted.org/packages/cc/33/992be126171d94666dddda9c785dac7d6c96ab928c13e136239938a72b1f/setuptools-3.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.8 2024-12-17T10:59:33,173 Found link https://files.pythonhosted.org/packages/ee/d7/34f3bef82a7ffe13625b8ce457df4e4d46c202113ecb5f655872aeb71934/setuptools-3.8.zip (from https://pypi.org/simple/setuptools/), version: 3.8 2024-12-17T10:59:33,174 Found link https://files.pythonhosted.org/packages/9f/76/1789d66f14c45100dd58590e453a481851c40a91df2f3b4f2ae880cf25e4/setuptools-3.8.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 3.8.1 2024-12-17T10:59:33,175 Found link https://files.pythonhosted.org/packages/0b/2f/05323cd8c349939ed38bf72611cd02374cc553c34872996e38ebf3107b0a/setuptools-3.8.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 3.8.1 2024-12-17T10:59:33,176 Found link https://files.pythonhosted.org/packages/29/55/4c68ee6236b36fb6032437b93c635246510fb001d700467f4063a214916a/setuptools-3.8.1.zip (from https://pypi.org/simple/setuptools/), version: 3.8.1 2024-12-17T10:59:33,177 Found link https://files.pythonhosted.org/packages/12/24/0885d9fe662ef964090217e3833f2ed4a67dfd446f9ddd428304d224eb6f/setuptools-4.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 4.0 2024-12-17T10:59:33,178 Found link https://files.pythonhosted.org/packages/54/07/6dfdb40647a291a665bfa66d228d1d516db9aaa1e2e9a2f84c6c97ac6c69/setuptools-4.0.zip (from https://pypi.org/simple/setuptools/), version: 4.0 2024-12-17T10:59:33,179 Found link https://files.pythonhosted.org/packages/52/71/a6e77590363fa6e3fe8ca14eb951476f08ad103486437335f9848a09e3c2/setuptools-4.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 4.0.1 2024-12-17T10:59:33,180 Found link https://files.pythonhosted.org/packages/cb/e0/b5ecf534e14304e62c781614d683d0daa571efe92678901559ea84c1559e/setuptools-4.0.1.zip (from https://pypi.org/simple/setuptools/), version: 4.0.1 2024-12-17T10:59:33,181 Found link https://files.pythonhosted.org/packages/81/94/ab636294e0a5180a51760909cc058d98ad9d01f7aaac9791e4fa1b6f2a8c/setuptools-5.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.0 2024-12-17T10:59:33,182 Found link https://files.pythonhosted.org/packages/43/49/92974712ba5b150d530abfea49a3591a547bdcb7b3c56594b0a1b38c78f7/setuptools-5.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.0 2024-12-17T10:59:33,183 Found link https://files.pythonhosted.org/packages/56/e9/94e4d4576ff800e67cb14bbe2d7f2944b583b74f8e0e844b566c15db838f/setuptools-5.0.zip (from https://pypi.org/simple/setuptools/), version: 5.0 2024-12-17T10:59:33,184 Found link https://files.pythonhosted.org/packages/d9/00/356346173b9aa57da6fde8def53587f6af51df29b1312a941feef13aaed8/setuptools-5.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.0.1 2024-12-17T10:59:33,185 Found link https://files.pythonhosted.org/packages/b3/7f/ff28c2b6d7b24fc6940d2a93d2ac736d844b499a30c8eb9e03d8379aa4a9/setuptools-5.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.0.1 2024-12-17T10:59:33,186 Found link https://files.pythonhosted.org/packages/52/83/870642b2d14d46e1f898edf722434d3b2812418705d501f5a0503a7f1761/setuptools-5.0.1.zip (from https://pypi.org/simple/setuptools/), version: 5.0.1 2024-12-17T10:59:33,187 Found link https://files.pythonhosted.org/packages/c6/31/e868dc1720daad287b658caef36defb02de9c7aad4b803c9c03bcc70c2e3/setuptools-5.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.0.2 2024-12-17T10:59:33,188 Found link https://files.pythonhosted.org/packages/1a/19/747b3fceb402d028dc93f227dd39d294ad8365c50d9fbde822ac151c9ab2/setuptools-5.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.0.2 2024-12-17T10:59:33,189 Found link https://files.pythonhosted.org/packages/92/c9/2f3a1f0c8b7f53892ac293953b47a7fc8a07e9a38b3d2966cf7302c49514/setuptools-5.0.2.zip (from https://pypi.org/simple/setuptools/), version: 5.0.2 2024-12-17T10:59:33,190 Found link https://files.pythonhosted.org/packages/33/8d/948cd1b924c3e81298da106a7b15942e824714f41f3e34ea22a351637f2c/setuptools-5.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.1 2024-12-17T10:59:33,191 Found link https://files.pythonhosted.org/packages/75/23/4b74bbff9c646a5235e85f619c0d541357b1f8ecf2ae9f68f03dccdabcfa/setuptools-5.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.1 2024-12-17T10:59:33,192 Found link https://files.pythonhosted.org/packages/e3/55/66e9cb495828d918c30b914bfb1ef2f6f22b69cc01ab1f56be40db61e922/setuptools-5.1.zip (from https://pypi.org/simple/setuptools/), version: 5.1 2024-12-17T10:59:33,193 Found link https://files.pythonhosted.org/packages/aa/85/e9e49394bc7f131a58dc130955ca73fa0bbe27bb2b247505260500901fb7/setuptools-5.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.2 2024-12-17T10:59:33,194 Found link https://files.pythonhosted.org/packages/93/e4/d7813c313947f6753f991ea7dd9101350373519aaab3f57a2ac5c50bb962/setuptools-5.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.2 2024-12-17T10:59:33,195 Found link https://files.pythonhosted.org/packages/67/ad/0feed436050d75dcb7f072abd0eaa6a367ca298e17d289040ae7c23d4bc1/setuptools-5.2.zip (from https://pypi.org/simple/setuptools/), version: 5.2 2024-12-17T10:59:33,196 Found link https://files.pythonhosted.org/packages/55/8c/e2020e08b436877d546d51e836766b448ef455a7146a2990cd3507d05acc/setuptools-5.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.3 2024-12-17T10:59:33,197 Found link https://files.pythonhosted.org/packages/4a/e0/7e35bf11ba31fa177976cd275ac1ade700b7d39d63715a6240a711d412fd/setuptools-5.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.3 2024-12-17T10:59:33,198 Found link https://files.pythonhosted.org/packages/48/d5/62680f41e2f6c208228c822f8932d4c7aa8a3127e12d708b5de9ad70136b/setuptools-5.3.zip (from https://pypi.org/simple/setuptools/), version: 5.3 2024-12-17T10:59:33,199 Found link https://files.pythonhosted.org/packages/48/c1/8f5c6fea2427904365c570da5c9b2e1b28fa5d9c8b02e31cf5b8969f722b/setuptools-5.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.4 2024-12-17T10:59:33,200 Found link https://files.pythonhosted.org/packages/00/2e/e023df8df47462a053fa8cf5225adce2fe24644c7848fb7728a29b24607e/setuptools-5.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.4 2024-12-17T10:59:33,201 Found link https://files.pythonhosted.org/packages/d5/a8/81835fcd723a073b38d2d86d1a8f6e109eb88cce1a252af81d4b591563d4/setuptools-5.4.zip (from https://pypi.org/simple/setuptools/), version: 5.4 2024-12-17T10:59:33,202 Found link https://files.pythonhosted.org/packages/b1/ba/02218786fe9d5beeb2cfdaf0e423219d132845774d703f6e8a708dd5e642/setuptools-5.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.4.1 2024-12-17T10:59:33,203 Found link https://files.pythonhosted.org/packages/cb/55/4143b8a178e17c39c246d95dd0620e8c26c699ffc5267eb5d444b6b2429a/setuptools-5.4.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.4.1 2024-12-17T10:59:33,204 Found link https://files.pythonhosted.org/packages/98/9c/079cd02e1511fa0bc155af16a333aef6a33d9753e7cb2ba201f4cbd79b0c/setuptools-5.4.1.zip (from https://pypi.org/simple/setuptools/), version: 5.4.1 2024-12-17T10:59:33,205 Found link https://files.pythonhosted.org/packages/bd/51/e4f4f62b5b70b191f955d04aed76fe1dc32926db48c5ba3c93ccaddd391c/setuptools-5.4.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.4.2 2024-12-17T10:59:33,206 Found link https://files.pythonhosted.org/packages/90/99/1b25b0ad3c07400b42dfd82e53b63e2b2517f5cd2cecbec5f639aa2a26f0/setuptools-5.4.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.4.2 2024-12-17T10:59:33,207 Found link https://files.pythonhosted.org/packages/1f/62/4c02b8534d35c0d43648e11ca92ca95ad6abe5abcc01edf8c18aeb01da4f/setuptools-5.4.2.zip (from https://pypi.org/simple/setuptools/), version: 5.4.2 2024-12-17T10:59:33,208 Found link https://files.pythonhosted.org/packages/40/60/478266f8f2dba7bb5f51432e5ece4fd418a6e4a518c6cba3fd275e6603d7/setuptools-5.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.5 2024-12-17T10:59:33,209 Found link https://files.pythonhosted.org/packages/ce/a5/cd5986d92c030bd92754c099d617f9b4f3c7a913345205073566980d5435/setuptools-5.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.5 2024-12-17T10:59:33,210 Found link https://files.pythonhosted.org/packages/9d/93/c996180360f022b09cab7f0b71a80967189eefa6d17ebe7f01c18af5fcc1/setuptools-5.5.zip (from https://pypi.org/simple/setuptools/), version: 5.5 2024-12-17T10:59:33,211 Found link https://files.pythonhosted.org/packages/97/b1/3c62eb46609eb301b7e7faffb3a8d378c42bba822346302312b345f258c2/setuptools-5.5.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.5.1 2024-12-17T10:59:33,212 Found link https://files.pythonhosted.org/packages/47/15/7f9aabb1ce09d3dc5ecdff2f5a97e0a47f724fe8e398eff6a88626d0164c/setuptools-5.5.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.5.1 2024-12-17T10:59:33,213 Found link https://files.pythonhosted.org/packages/07/37/b4c230b767cbe7ade1df979a32e38856ddface17124e6da31797a1f1448c/setuptools-5.5.1.zip (from https://pypi.org/simple/setuptools/), version: 5.5.1 2024-12-17T10:59:33,214 Found link https://files.pythonhosted.org/packages/12/7b/8a12ea7cbc3ae519ee304edaac71b17d74ce02eb4a2ced615e9ba3bc074e/setuptools-5.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.6 2024-12-17T10:59:33,215 Found link https://files.pythonhosted.org/packages/bc/f1/b248d4facd9b9710ef59d006ea05ea1afa98d9c584120319076f9b3b6b7a/setuptools-5.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.6 2024-12-17T10:59:33,216 Found link https://files.pythonhosted.org/packages/c4/e7/5be3134b53395e0f541f6da20bba04046b588cbd4ea666f799fddd838246/setuptools-5.6.zip (from https://pypi.org/simple/setuptools/), version: 5.6 2024-12-17T10:59:33,217 Found link https://files.pythonhosted.org/packages/28/29/2a99aaa46f9e7ca267433123a134132a06cbf8691b77b6e8d5b4d9915b72/setuptools-5.7-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.7 2024-12-17T10:59:33,218 Found link https://files.pythonhosted.org/packages/1c/09/3b60801cbd3ff9ac5ded466390c78b55703dcae28094f528330f498e9242/setuptools-5.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.7 2024-12-17T10:59:33,219 Found link https://files.pythonhosted.org/packages/08/1b/cfcdd4381459c3967a08dd3b7c16b7f10a5bfb8ad5c40b56f8ee4a25e8d7/setuptools-5.7.zip (from https://pypi.org/simple/setuptools/), version: 5.7 2024-12-17T10:59:33,220 Found link https://files.pythonhosted.org/packages/81/fd/b942a1caf9aa7340f93143ed81301a92b18f5e81116245252f09f8f5d557/setuptools-5.8-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 5.8 2024-12-17T10:59:33,221 Found link https://files.pythonhosted.org/packages/3e/9d/91d3ddf7e62eac384a95b5a8a0d4a46383d1d90b19b1232614cb20373544/setuptools-5.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 5.8 2024-12-17T10:59:33,222 Found link https://files.pythonhosted.org/packages/38/d7/71a61d368a84669c6a82b593f53e4163a1031271fc55e597cd3cd108e4f9/setuptools-5.8.zip (from https://pypi.org/simple/setuptools/), version: 5.8 2024-12-17T10:59:33,223 Found link https://files.pythonhosted.org/packages/71/bd/bbfc6a7b9ba0900f9ab44e2b03b301738cd9d90334afea8939e2536c1683/setuptools-6.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 6.0.1 2024-12-17T10:59:33,224 Found link https://files.pythonhosted.org/packages/9e/6c/3f5fd7df720b8285def2b5f111acbd79b6eb6e29fb2bbba6432a80cb30b1/setuptools-6.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 6.0.1 2024-12-17T10:59:33,225 Found link https://files.pythonhosted.org/packages/c2/82/2b2c796e0624bedfadc2b69a578b677fbba984a4fd700e709108ce3b750f/setuptools-6.0.1.zip (from https://pypi.org/simple/setuptools/), version: 6.0.1 2024-12-17T10:59:33,226 Found link https://files.pythonhosted.org/packages/af/55/954114b84b021d59746eb602a8d0b937b22d5b17813adcf1003e39a8147c/setuptools-6.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 6.0.2 2024-12-17T10:59:33,227 Found link https://files.pythonhosted.org/packages/26/8c/e1c6149e371758bc160bccce4efead2fbf3452808f0664470c016750511a/setuptools-6.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 6.0.2 2024-12-17T10:59:33,228 Found link https://files.pythonhosted.org/packages/4a/8c/e14333caa5fcfa69d82d87ff68c5d192856ae271d0bc943d8b89333ca955/setuptools-6.0.2.zip (from https://pypi.org/simple/setuptools/), version: 6.0.2 2024-12-17T10:59:33,230 Found link https://files.pythonhosted.org/packages/49/62/093854427bd78f9b7d3359cd0d116338fdcca3bca041265f949c35dc3213/setuptools-6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 6.1 2024-12-17T10:59:33,231 Found link https://files.pythonhosted.org/packages/54/d7/7e2b70b32ed7792e233b4d9891da77e9a5542a0fcb1d68e5a690fc73b0b3/setuptools-6.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 6.1 2024-12-17T10:59:33,232 Found link https://files.pythonhosted.org/packages/18/1f/6d365ad3dc73ef876c52c9943cc3bb4df93ff134b3e4f7cd5477c8e502b2/setuptools-6.1.zip (from https://pypi.org/simple/setuptools/), version: 6.1 2024-12-17T10:59:33,233 Found link https://files.pythonhosted.org/packages/e0/af/9ad21bc766c436b087f3fd63ffcef7f6819cc52f1905787450ac7fec0239/setuptools-7.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 7.0 2024-12-17T10:59:33,234 Found link https://files.pythonhosted.org/packages/0b/48/7298047bf4d67972d9bcb8a546e34f71ee4376d46186615b29678ac33a54/setuptools-7.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 7.0 2024-12-17T10:59:33,235 Found link https://files.pythonhosted.org/packages/fb/cb/279fb618621107373dc96d05df87547be5c34cc9d0ade8bb18929206360c/setuptools-7.0.zip (from https://pypi.org/simple/setuptools/), version: 7.0 2024-12-17T10:59:33,236 Found link https://files.pythonhosted.org/packages/ef/e7/537d8016e3a2026b5da2d4c7050c7a67e07989d804a4c97130e825ab9b78/setuptools-8.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.0 2024-12-17T10:59:33,237 Found link https://files.pythonhosted.org/packages/75/61/23794707407db0a66ead0baea37ec50b68dc8077ccd8ff08846bbab69e55/setuptools-8.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.0 2024-12-17T10:59:33,238 Found link https://files.pythonhosted.org/packages/a3/47/198b972944ce33de2b3dde67f4fdc156d8f41d656caa8f8b53dcaa066cc8/setuptools-8.0.zip (from https://pypi.org/simple/setuptools/), version: 8.0 2024-12-17T10:59:33,239 Found link https://files.pythonhosted.org/packages/75/8d/08c18187dc4b8f321cffcf37b03f4681ec2e7dbf19aa8e199c99b5842ab9/setuptools-8.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.0.1 2024-12-17T10:59:33,240 Found link https://files.pythonhosted.org/packages/b3/dc/bd60003eb8f044cb4626536d88c7fbc562eae02d596b8318d7638dde5f26/setuptools-8.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.0.1 2024-12-17T10:59:33,241 Found link https://files.pythonhosted.org/packages/28/e4/3d553bb84eae6d331fdb24a448e8bc455d6a60a63ca61a6633e9c5ff7407/setuptools-8.0.1.zip (from https://pypi.org/simple/setuptools/), version: 8.0.1 2024-12-17T10:59:33,242 Found link https://files.pythonhosted.org/packages/80/43/6adc94eb236ac6a14426aab29d96cdf7f406877361634872b75cfb068595/setuptools-8.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.0.2 2024-12-17T10:59:33,243 Found link https://files.pythonhosted.org/packages/95/96/9aec808b0b7ddfadcd9bec608548e896f928db8da6d4c9aa8f6e8a588464/setuptools-8.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.0.2 2024-12-17T10:59:33,244 Found link https://files.pythonhosted.org/packages/9e/4d/3a3b5ef6f18bfe1ee831b3313625973e48bc7af3029691ea916e316407e4/setuptools-8.0.2.zip (from https://pypi.org/simple/setuptools/), version: 8.0.2 2024-12-17T10:59:33,245 Found link https://files.pythonhosted.org/packages/50/26/483e2dbcee986da3276175d4f2ea6260c7a7cca1b7568e1a12f009451429/setuptools-8.0.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.0.3 2024-12-17T10:59:33,246 Found link https://files.pythonhosted.org/packages/8e/12/812047ed6e8bae2047f611c8b45d50ef7163b8ee569a0a57b2d9be22b36d/setuptools-8.0.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.0.3 2024-12-17T10:59:33,247 Found link https://files.pythonhosted.org/packages/a3/13/8c4fb8df6433711a5c53aa96f9e93993e4e58124a29560d500cdfc7283b9/setuptools-8.0.3.zip (from https://pypi.org/simple/setuptools/), version: 8.0.3 2024-12-17T10:59:33,248 Found link https://files.pythonhosted.org/packages/21/f4/e27f1a024b200b6c57d02c93ef9cc61d4aad15aca9364ad2c477112f68d6/setuptools-8.0.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.0.4 2024-12-17T10:59:33,249 Found link https://files.pythonhosted.org/packages/0c/d2/011e4648bbf92c8f393c8ec23a3766c17cea3cdc2913e00ebe42947c1305/setuptools-8.0.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.0.4 2024-12-17T10:59:33,250 Found link https://files.pythonhosted.org/packages/b8/3e/ceff6491997a5946465d5f1185f68acf8d54920c9ccb165a4654dcbd6cdd/setuptools-8.0.4.zip (from https://pypi.org/simple/setuptools/), version: 8.0.4 2024-12-17T10:59:33,251 Found link https://files.pythonhosted.org/packages/7a/d9/09e73cb52fe58697ffa955fcbba0e5c480bec88054fe729f9bc9ceb4fb9a/setuptools-8.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.1 2024-12-17T10:59:33,252 Found link https://files.pythonhosted.org/packages/ef/08/e37c9183f251f4a5b4e78c1371e173dea58d12a7c79ce40b63861797a7cc/setuptools-8.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.1 2024-12-17T10:59:33,253 Found link https://files.pythonhosted.org/packages/4f/54/442b0660c17ddf36e8531240abfe25a983e49451bed16f9c2b728559a8e1/setuptools-8.1.zip (from https://pypi.org/simple/setuptools/), version: 8.1 2024-12-17T10:59:33,254 Found link https://files.pythonhosted.org/packages/3c/e7/f8373689b94080d71ebf17edd3b16f05eadb278975d73490ec5755274f96/setuptools-8.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.2 2024-12-17T10:59:33,255 Found link https://files.pythonhosted.org/packages/5c/94/b852a1920e6c769f7b07568c952301d3524602560cf0f6c95cd55630a173/setuptools-8.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.2 2024-12-17T10:59:33,256 Found link https://files.pythonhosted.org/packages/46/9c/f58ba661ceca4d23857f7bcd8ffc2ae82257e24d6e6d736e03dd5a7a24a4/setuptools-8.2.zip (from https://pypi.org/simple/setuptools/), version: 8.2 2024-12-17T10:59:33,257 Found link https://files.pythonhosted.org/packages/dc/85/9653e32a36d4adf8ab35a2cbf0f25d387242a40b859cdcb0534eedf23b44/setuptools-8.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.2.1 2024-12-17T10:59:33,258 Found link https://files.pythonhosted.org/packages/1c/4c/b71920059f7be5335eea9f608703f1320d7467f3177e9f8dbf57d2964ff4/setuptools-8.2.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.2.1 2024-12-17T10:59:33,259 Found link https://files.pythonhosted.org/packages/a9/40/2f5948813c2542c3ca7384c16044963382bf6eb5c8d3d1d993891cf1747a/setuptools-8.2.1.zip (from https://pypi.org/simple/setuptools/), version: 8.2.1 2024-12-17T10:59:33,260 Found link https://files.pythonhosted.org/packages/ef/3a/6e1811346d7db4c237ef88af3c9b25cd798d6ffbbebbb08fd9267deea221/setuptools-8.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 8.3 2024-12-17T10:59:33,261 Found link https://files.pythonhosted.org/packages/73/48/e8971a9af1a2dc1a1d707fa8837f3f5662d584d1e214cc810fdcb185f8c7/setuptools-8.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 8.3 2024-12-17T10:59:33,262 Found link https://files.pythonhosted.org/packages/c6/5f/69dd9d47534efc1c2d566800b70ce687e20bc0e4bf9f91030659ce442018/setuptools-8.3.zip (from https://pypi.org/simple/setuptools/), version: 8.3 2024-12-17T10:59:33,263 Found link https://files.pythonhosted.org/packages/9b/84/984f56186a1c168b6bcdea368a7ffd9ac2dc1a8e542be65193e3c2ead9d9/setuptools-9.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 9.0 2024-12-17T10:59:33,264 Found link https://files.pythonhosted.org/packages/26/58/ece52b43b90885050cb93ef03c9651e85dee9958bfbd1bae58dab041c81b/setuptools-9.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 9.0 2024-12-17T10:59:33,265 Found link https://files.pythonhosted.org/packages/f6/84/5479171fd0a3f00e6ae2efffbd07975ba9c699cc7627cabcd4b7cc7839b0/setuptools-9.0.zip (from https://pypi.org/simple/setuptools/), version: 9.0 2024-12-17T10:59:33,266 Found link https://files.pythonhosted.org/packages/4d/a7/f14baf6e3f1bd91b23e3fe9cccd4a4a9c86341f5d4658a3fc16fe0c79097/setuptools-9.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 9.0.1 2024-12-17T10:59:33,267 Found link https://files.pythonhosted.org/packages/34/65/39ffd8d3344ece1e0ed664a509df7d022873eb314676fd49ddae91b3407e/setuptools-9.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 9.0.1 2024-12-17T10:59:33,268 Found link https://files.pythonhosted.org/packages/16/2c/1ad571e85048c57b4e7ba2218d0fff3db0452e8bfa0c20e1543e26f85121/setuptools-9.0.1.zip (from https://pypi.org/simple/setuptools/), version: 9.0.1 2024-12-17T10:59:33,269 Found link https://files.pythonhosted.org/packages/98/65/5893faed89f4f095b4ae8c95bb7332523ecd893c8ccb12fc4d8a80814a01/setuptools-9.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 9.1 2024-12-17T10:59:33,270 Found link https://files.pythonhosted.org/packages/c4/9b/159ffa84fe2f37fffdeda588717574e53cd2f6e68acf439b0759c9a921eb/setuptools-9.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 9.1 2024-12-17T10:59:33,271 Found link https://files.pythonhosted.org/packages/35/b2/626974cb6f02c4d58c33471b597f6723560f74be322857e9cd24700c3c70/setuptools-9.1.zip (from https://pypi.org/simple/setuptools/), version: 9.1 2024-12-17T10:59:33,272 Found link https://files.pythonhosted.org/packages/db/9d/863d9e5fb76a3942644372ff690a38106b37069211ef1294e270ffc6f346/setuptools-10.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 10.0 2024-12-17T10:59:33,273 Found link https://files.pythonhosted.org/packages/e7/57/26be96f253f0fa9b210f9b3e8430e8fc33a6a1cd5bfd7e175b31bbcfc5d7/setuptools-10.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 10.0 2024-12-17T10:59:33,274 Found link https://files.pythonhosted.org/packages/e4/07/3ce9d7c0f487e637c5f93dd035032aeddb4d2891a29cbaa8b7440a365515/setuptools-10.0.zip (from https://pypi.org/simple/setuptools/), version: 10.0 2024-12-17T10:59:33,275 Found link https://files.pythonhosted.org/packages/af/05/08d31c8011c1981ac79870c5ba5fc4e0f2cb4154a104341dabea7be34df2/setuptools-10.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 10.0.1 2024-12-17T10:59:33,276 Found link https://files.pythonhosted.org/packages/ee/62/38f2e8f34edb5e0ebd7fc64b569b72a94f7972ecfe9fb7f280008b092dd7/setuptools-10.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 10.0.1 2024-12-17T10:59:33,277 Found link https://files.pythonhosted.org/packages/00/43/136856df6b50dfb8edf1a4a4936455d68dc38ffa908763a055def184b0a9/setuptools-10.0.1.zip (from https://pypi.org/simple/setuptools/), version: 10.0.1 2024-12-17T10:59:33,278 Found link https://files.pythonhosted.org/packages/b2/69/699982624afc34549c8533bbf12774391862843faaa95d7ed795d0e2c36d/setuptools-10.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 10.1 2024-12-17T10:59:33,279 Found link https://files.pythonhosted.org/packages/9b/4b/79343fa8526cab01c95dca96caf50a9d2ea35e5075e29d1b168bf2add2bf/setuptools-10.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 10.1 2024-12-17T10:59:33,280 Found link https://files.pythonhosted.org/packages/87/a6/2c8af2d92c94b6a7c1c2cf3272b25fa2ef59b28b74144b0755bb29b281c2/setuptools-10.1.zip (from https://pypi.org/simple/setuptools/), version: 10.1 2024-12-17T10:59:33,281 Found link https://files.pythonhosted.org/packages/0f/ab/039427a18215b6a4a3bb023aeae0768f11b57778c611ee3d1a13306bd4ed/setuptools-10.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 10.2 2024-12-17T10:59:33,282 Found link https://files.pythonhosted.org/packages/75/e4/a85e8443980946967272049950361758805fda5e0b89d7d9bb348979f2fe/setuptools-10.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 10.2 2024-12-17T10:59:33,283 Found link https://files.pythonhosted.org/packages/0f/6d/1f8cdc3b0b57076ff2c8f8542b7e1d0826fe017815253eb98e98b1c7e0ba/setuptools-10.2.zip (from https://pypi.org/simple/setuptools/), version: 10.2 2024-12-17T10:59:33,284 Found link https://files.pythonhosted.org/packages/cf/82/1f64bdc07e33eca057b77594d0f87a5a015bc831e9a8a891596c392117be/setuptools-10.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 10.2.1 2024-12-17T10:59:33,285 Found link https://files.pythonhosted.org/packages/f8/7c/7551890036f17361996276387d16f6b93201566c86fff7bf7ccc43f51404/setuptools-10.2.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 10.2.1 2024-12-17T10:59:33,286 Found link https://files.pythonhosted.org/packages/70/6a/ce73dca788c85cfbfd1da29d70ce8ae16222c7e044bc75b0871418e577d9/setuptools-10.2.1.zip (from https://pypi.org/simple/setuptools/), version: 10.2.1 2024-12-17T10:59:33,287 Found link https://files.pythonhosted.org/packages/b8/65/1d62dea9e62e7680546678f445e24247d2c1dbd75c63a3936d2aa645760c/setuptools-11.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 11.0 2024-12-17T10:59:33,288 Found link https://files.pythonhosted.org/packages/c9/b6/fa2bd564458bf8e2493e4db4b95922f53bb38656ec9c4997254370d5521c/setuptools-11.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 11.0 2024-12-17T10:59:33,289 Found link https://files.pythonhosted.org/packages/37/53/de4e6b7ff77d1d4c3781819583021861b7ec39fbdf363f79b30bf8aecf4c/setuptools-11.0.zip (from https://pypi.org/simple/setuptools/), version: 11.0 2024-12-17T10:59:33,291 Found link https://files.pythonhosted.org/packages/b5/fc/34b8ae9f65418fda18efa13afa9c216c01f2efdde699702eee69604bb1f7/setuptools-11.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 11.1 2024-12-17T10:59:33,292 Found link https://files.pythonhosted.org/packages/1e/d9/295b5bcb96e4828dd517e8f140467df79c5b4dd513e6d98ca336b927e96f/setuptools-11.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 11.1 2024-12-17T10:59:33,293 Found link https://files.pythonhosted.org/packages/11/ed/1a33e609a40ba5bb5e87f1b9b601c103dbd66269bf241120afb9caccf462/setuptools-11.1.zip (from https://pypi.org/simple/setuptools/), version: 11.1 2024-12-17T10:59:33,294 Found link https://files.pythonhosted.org/packages/80/90/6788a1fa2fd333acc1e5adfccbceb2c0c0eedb8aefaac8b224f12d1230e7/setuptools-11.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 11.2 2024-12-17T10:59:33,295 Found link https://files.pythonhosted.org/packages/2f/aa/cc5b2e1e3326a35601508968767508374031c07e70e880e0f00c3e49fb2d/setuptools-11.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 11.2 2024-12-17T10:59:33,296 Found link https://files.pythonhosted.org/packages/f2/29/e69f1c1a12c579c6da265dc6594722ab11010683806e4e742eb7c8ffe08d/setuptools-11.2.zip (from https://pypi.org/simple/setuptools/), version: 11.2 2024-12-17T10:59:33,297 Found link https://files.pythonhosted.org/packages/db/c8/fb6817e76a2b6ab00e38c92286c526a8969e86a6739d251133ebcb7697ad/setuptools-11.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 11.3 2024-12-17T10:59:33,298 Found link https://files.pythonhosted.org/packages/34/a9/65ef401499e6878b3c67c473ecfd8803eacf274b03316ec8f2e86116708d/setuptools-11.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 11.3 2024-12-17T10:59:33,299 Found link https://files.pythonhosted.org/packages/85/b9/f32b943ce45853d778458ce0f9af007641557a5257acea29458e8cc2115d/setuptools-11.3.zip (from https://pypi.org/simple/setuptools/), version: 11.3 2024-12-17T10:59:33,300 Found link https://files.pythonhosted.org/packages/32/da/46df61c1c7f71483c73af190ff668c31fff096d789d0dd5ed83170e9366a/setuptools-11.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 11.3.1 2024-12-17T10:59:33,301 Found link https://files.pythonhosted.org/packages/ac/34/8e23ee6e86e0a7f2ad934aa7e16b03c13b3a3c1058d7972c60a60111cf2a/setuptools-11.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 11.3.1 2024-12-17T10:59:33,302 Found link https://files.pythonhosted.org/packages/98/44/cf4a8843803aa272b290679c2b08236029752c927bedaf3a6805b0191c3c/setuptools-11.3.1.zip (from https://pypi.org/simple/setuptools/), version: 11.3.1 2024-12-17T10:59:33,303 Found link https://files.pythonhosted.org/packages/3a/31/1faf2685a0cea0c36d4bbc035e53414026fdd5bd5f4e31b8b3c5d1767a54/setuptools-12.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.0 2024-12-17T10:59:33,304 Found link https://files.pythonhosted.org/packages/9e/be/ca16313dcc62f3b69b6f204470806042847656380cd401241a7b69b91a07/setuptools-12.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.0 2024-12-17T10:59:33,305 Found link https://files.pythonhosted.org/packages/9d/c9/b837359319988b156b9deed87ab6e8fc7e709afa82a97b93191c5a0077f4/setuptools-12.0.zip (from https://pypi.org/simple/setuptools/), version: 12.0 2024-12-17T10:59:33,306 Found link https://files.pythonhosted.org/packages/9f/ae/2344d112a43c5409449e8edeef86553c572150e596a455dc8fc8dce132d3/setuptools-12.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.0.1 2024-12-17T10:59:33,307 Found link https://files.pythonhosted.org/packages/31/f5/17ce5fa1f49d1665e7ec9fe5a2d1e6e73032d8f7cfb32440454059679a6f/setuptools-12.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.0.1 2024-12-17T10:59:33,308 Found link https://files.pythonhosted.org/packages/8d/40/7814758efbad56c5b13c7ca3bbb49b198577b3f62dd88334be7d1a9df6f7/setuptools-12.0.1.zip (from https://pypi.org/simple/setuptools/), version: 12.0.1 2024-12-17T10:59:33,309 Found link https://files.pythonhosted.org/packages/37/9c/e623f9b14d1b66ac1b73f6cefaef63c6116895c4a38c015a78d1c2e135c4/setuptools-12.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.0.2 2024-12-17T10:59:33,310 Found link https://files.pythonhosted.org/packages/eb/59/4103a48ece1a341350a587dd5ef8e27ea75d411c709cf59cf01e78b49a55/setuptools-12.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.0.2 2024-12-17T10:59:33,311 Found link https://files.pythonhosted.org/packages/49/f7/5962355be50b9ba5ea1e18fec91619c18ed6db434f0861085bc84db649b0/setuptools-12.0.2.zip (from https://pypi.org/simple/setuptools/), version: 12.0.2 2024-12-17T10:59:33,312 Found link https://files.pythonhosted.org/packages/2b/41/eef9b1bcf9dd28db416d2ca6f9b093ee0de74e758a3926a3fb18bb3f11dc/setuptools-12.0.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.0.3 2024-12-17T10:59:33,313 Found link https://files.pythonhosted.org/packages/aa/17/36aaaceb141ad7cbb9851158a8fd73215b93a63e7162fe5fcd7d773fb9b9/setuptools-12.0.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.0.3 2024-12-17T10:59:33,314 Found link https://files.pythonhosted.org/packages/39/8d/803fea27b92c8147f47e6254478a39eeef86b46d6fa72db6a358352b429c/setuptools-12.0.3.zip (from https://pypi.org/simple/setuptools/), version: 12.0.3 2024-12-17T10:59:33,315 Found link https://files.pythonhosted.org/packages/a0/b7/cc0ce2cb14b2312b253521c5985c1689e7e86ef1e27e36e4da6b4ccda768/setuptools-12.0.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.0.4 2024-12-17T10:59:33,316 Found link https://files.pythonhosted.org/packages/2c/1a/af35b7251503e04ca6946d2075bc694818edddbe1366b0c172c3e74c6133/setuptools-12.0.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.0.4 2024-12-17T10:59:33,317 Found link https://files.pythonhosted.org/packages/ac/9a/ee5772e08133a17f0640bd38ec3af687609d63a04f98a42fca142f73b6b3/setuptools-12.0.4.zip (from https://pypi.org/simple/setuptools/), version: 12.0.4 2024-12-17T10:59:33,318 Found link https://files.pythonhosted.org/packages/77/71/266b72e5c7df0f8a560599617495172036878ba24cff1e22ac4882d919b8/setuptools-12.0.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.0.5 2024-12-17T10:59:33,319 Found link https://files.pythonhosted.org/packages/c6/b6/7d0793d138644f8857753ac341e1f5fe744f157754a7b2b59a93b0ce6c38/setuptools-12.0.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.0.5 2024-12-17T10:59:33,320 Found link https://files.pythonhosted.org/packages/6f/bd/cde3aff4ef0b38b305ed68c05b696a202c2e7e72718831ade33eabd6d283/setuptools-12.0.5.zip (from https://pypi.org/simple/setuptools/), version: 12.0.5 2024-12-17T10:59:33,321 Found link https://files.pythonhosted.org/packages/a4/be/f9b8ef5079705f5872014198e1b5ddcefcedc75c22a59600868ca68cbbd0/setuptools-12.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.1 2024-12-17T10:59:33,322 Found link https://files.pythonhosted.org/packages/00/5b/a7dd72d8bab089f2c946b3682f1f9ebb459ca8c4bfef7b14640318ace782/setuptools-12.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.1 2024-12-17T10:59:33,323 Found link https://files.pythonhosted.org/packages/a8/4d/b668121f41308c83763a3f6030e9fde5cc8fd56cba422b923b0da3ac7668/setuptools-12.1.zip (from https://pypi.org/simple/setuptools/), version: 12.1 2024-12-17T10:59:33,324 Found link https://files.pythonhosted.org/packages/0b/36/6322d63caee39ce5efb932a289d892cf4c7b54e7e43376b7617638cd6e40/setuptools-12.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.2 2024-12-17T10:59:33,325 Found link https://files.pythonhosted.org/packages/13/c0/216e0adececaabad0bdfb11819af62b8c79ca507a179a01504adbf3726a3/setuptools-12.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.2 2024-12-17T10:59:33,326 Found link https://files.pythonhosted.org/packages/2c/72/1591dfe73b26a05bf53cd8035f85541283f9cb43febc67b76b6dd87fecb3/setuptools-12.2.zip (from https://pypi.org/simple/setuptools/), version: 12.2 2024-12-17T10:59:33,327 Found link https://files.pythonhosted.org/packages/ac/0f/29fb77656be5ab4cd72e51b5670f2f13b227377ae020ba49d9de2e4119a0/setuptools-12.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.3 2024-12-17T10:59:33,328 Found link https://files.pythonhosted.org/packages/d3/38/3f947884c009fc65c4d9f60ff154230be6226ac2215a30e631e155418a30/setuptools-12.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.3 2024-12-17T10:59:33,329 Found link https://files.pythonhosted.org/packages/e7/94/f2afdffc82361f4f0f1d771cb18cc9a757d4a52741453a3639bea5c34c4d/setuptools-12.3.zip (from https://pypi.org/simple/setuptools/), version: 12.3 2024-12-17T10:59:33,330 Found link https://files.pythonhosted.org/packages/95/c2/aba5df20f8f8b75c6cd99970809a789ac9ce5bd3033b9693098d9e647228/setuptools-12.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 12.4 2024-12-17T10:59:33,331 Found link https://files.pythonhosted.org/packages/05/99/4eb2d51cc8a1bbc2252c186f8455c68898734529b64daafaaf7d62264f94/setuptools-12.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 12.4 2024-12-17T10:59:33,333 Found link https://files.pythonhosted.org/packages/76/9d/4a0937535b4ed0ef752ed48dfd950d0d9c6ab3063a22f318ea08154d8bec/setuptools-12.4.zip (from https://pypi.org/simple/setuptools/), version: 12.4 2024-12-17T10:59:33,334 Found link https://files.pythonhosted.org/packages/08/80/6eb388e929f7212820aaf0e0943787ccb36bd49b86f0f7c4bf8e6ac00d27/setuptools-13.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 13.0.1 2024-12-17T10:59:33,335 Found link https://files.pythonhosted.org/packages/fa/ef/c0e1ac0e7509593a0addee204a4fc6b577e9323b5e92f03cccfc242ca5fa/setuptools-13.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 13.0.1 2024-12-17T10:59:33,336 Found link https://files.pythonhosted.org/packages/af/c5/63fe880591c601410cd2a168df603b24d66127a3c502b4688272e332ec19/setuptools-13.0.1.zip (from https://pypi.org/simple/setuptools/), version: 13.0.1 2024-12-17T10:59:33,337 Found link https://files.pythonhosted.org/packages/39/dd/d899e0ec56742d82a0ab83adff7ae0a2f36245047214bee9a6442bb9d4c6/setuptools-13.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 13.0.2 2024-12-17T10:59:33,338 Found link https://files.pythonhosted.org/packages/9f/9f/b8accb44e584d08bbdce792e4b99502f998b84130283c2ca539a4c3f2fd0/setuptools-13.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 13.0.2 2024-12-17T10:59:33,339 Found link https://files.pythonhosted.org/packages/ff/f3/498a65f5ed63ef35126da543d1be46b1526f0eb4f03dc47ffa2bdccf7e8b/setuptools-13.0.2.zip (from https://pypi.org/simple/setuptools/), version: 13.0.2 2024-12-17T10:59:33,340 Found link https://files.pythonhosted.org/packages/fb/5c/4e5898b5052e81a271faa03b0b9f5236c65682c3736d499d8de455264034/setuptools-14.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 14.0 2024-12-17T10:59:33,341 Found link https://files.pythonhosted.org/packages/60/79/b64b985b6c5eada9c650e12fb0ebd8c0136dbeabbd5b9b1be45f433a5ca1/setuptools-14.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 14.0 2024-12-17T10:59:33,342 Found link https://files.pythonhosted.org/packages/49/09/825f890e9f078a3ea74005bce4309143eee2662195f559b0d9b3910b868b/setuptools-14.0.zip (from https://pypi.org/simple/setuptools/), version: 14.0 2024-12-17T10:59:33,343 Found link https://files.pythonhosted.org/packages/7c/75/10917197567ce27a7d006fbdb5c37003478f626b1247c738f0d8584b9788/setuptools-14.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 14.1 2024-12-17T10:59:33,344 Found link https://files.pythonhosted.org/packages/1b/6c/de1a4da56ec6e7671d9b183ba0ad1ce76932d592be9c0da401538d98e1e5/setuptools-14.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 14.1 2024-12-17T10:59:33,345 Found link https://files.pythonhosted.org/packages/d7/f3/ac34e3cab9e07736ec3a72b1b435a3a4534daeb21a80d04ae411d09e73d0/setuptools-14.1.zip (from https://pypi.org/simple/setuptools/), version: 14.1 2024-12-17T10:59:33,346 Found link https://files.pythonhosted.org/packages/ca/a8/b3ced8c646d6e8e84b5b7e1861505b984c0a59bdd52c87fdf9765abf2a0b/setuptools-14.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 14.1.1 2024-12-17T10:59:33,347 Found link https://files.pythonhosted.org/packages/40/aa/7e810622378d14fe1f1ee6cc88c91a7c62f25dfa0f0b4cf3343d848ca5b1/setuptools-14.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 14.1.1 2024-12-17T10:59:33,348 Found link https://files.pythonhosted.org/packages/f1/c8/b5b997ff066cbf987660aa22bdc7b8b2cc804eea97170103b601bc7a40e5/setuptools-14.1.1.zip (from https://pypi.org/simple/setuptools/), version: 14.1.1 2024-12-17T10:59:33,349 Found link https://files.pythonhosted.org/packages/86/1e/55c39c8e647375f4ee053ab25dd47f847773113b3549e7642352a0d712f6/setuptools-14.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 14.2 2024-12-17T10:59:33,350 Found link https://files.pythonhosted.org/packages/43/3c/cb8b12b0f780caffdbb9621f63f39bb587f5549965ec0982abe73536e037/setuptools-14.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 14.2 2024-12-17T10:59:33,351 Found link https://files.pythonhosted.org/packages/b6/8b/19adbcfc88963f48906bd390c743184f59ca8c096dfb17c8a8b972436443/setuptools-14.2.zip (from https://pypi.org/simple/setuptools/), version: 14.2 2024-12-17T10:59:33,352 Found link https://files.pythonhosted.org/packages/e8/ac/6a4d5ea808ef5fe0a13319088e42937297140f112e86fbda5aff7c31cadc/setuptools-14.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 14.3 2024-12-17T10:59:33,353 Found link https://files.pythonhosted.org/packages/c6/07/2f5de27db67b1a7799811be804aa77dac9e04aaf39d8273f24205bb6dfb2/setuptools-14.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 14.3 2024-12-17T10:59:33,354 Found link https://files.pythonhosted.org/packages/7b/2e/6abcca232b3ee13e4b4d26ff27a06b7b473a597b18b91802668ab141d29d/setuptools-14.3.zip (from https://pypi.org/simple/setuptools/), version: 14.3 2024-12-17T10:59:33,355 Found link https://files.pythonhosted.org/packages/6d/eb/2fd142cc6387b5304850698369250f05fec5a69ae50e8ee512d6ec25237c/setuptools-14.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 14.3.1 2024-12-17T10:59:33,356 Found link https://files.pythonhosted.org/packages/e2/99/2f6deb6f2f50b7eb289f83d03d81d1018333b8886b1ca6c8dd7c7b52f3f9/setuptools-14.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 14.3.1 2024-12-17T10:59:33,357 Found link https://files.pythonhosted.org/packages/da/f0/7ef454473979ecf6d337c44c0af776d5793a31e0194391ac31e23392e8c9/setuptools-14.3.1.zip (from https://pypi.org/simple/setuptools/), version: 14.3.1 2024-12-17T10:59:33,358 Found link https://files.pythonhosted.org/packages/77/8d/7821039e75a509e52828c3f7bcc9faf4218aff2cbf37304e2ba239326db1/setuptools-15.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 15.0 2024-12-17T10:59:33,359 Found link https://files.pythonhosted.org/packages/7c/40/b38a541524c417e32333e1d459c7f2be56f8aceb96fd527476a5232276a7/setuptools-15.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 15.0 2024-12-17T10:59:33,360 Found link https://files.pythonhosted.org/packages/43/d8/8952db17766ec989fca23dc2305535efcbe6b3d07d4493f4cf312f94463d/setuptools-15.0.zip (from https://pypi.org/simple/setuptools/), version: 15.0 2024-12-17T10:59:33,361 Found link https://files.pythonhosted.org/packages/4f/58/07877759f873430057c08bde2136d489842597032cb5c8bbcc54aa0093b7/setuptools-15.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 15.1 2024-12-17T10:59:33,362 Found link https://files.pythonhosted.org/packages/de/14/2cf462619805bf49c1395030509fc4b30dd118d56ae94f0551910308fcbc/setuptools-15.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 15.1 2024-12-17T10:59:33,363 Found link https://files.pythonhosted.org/packages/db/db/bc5443e648500e22b48a3b55f7614157d2187b622936836a014de7e8e6c6/setuptools-15.1.zip (from https://pypi.org/simple/setuptools/), version: 15.1 2024-12-17T10:59:33,364 Found link https://files.pythonhosted.org/packages/21/9d/a071a5a012ce6db6c5e1cd5ef1125619eaf72195e389ba83f8399725ba4a/setuptools-15.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 15.2 2024-12-17T10:59:33,365 Found link https://files.pythonhosted.org/packages/a1/5f/e290ea36e7749a0d58ed2daab8c138fbe28178b91bc68d62d85a85964406/setuptools-15.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 15.2 2024-12-17T10:59:33,366 Found link https://files.pythonhosted.org/packages/28/17/f1b300eeec0405388bfffc51a1efb37c45ad713c978b231f2c24e1a7cee4/setuptools-15.2.zip (from https://pypi.org/simple/setuptools/), version: 15.2 2024-12-17T10:59:33,367 Found link https://files.pythonhosted.org/packages/66/5e/717a861f50bc8fa2a9bd516a9be52c9d482d3af5dd6b9bad56d2893eb50a/setuptools-16.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 16.0 2024-12-17T10:59:33,368 Found link https://files.pythonhosted.org/packages/03/68/ff7b42cce92cfb96d299311836249fa1d6adb050a2444b87c1d661adf5ec/setuptools-16.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 16.0 2024-12-17T10:59:33,369 Found link https://files.pythonhosted.org/packages/4f/2d/5ccd59268e5b9243e40bb93ff654499669ad210817f6cafaf396f0574a20/setuptools-16.0.zip (from https://pypi.org/simple/setuptools/), version: 16.0 2024-12-17T10:59:33,371 Found link https://files.pythonhosted.org/packages/b6/f0/f93e7c38bb7242ad00f78ea799fd3a0362f8316edc916a0d8ab02f0bcfcd/setuptools-17.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 17.0 2024-12-17T10:59:33,371 Found link https://files.pythonhosted.org/packages/df/b6/0d8caceca41ad57cf6902b533626481aadf79686024836cdab34fa470990/setuptools-17.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 17.0 2024-12-17T10:59:33,372 Found link https://files.pythonhosted.org/packages/0e/59/8562edadb9bd37d7efd73b2156ec9e7aa1e5df027837b0cb147430b6b12f/setuptools-17.0.zip (from https://pypi.org/simple/setuptools/), version: 17.0 2024-12-17T10:59:33,373 Found link https://files.pythonhosted.org/packages/d6/86/5e0b49553de3c450bca91a303a052bf26f54df14cf59ab65fbe77e452f87/setuptools-17.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 17.1 2024-12-17T10:59:33,374 Found link https://files.pythonhosted.org/packages/94/aa/68a87f84793f4efb0fe2d311f903f97c089dbc8d6c366541d63e5766a174/setuptools-17.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 17.1 2024-12-17T10:59:33,375 Found link https://files.pythonhosted.org/packages/0b/23/ffbb0b89f01676e28d2e79bd5cba47e2aa617bf13691c0cd3fc82a646fc4/setuptools-17.1.zip (from https://pypi.org/simple/setuptools/), version: 17.1 2024-12-17T10:59:33,376 Found link https://files.pythonhosted.org/packages/87/01/2d147e63b6cfb6948491efc73f6c9219c0bc5d9d183c9ab6bed8430fa78b/setuptools-17.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 17.1.1 2024-12-17T10:59:33,377 Found link https://files.pythonhosted.org/packages/3e/39/4b0c9d8121f0a43a466139aac0939acf0e0dc15e4c8a1bb61b06fd8fe654/setuptools-17.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 17.1.1 2024-12-17T10:59:33,378 Found link https://files.pythonhosted.org/packages/ab/45/fbcb04dbf423a82cd530f63a1a265b55055ec61bf5af250fc4e1044b60cf/setuptools-17.1.1.zip (from https://pypi.org/simple/setuptools/), version: 17.1.1 2024-12-17T10:59:33,379 Found link https://files.pythonhosted.org/packages/65/07/c240e40af3180056b16d0c343b23cfd0a3a7206e077cd1ef887cc5fc0d91/setuptools-18.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.0 2024-12-17T10:59:33,380 Found link https://files.pythonhosted.org/packages/04/9f/9e15924a1ee397d23b86f1dfed3aa9f1ce3db2572996530385917c925faf/setuptools-18.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.0 2024-12-17T10:59:33,381 Found link https://files.pythonhosted.org/packages/d8/4e/bcc2292b28f7d2bc0e859247eea94e589d4aa730b6b36d268be9f5f9e238/setuptools-18.0.zip (from https://pypi.org/simple/setuptools/), version: 18.0 2024-12-17T10:59:33,383 Found link https://files.pythonhosted.org/packages/00/d5/1233f051f7ce669a2009301aa75f1efbd97ccde6b60236997fd9111d5297/setuptools-18.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.0.1 2024-12-17T10:59:33,384 Found link https://files.pythonhosted.org/packages/8c/04/f4a2dce4364c0bfbb1992e4b3a8e01eb196bb46202f96a62e73927a752ef/setuptools-18.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.0.1 2024-12-17T10:59:33,385 Found link https://files.pythonhosted.org/packages/e1/c3/a9db1ecd786b88c3454b42498945e4a341b68d8717bde8d5c8aa0d32e604/setuptools-18.0.1.zip (from https://pypi.org/simple/setuptools/), version: 18.0.1 2024-12-17T10:59:33,386 Found link https://files.pythonhosted.org/packages/10/40/f079e5f10cedefa29fd3b62173da977cf736064b76d7541377afc8802e27/setuptools-18.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.1 2024-12-17T10:59:33,387 Found link https://files.pythonhosted.org/packages/c9/54/b716bdd25bb6096686d2dc6e1f2de9c58b6042a5dc40cd45918dcf835d50/setuptools-18.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.1 2024-12-17T10:59:33,388 Found link https://files.pythonhosted.org/packages/b7/37/63e7e32c0b29c6100d22aac00681c92165411dd50696db0db14abc0d71c5/setuptools-18.1.zip (from https://pypi.org/simple/setuptools/), version: 18.1 2024-12-17T10:59:33,389 Found link https://files.pythonhosted.org/packages/c3/f6/b3224fb53fd3ddebdcc2aafb8f2d3a044a66446c9f17f4e5a24ca03b781b/setuptools-18.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.2 2024-12-17T10:59:33,390 Found link https://files.pythonhosted.org/packages/44/34/88291437ae25021cf632ecc8d81587c18deec404642fceee4a59478f57ba/setuptools-18.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.2 2024-12-17T10:59:33,391 Found link https://files.pythonhosted.org/packages/f5/f4/03fdc144f760de50a2a1d82975e25af0b4374ae0d8b934eeb28e248468d0/setuptools-18.2.zip (from https://pypi.org/simple/setuptools/), version: 18.2 2024-12-17T10:59:33,392 Found link https://files.pythonhosted.org/packages/e3/15/361a2f5c0a660ee497eec4981eff772cdfe3b181a85c407b2879cc4454e4/setuptools-18.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.3 2024-12-17T10:59:33,393 Found link https://files.pythonhosted.org/packages/5b/07/56cc2388ab75c15cbeb56dde0542d6c12aa58db6ed76d90448177a8ed8e3/setuptools-18.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.3 2024-12-17T10:59:33,394 Found link https://files.pythonhosted.org/packages/13/9f/3b21c8ced6b093afb828b181bd0351dfc6043cb3f96132f3a390fea7de51/setuptools-18.3.zip (from https://pypi.org/simple/setuptools/), version: 18.3 2024-12-17T10:59:33,395 Found link https://files.pythonhosted.org/packages/09/f3/1dde395f7d8416510d276e5f4ccafd1ea3690a14e2e7af1dc5481d78e239/setuptools-18.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.3.1 2024-12-17T10:59:33,396 Skipping link: unsupported archive format: .egg: https://files.pythonhosted.org/packages/89/ea/4fb7162ef9244471947676d549ef1603c67dfd257427c0549b51357a1e5a/setuptools-18.3.1-py3.4.egg (from https://pypi.org/simple/setuptools/) 2024-12-17T10:59:33,397 Found link https://files.pythonhosted.org/packages/86/8a/c4666b05c74e840eb9b09d28f4e7ae76fc9075e8c653d0eb4d265a5b49d9/setuptools-18.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.3.1 2024-12-17T10:59:33,398 Found link https://files.pythonhosted.org/packages/22/26/6fdaea27dbe43163d63871f31cfce9a928520f616c1cbb5c98f2a37920a6/setuptools-18.3.1.zip (from https://pypi.org/simple/setuptools/), version: 18.3.1 2024-12-17T10:59:33,399 Found link https://files.pythonhosted.org/packages/4b/24/aa010e86a1762750be5c6863d95cb27721cec5382221dab1bdd76dbb0b33/setuptools-18.3.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.3.2 2024-12-17T10:59:33,400 Found link https://files.pythonhosted.org/packages/52/ba/51f53c8fa0c72750d6ea99d9493987a353a7a756cd7fba830326edda82d9/setuptools-18.3.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.3.2 2024-12-17T10:59:33,401 Found link https://files.pythonhosted.org/packages/fe/ce/063abef42134e75edc350ef67fdd3baf3df487ffe8e9cd4e282e864192aa/setuptools-18.3.2.zip (from https://pypi.org/simple/setuptools/), version: 18.3.2 2024-12-17T10:59:33,402 Found link https://files.pythonhosted.org/packages/cb/e7/63e4efa1bd3396d0d7d0697d896c7c9c39635a8929424c4016b0abcf6e4d/setuptools-18.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.4 2024-12-17T10:59:33,403 Found link https://files.pythonhosted.org/packages/f4/4c/2b6ab405ed5a3a9aba8db8d163fe37feafc284135e2cc7c1919c57a90bf9/setuptools-18.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.4 2024-12-17T10:59:33,404 Found link https://files.pythonhosted.org/packages/04/79/0d1aace91c2ba8edbc23930b4c08d81ff0ebd016726f213a427af34893b8/setuptools-18.4.zip (from https://pypi.org/simple/setuptools/), version: 18.4 2024-12-17T10:59:33,405 Found link https://files.pythonhosted.org/packages/69/9d/e6ff1608e4308ae7c544050b58926daa4bf7764e963c09cc9f9a0bcd3728/setuptools-18.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.5 2024-12-17T10:59:33,406 Found link https://files.pythonhosted.org/packages/ec/6d/b433a14c77ad17b917a9646d5ac96275309170a88fcffc967def7a1ba8ce/setuptools-18.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.5 2024-12-17T10:59:33,407 Found link https://files.pythonhosted.org/packages/01/e6/15b9f1d1dcbde0984c499c3775be47ea0e4063bc34d2e843c4425d164436/setuptools-18.5.zip (from https://pypi.org/simple/setuptools/), version: 18.5 2024-12-17T10:59:33,408 Found link https://files.pythonhosted.org/packages/1d/99/3375dfc6e5b5212f32438131dbd721762404bc6ba6c75a0eb4836b309756/setuptools-18.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.6 2024-12-17T10:59:33,409 Found link https://files.pythonhosted.org/packages/d3/c5/c61734bfbba5a635f2bc9f0dc0f031cee59b69165e02b391b966f63bee88/setuptools-18.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.6 2024-12-17T10:59:33,410 Found link https://files.pythonhosted.org/packages/27/9d/b481808fd55856faa1bee32a7749de5c59e67096abbbeca609546a7ce1d7/setuptools-18.6.zip (from https://pypi.org/simple/setuptools/), version: 18.6 2024-12-17T10:59:33,411 Found link https://files.pythonhosted.org/packages/63/a5/a9369d7450c8725c7ea868ea395108eaa86ce4db38480fe714d3ebc2987f/setuptools-18.6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.6.1 2024-12-17T10:59:33,412 Found link https://files.pythonhosted.org/packages/d7/6c/c44de1eb48a0528aee19ead52f64afac7830230ef94314e10d6de5c79ffd/setuptools-18.6.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.6.1 2024-12-17T10:59:33,413 Found link https://files.pythonhosted.org/packages/0d/c2/e2e94f17a5e3a9d23f6ade1936b276d37b5615c970847f7a73ac00dc597f/setuptools-18.6.1.zip (from https://pypi.org/simple/setuptools/), version: 18.6.1 2024-12-17T10:59:33,414 Found link https://files.pythonhosted.org/packages/47/04/7b211cb108f0ef1ec8d7f22750fb29126535609aabf9d4ae2a3d1392d10d/setuptools-18.7-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.7 2024-12-17T10:59:33,415 Found link https://files.pythonhosted.org/packages/b8/07/41e7b2d50ad56bff7767c9faffa3f006f30fe9bbde255b6dd13fb88f6c06/setuptools-18.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.7 2024-12-17T10:59:33,416 Found link https://files.pythonhosted.org/packages/1c/a9/0dc5641ce1e46eb08a25d6e986faf524d44377b3bc29405acfead2b7456b/setuptools-18.7.zip (from https://pypi.org/simple/setuptools/), version: 18.7 2024-12-17T10:59:33,417 Found link https://files.pythonhosted.org/packages/47/77/a1fd66157a3f27ccb1a5537897328f00c8a2ce52294841685eddbd83a752/setuptools-18.7.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.7.1 2024-12-17T10:59:33,418 Found link https://files.pythonhosted.org/packages/a2/20/5b06560f0a2a58df41ad920bd7c63811bc0496f1de28740ba5bb166bf5ac/setuptools-18.7.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.7.1 2024-12-17T10:59:33,419 Found link https://files.pythonhosted.org/packages/dc/a3/36a19c2d8187cd3d67537d1ff8d66d649738b820624dcb0953c8688648e5/setuptools-18.7.1.zip (from https://pypi.org/simple/setuptools/), version: 18.7.1 2024-12-17T10:59:33,420 Found link https://files.pythonhosted.org/packages/57/a4/f6b8bc74006295a8cf0a5a6c7d2abb23d0e061cf98c24bc8262c89c69212/setuptools-18.8-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.8 2024-12-17T10:59:33,421 Found link https://files.pythonhosted.org/packages/a8/44/e71cea10c597efc7c8255926c70fbd5cf0a919b88589877f01b3cf3bd796/setuptools-18.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.8 2024-12-17T10:59:33,422 Found link https://files.pythonhosted.org/packages/43/d9/015139565e4aa1be4fff52d6eccebf57df546ca9048df150d2b5c594aaf7/setuptools-18.8.zip (from https://pypi.org/simple/setuptools/), version: 18.8 2024-12-17T10:59:33,423 Found link https://files.pythonhosted.org/packages/62/bb/f30c6eec4fdad80dd2e24beca74f48b8953c989955d2e39572a2bba37e29/setuptools-18.8.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 18.8.1 2024-12-17T10:59:33,424 Found link https://files.pythonhosted.org/packages/e9/6b/60f0e5adea1b61bce06ffd02f414b0c115ec9608943c7387c997511d7cdc/setuptools-18.8.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 18.8.1 2024-12-17T10:59:33,425 Found link https://files.pythonhosted.org/packages/c8/4b/b87d0332ae6b6f816ebc7dd35b6ab7bc488af4acdf5d90e6a1fe3fa4be59/setuptools-18.8.1.zip (from https://pypi.org/simple/setuptools/), version: 18.8.1 2024-12-17T10:59:33,426 Found link https://files.pythonhosted.org/packages/25/e5/76920c6242c51dd97f418d9cdbb93bac9cc3626dbdfb67d0c7909b7332a7/setuptools-19.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.0 2024-12-17T10:59:33,427 Found link https://files.pythonhosted.org/packages/fd/0e/b4336a46bfa7f7aa2163d063ce7f85c9689a84d3ae4c918822b68e11ff7e/setuptools-19.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.0 2024-12-17T10:59:33,428 Found link https://files.pythonhosted.org/packages/07/a1/94d559a3b242c81d85a5ff6f283248952995b72c46bd84222f4d2c6c8fb6/setuptools-19.0.zip (from https://pypi.org/simple/setuptools/), version: 19.0 2024-12-17T10:59:33,429 Found link https://files.pythonhosted.org/packages/b8/b9/f7dadfb59d1f957bcb64c2e760fc4e1e6517e080ff23b7d02fa25c6c0f9a/setuptools-19.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.1 2024-12-17T10:59:33,430 Found link https://files.pythonhosted.org/packages/62/80/a982219d12596ae3ea8a03854b357cd5718ddb95721c00593464765cfb88/setuptools-19.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.1 2024-12-17T10:59:33,431 Found link https://files.pythonhosted.org/packages/49/a0/607ab10a870efb0276f9b2592fac438a008ea7af548cdaa86e1d31676483/setuptools-19.1.zip (from https://pypi.org/simple/setuptools/), version: 19.1 2024-12-17T10:59:33,432 Found link https://files.pythonhosted.org/packages/c9/7e/ff929dfb3c6268dfa23f86698b9ca17674cc2464e3b7bee8bd05ac653ed3/setuptools-19.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.1.1 2024-12-17T10:59:33,433 Found link https://files.pythonhosted.org/packages/8d/37/bd37d4432b0f788bdd2092f63190515c124e75613a24eccafe6f019d13d6/setuptools-19.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.1.1 2024-12-17T10:59:33,434 Found link https://files.pythonhosted.org/packages/99/97/b9ab8825b69fa53006ec6ff65322a75dfed4405af4c3cbc994f08a28e678/setuptools-19.1.1.zip (from https://pypi.org/simple/setuptools/), version: 19.1.1 2024-12-17T10:59:33,435 Found link https://files.pythonhosted.org/packages/50/4c/d1a74a90deb70f72981c138a70d3d0799721e5bd1dc8c4201900141b8915/setuptools-19.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.2 2024-12-17T10:59:33,436 Found link https://files.pythonhosted.org/packages/2d/f7/02abdb61deaf8135e463b7081d053e952cae3672f3f09d75ca26f4c824c9/setuptools-19.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.2 2024-12-17T10:59:33,437 Found link https://files.pythonhosted.org/packages/0f/b6/9357ac9dcbd267209621a1550ef6cf800d6055a6ed5814c75c1aa8c0dee7/setuptools-19.2.zip (from https://pypi.org/simple/setuptools/), version: 19.2 2024-12-17T10:59:33,438 Found link https://files.pythonhosted.org/packages/c8/df/d060af2269b6d4da20ef976368e97b500912f7f4a0066f1d13e66e691d6d/setuptools-19.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.3 2024-12-17T10:59:33,439 Found link https://files.pythonhosted.org/packages/1e/99/7606f9494383e77c2e2da269ffea6bff0412238c72a44930d6c2084ec961/setuptools-19.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.3 2024-12-17T10:59:33,440 Found link https://files.pythonhosted.org/packages/81/01/d296546e7a005d0eac2944cdb6f065db8fae4df41a982be9af130047cbc0/setuptools-19.3.zip (from https://pypi.org/simple/setuptools/), version: 19.3 2024-12-17T10:59:33,441 Found link https://files.pythonhosted.org/packages/cd/1f/8415bc5ec42da81d4c5da35a21eb8c36f33768de99daeee09c33aacd51eb/setuptools-19.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.4 2024-12-17T10:59:33,442 Found link https://files.pythonhosted.org/packages/65/1b/7fbfa8da32c8daaebdd3c932986d43646d46855d609db5d39b558a823ccf/setuptools-19.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.4 2024-12-17T10:59:33,443 Found link https://files.pythonhosted.org/packages/df/ae/95089f178d0ff51c7c218951b9bfc51d10170829c7dc23640af064440ecd/setuptools-19.4.zip (from https://pypi.org/simple/setuptools/), version: 19.4 2024-12-17T10:59:33,444 Found link https://files.pythonhosted.org/packages/90/e5/eebf9ffd75cb3df96d1fa639a86e3c6db555457854328f5c2706ac4068c2/setuptools-19.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.4.1 2024-12-17T10:59:33,445 Found link https://files.pythonhosted.org/packages/23/fa/980413db21bbeba755078e166b5bfe7d0e86b3dfbaf165f0d9575ded9abc/setuptools-19.4.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.4.1 2024-12-17T10:59:33,446 Found link https://files.pythonhosted.org/packages/e2/9e/052567ebe44024d17dbe8eb967f0227a23b0f68f47f6e54d11d9e2afccc0/setuptools-19.4.1.zip (from https://pypi.org/simple/setuptools/), version: 19.4.1 2024-12-17T10:59:33,447 Found link https://files.pythonhosted.org/packages/86/8b/375384ae41dcd985b66f5988a3122fecc872d3a6915090238508f9ad90d1/setuptools-19.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.5 2024-12-17T10:59:33,448 Found link https://files.pythonhosted.org/packages/14/59/93b6a05121d26276354c95ccd31aa7cfb97a01eed5c598c295b8ff829c57/setuptools-19.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.5 2024-12-17T10:59:33,449 Found link https://files.pythonhosted.org/packages/9b/00/d24d8f4c26c6dfcf25f5456eaa0c4a64a1d4f40006a3dc05a6928c5ba63a/setuptools-19.5.zip (from https://pypi.org/simple/setuptools/), version: 19.5 2024-12-17T10:59:33,450 Found link https://files.pythonhosted.org/packages/1c/84/e54b5356f7de2f7d33b6c6c4c187b12dc6f5417861a0d81271a6c37ecc3c/setuptools-19.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.6 2024-12-17T10:59:33,451 Found link https://files.pythonhosted.org/packages/8c/58/0a9154c04ff99594c5563e2b03fdcded92e128afd5fa56db202b5877933b/setuptools-19.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.6 2024-12-17T10:59:33,452 Found link https://files.pythonhosted.org/packages/f7/38/192acd9604546870cfe8f106923a63c5a532324cffc94f041a697b64cc5d/setuptools-19.6.zip (from https://pypi.org/simple/setuptools/), version: 19.6 2024-12-17T10:59:33,453 Found link https://files.pythonhosted.org/packages/ee/b5/595168f70a743d933bac6d4eb131dc9fc4a58fd38c59377a2c3903a7829d/setuptools-19.6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.6.1 2024-12-17T10:59:33,454 Found link https://files.pythonhosted.org/packages/28/02/a4e4199e27414c7b9bd01b24284b239a43fdebfd5cae50cc97821562cbfa/setuptools-19.6.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.6.1 2024-12-17T10:59:33,455 Found link https://files.pythonhosted.org/packages/fe/e4/83bda2ba07ba3489374583a7a2b1d1a56fb993314e80b09fa6898557a26f/setuptools-19.6.1.zip (from https://pypi.org/simple/setuptools/), version: 19.6.1 2024-12-17T10:59:33,456 Found link https://files.pythonhosted.org/packages/09/0e/ad6774ef6f280c255fa1ce14c83d2df8d83a841621d538c0474fc9603160/setuptools-19.6.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.6.2 2024-12-17T10:59:33,457 Found link https://files.pythonhosted.org/packages/3e/ec/9fec74fc9e96dca889df66833fc2b5eb0a158d3d6a71b9ad016dfd2a301f/setuptools-19.6.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.6.2 2024-12-17T10:59:33,458 Found link https://files.pythonhosted.org/packages/8c/69/c4ec7b141a529fea6f7baa71e04fd1c43b146529a602f660d072c01e865f/setuptools-19.6.2.zip (from https://pypi.org/simple/setuptools/), version: 19.6.2 2024-12-17T10:59:33,459 Found link https://files.pythonhosted.org/packages/26/39/f94c9a95b11f7616adda92d7edbf2cf60079991df53af2ad1462c767a9c1/setuptools-19.7-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 19.7 2024-12-17T10:59:33,460 Found link https://files.pythonhosted.org/packages/47/79/90fc6fa184a25502f901bdda59c0423dbbfb5ace72557aa0bc47db00de8a/setuptools-19.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 19.7 2024-12-17T10:59:33,461 Found link https://files.pythonhosted.org/packages/d2/22/2ed3e5bdae82c5f8b98d7d12b24951c73c87308afc77b3e746afb5895bb2/setuptools-19.7.zip (from https://pypi.org/simple/setuptools/), version: 19.7 2024-12-17T10:59:33,462 Found link https://files.pythonhosted.org/packages/f9/08/1cee3e1650e036fdc54ff328d88a735ed8ca7ac6a0bb20d26ccb27790575/setuptools-20.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.0 2024-12-17T10:59:33,463 Found link https://files.pythonhosted.org/packages/b2/8d/9cb60a838a783769729b6e3e9c42f53e735e9e2443ce0181ffc5a59ae826/setuptools-20.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.0 2024-12-17T10:59:33,464 Found link https://files.pythonhosted.org/packages/bc/bc/906f911c3255509b29f2edd7f7b63df11c2bb5be3348c8a6a557e326eb79/setuptools-20.0.zip (from https://pypi.org/simple/setuptools/), version: 20.0 2024-12-17T10:59:33,465 Found link https://files.pythonhosted.org/packages/53/f3/a1ed894c585833a22f7eb362afff8c381fc433efc3c305e4b681f783b769/setuptools-20.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.1 2024-12-17T10:59:33,466 Found link https://files.pythonhosted.org/packages/19/81/2d203308707cc50c531381e8a64965d0cfd233f64bf9e61bf76bd8710950/setuptools-20.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.1 2024-12-17T10:59:33,467 Found link https://files.pythonhosted.org/packages/b9/f4/daf82e949ff2602dd0e8f3e2e50091788135c0eb9f2d92a8468f2d745513/setuptools-20.1.zip (from https://pypi.org/simple/setuptools/), version: 20.1 2024-12-17T10:59:33,468 Found link https://files.pythonhosted.org/packages/e8/82/3b5455f74bf9ac0757d09c625b7741e6fc284d7519cffc3babb6c5173cf5/setuptools-20.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.1.1 2024-12-17T10:59:33,469 Found link https://files.pythonhosted.org/packages/9a/6f/3e4e5cc3fb0a155372791b0dbd0a997cea9699a72345d8e5f8fdbcc4e615/setuptools-20.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.1.1 2024-12-17T10:59:33,470 Found link https://files.pythonhosted.org/packages/0a/ac/982625a3231061811b02bfe1715c823ca6e483689cdebaab34e55c3200b4/setuptools-20.1.1.zip (from https://pypi.org/simple/setuptools/), version: 20.1.1 2024-12-17T10:59:33,472 Found link https://files.pythonhosted.org/packages/bc/6c/a07e4fd8ff7c7aa4eb535c17a7a5408d87a3d0bfc7251dea97f87be09f42/setuptools-20.2.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.2.2 2024-12-17T10:59:33,473 Found link https://files.pythonhosted.org/packages/69/65/4c544cde88d4d876cdf5cbc5f3f15d02646477756d89547e9a7ecd6afa76/setuptools-20.2.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.2.2 2024-12-17T10:59:33,474 Found link https://files.pythonhosted.org/packages/50/31/b777a1f82d2b34836b3a5f61d57977392e3bbe16d255b73a43a2f2e51b8d/setuptools-20.2.2.zip (from https://pypi.org/simple/setuptools/), version: 20.2.2 2024-12-17T10:59:33,475 Found link https://files.pythonhosted.org/packages/27/c5/a1dccd24bb075f0063afa13b15747a28d40efb1cccc8e85bdf256ae1475f/setuptools-20.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.3 2024-12-17T10:59:33,476 Found link https://files.pythonhosted.org/packages/2e/5e/b143cf33d98c41f2fb69fbcf50fbd4450e22771b1235aee515d48ecb3eac/setuptools-20.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.3 2024-12-17T10:59:33,477 Found link https://files.pythonhosted.org/packages/cd/c3/bb18476d15774c1d1ed0f91ad8ffa920b6e5133e6a6288c47e00ed10d30d/setuptools-20.3.zip (from https://pypi.org/simple/setuptools/), version: 20.3 2024-12-17T10:59:33,478 Found link https://files.pythonhosted.org/packages/89/8c/200568ed24675f32dfa8ff8df130c66edf4563b05b4b0a7e88b121683d7e/setuptools-20.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.3.1 2024-12-17T10:59:33,479 Found link https://files.pythonhosted.org/packages/fc/bf/e129e7ef5192a182228ad4aeb164442dab838f7038cabdc1b8e4b2366ae9/setuptools-20.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.3.1 2024-12-17T10:59:33,480 Found link https://files.pythonhosted.org/packages/9b/52/20f47b5f8ea75a76c789bdc6d003c1e05d0f52c1d046a72f37db5065724f/setuptools-20.3.1.zip (from https://pypi.org/simple/setuptools/), version: 20.3.1 2024-12-17T10:59:33,481 Found link https://files.pythonhosted.org/packages/6c/e6/1e47ec467ba8224fddbd7ce63eee7958b4a43960b8306b28392fc0a30320/setuptools-20.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.4 2024-12-17T10:59:33,482 Found link https://files.pythonhosted.org/packages/1b/10/021a03228d67fb287d9df9c46ef7b29f0b86579d04fb6bd24158dfb0173e/setuptools-20.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.4 2024-12-17T10:59:33,483 Found link https://files.pythonhosted.org/packages/c3/4a/c39e4d726c26aabaa07428cfd44ba3f65f7576771ebe5874b65714bb9ab3/setuptools-20.4.zip (from https://pypi.org/simple/setuptools/), version: 20.4 2024-12-17T10:59:33,484 Found link https://files.pythonhosted.org/packages/82/df/885e56f3a282f876b7280d98971efac45815ea372021b46bf25e82e4fe51/setuptools-20.6.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.6.6 2024-12-17T10:59:33,485 Found link https://files.pythonhosted.org/packages/83/9c/c35ea1a8c489518d59660bff85f83632bb421e1877e84328b7de0672709e/setuptools-20.6.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.6.6 2024-12-17T10:59:33,486 Found link https://files.pythonhosted.org/packages/aa/bb/491858898e25460f9cf38c2757d134bd6bd5f6d54594dd0d2455e21cadb5/setuptools-20.6.6.zip (from https://pypi.org/simple/setuptools/), version: 20.6.6 2024-12-17T10:59:33,487 Found link https://files.pythonhosted.org/packages/45/11/e67731adbe045d384dabb5de73b900db57f37a1399bfd9ef12dcae4b35b9/setuptools-20.6.7-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.6.7 2024-12-17T10:59:33,488 Found link https://files.pythonhosted.org/packages/72/60/120420b893a7a8fe6aa7d0a6b78d80f145cbb832e1c6035b9b24f1583418/setuptools-20.6.7.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.6.7 2024-12-17T10:59:33,489 Found link https://files.pythonhosted.org/packages/de/ef/d99fd3410990c69619ddadeed594dba1f307054ab0b35d5140cda6e774fc/setuptools-20.6.7.zip (from https://pypi.org/simple/setuptools/), version: 20.6.7 2024-12-17T10:59:33,490 Found link https://files.pythonhosted.org/packages/69/66/b3153ccb7e0a631b32ba51f02ecc781b3c9ea37b4a831b9bf06a235c0f10/setuptools-20.6.8-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.6.8 2024-12-17T10:59:33,491 Found link https://files.pythonhosted.org/packages/52/11/7eda69b8e0d2009822c970d8acd9bf3056d1daec1ed96310c8aeb39f1a46/setuptools-20.6.8.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.6.8 2024-12-17T10:59:33,492 Found link https://files.pythonhosted.org/packages/1d/3f/a5a1e8a805c9b8ce8ca085ebc79b0dd329e2b797cecd38a769a06531f6da/setuptools-20.6.8.zip (from https://pypi.org/simple/setuptools/), version: 20.6.8 2024-12-17T10:59:33,493 Found link https://files.pythonhosted.org/packages/73/73/57576f40b4d87a4f8d0fba656469d05559910337d852bc513ff34f47bdc8/setuptools-20.7.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.7.0 2024-12-17T10:59:33,494 Found link https://files.pythonhosted.org/packages/e8/8a/267dca7818b5ba66bd85e1dbf5f867f14c7c16d823455d0f3103e6085a04/setuptools-20.7.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.7.0 2024-12-17T10:59:33,495 Found link https://files.pythonhosted.org/packages/a2/6b/3203c18962402ce25875f7682970283991fe401d0ee5fcac96829727c188/setuptools-20.7.0.zip (from https://pypi.org/simple/setuptools/), version: 20.7.0 2024-12-17T10:59:33,496 Found link https://files.pythonhosted.org/packages/8b/59/51b23f214a5ae5b3c0e7307a211a4fe71a6a07ca3b9fc2e36742a85963b4/setuptools-20.8.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.8.0 2024-12-17T10:59:33,497 Found link https://files.pythonhosted.org/packages/ec/84/9fa193404ad183c712088fcef43a3a52f94e06b3825bd594861952fd556e/setuptools-20.8.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.8.0 2024-12-17T10:59:33,498 Found link https://files.pythonhosted.org/packages/fb/0c/c33d7bcb99c28cfe177f05cccb423327a1fcbf21a49593013dac6b6595ce/setuptools-20.8.0.zip (from https://pypi.org/simple/setuptools/), version: 20.8.0 2024-12-17T10:59:33,499 Found link https://files.pythonhosted.org/packages/4f/4b/d492e47006cf1fe5a1c5000c61921cbb740bdf25de9e41150205261dcbfd/setuptools-20.8.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.8.1 2024-12-17T10:59:33,500 Found link https://files.pythonhosted.org/packages/da/11/5ba1a8162dca3c28666e448f3a8ddb8057e786b09bbd48f3c381ab26e898/setuptools-20.8.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.8.1 2024-12-17T10:59:33,501 Found link https://files.pythonhosted.org/packages/c4/19/c1bdc88b53da654df43770f941079dbab4e4788c2dcb5658fb86259894c7/setuptools-20.8.1.zip (from https://pypi.org/simple/setuptools/), version: 20.8.1 2024-12-17T10:59:33,502 Found link https://files.pythonhosted.org/packages/c0/8f/f02fdd83bed337d3fd504c279b2bd94895fc0ae81d162ba1deca846d739d/setuptools-20.9.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.9.0 2024-12-17T10:59:33,503 Found link https://files.pythonhosted.org/packages/00/d7/5511e82e0645ed4b939bb42f0a07450d0cdf9cf3ed08758b459f3d002747/setuptools-20.9.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.9.0 2024-12-17T10:59:33,504 Found link https://files.pythonhosted.org/packages/36/cb/57c5af3e6b2795e3eef0af035ae712e3528b1007f6f972721162ae5167aa/setuptools-20.9.0.zip (from https://pypi.org/simple/setuptools/), version: 20.9.0 2024-12-17T10:59:33,505 Found link https://files.pythonhosted.org/packages/c5/e2/72d706eeda837564b9fecdc8b2bf48b33467ae928ed05d4ac157463c90fb/setuptools-20.10.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 20.10.1 2024-12-17T10:59:33,506 Found link https://files.pythonhosted.org/packages/d3/16/21cf5dc6974280197e42d57bf7d372380562ec69aef9bb796b5e2dbbed6e/setuptools-20.10.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 20.10.1 2024-12-17T10:59:33,507 Found link https://files.pythonhosted.org/packages/86/ee/622e83b0dbede6d48891ed209fa5ca83fcc485f9b6696cf56796eda40806/setuptools-20.10.1.zip (from https://pypi.org/simple/setuptools/), version: 20.10.1 2024-12-17T10:59:33,508 Found link https://files.pythonhosted.org/packages/15/b7/a76624e5a3b18c8c1c8d33a5240b34cdabb08aef2da44b536a8b53ba1a45/setuptools-21.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 21.0.0 2024-12-17T10:59:33,510 Found link https://files.pythonhosted.org/packages/ff/d4/209f4939c49e31f5524fa0027bf1c8ec3107abaf7c61fdaad704a648c281/setuptools-21.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 21.0.0 2024-12-17T10:59:33,511 Found link https://files.pythonhosted.org/packages/1d/c0/57c129132059297460922eec3cabf3016e792455adf9db8c5b144db67d69/setuptools-21.0.0.zip (from https://pypi.org/simple/setuptools/), version: 21.0.0 2024-12-17T10:59:33,512 Found link https://files.pythonhosted.org/packages/48/9b/b9a9b3aaf83171a97cbfcef1bfb4a92ab3f7ed3bd74fdeb7e079617ee637/setuptools-21.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 21.1.0 2024-12-17T10:59:33,514 Found link https://files.pythonhosted.org/packages/f0/32/99ead2d74cba43bd59aa213e9c6e8212a9d3ed07805bb66b8bf9affbb541/setuptools-21.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 21.1.0 2024-12-17T10:59:33,515 Found link https://files.pythonhosted.org/packages/d3/70/1bd111ada7168f63d6134fc1a574f689e1b46156634b4ad8b77428210fcb/setuptools-21.1.0.zip (from https://pypi.org/simple/setuptools/), version: 21.1.0 2024-12-17T10:59:33,516 Found link https://files.pythonhosted.org/packages/57/68/a5b7002017dfbbf5f52bc23d4a9adedc97f7ceb5d92ae15591e858a56415/setuptools-21.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 21.2.0 2024-12-17T10:59:33,517 Found link https://files.pythonhosted.org/packages/8a/c1/d2de34cfd207a5c14efda8a5cd4fe7fd47ca9d91549e0a8309a15cedfbfb/setuptools-21.2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 21.2.0 2024-12-17T10:59:33,518 Found link https://files.pythonhosted.org/packages/f9/ca/a4dd1a61159fc9576ff3b06c0ba71ff3f1367d409451e815398ba94b0697/setuptools-21.2.0.zip (from https://pypi.org/simple/setuptools/), version: 21.2.0 2024-12-17T10:59:33,519 Found link https://files.pythonhosted.org/packages/0b/71/2c2a7eedb682cfba4d86bc656be8e7c9e92795982b91487be6e4aa9713af/setuptools-21.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 21.2.1 2024-12-17T10:59:33,520 Found link https://files.pythonhosted.org/packages/13/e8/35d9c7528b3c266a17e888bea1e02eb061e9ab6cdabc7107dfb7da83a1d2/setuptools-21.2.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 21.2.1 2024-12-17T10:59:33,521 Found link https://files.pythonhosted.org/packages/18/43/f297fa8752573e03835971312ebecc167c5edf7e1dda810a7a799323f4d9/setuptools-21.2.1.zip (from https://pypi.org/simple/setuptools/), version: 21.2.1 2024-12-17T10:59:33,522 Found link https://files.pythonhosted.org/packages/9e/33/b4e3494d886eadde48f47f73fb0fc4e4061c65e9c05b0807c0e61e91a51b/setuptools-21.2.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 21.2.2 2024-12-17T10:59:33,523 Found link https://files.pythonhosted.org/packages/5b/6e/a4bf49ddc41f144fd511f24c096dfa7600bffaf348563e08ef381dd6323e/setuptools-21.2.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 21.2.2 2024-12-17T10:59:33,524 Found link https://files.pythonhosted.org/packages/94/ed/99b4cc83113d8f46234f8f4e47e0040977cac546de4d5f8bca9f52b54841/setuptools-21.2.2.zip (from https://pypi.org/simple/setuptools/), version: 21.2.2 2024-12-17T10:59:33,525 Found link https://files.pythonhosted.org/packages/70/4b/77c40f3a85809da4912977bcc949b541938250c3f65001bdc4e06cb2cfed/setuptools-22.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 22.0.0 2024-12-17T10:59:33,526 Found link https://files.pythonhosted.org/packages/f5/90/010892bde11d2da00548285da29a055e6b0e3b81592bb6021571b87f34a1/setuptools-22.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 22.0.0 2024-12-17T10:59:33,526 Found link https://files.pythonhosted.org/packages/0e/a4/d6e76f14075235f9ce64bba95bfb277ce24b305f1300afe353c2143ba234/setuptools-22.0.0.zip (from https://pypi.org/simple/setuptools/), version: 22.0.0 2024-12-17T10:59:33,527 Found link https://files.pythonhosted.org/packages/4f/d8/155e8dd2cf61d5091a331b7a5fec3bd0849a6f92a2108755ce0a031cc5b4/setuptools-22.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 22.0.1 2024-12-17T10:59:33,528 Found link https://files.pythonhosted.org/packages/a1/40/4e7350f71abd12eeb995ff6b22fb1e00e6e92b9197237684f9dd50a34076/setuptools-22.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 22.0.1 2024-12-17T10:59:33,528 Found link https://files.pythonhosted.org/packages/7d/b1/07544b46e1a0895c5049e23bb4b4959891970db24d03adb8a59b42c511b3/setuptools-22.0.1.zip (from https://pypi.org/simple/setuptools/), version: 22.0.1 2024-12-17T10:59:33,530 Found link https://files.pythonhosted.org/packages/a6/2b/803bd512ae9a69164ccfc29d289c99fa1b50cdfeb57aa3ab2239094e4751/setuptools-22.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 22.0.2 2024-12-17T10:59:33,531 Found link https://files.pythonhosted.org/packages/c4/53/c15ebef877fef2f719e0b6ddd380f64c1753080691108e061c1ca21ed449/setuptools-22.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 22.0.2 2024-12-17T10:59:33,532 Found link https://files.pythonhosted.org/packages/5e/65/c711495d09bfac87daa46af76051cd977eb6dd18b6aa63bd5be6fe30eac3/setuptools-22.0.2.zip (from https://pypi.org/simple/setuptools/), version: 22.0.2 2024-12-17T10:59:33,533 Found link https://files.pythonhosted.org/packages/5e/c2/8ab39c2652566b2a99875296a67b14bc21603553b47c7526d3afd95f2b32/setuptools-22.0.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 22.0.4 2024-12-17T10:59:33,534 Found link https://files.pythonhosted.org/packages/fb/df/68cc65abf4214a64e46da79b4bfa4a0f8d2cd8f0fb9bc7fae490c95141e1/setuptools-22.0.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 22.0.4 2024-12-17T10:59:33,535 Found link https://files.pythonhosted.org/packages/3b/01/a43e38867f02831cdad642cbae50958a1e87acc5f4dbe21b65c70f0b2bc3/setuptools-22.0.4.zip (from https://pypi.org/simple/setuptools/), version: 22.0.4 2024-12-17T10:59:33,536 Found link https://files.pythonhosted.org/packages/9c/e7/61c61680de7051a5de59ee58ef59738609cdfd2ac79575fc93230c2fd1a5/setuptools-22.0.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 22.0.5 2024-12-17T10:59:33,537 Found link https://files.pythonhosted.org/packages/90/7a/b64d5804b6d1aebed1892e4df1c21bcb4f8480095ba8004e48999601119d/setuptools-22.0.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 22.0.5 2024-12-17T10:59:33,538 Found link https://files.pythonhosted.org/packages/f4/27/72b6758f84cbd0dc2a21b87be7d080f491efa8c7bc23f12572f7f3a21b1e/setuptools-22.0.5.zip (from https://pypi.org/simple/setuptools/), version: 22.0.5 2024-12-17T10:59:33,539 Found link https://files.pythonhosted.org/packages/74/7c/c75c4f4032a4627406db06b742cdc7ba24c4833cd423ea7e22882380abde/setuptools-23.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 23.0.0 2024-12-17T10:59:33,540 Found link https://files.pythonhosted.org/packages/45/5e/79ca67a0d6f2f42bfdd9e467ef97398d6ad87ee2fa9c8cdf7caf3ddcab1e/setuptools-23.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 23.0.0 2024-12-17T10:59:33,541 Found link https://files.pythonhosted.org/packages/48/93/34a0210b2cb822ef2bde0b0849db071944ffb635ae7dabc9537d05827215/setuptools-23.0.0.zip (from https://pypi.org/simple/setuptools/), version: 23.0.0 2024-12-17T10:59:33,542 Found link https://files.pythonhosted.org/packages/d7/3d/577bafbfc9fcd78ed7b45de24a6bc30a94cc75cbde786389f1014d433614/setuptools-23.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 23.1.0 2024-12-17T10:59:33,543 Found link https://files.pythonhosted.org/packages/9f/7c/0a33c528164f1b7ff8cf0684cf88c2e733c8ae0119ceca4a3955c7fc059d/setuptools-23.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 23.1.0 2024-12-17T10:59:33,544 Found link https://files.pythonhosted.org/packages/89/86/ab1bf3a2550dcf43e2f5e77d72e9edb53dc701e78cbf07ef88ff8a08333e/setuptools-23.1.0.zip (from https://pypi.org/simple/setuptools/), version: 23.1.0 2024-12-17T10:59:33,545 Found link https://files.pythonhosted.org/packages/40/2d/7304d8992682423fbf0bd2b91107b1f0bc1e074a734f735589b2cce8f4a4/setuptools-23.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 23.2.0 2024-12-17T10:59:33,546 Found link https://files.pythonhosted.org/packages/a8/d1/b2f3500d39e8b0b4e1780fc10c8e6536db7718e3badd673be29760ce3369/setuptools-23.2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 23.2.0 2024-12-17T10:59:33,547 Found link https://files.pythonhosted.org/packages/ce/4e/d8d780d710a553a2900c087fb297646f01c023d44822a570f24e141efaf8/setuptools-23.2.0.zip (from https://pypi.org/simple/setuptools/), version: 23.2.0 2024-12-17T10:59:33,548 Found link https://files.pythonhosted.org/packages/a0/f9/d17efe888634046672f99514947c19d7568459a77c417576d99007671e42/setuptools-23.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 23.2.1 2024-12-17T10:59:33,549 Found link https://files.pythonhosted.org/packages/de/ca/21e71a0f9efc6f98462f92b1ebafcaf404b17b1bb9dbba11cf2adeaa5e35/setuptools-23.2.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 23.2.1 2024-12-17T10:59:33,550 Found link https://files.pythonhosted.org/packages/53/80/f00b72a5b155831213f79be0ef1a468199fc028219354dc92f18720e1c6b/setuptools-23.2.1.zip (from https://pypi.org/simple/setuptools/), version: 23.2.1 2024-12-17T10:59:33,551 Found link https://files.pythonhosted.org/packages/9f/e7/0dad3c2362a4b0ef0a432d07d5b8dab433a1b3cff54e55045b36f05153c2/setuptools-24.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.0.0 2024-12-17T10:59:33,552 Found link https://files.pythonhosted.org/packages/0a/40/a740a4890d9cc8f725f67da158ab250d3926b874e0f7cb85bdc836e3d069/setuptools-24.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.0.0 2024-12-17T10:59:33,553 Found link https://files.pythonhosted.org/packages/f6/d7/5caa03e11cb95140c08c4488e25979f3a6f8fc8695ca68d3c82fb97c2ba6/setuptools-24.0.0.zip (from https://pypi.org/simple/setuptools/), version: 24.0.0 2024-12-17T10:59:33,554 Found link https://files.pythonhosted.org/packages/e3/08/407c327962e7138de49ca09b599a32fffcc67c612dd78e7433945fd64d26/setuptools-24.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.0.1 2024-12-17T10:59:33,555 Found link https://files.pythonhosted.org/packages/7a/a8/5877fa2cec00f7678618fb465878fd9356858f0894b60c6960364b5cf816/setuptools-24.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.0.1 2024-12-17T10:59:33,556 Found link https://files.pythonhosted.org/packages/8b/ae/6c8fd57ce6c8313ce12bc6a32b488022d94423c25edadb63a9ae88fb013c/setuptools-24.0.1.zip (from https://pypi.org/simple/setuptools/), version: 24.0.1 2024-12-17T10:59:33,557 Found link https://files.pythonhosted.org/packages/75/5b/0a6348c852aabbecdc2a1cdea39f08df569ef8b5d576e6b88bd3fb60d67f/setuptools-24.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.0.2 2024-12-17T10:59:33,558 Found link https://files.pythonhosted.org/packages/21/d7/3e7e4b42d40469d2b770e10aee5b49538ecf2853eb5635d2d2536b286e2d/setuptools-24.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.0.2 2024-12-17T10:59:33,559 Found link https://files.pythonhosted.org/packages/f7/83/2865ee5727b46234c68efb833363dbce1922a191dd46e246853246a46182/setuptools-24.0.2.zip (from https://pypi.org/simple/setuptools/), version: 24.0.2 2024-12-17T10:59:33,560 Found link https://files.pythonhosted.org/packages/77/1d/aa9cee9843393165388ae2d764e811c42f995d9a493ec27354d8c9638216/setuptools-24.0.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.0.3 2024-12-17T10:59:33,561 Found link https://files.pythonhosted.org/packages/84/24/610d8bb87219ed6d0928018b7b35ac6f6f6ef27a71ed6a2d0cfb68200f65/setuptools-24.0.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.0.3 2024-12-17T10:59:33,562 Found link https://files.pythonhosted.org/packages/fe/d1/19813ec0d7966829b0f3fb2a975706e19c475251142e683d7a15660b180c/setuptools-24.0.3.zip (from https://pypi.org/simple/setuptools/), version: 24.0.3 2024-12-17T10:59:33,563 Found link https://files.pythonhosted.org/packages/3e/c0/f4d9dad75777145c47d0d76ae89ac1448b9000e47834fc4cbf218f172807/setuptools-24.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.1.0 2024-12-17T10:59:33,564 Found link https://files.pythonhosted.org/packages/83/2a/2e0b93208a8e68e536a1861ed91eca8b06b24cd63255e6ae31648233acdd/setuptools-24.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.1.0 2024-12-17T10:59:33,565 Found link https://files.pythonhosted.org/packages/d9/4b/566dd5f069c910a9cc642764bfac6dc41cf3441da77da28ed6210a3643be/setuptools-24.1.0.zip (from https://pypi.org/simple/setuptools/), version: 24.1.0 2024-12-17T10:59:33,566 Found link https://files.pythonhosted.org/packages/f3/11/37e470ce38a152b9674a71a5fd1ea3bca1a388d18dd542000da0409ce44b/setuptools-24.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.1.1 2024-12-17T10:59:33,567 Found link https://files.pythonhosted.org/packages/46/91/52d4045fef23635249f7da1547588cff37b75df36238a3a994dc760b0e73/setuptools-24.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.1.1 2024-12-17T10:59:33,568 Found link https://files.pythonhosted.org/packages/37/cd/92dab23239b6aa67871ceb73bf1ab924eab4fcc79f37e2d21ce665b0dc2a/setuptools-24.1.1.zip (from https://pypi.org/simple/setuptools/), version: 24.1.1 2024-12-17T10:59:33,569 Found link https://files.pythonhosted.org/packages/b6/aa/853ddef15e7d397e191fcf7b3436f21483b77a0da6156bf0ae77f25b5998/setuptools-24.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.2.0 2024-12-17T10:59:33,570 Found link https://files.pythonhosted.org/packages/ee/a7/6595292baa2a9d5a39affcdc37e4c5f2763ed440c94a08852b222d17e953/setuptools-24.2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.2.0 2024-12-17T10:59:33,571 Found link https://files.pythonhosted.org/packages/7f/df/f1db5805f28f80f19711d96e33eb172cfda95541d828e0d6dc806720fec3/setuptools-24.2.0.zip (from https://pypi.org/simple/setuptools/), version: 24.2.0 2024-12-17T10:59:33,572 Found link https://files.pythonhosted.org/packages/9f/3e/e4912f33a92257b29c28aa1d7121e8081536d9291d6185a313ecf0d1f8c7/setuptools-24.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.2.1 2024-12-17T10:59:33,573 Found link https://files.pythonhosted.org/packages/1e/07/172354ef5424923c1bf2e7c89233ab790a7c462536849957602752ebad25/setuptools-24.2.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.2.1 2024-12-17T10:59:33,574 Found link https://files.pythonhosted.org/packages/46/e7/d3d168372022bbb555619f5bc50bbc93d1c2309e3c1b607dc6b0c705df0f/setuptools-24.2.1.zip (from https://pypi.org/simple/setuptools/), version: 24.2.1 2024-12-17T10:59:33,575 Found link https://files.pythonhosted.org/packages/dd/b8/d195d56c0a6ef8f2816a6e41a4e8ed8446bc647c6abd6e212f7190e93aff/setuptools-24.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.3.0 2024-12-17T10:59:33,576 Found link https://files.pythonhosted.org/packages/1b/4f/e52b81c47396668deb139b628f4ebb499b3cd39fc05382851fa985d0b642/setuptools-24.3.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.3.0 2024-12-17T10:59:33,577 Found link https://files.pythonhosted.org/packages/d1/81/444dec9e9a7eab092651e501b27786d16ac36a28da990e59e8ed2d2c033c/setuptools-24.3.0.zip (from https://pypi.org/simple/setuptools/), version: 24.3.0 2024-12-17T10:59:33,578 Found link https://files.pythonhosted.org/packages/0b/1d/6debaf800af0bb247da8ee7bb167b5be6c87ca0a8f62593daa7b307aa20d/setuptools-24.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 24.3.1 2024-12-17T10:59:33,579 Found link https://files.pythonhosted.org/packages/5c/dd/c60ce480ae7f9acd5a31a91f8240d080ff213e5eb897d00c356d20e8328c/setuptools-24.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 24.3.1 2024-12-17T10:59:33,580 Found link https://files.pythonhosted.org/packages/73/f0/91e5227c2e99631036cc03e5ad0fc3f5c572c41b80948dfeb6d30d08e77d/setuptools-24.3.1.zip (from https://pypi.org/simple/setuptools/), version: 24.3.1 2024-12-17T10:59:33,581 Found link https://files.pythonhosted.org/packages/1f/eb/cee6969380d12f43444b8fd81a6f806f63123b5bbaba6afcec69df2766db/setuptools-25.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.0.0 2024-12-17T10:59:33,582 Found link https://files.pythonhosted.org/packages/a0/85/24d3b6b331b056180f28ce19658a515364dca58aa9e88eff2ac39bf825f2/setuptools-25.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.0.0 2024-12-17T10:59:33,583 Found link https://files.pythonhosted.org/packages/dc/9f/ecd9443b342757cd223088c419aa35c68b3ccf1782017c18d0398c9ceab7/setuptools-25.0.0.zip (from https://pypi.org/simple/setuptools/), version: 25.0.0 2024-12-17T10:59:33,584 Found link https://files.pythonhosted.org/packages/69/31/1f1f638830f55a57f8e7f6b7ae265baee2dfe55c687d9f39eb053e88a6b4/setuptools-25.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.0.1 2024-12-17T10:59:33,585 Found link https://files.pythonhosted.org/packages/f0/21/708b3eb6709ece3cb2613b6c44e749823c435bef0b26b9b45be1634afe16/setuptools-25.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.0.1 2024-12-17T10:59:33,587 Found link https://files.pythonhosted.org/packages/0a/f0/904432438dda1b4ed33c668392756bb45ae25a945458dd34d8215e68bdd7/setuptools-25.0.1.zip (from https://pypi.org/simple/setuptools/), version: 25.0.1 2024-12-17T10:59:33,588 Found link https://files.pythonhosted.org/packages/51/23/9ba87803415bf3e855db1f15973161aca7d317b697d31e8f02b92a53165b/setuptools-25.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.0.2 2024-12-17T10:59:33,589 Found link https://files.pythonhosted.org/packages/7a/ad/238451bc76d3b280395d785c390dcc01645af68059d221a45a872865f73c/setuptools-25.0.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.0.2 2024-12-17T10:59:33,590 Found link https://files.pythonhosted.org/packages/b6/e6/b373ff0579a030ccd35829afe892f49460b44a028fc238a30573c4fa6f05/setuptools-25.0.2.zip (from https://pypi.org/simple/setuptools/), version: 25.0.2 2024-12-17T10:59:33,591 Found link https://files.pythonhosted.org/packages/48/c6/3a30a886ea43ca7aef2c0d9a642d7ecdaa319579454ca340adea5aba89e8/setuptools-25.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.0 2024-12-17T10:59:33,592 Found link https://files.pythonhosted.org/packages/17/ed/ea984f05dd29e7a1ffdee0eba8335b5c73903e2ca10915fbdb6e8c5084c7/setuptools-25.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.0 2024-12-17T10:59:33,593 Found link https://files.pythonhosted.org/packages/29/c1/33ab781160aede84140523f2fd0685b0bbe46b2d0b7aa9b033a9665cabc4/setuptools-25.1.0.zip (from https://pypi.org/simple/setuptools/), version: 25.1.0 2024-12-17T10:59:33,594 Found link https://files.pythonhosted.org/packages/20/27/5a49d6ee5df931a86ab73b85631192da29bbec86db37d2e8024aba7cda25/setuptools-25.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.1 2024-12-17T10:59:33,595 Found link https://files.pythonhosted.org/packages/9c/25/fa63da717a694ecf3bdb27f438450f535cdcabd77a955b5b05113f1abd11/setuptools-25.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.1 2024-12-17T10:59:33,596 Found link https://files.pythonhosted.org/packages/89/2d/5c3517d4cf69d005151fdfccd6b3f9a342678dfab15b95a9272456cf70b5/setuptools-25.1.1.zip (from https://pypi.org/simple/setuptools/), version: 25.1.1 2024-12-17T10:59:33,597 Found link https://files.pythonhosted.org/packages/9a/75/612e5aae898d83b1f40337cef46693462ba5ad26197950294c686ac4b533/setuptools-25.1.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.2 2024-12-17T10:59:33,598 Found link https://files.pythonhosted.org/packages/12/1a/95c4ce8205e114efa16e91323c372d9a8adfa560d8cd00ad4b3aa2e27ae0/setuptools-25.1.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.2 2024-12-17T10:59:33,599 Found link https://files.pythonhosted.org/packages/94/99/3b63b80785fcf51b1429eee0491dd975828da68956d58752d9953deff478/setuptools-25.1.2.zip (from https://pypi.org/simple/setuptools/), version: 25.1.2 2024-12-17T10:59:33,600 Found link https://files.pythonhosted.org/packages/a0/67/266580f0326b2f1e46b1aae86907ad3935e980082f15d262acbf289a7d92/setuptools-25.1.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.3 2024-12-17T10:59:33,601 Found link https://files.pythonhosted.org/packages/46/db/baa571da945ff731f3739a119574e89b12add9b05c03842103bd641d0990/setuptools-25.1.3.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.3 2024-12-17T10:59:33,602 Found link https://files.pythonhosted.org/packages/c8/e0/d27f3b315a7bce1cc03b7d8b33bb6119806a385b06f20a27e3741614bdef/setuptools-25.1.3.zip (from https://pypi.org/simple/setuptools/), version: 25.1.3 2024-12-17T10:59:33,603 Found link https://files.pythonhosted.org/packages/b9/c4/c179ea0c805a552ce6e7fdd061c08b6de91f41a689a09581214fb09544bb/setuptools-25.1.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.4 2024-12-17T10:59:33,604 Found link https://files.pythonhosted.org/packages/4c/02/3cb39568f0946b29826f068f7a717f7ab24fd32f79d2cbc0ba044ed568e6/setuptools-25.1.4.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.4 2024-12-17T10:59:33,605 Found link https://files.pythonhosted.org/packages/e5/46/caa9a57d19ab44254f8c8cc1c613a46dc21aa3611e3bb5f7cbaf1a4d3c08/setuptools-25.1.4.zip (from https://pypi.org/simple/setuptools/), version: 25.1.4 2024-12-17T10:59:33,606 Found link https://files.pythonhosted.org/packages/cd/bd/f640c01881d07e46ea14e73b19434ce21ec6e9bed4275aea1a02ec17769f/setuptools-25.1.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.5 2024-12-17T10:59:33,607 Found link https://files.pythonhosted.org/packages/5b/ea/0c0c51368b260e0b314acb8ce4a28e759022435c860e1c5cc72fb4b211ec/setuptools-25.1.5.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.5 2024-12-17T10:59:33,608 Found link https://files.pythonhosted.org/packages/91/f6/a6fed3e2484b9062ead5f3b90cb1a5ceed55140b214300d9c00f2b4b04b7/setuptools-25.1.5.zip (from https://pypi.org/simple/setuptools/), version: 25.1.5 2024-12-17T10:59:33,609 Found link https://files.pythonhosted.org/packages/0f/31/47f09564c1f513b18c34aa755181d7a66362c16a8873221e4082d7d758da/setuptools-25.1.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.1.6 2024-12-17T10:59:33,610 Found link https://files.pythonhosted.org/packages/1f/7a/6b239a65d452b04ad8068193ae313b386e6fc745b92cd4584fccebecebf0/setuptools-25.1.6.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.1.6 2024-12-17T10:59:33,611 Found link https://files.pythonhosted.org/packages/c3/40/4c0e626ae88f44ddfeb56b58a8dc3d8b8c4274b245e5ffacdc75ebe1d9c7/setuptools-25.1.6.zip (from https://pypi.org/simple/setuptools/), version: 25.1.6 2024-12-17T10:59:33,612 Found link https://files.pythonhosted.org/packages/9b/81/5258d4928d2ba039c98f8175e6c3d3995814b9449b57802be9d71e37c944/setuptools-25.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.2.0 2024-12-17T10:59:33,613 Found link https://files.pythonhosted.org/packages/9f/32/81c324675725d78e7f6da777483a3453611a427db0145dfb878940469692/setuptools-25.2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.2.0 2024-12-17T10:59:33,614 Found link https://files.pythonhosted.org/packages/93/56/225ab3880e2ef5e6d85334843141e97ffad2acb2044278de5acb174c73d3/setuptools-25.2.0.zip (from https://pypi.org/simple/setuptools/), version: 25.2.0 2024-12-17T10:59:33,615 Found link https://files.pythonhosted.org/packages/6b/41/c6bf7e2ee1d43d1e3fab6bf830cd63d333d3a28249f145194a2accd12eab/setuptools-25.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.3.0 2024-12-17T10:59:33,616 Found link https://files.pythonhosted.org/packages/b1/9a/cda61ff6ea0e10780dcc49c8fd021d980398285e85c54e4977f88f8c2a9c/setuptools-25.3.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.3.0 2024-12-17T10:59:33,617 Found link https://files.pythonhosted.org/packages/78/1f/3da475bb81ae407962c65e29736ebb3c36728fc1e6335c66b054bf6db5ca/setuptools-25.3.0.zip (from https://pypi.org/simple/setuptools/), version: 25.3.0 2024-12-17T10:59:33,618 Found link https://files.pythonhosted.org/packages/cd/48/45dee63e94368e331cfd8d90d1e804e8ad0c0d055e677ef2c1317de863e1/setuptools-25.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 25.4.0 2024-12-17T10:59:33,619 Found link https://files.pythonhosted.org/packages/fa/76/a94f7738865199ab9700977612ec1ba3298fb271ba3a8981017a48507c31/setuptools-25.4.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 25.4.0 2024-12-17T10:59:33,620 Found link https://files.pythonhosted.org/packages/3b/40/69fefe3c5c06923a6518a2c1abe6664d985a63da3614cef75d8c119eb634/setuptools-25.4.0.zip (from https://pypi.org/simple/setuptools/), version: 25.4.0 2024-12-17T10:59:33,621 Found link https://files.pythonhosted.org/packages/07/1a/19b5d2de13e1c300f703e7914031fe5fe449d19e0ded5a34db9f3e7969ff/setuptools-26.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 26.0.0 2024-12-17T10:59:33,622 Found link https://files.pythonhosted.org/packages/0d/13/ce6a0a22220f3da7483131bb8212d5791a03c8c3e86ff61b2c6a2de547cd/setuptools-26.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 26.0.0 2024-12-17T10:59:33,623 Found link https://files.pythonhosted.org/packages/fd/e2/6685fa17489a921804951bdeb13faa177cd1095da91d9371c4908c903367/setuptools-26.0.0.zip (from https://pypi.org/simple/setuptools/), version: 26.0.0 2024-12-17T10:59:33,624 Found link https://files.pythonhosted.org/packages/29/17/fbfdcf6b6bbd243f2db12372ac2970dcaf75be4d761d922b1e6a389934d3/setuptools-26.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 26.1.0 2024-12-17T10:59:33,625 Found link https://files.pythonhosted.org/packages/df/c3/4265eb901f9db8c0ea5bdfb344084d85bc96c1a9b883f70430254b5491f6/setuptools-26.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 26.1.0 2024-12-17T10:59:33,626 Found link https://files.pythonhosted.org/packages/a3/f0/92458608fdc6747f5ad92c5b4fda5d31ecb1e1f18cf1c74207ca6c26bfa7/setuptools-26.1.0.zip (from https://pypi.org/simple/setuptools/), version: 26.1.0 2024-12-17T10:59:33,627 Found link https://files.pythonhosted.org/packages/3b/c7/e9724e6f81c96248fba5876054418c11d327b3093d075790903cd66fad44/setuptools-26.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 26.1.1 2024-12-17T10:59:33,628 Found link https://files.pythonhosted.org/packages/32/3c/e853a68b703f347f5ed86585c2dd2828a83252e1216c1201fa6f81270578/setuptools-26.1.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 26.1.1 2024-12-17T10:59:33,629 Found link https://files.pythonhosted.org/packages/6f/10/5398a054e63ce97921913052fde13ebf332a3a4104c50c4d7be9c465930e/setuptools-26.1.1.zip (from https://pypi.org/simple/setuptools/), version: 26.1.1 2024-12-17T10:59:33,630 Found link https://files.pythonhosted.org/packages/4b/30/ab37d6856850cb5a39041f1149498b71c580d0001d34035c7c276e55bed3/setuptools-27.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 27.0.0 2024-12-17T10:59:33,631 Found link https://files.pythonhosted.org/packages/70/0b/5766531af44aabeb52238beb95491d9323a32d83f1a6d202bf8cb56bdb90/setuptools-27.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 27.0.0 2024-12-17T10:59:33,632 Found link https://files.pythonhosted.org/packages/0f/a6/e790304c3676cc50269c0a79b5686ad3713f0986e3b2a3a5f00e7d1de1c4/setuptools-27.0.0.zip (from https://pypi.org/simple/setuptools/), version: 27.0.0 2024-12-17T10:59:33,633 Found link https://files.pythonhosted.org/packages/ac/d9/326012112791f043aab374221e1a096ac0b41c3097fcd0b33408b85d077d/setuptools-27.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 27.1.0 2024-12-17T10:59:33,634 Found link https://files.pythonhosted.org/packages/a0/21/964dfff9e662bbee6004641b5e3dabdaef14de6f179833571dc7b83ebe8c/setuptools-27.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 27.1.0 2024-12-17T10:59:33,635 Found link https://files.pythonhosted.org/packages/0e/ae/e55aa2c072b42f99229676f4a20291afb7d31678acd8672217911ffc696b/setuptools-27.1.0.zip (from https://pypi.org/simple/setuptools/), version: 27.1.0 2024-12-17T10:59:33,637 Found link https://files.pythonhosted.org/packages/2d/76/bce013588c82099ea243241441364db1e55a8d2d1a7cc962cee8873ccaea/setuptools-27.1.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 27.1.2 2024-12-17T10:59:33,637 Found link https://files.pythonhosted.org/packages/7b/e7/d9b468ead9854ca55110325ce00ae6ee64d11b957cc5214aa5174738187e/setuptools-27.1.2.tar.gz (from https://pypi.org/simple/setuptools/), version: 27.1.2 2024-12-17T10:59:33,638 Found link https://files.pythonhosted.org/packages/80/cd/9bc7dc5aba7c64bd01f7a26517c622d9e863f5f58c75a433faffe55822fc/setuptools-27.1.2.zip (from https://pypi.org/simple/setuptools/), version: 27.1.2 2024-12-17T10:59:33,639 Found link https://files.pythonhosted.org/packages/0c/5d/309113d5359654094f7423ad9c32ac55255b83304f36d0fa96129f28db83/setuptools-27.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 27.2.0 2024-12-17T10:59:33,640 Found link https://files.pythonhosted.org/packages/87/ba/54197971d107bc06f5f3fbdc0d728a7ae0b10cafca46acfddba65a0899d8/setuptools-27.2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 27.2.0 2024-12-17T10:59:33,641 Found link https://files.pythonhosted.org/packages/a5/88/e0b97490f4a7148c3e7766c9047b6fdc0eb760510dd428dcbe70e2d0b046/setuptools-27.2.0.zip (from https://pypi.org/simple/setuptools/), version: 27.2.0 2024-12-17T10:59:33,642 Found link https://files.pythonhosted.org/packages/8d/ae/766f375fc05b3d345b7082333da9f8b49af02d9c5680ff4eb15655fc5ae1/setuptools-27.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 27.3.0 2024-12-17T10:59:33,643 Found link https://files.pythonhosted.org/packages/72/e1/741cd8c4825e58119481d8be4254c9cd133db50876b159cdf8cbd253fbb3/setuptools-27.3.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 27.3.0 2024-12-17T10:59:33,644 Found link https://files.pythonhosted.org/packages/a9/84/8542f2f057005f4d9f788a5b686a4656614dade9ff84b528b20f4f1f70be/setuptools-27.3.0.zip (from https://pypi.org/simple/setuptools/), version: 27.3.0 2024-12-17T10:59:33,645 Found link https://files.pythonhosted.org/packages/6d/24/21cfe43cf54ee6461ac31dd96bf9ae2ba18594c073b6ef4fb36a1ad92d4c/setuptools-27.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 27.3.1 2024-12-17T10:59:33,646 Found link https://files.pythonhosted.org/packages/30/79/36ae55fa99fb888ddfbfd0c0c75e3e2b14d943822012401cdaa99085f6ea/setuptools-27.3.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 27.3.1 2024-12-17T10:59:33,647 Found link https://files.pythonhosted.org/packages/41/2e/2944b9b85b4ea2a65eedb0578c3d0037f5ac07f193e3544c2f26b0a76191/setuptools-27.3.1.zip (from https://pypi.org/simple/setuptools/), version: 27.3.1 2024-12-17T10:59:33,648 Found link https://files.pythonhosted.org/packages/10/46/2a5a1fa61982a622d803d3744ce5fc551ddbb35b26a4c0e1115a428f879c/setuptools-28.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.0.0 2024-12-17T10:59:33,650 Found link https://files.pythonhosted.org/packages/f7/94/eee867605a99ac113c4108534ad7c292ed48bf1d06dfe7b63daa51e49987/setuptools-28.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.0.0 2024-12-17T10:59:33,651 Found link https://files.pythonhosted.org/packages/14/41/b1acc3a67584fc45080dad57445807f1d4a7f5175aea2ba77d044c50ace7/setuptools-28.0.0.zip (from https://pypi.org/simple/setuptools/), version: 28.0.0 2024-12-17T10:59:33,651 Found link https://files.pythonhosted.org/packages/27/1b/a7e72fc6590cafbf9d85a96050fe05d6484133e818c4f256ff9fc9b85a34/setuptools-28.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.1.0 2024-12-17T10:59:33,653 Found link https://files.pythonhosted.org/packages/8b/41/da4f755b212af7eeeaa6f4f336d1b8d8782531610dd945e115a93cf69801/setuptools-28.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.1.0 2024-12-17T10:59:33,654 Found link https://files.pythonhosted.org/packages/13/e1/bc23cc7207daaae29862c6bf777afe94660af40493ae0a7269f2f616e136/setuptools-28.1.0.zip (from https://pypi.org/simple/setuptools/), version: 28.1.0 2024-12-17T10:59:33,655 Found link https://files.pythonhosted.org/packages/be/20/3f4d2fb59ddeed35532bd4e11e900abcf8019d29f4558d38169639303536/setuptools-28.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.2.0 2024-12-17T10:59:33,656 Found link https://files.pythonhosted.org/packages/fa/dd/e310aaaf1702516e12451d2d5eb78175587edc7fbeb1afd58263171e9384/setuptools-28.2.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.2.0 2024-12-17T10:59:33,657 Found link https://files.pythonhosted.org/packages/c9/9b/a03e851505aba1f7b33cb7135ac42cf0fff61dcd9a218f4592738bd310ea/setuptools-28.2.0.zip (from https://pypi.org/simple/setuptools/), version: 28.2.0 2024-12-17T10:59:33,658 Found link https://files.pythonhosted.org/packages/21/5c/46a549d8b15f751e9428d5e821e9bc3f69dd8b579c3a9f13ab9bd3e75589/setuptools-28.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.3.0 2024-12-17T10:59:33,659 Found link https://files.pythonhosted.org/packages/6b/dd/a7de8caeeffab76bacf56972b3f090c12e0ae6932245abbce706690a6436/setuptools-28.3.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.3.0 2024-12-17T10:59:33,661 Found link https://files.pythonhosted.org/packages/eb/88/ae1edbd71d08e37537f515ba83873a52df12fe2fffaa62cdc6142044ab6a/setuptools-28.3.0.zip (from https://pypi.org/simple/setuptools/), version: 28.3.0 2024-12-17T10:59:33,663 Found link https://files.pythonhosted.org/packages/42/98/96c206155a10b61ecf06b60b31f9679d5513f97f6526c4f996ec71976cc1/setuptools-28.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.4.0 2024-12-17T10:59:33,665 Found link https://files.pythonhosted.org/packages/a4/d3/a174c339d20fa9c687d079742c0b8a04aa70150823050aa952ccd7f560da/setuptools-28.4.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.4.0 2024-12-17T10:59:33,666 Found link https://files.pythonhosted.org/packages/67/6b/e0ad595d4a69078c051e5e4deb188ce8136bd6f762c80b1129483002603e/setuptools-28.4.0.zip (from https://pypi.org/simple/setuptools/), version: 28.4.0 2024-12-17T10:59:33,667 Found link https://files.pythonhosted.org/packages/e9/41/4bcb23afdd1c94e73d333344a75fe1ea0800461f6eb13c2a0135075e12ca/setuptools-28.5.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.5.0 2024-12-17T10:59:33,668 Found link https://files.pythonhosted.org/packages/8a/36/df963b2b3f841dd44fdcefa23e33aee89a77e6b2dc89319d39199c977f91/setuptools-28.5.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.5.0 2024-12-17T10:59:33,670 Found link https://files.pythonhosted.org/packages/7a/a6/b46d288805469509f776ee7c805d9d253a3e9d8a77d28925d6662f89a278/setuptools-28.5.0.zip (from https://pypi.org/simple/setuptools/), version: 28.5.0 2024-12-17T10:59:33,671 Found link https://files.pythonhosted.org/packages/0a/82/7f0156a8d1cbb6bff246f479afa379204dbfab159ae1ff2029a90a6fd461/setuptools-28.6.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.6.0 2024-12-17T10:59:33,671 Found link https://files.pythonhosted.org/packages/cd/1b/2aaf7aef152a274c687e0441a75f3df5fa1de0144cf3fba856d916558c20/setuptools-28.6.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.6.0 2024-12-17T10:59:33,672 Found link https://files.pythonhosted.org/packages/9d/60/e19cf81ad1743cebea5a799d4ff7179b705b949844c841975e3be4bbb26e/setuptools-28.6.0.zip (from https://pypi.org/simple/setuptools/), version: 28.6.0 2024-12-17T10:59:33,672 Found link https://files.pythonhosted.org/packages/8a/1f/e2e14f0b98d0b6de6c3fb4e8a3b45d3b8907783937c497cb53539c0d2b19/setuptools-28.6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.6.1 2024-12-17T10:59:33,673 Found link https://files.pythonhosted.org/packages/b5/9a/9ce1a45a076f977cb870bf0c9370347c9371b0e9aa9ca9859196ce58afda/setuptools-28.6.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.6.1 2024-12-17T10:59:33,674 Found link https://files.pythonhosted.org/packages/57/d7/0848d1152d479cb8d7329919cc4ec4f8a21c5487c5bbd95c3a15c290eee1/setuptools-28.6.1.zip (from https://pypi.org/simple/setuptools/), version: 28.6.1 2024-12-17T10:59:33,675 Found link https://files.pythonhosted.org/packages/fb/46/642886741c17d0e4caf08358a6588467b3b1abd8e935384cff84973484fa/setuptools-28.7.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.7.0 2024-12-17T10:59:33,676 Found link https://files.pythonhosted.org/packages/94/b5/f1ad3a987acdf58eda28e720b671af6aef43dfe2b8e54682dece964799e7/setuptools-28.7.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.7.0 2024-12-17T10:59:33,677 Found link https://files.pythonhosted.org/packages/0d/be/9f2857889551d53a103e7a9bb6f2fdb8416e263b0dcc27e8130a1367363c/setuptools-28.7.0.zip (from https://pypi.org/simple/setuptools/), version: 28.7.0 2024-12-17T10:59:33,678 Found link https://files.pythonhosted.org/packages/74/c5/c78a788e65f9eb241c531839e909df1226534ea2d09d300231766b82b79a/setuptools-28.7.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.7.1 2024-12-17T10:59:33,679 Found link https://files.pythonhosted.org/packages/1d/04/97e37cf85972ea19364c22db34ee8192db3876a80ed5bffd6413dcdabe2d/setuptools-28.7.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.7.1 2024-12-17T10:59:33,680 Found link https://files.pythonhosted.org/packages/9a/37/7f85f5b4b03983357c0d1d3f5fbd2602e0ab278d9c2792544db0eb52447f/setuptools-28.7.1.zip (from https://pypi.org/simple/setuptools/), version: 28.7.1 2024-12-17T10:59:33,682 Found link https://files.pythonhosted.org/packages/3b/7e/293d19ccd106119e35db4bf3e111b1895098f618b455b758aa636496cf03/setuptools-28.8.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.8.0 2024-12-17T10:59:33,684 Found link https://files.pythonhosted.org/packages/25/4e/1b16cfe90856235a13872a6641278c862e4143887d11a12ac4905081197f/setuptools-28.8.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.8.0 2024-12-17T10:59:33,686 Found link https://files.pythonhosted.org/packages/e9/93/e53fb79dbf5f4a1407feed7a19ea6d0e83765b354754e003cce7aa12b976/setuptools-28.8.0.zip (from https://pypi.org/simple/setuptools/), version: 28.8.0 2024-12-17T10:59:33,688 Found link https://files.pythonhosted.org/packages/1d/c7/edad005b9fcc59f299a05394980ca76a376254d8dbcab639bb3e2e989807/setuptools-28.8.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 28.8.1 2024-12-17T10:59:33,690 Found link https://files.pythonhosted.org/packages/73/cc/69479045ede36b4786e6069d616dc6c232ee875e8686ef9fd7af3d3c7404/setuptools-28.8.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 28.8.1 2024-12-17T10:59:33,692 Found link https://files.pythonhosted.org/packages/07/39/899c49ac766533c2326133a73de1bebf980c116d30df9d38445cd767b0c7/setuptools-28.8.1.zip (from https://pypi.org/simple/setuptools/), version: 28.8.1 2024-12-17T10:59:33,693 Found link https://files.pythonhosted.org/packages/5b/22/ee2f999f9fc1ce934b523852bd7c1ea12e0f0fa1de19317135a0d1159507/setuptools-29.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 29.0.0 2024-12-17T10:59:33,695 Found link https://files.pythonhosted.org/packages/8b/40/9fd40ccf8987ae89e43298eac4f662bab2d739cbb8943b9c019fe1974fdb/setuptools-29.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 29.0.0 2024-12-17T10:59:33,697 Found link https://files.pythonhosted.org/packages/6f/4f/62e4eb1ff67f8877434b3aaa62298cd0abcac9a73aee44b00249b9bac1f7/setuptools-29.0.0.zip (from https://pypi.org/simple/setuptools/), version: 29.0.0 2024-12-17T10:59:33,699 Found link https://files.pythonhosted.org/packages/06/4b/86a670fd21f7849adb092e40883c48dcd0d66b8a878fc8d63b7f0ea04213/setuptools-29.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 29.0.1 2024-12-17T10:59:33,702 Found link https://files.pythonhosted.org/packages/59/88/2f3990916931a5de6fa9706d6d75eb32ee8b78627bb2abaab7ed9e6d0622/setuptools-29.0.1.tar.gz (from https://pypi.org/simple/setuptools/), version: 29.0.1 2024-12-17T10:59:33,703 Found link https://files.pythonhosted.org/packages/1a/31/3c29a0d6eaf8851d2031003f300b4accb724e3f5c4d519e8e7d88bc373a3/setuptools-29.0.1.zip (from https://pypi.org/simple/setuptools/), version: 29.0.1 2024-12-17T10:59:33,704 Found link https://files.pythonhosted.org/packages/d8/ca/dff6c67f45bff7a2ad2fd9a69ae9ebdbea742fd961f76486ae2d84517464/setuptools-30.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 30.0.0 2024-12-17T10:59:33,705 Found link https://files.pythonhosted.org/packages/66/6d/dad0d39ce1cfa98ef3634463926e7324e342c956aecb066968e2e3696300/setuptools-30.0.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 30.0.0 2024-12-17T10:59:33,706 Found link https://files.pythonhosted.org/packages/03/53/65d932f96d5aab57c21679c30e6ec33c37f8530828263d0a1d41f9faddc9/setuptools-30.0.0.zip (from https://pypi.org/simple/setuptools/), version: 30.0.0 2024-12-17T10:59:33,707 Found link https://files.pythonhosted.org/packages/f1/2b/6fb5c6988b062144d4d0fd5c31cd9ff74ce8ff55e1ee2a043efff49f0c91/setuptools-30.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/), version: 30.1.0 2024-12-17T10:59:33,708 Found link https://files.pythonhosted.org/packages/1e/43/002c8616db9a3e7be23c2556e39b90a32bb40ba0dc652de1999d5334d372/setuptools-30.1.0.tar.gz (from https://pypi.org/simple/setuptools/), version: 30.1.0 2024-12-17T10:59:33,709 Found link https://files.pythonhosted.org/packages/34/28/ac537928ef346f7c6ba2bfa822450af4d2b41321964532ef9157112c830e/setuptools-30.1.0.zip (from https://pypi.org/simple/setuptools/), version: 30.1.0 2024-12-17T10:59:33,710 Found link https://files.pythonhosted.org/packages/b8/cb/b919f52dd81b4b2210d0c5529b6b629a4002e08d49a90183605d1181b10c/setuptools-30.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.0 2024-12-17T10:59:33,711 Found link https://files.pythonhosted.org/packages/f1/92/12c7251039b274c30106c3e0babdcb040cbd13c3ad4b3f0ef9a7c217e36a/setuptools-30.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.0 2024-12-17T10:59:33,712 Found link https://files.pythonhosted.org/packages/48/c0/f01379bc7b1b7684bdf4cc744b6124bc0a089349978ec576687ac8f809a7/setuptools-30.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.0 2024-12-17T10:59:33,714 Found link https://files.pythonhosted.org/packages/05/c3/b5534ca0113d5a6779802644f88f9e110de92287d2d11b7f83723778c83c/setuptools-30.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.1 2024-12-17T10:59:33,715 Found link https://files.pythonhosted.org/packages/7e/ee/9c5f692af20450c67ebfd2c8b6ec9fc359c00627162063832e647ee0d0a0/setuptools-30.2.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.1 2024-12-17T10:59:33,716 Found link https://files.pythonhosted.org/packages/c7/d5/9a95d0e941f753c372196a5b8cf050d5f48be1cb04842805e93a37ad10fa/setuptools-30.2.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.1 2024-12-17T10:59:33,717 Found link https://files.pythonhosted.org/packages/f3/5f/df3db5e01f268f53646f51f9b5063d6834a6744a0efdea4093bbcf86f83f/setuptools-30.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.3.0 2024-12-17T10:59:33,718 Found link https://files.pythonhosted.org/packages/e0/b4/1e023e0f0e3a1475c146889f91989a306162c162d76eceac8ad13d6fad8d/setuptools-30.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.3.0 2024-12-17T10:59:33,720 Found link https://files.pythonhosted.org/packages/9f/a4/97874b4ccdd40a6c0e8f8ed1c1dc3be709c126ebbd5f09edcbcc87856845/setuptools-30.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.3.0 2024-12-17T10:59:33,721 Found link https://files.pythonhosted.org/packages/16/9b/5e491cef98014d9a1b1f15896e503661d3973d02970583cfb026b613d0fd/setuptools-30.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.4.0 2024-12-17T10:59:33,722 Found link https://files.pythonhosted.org/packages/b4/ed/cf46e89ea621166473ad82657f8947218a76f8d9ab08721a3d3dc226d710/setuptools-30.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.4.0 2024-12-17T10:59:33,723 Found link https://files.pythonhosted.org/packages/84/c0/ffefe842cad8f73271a5169d65bfcc49862263569a9f26fe1ed1fa785589/setuptools-30.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.4.0 2024-12-17T10:59:33,724 Found link https://files.pythonhosted.org/packages/c2/03/9748e703e9f7402aa5d83ba496a350325a2686ba965d443bff91e0cbea09/setuptools-31.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.0 2024-12-17T10:59:33,725 Found link https://files.pythonhosted.org/packages/68/13/1bfbfbd86560e61fa9803d241084fff41a775bf56ee8b3ad72fc9e550dad/setuptools-31.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.0 2024-12-17T10:59:33,726 Found link https://files.pythonhosted.org/packages/06/07/606dbad6d0994d06a2e8147f4c6a7c699b7484efaf126810572a904ad1fd/setuptools-31.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.0 2024-12-17T10:59:33,727 Found link https://files.pythonhosted.org/packages/95/77/e7b546c84cd9d98f26cb7e2aaee8193abc17e23e19dfdcdcc10b8e9b6619/setuptools-31.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.1 2024-12-17T10:59:33,729 Found link https://files.pythonhosted.org/packages/42/03/3ece0509e844a31bae7a80adaf7b93fdbbe91cdb8c77f27d25dfd3b49db3/setuptools-31.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.1 2024-12-17T10:59:33,730 Found link https://files.pythonhosted.org/packages/4a/27/cf254815e1c31b4ccd37acce8d9ed9fb923c820c589b0cb3149b3f0e3ea3/setuptools-31.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.1 2024-12-17T10:59:33,732 Found link https://files.pythonhosted.org/packages/9f/d6/08d72760617ab501ebb3b30a945e19c0fa5cd1bfa80a7f6aacf481e60ee8/setuptools-32.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.0.0 2024-12-17T10:59:33,733 Found link https://files.pythonhosted.org/packages/dc/37/f01d823fd312ba8ea6c3aea906d2d6ac9e9e8bf9e7853e34f296e94b0d0d/setuptools-32.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.0.0 2024-12-17T10:59:33,734 Found link https://files.pythonhosted.org/packages/74/6e/a1eec5bab831386eb043438225e0a7d311702047d20cee460ad4318238f4/setuptools-32.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.0.0 2024-12-17T10:59:33,735 Found link https://files.pythonhosted.org/packages/28/cd/e9fbf7cf35aade9661304f9c3e86520e043042d1cd0df0bee238abe6ec94/setuptools-32.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.0 2024-12-17T10:59:33,736 Found link https://files.pythonhosted.org/packages/26/d1/dc7fe14ce4a3ff3faebf1ac11350de4104ea2d2a80c98393b55c84362b0c/setuptools-32.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.0 2024-12-17T10:59:33,738 Found link https://files.pythonhosted.org/packages/40/e2/114f0b42ca5d7dcbefafbcbe4f8fdbe407b577345caac08f943855d72fe1/setuptools-32.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.0 2024-12-17T10:59:33,739 Found link https://files.pythonhosted.org/packages/04/8a/0f562a74f21d2ed48c586ae9148a536905c9b3e4c4070c83611c3fbbbf59/setuptools-32.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.1 2024-12-17T10:59:33,741 Found link https://files.pythonhosted.org/packages/6b/b2/b79df1b728dc14469269844cbd6cbe82c71a16839a131c60357b13117c96/setuptools-32.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.1 2024-12-17T10:59:33,742 Found link https://files.pythonhosted.org/packages/d6/38/54338b224a06a618bc6e05453ab54094f0feede29f277f684e4985728fe2/setuptools-32.1.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.2 2024-12-17T10:59:33,744 Found link https://files.pythonhosted.org/packages/5f/66/bfd7f09fddc2530e5c1096736fe08742d475c4eab80fe8527f0440d885ec/setuptools-32.1.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.2 2024-12-17T10:59:33,746 Found link https://files.pythonhosted.org/packages/2a/0b/80d014192eb120270e936cb166e9c5f7d7e9316d20540d0cc41221be1d93/setuptools-32.1.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.3 2024-12-17T10:59:33,748 Found link https://files.pythonhosted.org/packages/60/23/8e79ce5164310c2f367a66a6110da77b0088365b14363a873bfc91d9c702/setuptools-32.1.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.3 2024-12-17T10:59:33,750 Found link https://files.pythonhosted.org/packages/3a/fb/570e51a1a4b0de85eb6ec36a6c47bd5fd7a55128a1391a15b6e21d290a87/setuptools-32.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.2.0 2024-12-17T10:59:33,751 Found link https://files.pythonhosted.org/packages/87/1a/33d3d05569e857c5c5cc3e90d197bf4d9696dc740a05f66a09599d66e5bd/setuptools-32.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.2.0 2024-12-17T10:59:33,753 Found link https://files.pythonhosted.org/packages/50/77/581dc566d4a03d408d3797153a537c0edc67aded8765ac556124e0e25ef0/setuptools-32.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.3.0 2024-12-17T10:59:33,755 Found link https://files.pythonhosted.org/packages/b0/04/d7aac18d0d8b1b9bd9b88af02af8090e72653753bced3226f9903cabb991/setuptools-32.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.3.0 2024-12-17T10:59:33,757 Found link https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.3.1 2024-12-17T10:59:33,758 Found link https://files.pythonhosted.org/packages/e8/68/f968ebc015c7e0021e76b60b8cfd29f9ffbae4b3b58d96ad20045a99562e/setuptools-32.3.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.3.1 2024-12-17T10:59:33,760 Found link https://files.pythonhosted.org/packages/d3/72/0108eee78038fa8961e2309d4486294b1035968bd940546748b72d309737/setuptools-33.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 33.1.0 2024-12-17T10:59:33,762 Found link https://files.pythonhosted.org/packages/74/48/b99482eaf90785868e0ba83e8d21a62cf88cf1067ff481f37eff528c22ab/setuptools-33.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 33.1.0 2024-12-17T10:59:33,764 Found link https://files.pythonhosted.org/packages/e5/53/92a8ac9d252ec170d9197dcf988f07e02305a06078d7e83a41ba4e3ed65b/setuptools-33.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 33.1.1 2024-12-17T10:59:33,765 Found link https://files.pythonhosted.org/packages/dc/8c/7c9869454bdc53e72fb87ace63eac39336879eef6f2bf96e946edbf03e90/setuptools-33.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 33.1.1 2024-12-17T10:59:33,767 Found link https://files.pythonhosted.org/packages/67/d9/0633db28d5c86047501909cdb7c2614602ca425c14ff38faf9eafa383010/setuptools-34.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.0 2024-12-17T10:59:33,769 Found link https://files.pythonhosted.org/packages/4f/5d/77ab299135d7a882fff2970b45c6a77d7d79db0363c395081770632e6f1d/setuptools-34.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.0 2024-12-17T10:59:33,771 Found link https://files.pythonhosted.org/packages/52/85/15b618883d7289920943c7971b1add55188a5e4769a4f1fbec982279bcc0/setuptools-34.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.1 2024-12-17T10:59:33,773 Found link https://files.pythonhosted.org/packages/b1/d1/3df86b914d72b18d37266f964a11576f135eadbb7d2e3c5165377e4263bc/setuptools-34.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.1 2024-12-17T10:59:33,774 Found link https://files.pythonhosted.org/packages/fb/95/6af4e7a9f3a1af7e04ffdf45dfdc1a86ab36e6888708e578e506b357240d/setuptools-34.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.2 2024-12-17T10:59:33,776 Found link https://files.pythonhosted.org/packages/e3/6b/bb793ca610f364d1888b9bd7b83dccd0c27d779e4fd91a953ce8bae74996/setuptools-34.0.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.2 2024-12-17T10:59:33,778 Found link https://files.pythonhosted.org/packages/e2/e4/4a35e641eb36f3a8a1ebe1a38cbd6f251da416cb2680ef44fab4fd07dc20/setuptools-34.0.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.3 2024-12-17T10:59:33,780 Found link https://files.pythonhosted.org/packages/d7/53/291726cd289b87588381db8a63f027819ee133a5764d7f0adbcb4a5f7951/setuptools-34.0.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.3 2024-12-17T10:59:33,782 Found link https://files.pythonhosted.org/packages/a7/62/3995dc3067cbf8d4a13ddac0f87417b9a08799c586b3faa77d62ad9085de/setuptools-34.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.1.0 2024-12-17T10:59:33,784 Found link https://files.pythonhosted.org/packages/64/88/d434873ba1ce02c0ed669f574afeabaeaaeec207929a41b5c1ed947270fc/setuptools-34.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.1.0 2024-12-17T10:59:33,785 Found link https://files.pythonhosted.org/packages/e4/1a/24d196d3f3c62db133afb09d221d0b9b2f48f6d7e81020e9892b4eab7686/setuptools-34.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.1.1 2024-12-17T10:59:33,787 Found link https://files.pythonhosted.org/packages/e2/51/3ea582a6d64dcd36858a10de31d43ca8ea0a3be5386dd0caf6503167cdfb/setuptools-34.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.1.1 2024-12-17T10:59:33,795 Found link https://files.pythonhosted.org/packages/9a/9e/7614c97ca7f88a74352c726cfae1fa3f9823701d3a8b71f8c95ea581e493/setuptools-34.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.2.0 2024-12-17T10:59:33,796 Found link https://files.pythonhosted.org/packages/16/ef/44baff6e9b1f8125d759d026757677a8a82d14d9974726f13726dee9adfb/setuptools-34.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.2.0 2024-12-17T10:59:33,797 Found link https://files.pythonhosted.org/packages/ad/bb/940a5b3244d62ffdef887dc3a8061649f4f0fa5cbbd498b09a862e91b6b9/setuptools-34.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.0 2024-12-17T10:59:33,798 Found link https://files.pythonhosted.org/packages/87/24/0a39eaaf6caac0dc20158c0d5e8e4e4f8a195d0481dc3d14043fb8e9ca94/setuptools-34.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.0 2024-12-17T10:59:33,799 Found link https://files.pythonhosted.org/packages/49/09/68b43c68492a9d437c137892d11427ac45a1497812c8a8ce2cd17649a27c/setuptools-34.3.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.1 2024-12-17T10:59:33,800 Found link https://files.pythonhosted.org/packages/03/79/e56106d77d3d2ae607ba1e1d7f8c3ed61880f7decba1f253feb714b7eafe/setuptools-34.3.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.1 2024-12-17T10:59:33,802 Found link https://files.pythonhosted.org/packages/de/b2/b63accae9aa1a4cf02e03c7522102f686a1bd9b8b1b847716198152d2c63/setuptools-34.3.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.2 2024-12-17T10:59:33,803 Found link https://files.pythonhosted.org/packages/b5/e2/cca325e160b8e12334f5b2923ffcdb3c02da9fded1d2899d7930ac1c7448/setuptools-34.3.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.2 2024-12-17T10:59:33,804 Found link https://files.pythonhosted.org/packages/dd/d5/0c24cf773269681b2ce088b7afbaadddc2273cf0bd91c3f3961458097de2/setuptools-34.3.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.3 2024-12-17T10:59:33,805 Found link https://files.pythonhosted.org/packages/d5/b7/e52b7dccd3f91eec858309dcd931c1387bf70b6d458c86a9bfcb50134fbd/setuptools-34.3.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.3 2024-12-17T10:59:33,806 Found link https://files.pythonhosted.org/packages/4f/45/4ff49ef85e3bda6e63eefeae4d42642de0c58b63acabf01cbf3512b851f6/setuptools-34.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.4.0 2024-12-17T10:59:33,807 Found link https://files.pythonhosted.org/packages/b7/58/53b0dea2c7563abebbc774318b298b8d78f41464e0b24833817e33c96438/setuptools-34.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.4.0 2024-12-17T10:59:33,809 Found link https://files.pythonhosted.org/packages/61/da/d37d49dc549683b7a5f1074641c6f42b4c0093dc7085bc680485ad160ef8/setuptools-34.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.4.1 2024-12-17T10:59:33,811 Found link https://files.pythonhosted.org/packages/ad/73/536baf7b0c6b20129a142f653b0b9750e6bbef5cc8ac03b4eb8fd939fc4c/setuptools-34.4.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.4.1 2024-12-17T10:59:33,814 Found link https://files.pythonhosted.org/packages/ff/96/5e917753dbdd7b28217c1068d9e3fbe54a7ef0ff3a6411d0cc81faf37070/setuptools-35.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.0 2024-12-17T10:59:33,815 Found link https://files.pythonhosted.org/packages/9d/4c/e52cb975d7deee609e78d24e652251dd2a10144c796ca982500cb15389c9/setuptools-35.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.0 2024-12-17T10:59:33,816 Found link https://files.pythonhosted.org/packages/76/10/f61ea34f5ca2ab6437d8529d10954cbdf0bbb0f9826e1b703863a66a40ae/setuptools-35.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.1 2024-12-17T10:59:33,818 Found link https://files.pythonhosted.org/packages/55/61/fdecfda95355db1c67daa6c8e6ee747f8a0bbc0a5e18f8bfd716bdffac3e/setuptools-35.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.1 2024-12-17T10:59:33,820 Found link https://files.pythonhosted.org/packages/27/45/79618f80704497f74f2de1ca62216a5c3ffdbd49f43047c81c30e126a055/setuptools-35.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.2 2024-12-17T10:59:33,822 Found link https://files.pythonhosted.org/packages/88/13/7d560b75334a8e4b4903f537b7e5a1ad9f1a2f1216e2587aaaf91b38c991/setuptools-35.0.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.2 2024-12-17T10:59:33,823 Found link https://files.pythonhosted.org/packages/fc/cb/748dcabb152fbc7eceaf585d052b8bc11cf028b917a7d2343cf1e0c092c3/setuptools-36.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.0.1 2024-12-17T10:59:33,825 Found link https://files.pythonhosted.org/packages/a9/23/720c7558ba6ad3e0f5ad01e0d6ea2288b486da32f053c73e259f7c392042/setuptools-36.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.0.1 2024-12-17T10:59:33,827 Found link https://files.pythonhosted.org/packages/e3/13/e5705e5a8fc366cfb92807d3c926ed033186f644a995b238fd7ba0ab2ea8/setuptools-36.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.1.0 2024-12-17T10:59:33,828 Found link https://files.pythonhosted.org/packages/8f/e1/02e6e8f5d5cb120748cdcff48b82c7fffce9750fdaf9362a860d669a617d/setuptools-36.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.1.0 2024-12-17T10:59:33,830 Found link https://files.pythonhosted.org/packages/62/64/5161818bd7d574dda208ec8e41307fd661b45ea8d5f6aa7e2dda09fc9b18/setuptools-36.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.1.1 2024-12-17T10:59:33,832 Found link https://files.pythonhosted.org/packages/0e/d3/672f680d7185bc30478691aea62486c85e51ff07b06a52635699b29c0460/setuptools-36.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.1.1 2024-12-17T10:59:33,834 Found link https://files.pythonhosted.org/packages/e2/79/a865e78ab721a6dda2dea171526e6f8db51ba50814766429477e87c6ba8a/setuptools-36.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.0 2024-12-17T10:59:33,835 Found link https://files.pythonhosted.org/packages/25/c1/344fdd1f543cba2d38c6fb7db86f2ffc468e72006487005e50df08f0243d/setuptools-36.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.0 2024-12-17T10:59:33,838 Found link https://files.pythonhosted.org/packages/54/78/55b06e9c83fe661bd7554ce8b2620c253cba25df36ae402ba184df980ec0/setuptools-36.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.1 2024-12-17T10:59:33,839 Found link https://files.pythonhosted.org/packages/ef/e7/c55562d31056ab4a2bb7edc51d750531db055c770664ea4542bccf0cf405/setuptools-36.2.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.1 2024-12-17T10:59:33,841 Found link https://files.pythonhosted.org/packages/b7/e8/c7e5fabf907ee4f17dbec13cf18eba3c48e1ac97adb209fcbd2e0f5e4316/setuptools-36.2.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.2 2024-12-17T10:59:33,843 Found link https://files.pythonhosted.org/packages/62/48/5902109864b2c22d5ed5804479175ae4e2239b04e06b5917d2dc90a83a8c/setuptools-36.2.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.2 2024-12-17T10:59:33,844 Found link https://files.pythonhosted.org/packages/4d/d8/fb50bb18b1b3652022f2f1ca560db7b0d8e02e9573b263e978501ba5f4a6/setuptools-36.2.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.3 2024-12-17T10:59:33,846 Found link https://files.pythonhosted.org/packages/46/44/648b37b1dc8f6e70c05c0f91cc7873b76484a924b8a2d5aa2e57d6846076/setuptools-36.2.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.3 2024-12-17T10:59:33,848 Found link https://files.pythonhosted.org/packages/9c/33/486970f273c7d8e4610bf17106a6b5949ddf214ff61835804407e02987e4/setuptools-36.2.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.4 2024-12-17T10:59:33,850 Found link https://files.pythonhosted.org/packages/08/ed/a71819fa8a3c689bb00df79a966921f7f59409352f3143a85f6937ae7c97/setuptools-36.2.4.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.4 2024-12-17T10:59:33,851 Found link https://files.pythonhosted.org/packages/47/0e/0a8d5b5de0325e276c772254d5036b9228b744befc427c9fb9997aab5f25/setuptools-36.2.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.5 2024-12-17T10:59:33,853 Found link https://files.pythonhosted.org/packages/e1/b1/b9a490783bc7c10ca9e87aecbdc21baedb97a80a65f98559f283e3c7fb46/setuptools-36.2.5.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.5 2024-12-17T10:59:33,855 Found link https://files.pythonhosted.org/packages/40/91/75d94d70b669ce6915b17992a68e2c3214a217f0d8e21aebbf94b10beae4/setuptools-36.2.6-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.6 2024-12-17T10:59:33,857 Found link https://files.pythonhosted.org/packages/1c/cf/bceaa680300c39f8561d43a06aaa2a9a3b6217ebd37ccadbc1aae0836e88/setuptools-36.2.6.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.6 2024-12-17T10:59:33,858 Found link https://files.pythonhosted.org/packages/f6/d0/926c904249bee08b7c92848cb015cc8204cc4a36c4e0f9132e32109f8ab1/setuptools-36.2.7-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.7 2024-12-17T10:59:33,860 Found link https://files.pythonhosted.org/packages/07/a0/11d3d76df54b9701c0f7bf23ea9b00c61c5e14eb7962bb29aed866a5844e/setuptools-36.2.7.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.7 2024-12-17T10:59:33,862 Found link https://files.pythonhosted.org/packages/25/56/8911aee89553b72f799f80790ddf1c36aeda125eb5bd0bd3487663856556/setuptools-36.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.3.0 2024-12-17T10:59:33,864 Found link https://files.pythonhosted.org/packages/6a/a7/e3af543c6dde4de7584536c868ac38570f58ae451f9201ff674532ea3809/setuptools-36.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.3.0 2024-12-17T10:59:33,866 Found link https://files.pythonhosted.org/packages/1b/95/e6f28144fdb6c06186c1f0e70cea02791e6ec787682bdfc437ce69b8186c/setuptools-36.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.4.0 2024-12-17T10:59:33,867 Found link https://files.pythonhosted.org/packages/28/4f/889339f38da415e49cff15b21ab27becbf4c017c79fbfdeca663f5b33b36/setuptools-36.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.4.0 2024-12-17T10:59:33,869 Found link https://files.pythonhosted.org/packages/32/28/16fffbead19dc705f9546134ca81090d6c266aff6173fb092bb6d8dfd76a/setuptools-36.5.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.5.0 2024-12-17T10:59:33,871 Found link https://files.pythonhosted.org/packages/a4/c8/9a7a47f683d54d83f648d37c3e180317f80dc126a304c45dc6663246233a/setuptools-36.5.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.5.0 2024-12-17T10:59:33,872 Found link https://files.pythonhosted.org/packages/bd/4c/b06ab3abfc8bc93b87b70f4cab22352c3c72deba7b71390d14bfffa97c85/setuptools-36.6.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.6.0 2024-12-17T10:59:33,874 Found link https://files.pythonhosted.org/packages/45/29/8814bf414e7cd1031e1a3c8a4169218376e284ea2553cc0822a6ea1c2d78/setuptools-36.6.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.6.0 2024-12-17T10:59:33,876 Found link https://files.pythonhosted.org/packages/85/36/b36167b5df1fe186ea0a476f7029cfb1f67ddc21dc24fe6704a89b162c99/setuptools-36.6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.6.1 2024-12-17T10:59:33,878 Found link https://files.pythonhosted.org/packages/56/a0/4dfcc515b1b993286a64b9ab62562f09e6ed2d09288909aee1efdb9dde16/setuptools-36.6.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.6.1 2024-12-17T10:59:33,879 Found link https://files.pythonhosted.org/packages/3d/57/9b439f6de8dcca7663d592aa4b50c010a7e46bb842ce2ad087f5b48fc19f/setuptools-36.7.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.0 2024-12-17T10:59:33,881 Found link https://files.pythonhosted.org/packages/a9/5e/be163b88ee1c0093532e96ac68e42b840c5d85fd9888d8a96645ac5b71e4/setuptools-36.7.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.0 2024-12-17T10:59:33,883 Found link https://files.pythonhosted.org/packages/e5/63/8b03cf8480caef721a22ad4241202165ed95c3ba2d2ab7ba8886b239c021/setuptools-36.7.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.1 2024-12-17T10:59:33,885 Found link https://files.pythonhosted.org/packages/4f/12/fe19686c43d82c2101c70b917185682f4fc907cbfc9290368ecace403ad6/setuptools-36.7.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.1 2024-12-17T10:59:33,886 Found link https://files.pythonhosted.org/packages/d1/56/fe971f02e075c9e712f23d1fe5c427f573fce178c368deebf5794f80b7c9/setuptools-36.7.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.2 2024-12-17T10:59:33,888 Found link https://files.pythonhosted.org/packages/0f/22/7fdcc777ba60e2a8b1ea17f679c2652ffe80bd5a2f35d61c629cb9545d5e/setuptools-36.7.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.2 2024-12-17T10:59:33,890 Found link https://files.pythonhosted.org/packages/27/f6/fabfc9c71c9b1b99d2ec4768a6e1f73b2e924f51c89d436302b8c2a25459/setuptools-36.8.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.8.0 2024-12-17T10:59:33,892 Found link https://files.pythonhosted.org/packages/b8/04/be569e393006fa9a2c10ef72ea33133c2902baa115dd1d4279dae55c3b3b/setuptools-36.8.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.8.0 2024-12-17T10:59:33,893 Found link https://files.pythonhosted.org/packages/0f/40/b3c98aa32bc91d3d8c573443a29aa482d77268d77132b63f09d8385b21ff/setuptools-37.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 37.0.0 2024-12-17T10:59:33,895 Found link https://files.pythonhosted.org/packages/7c/cb/bdfbb0b6a56459d5461768de824d4f40ec4c4c778f3a8fb0b84c25f03b68/setuptools-37.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 37.0.0 2024-12-17T10:59:33,897 Found link https://files.pythonhosted.org/packages/54/60/54e7ee235b377854f8ccaec996ccae04c33f59eb86c44c387761a82cafea/setuptools-38.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.0.0 2024-12-17T10:59:33,899 Found link https://files.pythonhosted.org/packages/55/23/726b0d4f6c96ff62bd6593398b64427882c74939e862849ea8f2b0bc0bb8/setuptools-38.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.0.0 2024-12-17T10:59:33,900 Found link https://files.pythonhosted.org/packages/44/84/36374822b182d0334928af192ba03b7b287b27675a788d3e218af2773b8e/setuptools-38.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.1.0 2024-12-17T10:59:33,902 Found link https://files.pythonhosted.org/packages/c6/34/cd488be4302b6e72fa10a336eacd789c6ef2affa251e9c5f76402ccdb243/setuptools-38.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.1.0 2024-12-17T10:59:33,904 Found link https://files.pythonhosted.org/packages/09/ec/d02a4ec3942435c14677e4b6d6852a382ae19fc53f1a92184738450d0e72/setuptools-38.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.0 2024-12-17T10:59:33,905 Found link https://files.pythonhosted.org/packages/70/7a/1ca7761f8d056ecf40f0ed3300669bba184ce1ed943fa393ed0259606118/setuptools-38.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.0 2024-12-17T10:59:33,907 Found link https://files.pythonhosted.org/packages/dc/00/338a7476782b3059976ee4d1e2117e03f8bec6ae86c7a86b36648f491373/setuptools-38.2.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.1 2024-12-17T10:59:33,909 Found link https://files.pythonhosted.org/packages/27/25/6f8cf695e021a0b20ab9b1eaf95b286695e8ff27dea9afa4427f954f8998/setuptools-38.2.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.1 2024-12-17T10:59:33,911 Found link https://files.pythonhosted.org/packages/e3/39/ec976dc30d045c5ee30cfcd849b88726e0fa1d4ba9de44e6ec7e926b9f20/setuptools-38.2.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.3 2024-12-17T10:59:33,913 Found link https://files.pythonhosted.org/packages/41/80/268fda78a53c2629128f8174d2952c7f902c93ebaa2062b64f27aa101b07/setuptools-38.2.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.3 2024-12-17T10:59:33,916 Found link https://files.pythonhosted.org/packages/bb/e0/ea620f9ecbaaaf3ebb288cdbbe8cc20b6a789c17e42d8916662b218e3349/setuptools-38.2.4-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.4 2024-12-17T10:59:33,918 Found link https://files.pythonhosted.org/packages/69/56/f0f52281b5175e3d9ca8623dadbc3b684e66350ea9e0006736194b265e99/setuptools-38.2.4.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.4 2024-12-17T10:59:33,920 Found link https://files.pythonhosted.org/packages/4c/00/19ad1da0869e6699577d90ea843325036952015f924fc8488d181c140729/setuptools-38.2.5-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.5 2024-12-17T10:59:33,921 Found link https://files.pythonhosted.org/packages/e9/c3/5986db56819bd88e1a250cad2a97249211686b1b7b5d95f9ab64d403a2cb/setuptools-38.2.5.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.5 2024-12-17T10:59:33,923 Found link https://files.pythonhosted.org/packages/0c/f4/69bd5904cc1ecccf7b625f0d2f1de8cb168fe76bac31bec197c845c77a1d/setuptools-38.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.3.0 2024-12-17T10:59:33,925 Found link https://files.pythonhosted.org/packages/f4/21/9990132a250d49190c2fb41ea2adb9b4693c0b10ec1b92db476d3f06e6cb/setuptools-38.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.3.0 2024-12-17T10:59:33,927 Found link https://files.pythonhosted.org/packages/75/d1/5abca4ccf61a7ab86c255dd315fb96e566fbf9b5d3a480e72c93e8ec2802/setuptools-38.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.4.0 2024-12-17T10:59:33,928 Found link https://files.pythonhosted.org/packages/41/5f/6da80400340fd48ba4ae1c673be4dc3821ac06cd9821ea60f9c7d32a009f/setuptools-38.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.4.0 2024-12-17T10:59:33,930 Found link https://files.pythonhosted.org/packages/61/c8/3e04b8f555a598de6053bd6e07c6aa389e6801467599d166d17f984af6c0/setuptools-38.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.4.1 2024-12-17T10:59:33,932 Found link https://files.pythonhosted.org/packages/d7/18/ef605d86063c11555d497a5f049709d6a90c5f8232bd6748a692794c10b7/setuptools-38.4.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.4.1 2024-12-17T10:59:33,934 Found link https://files.pythonhosted.org/packages/aa/64/ea9f0f022bb9660b8a3c549754bf9105e05284ec408e93a65644522c1ecc/setuptools-38.5.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.0 2024-12-17T10:59:33,935 Found link https://files.pythonhosted.org/packages/1d/80/eb09090e89f658990ee8b92c41fd4f5b04b5a07ddac121b94874473c7171/setuptools-38.5.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.0 2024-12-17T10:59:33,937 Found link https://files.pythonhosted.org/packages/43/41/033a273f9a25cb63050a390ee8397acbc7eae2159195d85f06f17e7be45a/setuptools-38.5.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.1 2024-12-17T10:59:33,939 Found link https://files.pythonhosted.org/packages/6c/54/f7e9cea6897636a04e74c3954f0d8335cc38f7d01e27eec98026b049a300/setuptools-38.5.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.1 2024-12-17T10:59:33,941 Found link https://files.pythonhosted.org/packages/ad/dc/fcced9ec3f2561c0cbe8eb6527eef7cf4f4919a2b3a07891a36e846635af/setuptools-38.5.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.2 2024-12-17T10:59:33,942 Found link https://files.pythonhosted.org/packages/e0/02/2b14188e06ddf61e5b462e216b15d893e8472fca28b1b0c5d9272ad7e87c/setuptools-38.5.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.2 2024-12-17T10:59:33,944 Found link https://files.pythonhosted.org/packages/b2/8a/9b1fa583782c63b89d21c4bf32dfdee40fa30be1339201f0acfe3fb21510/setuptools-38.6.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.6.0 2024-12-17T10:59:33,946 Found link https://files.pythonhosted.org/packages/95/b9/7c61dcfa6953271f567a8db96f110cd8cf75e13a84c1d293649d584d2d39/setuptools-38.6.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.6.0 2024-12-17T10:59:33,948 Found link https://files.pythonhosted.org/packages/6f/91/ed40033d671744824b938d0cea41c0e35a42eded4254fe720d3226411a37/setuptools-38.6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.6.1 2024-12-17T10:59:33,949 Found link https://files.pythonhosted.org/packages/d6/09/55f3263f7adbe1341529a47ed6dc0dfad915bc05a35a21b37da443962b67/setuptools-38.6.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.6.1 2024-12-17T10:59:33,951 Found link https://files.pythonhosted.org/packages/f3/8d/74c86edb326ee18c0ffbec9d0a97f6b5a519f6449a64d21673b29e67b8db/setuptools-38.7.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.7.0 2024-12-17T10:59:33,953 Found link https://files.pythonhosted.org/packages/0e/12/d62a8359835c4c46c883d6b80ea11f9333a8594ed45dae99aea92df2e72f/setuptools-38.7.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.7.0 2024-12-17T10:59:33,955 Found link https://files.pythonhosted.org/packages/26/57/69f35fa2ee411cfa3557efa40f776992dffb54d8edd52e03ec0be5fb3bb9/setuptools-39.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.0.0 2024-12-17T10:59:33,956 Found link https://files.pythonhosted.org/packages/47/bf/f1640538c9a329ef5459ad7093cf305767e45c5d9adcd6f97f1e43581944/setuptools-39.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.0.0 2024-12-17T10:59:33,958 Found link https://files.pythonhosted.org/packages/20/d7/04a0b689d3035143e2ff288f4b9ee4bf6ed80585cc121c90bfd85a1a8c2e/setuptools-39.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.0.1 2024-12-17T10:59:33,960 Found link https://files.pythonhosted.org/packages/72/c2/c09362ab29338413ab687b47dab03bab4a792e2bbb727a1eb5e0a88e3b86/setuptools-39.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.0.1 2024-12-17T10:59:33,961 Found link https://files.pythonhosted.org/packages/8c/10/79282747f9169f21c053c562a0baa21815a8c7879be97abd930dbcf862e8/setuptools-39.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.1.0 2024-12-17T10:59:33,963 Found link https://files.pythonhosted.org/packages/a6/5b/f399fcffb9128d642387133dc3aa9bb81f127b949cd4d9f63e5602ad1d71/setuptools-39.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.1.0 2024-12-17T10:59:33,965 Found link https://files.pythonhosted.org/packages/7f/e1/820d941153923aac1d49d7fc37e17b6e73bfbd2904959fffbad77900cf92/setuptools-39.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.2.0 2024-12-17T10:59:33,967 Found link https://files.pythonhosted.org/packages/1a/04/d6f1159feaccdfc508517dba1929eb93a2854de729fa68da9d5c6b48fa00/setuptools-39.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.2.0 2024-12-17T10:59:33,969 Found link https://files.pythonhosted.org/packages/ff/f4/385715ccc461885f3cedf57a41ae3c12b5fec3f35cce4c8706b1a112a133/setuptools-40.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.0.0 2024-12-17T10:59:33,971 Found link https://files.pythonhosted.org/packages/d3/3e/1d74cdcb393b68ab9ee18d78c11ae6df8447099f55fe86ee842f9c5b166c/setuptools-40.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.0.0 2024-12-17T10:59:33,972 Found link https://files.pythonhosted.org/packages/18/97/57c2a06449457449086182d8239c2261e9e63db69dceb266bc9f8212f788/setuptools-40.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.1.0 2024-12-17T10:59:33,974 Found link https://files.pythonhosted.org/packages/5a/df/b2e3d9693bb0dcbeac516a73dd7a9eb82b126ae52e4a74605a9b01beddd5/setuptools-40.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.1.0 2024-12-17T10:59:33,976 Found link https://files.pythonhosted.org/packages/72/3d/5235c1035a58a8b190607fef7814d972b5c2cf269aa15bad48535fdeea2b/setuptools-40.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.1.1 2024-12-17T10:59:33,978 Found link https://files.pythonhosted.org/packages/15/ff/8c1e022d096c201f9063a1fb836759db8e2aed3c85792560c3f92f8069ec/setuptools-40.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.1.1 2024-12-17T10:59:33,980 Found link https://files.pythonhosted.org/packages/66/e8/570bb5ca88a8bcd2a1db9c6246bb66615750663ffaaeada95b04ffe74e12/setuptools-40.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.2.0 2024-12-17T10:59:33,982 Found link https://files.pythonhosted.org/packages/ef/1d/201c13e353956a1c840f5d0fbf0461bd45bbd678ea4843ebf25924e8984c/setuptools-40.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.2.0 2024-12-17T10:59:33,984 Found link https://files.pythonhosted.org/packages/27/f9/0d705bb4963ee952946670f8a185d8ce3afca11084d60cf5c589622bfe6b/setuptools-40.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.3.0 2024-12-17T10:59:33,986 Found link https://files.pythonhosted.org/packages/80/f1/89d8a18ed758d4de4efbc56712676052b0f8a94f0d5c115d080b219f29af/setuptools-40.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.3.0 2024-12-17T10:59:33,988 Found link https://files.pythonhosted.org/packages/9f/ef/64d825524ad88c1a364126f335da89eca0d8ad9bea89313994103d182a50/setuptools-40.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.0 2024-12-17T10:59:33,990 Found link https://files.pythonhosted.org/packages/b0/58/10324f2e21466c2c3abebec1599121c0e38ccc1382f723d23e2fb80e25dd/setuptools-40.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.0 2024-12-17T10:59:33,992 Found link https://files.pythonhosted.org/packages/81/17/a6301c14aa0c0dd02938198ce911eba84602c7e927a985bf9015103655d1/setuptools-40.4.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.1 2024-12-17T10:59:33,994 Found link https://files.pythonhosted.org/packages/c3/a8/a497f2f220fd51a714d0a466a32b8ec7d71dafbb053cb490a427b5fa2a1c/setuptools-40.4.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.1 2024-12-17T10:59:33,995 Found link https://files.pythonhosted.org/packages/6e/9c/cc2eb661d85f4aa541910af1a72b834a0f5c9209079fcbd1438fa6da17c6/setuptools-40.4.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.2 2024-12-17T10:59:33,997 Found link https://files.pythonhosted.org/packages/67/76/f777f50a1303b481d575fcf2af7de336a23c88f17fb4b6e7894de6b602cd/setuptools-40.4.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.2 2024-12-17T10:59:33,999 Found link https://files.pythonhosted.org/packages/96/06/c8ee69628191285ddddffb277bd5abdf769166e7a14b867c2a172f0175b1/setuptools-40.4.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.3 2024-12-17T10:59:34,001 Found link https://files.pythonhosted.org/packages/6e/9c/6a003320b00ef237f94aa74e4ad66c57a7618f6c79d67527136e2544b728/setuptools-40.4.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.3 2024-12-17T10:59:34,003 Found link https://files.pythonhosted.org/packages/82/a1/ba6fb41367b375f5cb653d1317d8ca263c636cff6566e2da1b0da716069d/setuptools-40.5.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.5.0 2024-12-17T10:59:34,005 Found link https://files.pythonhosted.org/packages/26/e5/9897eee1100b166a61f91b68528cb692e8887300d9cbdaa1a349f6304b79/setuptools-40.5.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.5.0 2024-12-17T10:59:34,007 Found link https://files.pythonhosted.org/packages/18/1c/c0a1125640eab61a486ec4c7432fbf626db80cc3322c49180b07628e7689/setuptools-40.6.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.0 2024-12-17T10:59:34,009 Found link https://files.pythonhosted.org/packages/35/e8/863091ea5615f5bab19b350eccb507edaad0c56b2ca1ce3afdd311e3dc0b/setuptools-40.6.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.0 2024-12-17T10:59:34,010 Found link https://files.pythonhosted.org/packages/4b/47/1417da90ed6f4c88465d08ea2461ff41c94cc6cc223f333d130d7a99199a/setuptools-40.6.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.1 2024-12-17T10:59:34,012 Found link https://files.pythonhosted.org/packages/87/3a/d32f2aa163902b58e56921bf6977cac4ea3dc1c64be359fd800551c27f96/setuptools-40.6.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.1 2024-12-17T10:59:34,014 Found link https://files.pythonhosted.org/packages/e7/16/da8cb8046149d50940c6110310983abb359bbb8cbc3539e6bef95c29428a/setuptools-40.6.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.2 2024-12-17T10:59:34,016 Found link https://files.pythonhosted.org/packages/b0/d1/8acb42f391cba52e35b131e442e80deffbb8d0676b93261d761b1f0ef8fb/setuptools-40.6.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.2 2024-12-17T10:59:34,018 Found link https://files.pythonhosted.org/packages/37/06/754589caf971b0d2d48f151c2586f62902d93dc908e2fd9b9b9f6aa3c9dd/setuptools-40.6.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.3 2024-12-17T10:59:34,020 Found link https://files.pythonhosted.org/packages/37/1b/b25507861991beeade31473868463dad0e58b1978c209de27384ae541b0b/setuptools-40.6.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.3 2024-12-17T10:59:34,022 Found link https://files.pythonhosted.org/packages/5b/ac/90c7617bfc48ae1265d2c0cc46aeb0a0d482e00577008d21b64efe9a2006/setuptools-40.7.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.0 2024-12-17T10:59:34,024 Found link https://files.pythonhosted.org/packages/8e/6a/bab79e7bf3ceede6c371d93c3ffc197b54b04a1e6f631b40cd1c71d656e4/setuptools-40.7.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.0 2024-12-17T10:59:34,026 Found link https://files.pythonhosted.org/packages/bf/ae/a23db1762646069742cc21393833577d3fa438eecaa59d11fb04fa57fcd5/setuptools-40.7.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.1 2024-12-17T10:59:34,028 Found link https://files.pythonhosted.org/packages/3b/17/81a4ab4c94e9c78f98dfaad0208994129213089361dc53a7cd8de177d1e3/setuptools-40.7.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.1 2024-12-17T10:59:34,029 Found link https://files.pythonhosted.org/packages/14/43/4f6ccba67890ad39c3d5c736dd0de3b122bf252ee4e5b4ea3d900990d64d/setuptools-40.7.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.2 2024-12-17T10:59:34,031 Found link https://files.pythonhosted.org/packages/cc/5e/7c7bbbfb0323a2e58b8ba45b4e082e40e195656394f30a70a6822c8c807f/setuptools-40.7.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.2 2024-12-17T10:59:34,033 Found link https://files.pythonhosted.org/packages/82/9c/e812a9838feaf76cd9a960ca4ced3be7f2db31e473677a621d006e128db2/setuptools-40.7.3-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.3 2024-12-17T10:59:34,035 Found link https://files.pythonhosted.org/packages/90/86/00ab839a8647e0fee435fe77f70795865ca4534387872a6c23b22fd85ac8/setuptools-40.7.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.3 2024-12-17T10:59:34,037 Found link https://files.pythonhosted.org/packages/d1/6a/4b2fcefd2ea0868810e92d519dacac1ddc64a2e53ba9e3422c3b62b378a6/setuptools-40.8.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.8.0 2024-12-17T10:59:34,039 Found link https://files.pythonhosted.org/packages/c2/f7/c7b501b783e5a74cf1768bc174ee4fb0a8a6ee5af6afa92274ff964703e0/setuptools-40.8.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.8.0 2024-12-17T10:59:34,041 Found link https://files.pythonhosted.org/packages/44/56/75e64a8fbbe9e0bd30cfdd58ca1856bc0dc15a43e41504a58d8373f34213/setuptools-40.9.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.9.0 2024-12-17T10:59:34,043 Found link https://files.pythonhosted.org/packages/ca/e6/97a6ea040026f2c86abb96827990ace8cdfdfa05967fc3f7dd7461ce4b39/setuptools-40.9.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.9.0 2024-12-17T10:59:34,045 Found link https://files.pythonhosted.org/packages/c8/b0/cc6b7ba28d5fb790cf0d5946df849233e32b8872b6baca10c9e002ff5b41/setuptools-41.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.0.0 2024-12-17T10:59:34,047 Found link https://files.pythonhosted.org/packages/ed/69/c805067de1feedbb98c53174b0f2df44cc05e0e9ee73bb85eebc59e508c6/setuptools-41.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.0.0 2024-12-17T10:59:34,048 Found link https://files.pythonhosted.org/packages/ec/51/f45cea425fd5cb0b0380f5b0f048ebc1da5b417e48d304838c02d6288a1e/setuptools-41.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.0.1 2024-12-17T10:59:34,050 Found link https://files.pythonhosted.org/packages/1d/64/a18a487b4391a05b9c7f938b94a16d80305bf0369c6b0b9509e86165e1d3/setuptools-41.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.0.1 2024-12-17T10:59:34,052 Found link https://files.pythonhosted.org/packages/75/b3/0a106dfaf7f48aef638da80b32608617cc8de4b24a22c8cd3759c32e5d30/setuptools-41.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.1.0 2024-12-17T10:59:34,054 Found link https://files.pythonhosted.org/packages/68/0c/e470db6866aedbff3c4c88faf7f81b90343d8ff32cd68b62db1b65037fb4/setuptools-41.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.1.0 2024-12-17T10:59:34,056 Found link https://files.pythonhosted.org/packages/b2/86/095d2f7829badc207c893dd4ac767e871f6cd547145df797ea26baea4e2e/setuptools-41.2.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.2.0 2024-12-17T10:59:34,058 Found link https://files.pythonhosted.org/packages/d9/ca/7279974e489e8b65003fe618a1a741d6350227fa2bf48d16be76c7422423/setuptools-41.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.2.0 2024-12-17T10:59:34,060 Found link https://files.pythonhosted.org/packages/84/14/d7aefed8d7d3c9eae31c43b830421afe4640f127daee2a193f7b7e6e5c88/setuptools-41.3.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.3.0 2024-12-17T10:59:34,062 Found link https://files.pythonhosted.org/packages/cf/af/1cbf2f4c78b5f6dcc5e3f387224302bb82c44ec7a00fd2dbfc482b673456/setuptools-41.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.3.0 2024-12-17T10:59:34,064 Found link https://files.pythonhosted.org/packages/6a/9a/50fadfd53ec909e4399b67c74cc7f4e883488035cfcdb90b685758fa8b34/setuptools-41.4.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.4.0 2024-12-17T10:59:34,066 Found link https://files.pythonhosted.org/packages/f4/d5/a6c19dcbcbc267aca376558797f036d9bcdff344c9f785fe7d0fe9a5f2a7/setuptools-41.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.4.0 2024-12-17T10:59:34,067 Found link https://files.pythonhosted.org/packages/ea/98/9db5ebb9c33716ab8c45ee355a300facb44575b9b6d68a95fa49e81a2f04/setuptools-41.5.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.5.0 2024-12-17T10:59:34,069 Found link https://files.pythonhosted.org/packages/cb/83/055c30a0d60b12aec280e41fa3b0b316ae9d655b11ff8decfe74c4395908/setuptools-41.5.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.5.0 2024-12-17T10:59:34,071 Found link https://files.pythonhosted.org/packages/db/3c/1065553af43e5f388cb5ae96f44867470063a2d04c02551104dcb12794bd/setuptools-41.5.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.5.1 2024-12-17T10:59:34,073 Found link https://files.pythonhosted.org/packages/e7/93/ee0ad1215dc5abe6cf43c988e270504670e41e90ae6625703699d8ffe10e/setuptools-41.5.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.5.1 2024-12-17T10:59:34,075 Found link https://files.pythonhosted.org/packages/d9/de/554b6310ac87c5b921bc45634b07b11394fe63bc4cb5176f5240addf18ab/setuptools-41.6.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.6.0 2024-12-17T10:59:34,077 Found link https://files.pythonhosted.org/packages/11/0a/7f13ef5cd932a107cd4c0f3ebc9d831d9b78e1a0e8c98a098ca17b1d7d97/setuptools-41.6.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.6.0 2024-12-17T10:59:34,079 Found link https://files.pythonhosted.org/packages/61/a2/82b506a6cdb42cc79a65d5a9e790112cf6b98ee7aba4a53a2b9c9c8047d0/setuptools-42.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.0 2024-12-17T10:59:34,081 Found link https://files.pythonhosted.org/packages/ab/41/ab6ae1937191de0c9cbc115d0e91e335f268aa1cd85524c86e5970fdb68a/setuptools-42.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.0 2024-12-17T10:59:34,083 Found link https://files.pythonhosted.org/packages/9e/d5/444a443d890f09fc1ca1a2c3c9fc7e84cb148177b05ac94fe5084e3d9abb/setuptools-42.0.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.1 2024-12-17T10:59:34,084 Found link https://files.pythonhosted.org/packages/ce/1d/96320b9784b04943c924a9f1c6fa49124a1542039ce098a5f9a369227bad/setuptools-42.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.1 2024-12-17T10:59:34,086 Found link https://files.pythonhosted.org/packages/54/28/c45d8b54c1339f9644b87663945e54a8503cfef59cf0f65b3ff5dd17cf64/setuptools-42.0.2-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.2 2024-12-17T10:59:34,088 Found link https://files.pythonhosted.org/packages/f7/b6/5b98441b6749ea1db1e41e5e6e7a93cbdd7ffd45e11fe1b22d45884bc777/setuptools-42.0.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.2 2024-12-17T10:59:34,090 Found link https://files.pythonhosted.org/packages/91/af/18d58ed8a8e7e6b91d71b0367034faf8ea41e1004018811388ed07a7f2d6/setuptools-43.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 43.0.0 2024-12-17T10:59:34,092 Found link https://files.pythonhosted.org/packages/06/51/8f2aa4b85f2fb394af0d440fc9a35747a1aeab27214f6e6f7d02e3b43719/setuptools-43.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 43.0.0 2024-12-17T10:59:34,094 Found link https://files.pythonhosted.org/packages/f9/d3/955738b20d3832dfa3cd3d9b07e29a8162edb480bf988332f5e6e48ca444/setuptools-44.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.0.0 2024-12-17T10:59:34,096 Found link https://files.pythonhosted.org/packages/b0/f3/44da7482ac6da3f36f68e253cb04de37365b3dba9036a3c70773b778b485/setuptools-44.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.0.0 2024-12-17T10:59:34,098 Found link https://files.pythonhosted.org/packages/ab/b5/3679d7c98be5b65fa5522671ef437b792d909cf3908ba54fe9eca5d2a766/setuptools-44.1.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.1.0 2024-12-17T10:59:34,100 Found link https://files.pythonhosted.org/packages/ed/7b/bbf89ca71e722b7f9464ebffe4b5ee20a9e5c9a555a56e2d3914bb9119a6/setuptools-44.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.1.0 2024-12-17T10:59:34,102 Found link https://files.pythonhosted.org/packages/e1/b7/182161210a13158cd3ccc41ee19aadef54496b74f2817cc147006ec932b4/setuptools-44.1.1-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.1.1 2024-12-17T10:59:34,104 Found link https://files.pythonhosted.org/packages/b2/40/4e00501c204b457f10fe410da0c97537214b2265247bc9a5bc6edd55b9e4/setuptools-44.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.1.1 2024-12-17T10:59:34,106 Found link https://files.pythonhosted.org/packages/af/e7/02db816dc88c598281bacebbb7ccf2c9f1a6164942e88f1a0fded8643659/setuptools-45.0.0-py2.py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.0.0 2024-12-17T10:59:34,107 Found link https://files.pythonhosted.org/packages/fd/76/3c7f726ed5c582019937f178d7478ce62716b7e8263344f1684cbe11ab3e/setuptools-45.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.0.0 2024-12-17T10:59:34,108 Found link https://files.pythonhosted.org/packages/a7/c5/6c1acea1b4ea88b86b03280f3fde1efa04fefecd4e7d2af13e602661cde4/setuptools-45.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.1.0 2024-12-17T10:59:34,109 Found link https://files.pythonhosted.org/packages/42/3e/2464120172859e5d103e5500315fb5555b1e908c0dacc73d80d35a9480ca/setuptools-45.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.1.0 2024-12-17T10:59:34,111 Found link https://files.pythonhosted.org/packages/3d/72/1c1498c1e908e0562b1e1cd30012580baa7d33b5b0ffdbeb5fde2462cc71/setuptools-45.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.2.0 2024-12-17T10:59:34,112 Found link https://files.pythonhosted.org/packages/68/75/d1d7b7340b9eb6e0388bf95729e63c410b381eb71fe8875cdfd949d8f9ce/setuptools-45.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.2.0 2024-12-17T10:59:34,113 Found link https://files.pythonhosted.org/packages/0e/8e/4d9a9009afeae48ec1301713d96b9ae901aa6e157637ddf37e844c1bf4ee/setuptools-45.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.3.0 2024-12-17T10:59:34,115 Found link https://files.pythonhosted.org/packages/c8/1f/178e51e013f42c5e16e6f7c22ffdaea54ac9b90cd0b13b217b1aba283dc0/setuptools-45.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 45.3.0 2024-12-17T10:59:34,116 Found link https://files.pythonhosted.org/packages/70/b8/b23170ddda9f07c3444d49accde49f2b92f97bb2f2ebc312618ef12e4bd6/setuptools-46.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.0.0 2024-12-17T10:59:34,117 Found link https://files.pythonhosted.org/packages/df/ed/bea598a87a8f7e21ac5bbf464102077c7102557c07db9ff4e207bd9f7806/setuptools-46.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.0.0 2024-12-17T10:59:34,119 Found link https://files.pythonhosted.org/packages/61/8e/95c01d39bddaf26e458dd4cc6759db5540b969fb3edede77a3b7e59d2c50/setuptools-46.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.0 2024-12-17T10:59:34,120 Found link https://files.pythonhosted.org/packages/4c/73/ce6a8775eae76ca0ce8a3f5fc6d857f49be657fb36edb51ec4334d4040e9/setuptools-46.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.0 2024-12-17T10:59:34,121 Found link https://files.pythonhosted.org/packages/1e/32/69e6ce8502a12af0cdcbb8de91f1cbafd4533f84d8fe17bf712f6200f21b/setuptools-46.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.1 2024-12-17T10:59:34,122 Found link https://files.pythonhosted.org/packages/bb/e7/28d295e0b3f3ddfea42843fb8528918c84cdaf26153242fac5ca6a212622/setuptools-46.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.1 2024-12-17T10:59:34,124 Found link https://files.pythonhosted.org/packages/c6/ca/e912015113aa194a69c0cd4c9e46ff278a0250f35f32ddcf1f096e7c5129/setuptools-46.1.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.2 2024-12-17T10:59:34,125 Found link https://files.pythonhosted.org/packages/18/bb/40d830614e0763df2e8315777f7be6bc164b2cf252ebb00f4ef7984b5dc6/setuptools-46.1.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.2 2024-12-17T10:59:34,126 Found link https://files.pythonhosted.org/packages/a0/df/635cdb901ee4a8a42ec68e480c49f85f4c59e8816effbf57d9e6ee8b3588/setuptools-46.1.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.3 2024-12-17T10:59:34,128 Found link https://files.pythonhosted.org/packages/b5/96/af1686ea8c1e503f4a81223d4a3410e7587fd52df03083de24161d0df7d4/setuptools-46.1.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.3 2024-12-17T10:59:34,129 Found link https://files.pythonhosted.org/packages/73/22/156aac338c4ac8ffb1c3c6c3d4841611fdd4e40a9be7518bf5be432fd38c/setuptools-46.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.2.0 2024-12-17T10:59:34,130 Found link https://files.pythonhosted.org/packages/96/42/5939499f45c1bfd1a8f61d031d28eed988158f957fe3bec99be2f11500b4/setuptools-46.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.2.0 2024-12-17T10:59:34,132 Found link https://files.pythonhosted.org/packages/09/27/98ef5f13ca9c63d9d8601e739817839dde55baeb105a6c32fc8f24daddc2/setuptools-46.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.3.0 2024-12-17T10:59:34,133 Found link https://files.pythonhosted.org/packages/68/91/cc0107f3b8aa90968d11ea3334d89d5c63a48b31236f40a80373cc3aec74/setuptools-46.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.3.0 2024-12-17T10:59:34,134 Found link https://files.pythonhosted.org/packages/01/6c/144e693dae0596db1aa5ab12df2d364b6266afbf85acd12b10774d2de029/setuptools-46.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.3.1 2024-12-17T10:59:34,135 Found link https://files.pythonhosted.org/packages/23/79/1601b04682bcfd9563f8b99d7b05d72605ca174c98851ba1d2155d021e10/setuptools-46.3.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.3.1 2024-12-17T10:59:34,137 Found link https://files.pythonhosted.org/packages/2c/c5/0d38afb961f83e0d51f319f7dc166195ebabc1ea3cb20a10a77f500f7156/setuptools-46.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.4.0 2024-12-17T10:59:34,138 Found link https://files.pythonhosted.org/packages/ac/d6/0f6c0d9d0b07bbb2085e94a71aded1e137c7c9002ac54924bc1c0adf748a/setuptools-46.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 46.4.0 2024-12-17T10:59:34,139 Found link https://files.pythonhosted.org/packages/a5/d6/8b19692730c5472178365289665bd1f47fe7381ec385fc51e31fd3541404/setuptools-47.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.0.0 2024-12-17T10:59:34,141 Found link https://files.pythonhosted.org/packages/95/d1/831c69ff38445fc0399794f7aac1d2ff17feccd5933b26bfe1187007c996/setuptools-47.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.0.0 2024-12-17T10:59:34,142 Found link https://files.pythonhosted.org/packages/db/26/7a2d60129e89914f47423e5b3339f0f50ecc9ef93c0894db5490b40b90ed/setuptools-47.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.1.0 2024-12-17T10:59:34,143 Found link https://files.pythonhosted.org/packages/26/56/5cf6861a36bcaee9239f99fd92ea3c7b802b2939e5fe1eddab01f5974302/setuptools-47.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.1.0 2024-12-17T10:59:34,145 Found link https://files.pythonhosted.org/packages/95/95/f657b6e17f00c3f35b5f68b10e46c3a43af353d8856bd57bfcfb1dbb3e92/setuptools-47.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.1.1 2024-12-17T10:59:34,146 Found link https://files.pythonhosted.org/packages/25/bf/a37e89d3148221fedd4def62bb68749041d79f3840d58a7943f81a6f6c6e/setuptools-47.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.1.1 2024-12-17T10:59:34,147 Found link https://files.pythonhosted.org/packages/68/6c/504404be24846206811fdb52a80ecaef2e5284870f6bb9f8181ef3fe4a32/setuptools-47.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.2.0 2024-12-17T10:59:34,148 Found link https://files.pythonhosted.org/packages/76/e3/dd0c8e57feec58ab44eb6de4abb62ecc89d3b457c0c3ec240d530098454a/setuptools-47.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.2.0 2024-12-17T10:59:34,150 Found link https://files.pythonhosted.org/packages/c4/f9/15ec4639c50f54043a6d385a89447f69b3ee3601f65cc7c17ab8c178f0a6/setuptools-47.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.0 2024-12-17T10:59:34,151 Found link https://files.pythonhosted.org/packages/12/86/59b9683467659dcaf2729d7bbfa1d05a83ec417863bca73367e68d299281/setuptools-47.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.0 2024-12-17T10:59:34,152 Found link https://files.pythonhosted.org/packages/e9/93/4860cebd5ad3ff2664ad3c966490ccb46e3b88458b2095145bca11727ca4/setuptools-47.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.1 2024-12-17T10:59:34,154 Found link https://files.pythonhosted.org/packages/95/fe/2687907be1d6291a84a9b51220595a4f89d9477032c57f21e7c633465540/setuptools-47.3.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.1 2024-12-17T10:59:34,155 Found link https://files.pythonhosted.org/packages/90/0f/1e97de8eebf9d3c61b92202e69dbd40a8c0022ae25db5f64e0f28d501dd8/setuptools-47.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.2 2024-12-17T10:59:34,156 Found link https://files.pythonhosted.org/packages/51/16/58e24b2b9dcae0cb77b9fa6601b123a9c6a3723d9d92b58d172754eab2f2/setuptools-47.3.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.2 2024-12-17T10:59:34,157 Found link https://files.pythonhosted.org/packages/52/b4/2b8decca516c7139f2d262b6a0c5dcd6388d0a2d2c760c6bbc830e49347e/setuptools-48.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 48.0.0 2024-12-17T10:59:34,159 Found link https://files.pythonhosted.org/packages/b4/28/cb684152691c3ba02dd8081b084b3d846b39bed11f922f289762bdee036e/setuptools-48.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 48.0.0 2024-12-17T10:59:34,160 Found link https://files.pythonhosted.org/packages/a1/61/64936a2a178908f17ac27e733b4cdeffab618072d9f29743fd346b6fdbb0/setuptools-49.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.0.0 2024-12-17T10:59:34,161 Found link https://files.pythonhosted.org/packages/43/fa/4105deb81a75458c120a77b72cbaa3f2a37f622fbdf0364d85eb340b0521/setuptools-49.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.0.0 2024-12-17T10:59:34,163 Found link https://files.pythonhosted.org/packages/e5/d8/5c49c696141e251c0b5ff9df5e83e56f13692aad0953d97b85ee5d9bc49e/setuptools-49.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.0.1 2024-12-17T10:59:34,164 Found link https://files.pythonhosted.org/packages/16/ea/02a0713b40f3e54b4804d7f51302df62a0e0c166396eda7869c3269500d4/setuptools-49.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.0.1 2024-12-17T10:59:34,165 Found link https://files.pythonhosted.org/packages/41/fa/60888a1d591db07bc9c17dce2bcfb9f00ac507c0a23ecb827e76feb8f816/setuptools-49.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.0 2024-12-17T10:59:34,167 Found link https://files.pythonhosted.org/packages/8b/0f/5f135746c4d0c95fcc3c9a30ac942330bbdf092879ccaae7e3dcba6ea214/setuptools-49.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.0 2024-12-17T10:59:34,168 Found link https://files.pythonhosted.org/packages/d4/2a/4963d195f9d539d6498b3efcd179aba4cf6c259ac3cacee7a397cbe8466a/setuptools-49.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.1 2024-12-17T10:59:34,169 Found link https://files.pythonhosted.org/packages/7b/a2/dd3f48637e928459410c471fc4ef0a31c6f96e68dec25b21741170768ad6/setuptools-49.1.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.1 2024-12-17T10:59:34,170 Found link https://files.pythonhosted.org/packages/bd/a3/dfa1fe840aac5ea628155ca2341416c397496ece599b633658773295d7f0/setuptools-49.1.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.2 2024-12-17T10:59:34,172 Found link https://files.pythonhosted.org/packages/48/e2/68a7f24fbeb842546abf1d4709ec8190bcd50dc023e1ba8d7781bc574384/setuptools-49.1.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.2 2024-12-17T10:59:34,173 Found link https://files.pythonhosted.org/packages/a1/64/dcccbe676d964a05ea8f07528818ace12c5da0a74ac165bd99ad3de2b84b/setuptools-49.1.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.3 2024-12-17T10:59:34,174 Found link https://files.pythonhosted.org/packages/d0/4a/22ee76842d8ffc123d4fc48d24a623c1d206b99968fe3960039f1efc2cbc/setuptools-49.1.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.3 2024-12-17T10:59:34,176 Found link https://files.pythonhosted.org/packages/8e/11/9e10f1cad4518cb307b484c255cae61e97f05b82f6d536932b1714e01b47/setuptools-49.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.2.0 2024-12-17T10:59:34,177 Found link https://files.pythonhosted.org/packages/2f/8e/38259f4a44944a92068d5ff77230511a4c685604b47a81318f9e5cf2cc24/setuptools-49.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.2.0 2024-12-17T10:59:34,178 Found link https://files.pythonhosted.org/packages/ed/16/e9f5c5b86696da09298ea10c32d68ad8ea21f888e45b11aa9e615adda6c9/setuptools-49.2.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.2.1 2024-12-17T10:59:34,179 Found link https://files.pythonhosted.org/packages/4f/20/b97449e107801263cf6df2eceaeed290ee63262ac2c6f736df6964a90879/setuptools-49.2.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.2.1 2024-12-17T10:59:34,181 Found link https://files.pythonhosted.org/packages/f9/d8/89848d7f341de2d2acf18e9c9b30ee69dcf6d87f839121c0564c0cf013bc/setuptools-49.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.0 2024-12-17T10:59:34,182 Found link https://files.pythonhosted.org/packages/14/ca/441729af4f3d11408c880fbca98c607a02bf4e00b332331d5cfa78259827/setuptools-49.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.0 2024-12-17T10:59:34,183 Found link https://files.pythonhosted.org/packages/cd/86/db096edd95e839f3fe123f78ae891efe9caf0e28f0333f2e9ac584bab9fd/setuptools-49.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.1 2024-12-17T10:59:34,185 Found link https://files.pythonhosted.org/packages/02/f7/6996956ac78bee9043ad1884a9c0ec5f069d538f76631435ac52286a2190/setuptools-49.3.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.1 2024-12-17T10:59:34,186 Found link https://files.pythonhosted.org/packages/fd/36/9fdefefb11902ca987dbd92c0fe869ed5e2a798822bb4cea843b2a8f7571/setuptools-49.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.2 2024-12-17T10:59:34,187 Found link https://files.pythonhosted.org/packages/ed/72/046e8d3ad9da774dee020f88964b159ab24697c001c776e76a85450d699d/setuptools-49.3.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.2 2024-12-17T10:59:34,189 Found link https://files.pythonhosted.org/packages/5b/01/866d11f9b92e920cab4c5c8c054862c1a0226026121a82c73b3cafb6a8a8/setuptools-49.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.4.0 2024-12-17T10:59:34,190 Found link https://files.pythonhosted.org/packages/d9/d5/8c0f83909f6054a587018dc10f3feff0d9e3315b1b5d519c790996cbd724/setuptools-49.4.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.4.0 2024-12-17T10:59:34,191 Found link https://files.pythonhosted.org/packages/b3/a1/047f84b8740d63e8fab2c92c4349039d53563c2e244378a8a7b857b94cc8/setuptools-49.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.5.0 2024-12-17T10:59:34,192 Found link https://files.pythonhosted.org/packages/7b/86/8d6cae997e2c9fedf9f805e386df6b8308106697533a9c1620fa1ec4bebe/setuptools-49.5.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.5.0 2024-12-17T10:59:34,194 Found link https://files.pythonhosted.org/packages/c3/a9/5dc32465951cf4812e9e93b4ad2d314893c2fa6d5f66ce5c057af6e76d85/setuptools-49.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.6.0 2024-12-17T10:59:34,195 Found link https://files.pythonhosted.org/packages/38/cc/db23dbe4efc464c3c0111fedf7d46de8888f05b09488d610f6f8ab6e2544/setuptools-49.6.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 49.6.0 2024-12-17T10:59:34,196 Found link https://files.pythonhosted.org/packages/b0/8b/379494d7dbd3854aa7b85b216cb0af54edcb7fce7d086ba3e35522a713cf/setuptools-50.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.0 2024-12-17T10:59:34,198 Found link https://files.pythonhosted.org/packages/b6/af/40f3587d4ebd54cdeb8f87ad7d189618e166e8057ebefd2acd4443aa94f4/setuptools-50.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.0 2024-12-17T10:59:34,199 Found link https://files.pythonhosted.org/packages/a3/7c/771a47323293921f9b08cd89f759a1230b460c9e40dd6af3c5462134c870/setuptools-50.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.1 2024-12-17T10:59:34,200 Found link https://files.pythonhosted.org/packages/3d/92/d5c1de1a3e9fdbe96fc92691baa20af301bc5ba4565d8057efb27bac565b/setuptools-50.0.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.1 2024-12-17T10:59:34,201 Found link https://files.pythonhosted.org/packages/4e/f4/725ac80eb45f46f971463d61fe0324ec6dce5da87bbe9dbf2e1294d5d410/setuptools-50.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.2 2024-12-17T10:59:34,203 Found link https://files.pythonhosted.org/packages/4e/55/6b55971ab84e9c4327e099e48fa38d116f64e1388e6a2cc08af240f9ad0c/setuptools-50.0.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.2 2024-12-17T10:59:34,204 Found link https://files.pythonhosted.org/packages/6d/ed/52e05469314a266f68d9f251a8c1ab7a21a03327b1724056e3eea654bfd1/setuptools-50.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.3 2024-12-17T10:59:34,205 Found link https://files.pythonhosted.org/packages/5f/6c/b965a61c73f49eec24fbd9494b3e6933aa92f4997f8ec7d201870f260bbf/setuptools-50.0.3.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.3 2024-12-17T10:59:34,207 Found link https://files.pythonhosted.org/packages/35/f7/f86e670ebd628f447845798aa3b6a1b6da235941a1591d664d718aac171c/setuptools-50.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.1.0 2024-12-17T10:59:34,208 Found link https://files.pythonhosted.org/packages/fd/53/a626e098cbbc443a5bba1e0f780d1fe97115218a8f5d1e2df6bfa1f47a31/setuptools-50.1.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.1.0 2024-12-17T10:59:34,209 Found link https://files.pythonhosted.org/packages/7d/53/cd47a7799c5e82de7e408fecd72266dcc6cd7be32629b6022d4d6d91a2fc/setuptools-50.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.2.0 2024-12-17T10:59:34,211 Found link https://files.pythonhosted.org/packages/02/49/3f7a2c9617e73107d38c7be98d953f39e46a1813d2113786da30511eddfc/setuptools-50.2.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.2.0 2024-12-17T10:59:34,212 Found link https://files.pythonhosted.org/packages/44/a6/7fb6e8b3f4a6051e72e4e2218889351f0ee484b9ee17e995f5ccff780300/setuptools-50.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.0 2024-12-17T10:59:34,213 Found link https://files.pythonhosted.org/packages/7c/1b/9b68465658cda69f33c31c4dbd511ac5648835680ea8de87ce05c81f95bf/setuptools-50.3.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.0 2024-12-17T10:59:34,214 Found link https://files.pythonhosted.org/packages/37/80/f13112921d93c656edaafeb344ff2969515e349351485274bca7d129d8ef/setuptools-50.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.1 2024-12-17T10:59:34,216 Found link https://files.pythonhosted.org/packages/ed/a9/891c9d088b353df30e315b66ba2b0594785f96433e3205b3eecace89a528/setuptools-50.3.1.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.1 2024-12-17T10:59:34,217 Found link https://files.pythonhosted.org/packages/6d/38/c21ef5034684ffc0412deefbb07d66678332290c14bb5269c85145fbd55e/setuptools-50.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.2 2024-12-17T10:59:34,219 Found link https://files.pythonhosted.org/packages/a7/e0/30642b9c2df516506d40b563b0cbd080c49c6b3f11a70b4c7a670f13a78b/setuptools-50.3.2.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.2 2024-12-17T10:59:34,220 Found link https://files.pythonhosted.org/packages/3d/f2/1489d3b6c72d68bf79cd0fba6b6c7497df4ebf7d40970e2d7eceb8d0ea9c/setuptools-51.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.0.0 2024-12-17T10:59:34,221 Found link https://files.pythonhosted.org/packages/12/e1/b9a2926a3c5a3fb055b8f85052f5baa890106a0e21b64a977c10affea751/setuptools-51.0.0.zip (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.0.0 2024-12-17T10:59:34,222 Found link https://files.pythonhosted.org/packages/ce/3c/096ac70aeb74485a2e7ab6f8146ea41cb4cecd955fdb2f30d51b51d7d146/setuptools-51.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.0 2024-12-17T10:59:34,224 Found link https://files.pythonhosted.org/packages/ea/81/a7428efddb7bac2db7969cc02c94d89f57a98acdc0b6f760c7e123234ab5/setuptools-51.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.0 2024-12-17T10:59:34,225 Found link https://files.pythonhosted.org/packages/6e/77/e921ae5c370698762cf645797f42e6d4d7e679f705a8a9697234591808aa/setuptools-51.1.0.post20201221-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.0.post20201221 2024-12-17T10:59:34,227 Found link https://files.pythonhosted.org/packages/dc/10/903b6f02c98789b1341c9ba61f72ca2d37340f79239e8e8fe2cc9d79c2d7/setuptools-51.1.0.post20201221.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.0.post20201221 2024-12-17T10:59:34,228 Found link https://files.pythonhosted.org/packages/34/b6/33396512781ec5c40de2e70e8a68f2d0c4d91d6cc182410788c34a00002d/setuptools-51.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.1 2024-12-17T10:59:34,230 Found link https://files.pythonhosted.org/packages/94/23/e9e3d96500c063129a19feb854efbb01e6ffe7d913f1da8176692418ab8e/setuptools-51.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.1 2024-12-17T10:59:34,231 Found link https://files.pythonhosted.org/packages/aa/d4/0089d680a610c7b5afda26c1ae588eb363b9050ccf5f33a8c2d1164210f3/setuptools-51.1.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.2 2024-12-17T10:59:34,233 Found link https://files.pythonhosted.org/packages/82/2f/ef7afd98530d07c89deffec833b4b1a91a27a5db6d9f1a216599f5f0316e/setuptools-51.1.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.2 2024-12-17T10:59:34,234 Found link https://files.pythonhosted.org/packages/84/ad/45704c4b41308d54919d86835c3e2e8f77d0aefcb2cb20595ea41768431b/setuptools-51.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.2.0 2024-12-17T10:59:34,235 Found link https://files.pythonhosted.org/packages/d5/20/6c6898eb8d9e126bacce98822f40b21d36041fedbdd5dd6628ed7fb91cdd/setuptools-51.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.2.0 2024-12-17T10:59:34,237 Found link https://files.pythonhosted.org/packages/4e/e2/2d6d2bce8df4d5cd910ffb5aa41e8fc1feb9862bca7b0bfa252edb9165a8/setuptools-51.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.0 2024-12-17T10:59:34,238 Found link https://files.pythonhosted.org/packages/1a/8c/aee547aa130015cf87891f539d282823f1a00d4961d99b572f962d2fa40c/setuptools-51.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.0 2024-12-17T10:59:34,239 Found link https://files.pythonhosted.org/packages/66/6b/8a8a77498a6da8d78613cc4df7198736cca29a5b444eb551a64ccc72b4d6/setuptools-51.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.1 2024-12-17T10:59:34,240 Found link https://files.pythonhosted.org/packages/d5/14/f907bda525861b0b43105d55828b1efc04051ccd6efff612e5ce8c75bd6f/setuptools-51.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.1 2024-12-17T10:59:34,242 Found link https://files.pythonhosted.org/packages/6c/8e/0b3e3b7188c39757167790a4d0c5cc7fddc0626071dab3bb9e9f9f1c550e/setuptools-51.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.2 2024-12-17T10:59:34,243 Found link https://files.pythonhosted.org/packages/5e/39/976717079fbbb86d2633df45aa70577ec28bd74efbf8ec62d4602a2ab5bc/setuptools-51.3.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.2 2024-12-17T10:59:34,244 Found link https://files.pythonhosted.org/packages/b2/81/509db0082c0d2ca2af307c6652ea422865de1f83c14b1e1f3549e415cfac/setuptools-51.3.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.3 2024-12-17T10:59:34,246 Found link https://files.pythonhosted.org/packages/96/66/1138b7ec901e86139c07900ce906c2f1e5c3400ee1cfd1e7ab3c776248c9/setuptools-51.3.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.3 2024-12-17T10:59:34,247 Found link https://files.pythonhosted.org/packages/f7/30/f963996d7efea5a336455a3c727711469280c318e2711e295007dea04d7e/setuptools-52.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 52.0.0 2024-12-17T10:59:34,248 Found link https://files.pythonhosted.org/packages/84/48/5c99d8770fd0a9eb0f82654c3294aad6d0ba9f8600638c2e2ad74f2c5d52/setuptools-52.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 52.0.0 2024-12-17T10:59:34,249 Found link https://files.pythonhosted.org/packages/15/0e/255e3d57965f318973e417d5b7034223f1223de500d91b945ddfaef42a37/setuptools-53.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 53.0.0 2024-12-17T10:59:34,251 Found link https://files.pythonhosted.org/packages/12/68/95515eaff788370246dac534830ea9ccb0758e921ac9e9041996026ecaf2/setuptools-53.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 53.0.0 2024-12-17T10:59:34,252 Found link https://files.pythonhosted.org/packages/4e/ca/0456249eead852a957d306feb0cce454b823cbc3bea7821971febfa45f99/setuptools-53.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 53.1.0 2024-12-17T10:59:34,253 Found link https://files.pythonhosted.org/packages/8f/6b/0dcf95d95086ce459152e4c0ac306f2dbbcf984177a2b8b77b320ebfbf22/setuptools-53.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 53.1.0 2024-12-17T10:59:34,255 Found link https://files.pythonhosted.org/packages/70/06/849cc805ac6332210083f2114a95b22ee252ce81ed4e1be4f1d2b87c9108/setuptools-54.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.0.0 2024-12-17T10:59:34,256 Found link https://files.pythonhosted.org/packages/0b/bb/a212bcfd147edcbca13ba95691411d7843bfeeb5165857abf4e9a0822e99/setuptools-54.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.0.0 2024-12-17T10:59:34,257 Found link https://files.pythonhosted.org/packages/ae/4d/153a2cfab2ea03d4f4aee45d9badb52426db9e2275edfb4b825c5dc55a10/setuptools-54.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.0 2024-12-17T10:59:34,259 Found link https://files.pythonhosted.org/packages/f6/1c/1a76007a43500cbd118b126107e88fbfd59bbcdef276ade5175f7698e618/setuptools-54.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.0 2024-12-17T10:59:34,260 Found link https://files.pythonhosted.org/packages/60/6a/dd9533ae9367a1f35b1b704e2ac9554a61e6dfa4d97e1d86c3760e1e135d/setuptools-54.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.1 2024-12-17T10:59:34,261 Found link https://files.pythonhosted.org/packages/18/c0/36f3e535bf1fef10a8f0f6fbf5ea5f2a39e0a24b4b308058fc78af5237c5/setuptools-54.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.1 2024-12-17T10:59:34,262 Found link https://files.pythonhosted.org/packages/0c/12/18eda60a1b961e0248e1b1e3ec1ff417420596dc7edf3614ef58a7a8cf6a/setuptools-54.1.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.2 2024-12-17T10:59:34,264 Found link https://files.pythonhosted.org/packages/b8/d3/155ebd29b6e34ac283614d3a1e7f476ffb93f535aa0d8b3647fa014815aa/setuptools-54.1.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.2 2024-12-17T10:59:34,265 Found link https://files.pythonhosted.org/packages/0c/2a/a9a614415328b9ecadca58b8038c51988dd963a4c5dba6ebcadbc3b45f3c/setuptools-54.1.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.3 2024-12-17T10:59:34,267 Found link https://files.pythonhosted.org/packages/c4/b3/09e030ab858b2c59b79794280307ba0dc566bfa44eb56b8f4e54d78ac3d6/setuptools-54.1.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.3 2024-12-17T10:59:34,268 Found link https://files.pythonhosted.org/packages/9e/d4/b99a960314121a003e9f39c61dfde01a1010bb47661e193a7722f7f32d52/setuptools-54.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.2.0 2024-12-17T10:59:34,270 Found link https://files.pythonhosted.org/packages/94/75/05e1d69c61c4dfaf65ad12785cd18bedc1e0129976c55914d6aea59c7da8/setuptools-54.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 54.2.0 2024-12-17T10:59:34,271 Found link https://files.pythonhosted.org/packages/ae/42/2876a3a136f8bfa9bd703518441c8db78ff1eeaddf174baa85c083c1fd15/setuptools-56.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 56.0.0 2024-12-17T10:59:34,273 Found link https://files.pythonhosted.org/packages/f6/e9/19af16328705915233299f6f1f02db95899fb00c75ac9da4757aa1e5d1de/setuptools-56.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 56.0.0 2024-12-17T10:59:34,274 Found link https://files.pythonhosted.org/packages/11/1b/7012b145cb228aed20f9b2b8b259df49e7963d900799ea44791f54d06ab9/setuptools-56.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 56.1.0 2024-12-17T10:59:34,275 Found link https://files.pythonhosted.org/packages/71/a0/96ab4813ede181fa6c5d01c951dbf156b7d126f7589d0efa3f7861ce7a67/setuptools-56.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 56.1.0 2024-12-17T10:59:34,277 Found link https://files.pythonhosted.org/packages/d0/15/5041473f5d142ee93bf1593deb8f932e27a078f6f04e2020cf44044f72c5/setuptools-56.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 56.2.0 2024-12-17T10:59:34,278 Found link https://files.pythonhosted.org/packages/fc/0a/b486efab52f8ad03c3eca0c998dd3deafba0c39b29e0c49c68a7152c8b2d/setuptools-56.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 56.2.0 2024-12-17T10:59:34,279 Found link https://files.pythonhosted.org/packages/4e/78/56aa1b5f4d8ac548755ae767d84f0be54fdd9d404197a3d9e4659d272348/setuptools-57.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.0.0 2024-12-17T10:59:34,281 Found link https://files.pythonhosted.org/packages/88/fc/d17731c0cc67a5a8e385e4f47c3b0b186720e198b70f076ccb4676804a8f/setuptools-57.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.0.0 2024-12-17T10:59:34,282 Found link https://files.pythonhosted.org/packages/a2/e1/902fbc2f61ad6243cd3d57ffa195a9eb123021ec912ec5d811acf54a39f8/setuptools-57.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.1.0 2024-12-17T10:59:34,283 Found link https://files.pythonhosted.org/packages/cf/79/1a19c2f792da00cbead7b6caa176afdddf517522cb9163ce39576025b050/setuptools-57.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.1.0 2024-12-17T10:59:34,285 Found link https://files.pythonhosted.org/packages/47/32/fc8e244a008617adae684dafd28e24c61f4f7f19e9e40e915be72bdd0549/setuptools-57.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.2.0 2024-12-17T10:59:34,286 Found link https://files.pythonhosted.org/packages/1d/32/94680de1e9153e4fd9d15f82a919c732a046a851b2ccd0c5b05f4ece346b/setuptools-57.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.2.0 2024-12-17T10:59:34,287 Found link https://files.pythonhosted.org/packages/b8/62/fef49ecfb5b59e8138042056b2ebd7ed876bd7ff954d189739a431d01880/setuptools-57.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.3.0 2024-12-17T10:59:34,289 Found link https://files.pythonhosted.org/packages/9a/79/2b62dc9b272c8c28c0b67b0d49e75914d1e52a7b9b2ab46e61fa2396f606/setuptools-57.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.3.0 2024-12-17T10:59:34,290 Found link https://files.pythonhosted.org/packages/bd/25/5bdf7f1adeebd4e3fa76b2e2f045ae53ee208e40a4231ad0f0c3007e4353/setuptools-57.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.4.0 2024-12-17T10:59:34,291 Found link https://files.pythonhosted.org/packages/db/e2/c0ced9ccffb61432305665c22842ea120c0f649eec47ecf2a45c596707c4/setuptools-57.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.4.0 2024-12-17T10:59:34,292 Found link https://files.pythonhosted.org/packages/4b/b9/71687c5d2034c863db1db2e0704f5e27581ff3cb44d7f293968c5e08ceb3/setuptools-57.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.5.0 2024-12-17T10:59:34,294 Found link https://files.pythonhosted.org/packages/20/f7/205a71cc9cc68f23afd9f3083002d0fb0a8c2277baf41a528395552e13c0/setuptools-57.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 57.5.0 2024-12-17T10:59:34,295 Found link https://files.pythonhosted.org/packages/57/5a/80fd2846d0151aa81a13540afc97be49f8fa19752933172b76854ba90adc/setuptools-58.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.0 2024-12-17T10:59:34,296 Found link https://files.pythonhosted.org/packages/00/59/5a302942bd2e36194cc37a408989a87d6423e000859713dc3dd440c9dbae/setuptools-58.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.0 2024-12-17T10:59:34,298 Found link https://files.pythonhosted.org/packages/fe/06/4337a1a8067618fbd40f294117edb8960920eff3e31b9cc5e9de2602ff13/setuptools-58.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.1 2024-12-17T10:59:34,299 Found link https://files.pythonhosted.org/packages/c1/e5/8a450f10613b93bd53d59e11d8fe9d9b654b56a87282fd23311be5d19499/setuptools-58.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.1 2024-12-17T10:59:34,300 Found link https://files.pythonhosted.org/packages/56/0f/52135ff086dd42b10636a205170f50a0a8dcd0d648835abdd3a8c0bc06ac/setuptools-58.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.2 2024-12-17T10:59:34,301 Found link https://files.pythonhosted.org/packages/11/c6/9e16df5a5526f7dd2ad17284928e36fc341305fe74c7ab06bb5960a5da94/setuptools-58.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.2 2024-12-17T10:59:34,303 Found link https://files.pythonhosted.org/packages/37/72/18182298997d20e333d4bae0bead740add1b09ca99200eae65a73d9aa732/setuptools-58.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.3 2024-12-17T10:59:34,304 Found link https://files.pythonhosted.org/packages/6d/f2/85d487d516e7319fad8052a6bb4a4447244e59f830d17515fb40d3141072/setuptools-58.0.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.3 2024-12-17T10:59:34,306 Found link https://files.pythonhosted.org/packages/c4/c1/aed7dfedb18ea73d7713bf6ca034ab001a6425be49ffa7e79bbd5999f677/setuptools-58.0.4-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.4 2024-12-17T10:59:34,307 Found link https://files.pythonhosted.org/packages/9a/74/de4d8c69466b6413b1616048b39f8b73d65f98c15f6202b68ccfc9550f1f/setuptools-58.0.4.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.4 2024-12-17T10:59:34,309 Found link https://files.pythonhosted.org/packages/4e/2e/f8e006dbaaa46ed1e762c287585b92476deb8d3ccb79b720ed3b86bc6113/setuptools-58.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.1.0 2024-12-17T10:59:34,310 Found link https://files.pythonhosted.org/packages/59/b8/adeb445fa6c636f78c532f0dd6f847f0f90e709afa7d41396181d438be5a/setuptools-58.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.1.0 2024-12-17T10:59:34,311 Found link https://files.pythonhosted.org/packages/41/f4/a7ca4859317232b1efb64a826b8d2d7299bb77fb60bdb08e2bd1d61cf80d/setuptools-58.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.2.0 2024-12-17T10:59:34,313 Found link https://files.pythonhosted.org/packages/1e/5c/3d7b3d91a86d71faf5038c5d259ed36b5d05b7804648e2c43251d574a6e6/setuptools-58.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.2.0 2024-12-17T10:59:34,314 Found link https://files.pythonhosted.org/packages/46/a5/1949127a03a85aebf06ee809249239929d9ca7b2b6e90f236c52e17fc713/setuptools-58.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.3.0 2024-12-17T10:59:34,316 Found link https://files.pythonhosted.org/packages/80/98/8de0fd3e86d8286a2594e3fa6afc46d751130d26ebb7b1f34e9067992c6f/setuptools-58.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.3.0 2024-12-17T10:59:34,317 Found link https://files.pythonhosted.org/packages/a8/50/76fb9cfe521b531feecd932ab920cd6e32f6838527af7b34ef78d5f39a18/setuptools-58.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.4.0 2024-12-17T10:59:34,319 Found link https://files.pythonhosted.org/packages/02/b5/456e90af3712ca1b25c60ed74d0facb8b65cbaaa42cdceedf3b210580eef/setuptools-58.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.4.0 2024-12-17T10:59:34,320 Found link https://files.pythonhosted.org/packages/23/f9/c2aae8baddb100e01867c6ce27f4f1be3e57106e02c5f97550157826d437/setuptools-58.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.0 2024-12-17T10:59:34,321 Found link https://files.pythonhosted.org/packages/b1/91/b5daf855a39d4a803679124ca888b01ecfcd8beca7bb638072affd9dfa2d/setuptools-58.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.0 2024-12-17T10:59:34,323 Found link https://files.pythonhosted.org/packages/5f/9b/2220f81413d5a61d8b569bb0fedcb3a535105703a2a1b2d2bb1e967a8a42/setuptools-58.5.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.1 2024-12-17T10:59:34,324 Found link https://files.pythonhosted.org/packages/cb/c3/c2854129ab277d98b5dd3dae2163c5391928f0274840bef3df6379af852b/setuptools-58.5.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.1 2024-12-17T10:59:34,325 Found link https://files.pythonhosted.org/packages/83/0d/126a3f26770437a3755c383c9ffd43f1175fd03ce2d9b508ced58178c80d/setuptools-58.5.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.2 2024-12-17T10:59:34,327 Found link https://files.pythonhosted.org/packages/1d/d3/4e7e22c2e6f1cd7c31d78f573e44a83b45c013001c17ca53859d01155513/setuptools-58.5.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.2 2024-12-17T10:59:34,328 Found link https://files.pythonhosted.org/packages/70/e9/84e2865fddfaba4506bc5d293d2a535bf27e31b12ca16d31564f8ce28cdb/setuptools-58.5.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.3 2024-12-17T10:59:34,329 Found link https://files.pythonhosted.org/packages/1e/00/05f51ceab8d3b9be4295000d8be4c830c53e5477755888994e9825606cd9/setuptools-58.5.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.3 2024-12-17T10:59:34,331 Found link https://files.pythonhosted.org/packages/7e/73/83bce9ecff7270cc00dc145f1542078fb5cb5ffc5f8587d7f2fc51aad7af/setuptools-59.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.0.1 2024-12-17T10:59:34,332 Found link https://files.pythonhosted.org/packages/cd/9a/6fff2cee92de1d34c0e8d48bb2ccedb0899eebb2cfe7955584b53bdaded7/setuptools-59.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.0.1 2024-12-17T10:59:34,333 Found link https://files.pythonhosted.org/packages/9d/d2/182e27182d7f61274787e5f0a737f06ad6ad35f27e6b60fed6b8de23b6f5/setuptools-59.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.1.0 2024-12-17T10:59:34,334 Found link https://files.pythonhosted.org/packages/07/88/717b307b2c7833fb8d13457f6bc6a2b368070c9cfec3abbbab7693537776/setuptools-59.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.1.0 2024-12-17T10:59:34,336 Found link https://files.pythonhosted.org/packages/ed/60/15ee37d6d3385e6a432d39b5ac51f8467178ad989ba50f2b55681c1a038e/setuptools-59.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.1.1 2024-12-17T10:59:34,337 Found link https://files.pythonhosted.org/packages/33/68/e72f8c047e7f25b20c9df02163d925dc734bbee46597018e122a2bce9d3e/setuptools-59.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.1.1 2024-12-17T10:59:34,338 Found link https://files.pythonhosted.org/packages/18/ad/ec41343a49a0371ea40daf37b1ba2c11333cdd121cb378161635d14b9750/setuptools-59.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.2.0 2024-12-17T10:59:34,339 Found link https://files.pythonhosted.org/packages/a8/e7/1440b0d19054a5616e9e5beeaa22f68485aa9de20d187f04e52880b7ae7a/setuptools-59.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.2.0 2024-12-17T10:59:34,341 Found link https://files.pythonhosted.org/packages/29/e3/a1edb6bef52fd8d4cbe62cf2b6b444e7145edf89fae7ce9bffbfb92ae8b9/setuptools-59.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.3.0 2024-12-17T10:59:34,342 Found link https://files.pythonhosted.org/packages/14/f7/c064250ee08ab28cb6f55f09311ea0a1b05ac837eb7b51363ef1733c9168/setuptools-59.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.3.0 2024-12-17T10:59:34,343 Found link https://files.pythonhosted.org/packages/6f/ea/e12311dabc63a6a434be25e6011c1513cc95d0cf22e5f13036f75b3ec508/setuptools-59.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.4.0 2024-12-17T10:59:34,345 Found link https://files.pythonhosted.org/packages/6e/41/853fda5af9b4c336965ebcaf10009d3ede674a010961ec80afaf17519247/setuptools-59.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.4.0 2024-12-17T10:59:34,346 Found link https://files.pythonhosted.org/packages/40/a9/7deac76c58fa47c95360116a06b53b9b62f6db11336fe61b6ab53784d98b/setuptools-59.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.5.0 2024-12-17T10:59:34,347 Found link https://files.pythonhosted.org/packages/e6/e2/f2bfdf364e016f7a464db709ea40d1101c4c5a463dd7019dae0a42dbd1c6/setuptools-59.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.5.0 2024-12-17T10:59:34,349 Found link https://files.pythonhosted.org/packages/b0/3a/88b210db68e56854d0bcf4b38e165e03be377e13907746f825790f3df5bf/setuptools-59.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.6.0 2024-12-17T10:59:34,350 Found link https://files.pythonhosted.org/packages/6a/fa/5ec0fa9095c9b72cb1c31a8175c4c6745bf5927d1045d7a70df35d54944f/setuptools-59.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.6), version: 59.6.0 2024-12-17T10:59:34,351 Found link https://files.pythonhosted.org/packages/4f/27/b51cc9cebfd53b168b8a187c844e7a67dc523dda76be9b46d532815df284/setuptools-59.7.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 59.7.0 2024-12-17T10:59:34,353 Found link https://files.pythonhosted.org/packages/99/61/f3b6c920f0e187368f4eeb57a7255afb428926beefba33f05f16214e66bb/setuptools-59.7.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 59.7.0 2024-12-17T10:59:34,354 Found link https://files.pythonhosted.org/packages/8d/25/88b377b99ffb4ad0fc44ff5735fd6be605b2183f743d1ff5c10b7790cea5/setuptools-59.8.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 59.8.0 2024-12-17T10:59:34,355 Found link https://files.pythonhosted.org/packages/ef/75/2bc7bef4d668f9caa9c6ed3f3187989922765403198243040d08d2a52725/setuptools-59.8.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 59.8.0 2024-12-17T10:59:34,356 Found link https://files.pythonhosted.org/packages/f9/73/a1e8254ee8604a7f8598f5b7c09d587b329ad2727f410a210f26c9595b7a/setuptools-60.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.0 2024-12-17T10:59:34,358 Found link https://files.pythonhosted.org/packages/57/e8/675eabec05702d8f3cddff494a4bb8c9cdb9e76d295705377b1eb73bfadf/setuptools-60.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.0 2024-12-17T10:59:34,359 Found link https://files.pythonhosted.org/packages/c1/b1/f775e1cce396e9e6905fc61af075f5b4110376306ed92e6dc1a4b79c91af/setuptools-60.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.1 2024-12-17T10:59:34,360 Found link https://files.pythonhosted.org/packages/6a/ee/0b2929a264a9a967d43321ca44c2ee27dfcc7c6b79a98d3f929433a97e62/setuptools-60.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.1 2024-12-17T10:59:34,362 Found link https://files.pythonhosted.org/packages/8a/ff/593e863da0712038adb7272172bb2d3ae61b1350094fee9d875674bd9ffd/setuptools-60.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.2 2024-12-17T10:59:34,363 Found link https://files.pythonhosted.org/packages/52/a6/f3ba38bb9994ab8bdbe9164b94ddb4d751ef3ca648ddbcccbff205cc6914/setuptools-60.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.2 2024-12-17T10:59:34,364 Found link https://files.pythonhosted.org/packages/df/0d/706cb6888df0dfe7f5a3dc4b1b8c39b949386ef28e66cd989d6d5c16b8ca/setuptools-60.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.3 2024-12-17T10:59:34,365 Found link https://files.pythonhosted.org/packages/7f/0c/df74ee211715db60b333eaa7bf1793b1b21c777ce53295a45a98b9b1a0fe/setuptools-60.0.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.3 2024-12-17T10:59:34,367 Found link https://files.pythonhosted.org/packages/4f/e6/8502336aa2f185b1d9ca56f2fb5048e138c2322262aa45c09c3b5b40012e/setuptools-60.0.4-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.4 2024-12-17T10:59:34,368 Found link https://files.pythonhosted.org/packages/3d/52/abcfab4e0f6dcf6b92df7559dce488eac4e3c82f01b82dfb3ac65c18379b/setuptools-60.0.4.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.4 2024-12-17T10:59:34,369 Found link https://files.pythonhosted.org/packages/ff/27/92a1a57aff92dac23df4a6867be19e29449f52fb05e17de9b1d64e61ebe1/setuptools-60.0.5-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.5 2024-12-17T10:59:34,371 Found link https://files.pythonhosted.org/packages/05/ab/69076a67f4f0588838e3afa2adeea837ca58ffc39977a77038ff373d2b3d/setuptools-60.0.5.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.5 2024-12-17T10:59:34,372 Found link https://files.pythonhosted.org/packages/75/cd/178028262e067ed10011779e8de4c12821de3dc1598de42920988ebd412d/setuptools-60.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.1.0 2024-12-17T10:59:34,373 Found link https://files.pythonhosted.org/packages/80/d3/2954b9ac8ad256f352d941453c44d2d2b219aafeb95277e9282bef606329/setuptools-60.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.1.0 2024-12-17T10:59:34,375 Found link https://files.pythonhosted.org/packages/d3/6b/9ba419f861fef1eb624f77fcb2c081ccac6f11e363bcf47bee6a4d2d5e0d/setuptools-60.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.1.1 2024-12-17T10:59:34,376 Found link https://files.pythonhosted.org/packages/15/8f/cf533796488c53b4824be97b79b86ac161bcc011af9613bec6027f52e78d/setuptools-60.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.1.1 2024-12-17T10:59:34,377 Found link https://files.pythonhosted.org/packages/8e/16/8f64922c8d7cd7ec193b145c9b11ad281064ff8604452ba19a6d5bbd7ed9/setuptools-60.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.2.0 2024-12-17T10:59:34,378 Found link https://files.pythonhosted.org/packages/9b/be/13f54335c7dba713b0e97e11e7a41db3df4a85073d6c5a6e7f6468b22ee2/setuptools-60.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.2.0 2024-12-17T10:59:34,380 Found link https://files.pythonhosted.org/packages/eb/0a/d86dd882b2087570ab9cb86c67e720e1bef7532597b467c2909b3930af3c/setuptools-60.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.3.0 2024-12-17T10:59:34,381 Found link https://files.pythonhosted.org/packages/af/34/508a2cc1af07a20ec7542f489734917d15ccaddb67fa09358ea34a4d749b/setuptools-60.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.3.0 2024-12-17T10:59:34,382 Found link https://files.pythonhosted.org/packages/04/e0/2fb461b22be560d2a1f630346bfafde0029205484ccfc4f1046e79f599a3/setuptools-60.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.3.1 2024-12-17T10:59:34,383 Found link https://files.pythonhosted.org/packages/d9/15/0c48951d6fe38d7b3396401f2cfc43c86bc32408ed6c637ce1a9c6df1bdd/setuptools-60.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.3.1 2024-12-17T10:59:34,385 Found link https://files.pythonhosted.org/packages/95/85/1a132ab9f13bbdaba34144ce47e106539ce5480b795f68b7bad2321b56e4/setuptools-60.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.4.0 2024-12-17T10:59:34,386 Found link https://files.pythonhosted.org/packages/b0/4a/bdfc4b6309af6b0a69066bae6e10fd77848a423b173432babf5f11a079eb/setuptools-60.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.4.0 2024-12-17T10:59:34,387 Found link https://files.pythonhosted.org/packages/eb/53/0dd4c7960579da8be13fa9b2c2591643d37f323e3d79f8bc8b1b6c8e6217/setuptools-60.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.5.0 2024-12-17T10:59:34,389 Found link https://files.pythonhosted.org/packages/69/77/aee1ecacea4d0db740046ce1785e81d16c4b1755af50eceac4ca1a1f8bfd/setuptools-60.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.5.0 2024-12-17T10:59:34,390 Found link https://files.pythonhosted.org/packages/11/b9/adac241e2c4aca7ae4ddd86d3c18227667665b6e7eac550695bfc50c7e3d/setuptools-60.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.6.0 2024-12-17T10:59:34,392 Found link https://files.pythonhosted.org/packages/8f/89/9fec81ec84737c925a1ee992af2c6c7153aec4051c26afeadd6b822354d2/setuptools-60.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.6.0 2024-12-17T10:59:34,393 Found link https://files.pythonhosted.org/packages/fa/cb/25e80b7edc9e2d0d49b3c05ee8992220978591290d88d71c595cf1e7d3ad/setuptools-60.7.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.7.0 2024-12-17T10:59:34,394 Found link https://files.pythonhosted.org/packages/29/dd/48d662bb93e5e51e72265ef612f869947d4ae4126328d7156824cd50d440/setuptools-60.7.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.7.0 2024-12-17T10:59:34,395 Found link https://files.pythonhosted.org/packages/3d/93/903f1a10b3c4651d363b559acc4017b05f082b8461928d0b842a8b5d182a/setuptools-60.7.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.7.1 2024-12-17T10:59:34,397 Found link https://files.pythonhosted.org/packages/1b/78/c0316b86d692e3c7f0905bc5506292e2d8ee810d188544c48865a0335c2c/setuptools-60.7.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.7.1 2024-12-17T10:59:34,398 Found link https://files.pythonhosted.org/packages/c2/14/69df4fd998811fd41c74fab6584ad8576524c87c4da1028a759da655eb39/setuptools-60.8.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.0 2024-12-17T10:59:34,399 Found link https://files.pythonhosted.org/packages/d3/a6/ae5e0a6ea3592af875c838c00decb00f1e6f2d0a3bf7604a8cb797eed767/setuptools-60.8.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.0 2024-12-17T10:59:34,401 Found link https://files.pythonhosted.org/packages/2d/5c/e09f0ce3961663aa323508440796d64f3ca6a874470be76bb2b59acbb26b/setuptools-60.8.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.1 2024-12-17T10:59:34,402 Found link https://files.pythonhosted.org/packages/56/4a/8ba3babea25b807d6f65258437d8d3bed6a820e4a7166f322ebb60d2d127/setuptools-60.8.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.1 2024-12-17T10:59:34,403 Found link https://files.pythonhosted.org/packages/ad/65/7b98718c0ecebbdae5a5251fffc43dd3800ff3d1a6f7cc1aa09cfbcf17a5/setuptools-60.8.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.2 2024-12-17T10:59:34,404 Found link https://files.pythonhosted.org/packages/ae/0b/e458b0d07dced3d7fa2d21d828e708f374ef82040f2012c05d35f47f9af3/setuptools-60.8.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.2 2024-12-17T10:59:34,406 Found link https://files.pythonhosted.org/packages/1e/23/d9d5e23c8001f3614aace339b699d4d05fda9f1ec8be9155048d6613ed33/setuptools-60.9.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.0 2024-12-17T10:59:34,407 Found link https://files.pythonhosted.org/packages/3e/d3/e85cd0d84cf52054caed83b64dd8c922bbf0e33071689d7e3da3f96caabd/setuptools-60.9.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.0 2024-12-17T10:59:34,408 Found link https://files.pythonhosted.org/packages/42/1f/154a2f2eeaa319a313636a052a3a6cf5ac35ee2aa49ad30f0216ad695678/setuptools-60.9.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.1 2024-12-17T10:59:34,410 Found link https://files.pythonhosted.org/packages/e9/84/a1171328f0a8789a1963e301be7c27163ff67da389b94588ab37a55c49f9/setuptools-60.9.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.1 2024-12-17T10:59:34,411 Found link https://files.pythonhosted.org/packages/7d/c4/33822b323a5d2f6239ea668ad04261b6965c309953880a32ce373caf22c7/setuptools-60.9.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.2 2024-12-17T10:59:34,412 Found link https://files.pythonhosted.org/packages/bf/b0/b4599baf535aff5a8675f038a9b4b380df7e5de33c78a155e0883da05403/setuptools-60.9.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.2 2024-12-17T10:59:34,414 Found link https://files.pythonhosted.org/packages/3b/02/8d4d27b1cacaac2d129a27d17a22d92a2a5eedcb7817d4ed8ab0d4daf5c4/setuptools-60.9.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.3 2024-12-17T10:59:34,415 Found link https://files.pythonhosted.org/packages/14/74/54890935244ce053abcc4fa01ef4982a84743a8d128d4cf5eae56e2d156c/setuptools-60.9.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.3 2024-12-17T10:59:34,416 Found link https://files.pythonhosted.org/packages/7c/5b/3d92b9f0f7ca1645cba48c080b54fe7d8b1033a4e5720091d1631c4266db/setuptools-60.10.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.10.0 2024-12-17T10:59:34,417 Found link https://files.pythonhosted.org/packages/af/e8/894c71e914dfbe01276a42dfad40025cd96119f2eefc39c554b6e8b9df86/setuptools-60.10.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 60.10.0 2024-12-17T10:59:34,419 Found link https://files.pythonhosted.org/packages/50/09/2e7557fff6a272e795930229f17a0a0bc62e11069f0f859ebf961c19ed62/setuptools-61.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.0.0 2024-12-17T10:59:34,420 Found link https://files.pythonhosted.org/packages/cf/68/bc4babfa1f0853d9164ed8f9fc97e3cc8293fa6e77277fb1a72b4de75ba5/setuptools-61.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.0.0 2024-12-17T10:59:34,421 Found link https://files.pythonhosted.org/packages/4b/44/4a59818106036bbbbe0fda2a78852077164394b5d842832e254a910d3ae4/setuptools-61.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.1.0 2024-12-17T10:59:34,423 Found link https://files.pythonhosted.org/packages/27/01/6d721dbe597bd8234d978270b99717d017cafb6b1115e0eaafd373eaaa68/setuptools-61.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.1.0 2024-12-17T10:59:34,424 Found link https://files.pythonhosted.org/packages/0d/2f/3d6bdf48b8ef7b915a2f62568dc3cb856a9afea14adb447ab9585d8dd58c/setuptools-61.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.1.1 2024-12-17T10:59:34,425 Found link https://files.pythonhosted.org/packages/81/37/815cc2b7e708d522ccf8051fad1fb278a438fd0e94bcb0a3c2337ee573ce/setuptools-61.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.1.1 2024-12-17T10:59:34,426 Found link https://files.pythonhosted.org/packages/65/d1/1590f71a3ea7ed5f392ba4a7725205048b52e85102e48cbdc7cae3be8f4b/setuptools-61.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.2.0 2024-12-17T10:59:34,428 Found link https://files.pythonhosted.org/packages/a2/fc/f988372c4cdaaf6151ec4270be4e8ca45f0603256d979f81774fca73ad10/setuptools-61.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.2.0 2024-12-17T10:59:34,429 Found link https://files.pythonhosted.org/packages/7a/bb/3d7f9f61d002a4831e0aa4fa7dd7dfb552e48f50e2a0cfef316b9036de19/setuptools-61.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.3.0 2024-12-17T10:59:34,430 Found link https://files.pythonhosted.org/packages/0e/29/8fdaa8081e885e01923f518095ae0f52953844ade373f7105c441e09bc7b/setuptools-61.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.3.0 2024-12-17T10:59:34,432 Found link https://files.pythonhosted.org/packages/66/e7/5a78a242b3a0f4cad3a9a9376bcf0d2b1f2bfb54871d9e46f46cb0ed0914/setuptools-61.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.3.1 2024-12-17T10:59:34,433 Found link https://files.pythonhosted.org/packages/c9/42/16ac560057f5e74aa39754a3811334cc60908f59183c336ba5097369a81d/setuptools-61.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 61.3.1 2024-12-17T10:59:34,434 Found link https://files.pythonhosted.org/packages/0c/3c/548d361162702df85a0301f0cd0c47d05176b20bb086077a0fda740daf41/setuptools-62.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.0.0 2024-12-17T10:59:34,436 Found link https://files.pythonhosted.org/packages/a2/13/229d17002cbab8c8f07b46f8a9adc6bfdd127733a7457f10da06756e1cc3/setuptools-62.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.0.0 2024-12-17T10:59:34,437 Found link https://files.pythonhosted.org/packages/fb/58/9efbfe68482dab9557c49d433a60fff9efd7ed8835f829eba8297c2c124a/setuptools-62.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.1.0 2024-12-17T10:59:34,438 Found link https://files.pythonhosted.org/packages/ea/a3/3d3cbbb7150f90c4cf554048e1dceb7c6ab330e4b9138a40e130a4cc79e1/setuptools-62.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.1.0 2024-12-17T10:59:34,439 Found link https://files.pythonhosted.org/packages/ee/0f/dba055d3696c63fff7430bbc5f337454ac66711d91965f08146784afecad/setuptools-62.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.2.0 2024-12-17T10:59:34,441 Found link https://files.pythonhosted.org/packages/b1/77/75f6543eafdffc0b3f07f99682497bea817ef0b6c361fe72b932eb82459c/setuptools-62.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.2.0 2024-12-17T10:59:34,442 Found link https://files.pythonhosted.org/packages/4a/f3/cf2d1deafeb98bcc9b84ddc432db1881e5a49696994719c6bdcd21f2e597/setuptools-62.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.0 2024-12-17T10:59:34,443 Found link https://files.pythonhosted.org/packages/2b/ca/795fe59736dcc0bd7ff85239ebd017aec6c294983c469b40ee4ef44ca950/setuptools-62.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.0 2024-12-17T10:59:34,445 Found link https://files.pythonhosted.org/packages/fc/d6/764e0cf61f1456b974d9d71b696d483fe269ab31466d76007def02bc4739/setuptools-62.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.1 2024-12-17T10:59:34,446 Found link https://files.pythonhosted.org/packages/87/db/d840e1b888bd82b0b826b8864d1674df52f6d9d909177e1d144ab38a8c50/setuptools-62.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.1 2024-12-17T10:59:34,447 Found link https://files.pythonhosted.org/packages/e9/1c/ec080fde54ab30a738c92f794eab7f5d2f354f2b619ee95b2efe353e0766/setuptools-62.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.2 2024-12-17T10:59:34,448 Found link https://files.pythonhosted.org/packages/4a/25/ec29a23ef38b9456f9965c57a9e1221e6c246d87abbf2a31158799bca201/setuptools-62.3.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.2 2024-12-17T10:59:34,450 Found link https://files.pythonhosted.org/packages/27/0b/cb81bc3a06a242c7626fca8aa9ce82453af3bc44e72a39666bb4052ac302/setuptools-62.3.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.3 2024-12-17T10:59:34,451 Found link https://files.pythonhosted.org/packages/fb/50/005826d31d58a7b90585b5510f2f597c5406ae34df884f4f5d63abfb6ca7/setuptools-62.3.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.3 2024-12-17T10:59:34,452 Found link https://files.pythonhosted.org/packages/8d/67/614c3c236f2b638b503aa388302bd1eba67b9a10c34caa046e4352e5b825/setuptools-62.3.4-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.4 2024-12-17T10:59:34,454 Found link https://files.pythonhosted.org/packages/7f/49/7c3f041fa83a28137f8945c025795d749292a1ab643d4d52cf63a3413849/setuptools-62.3.4.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.4 2024-12-17T10:59:34,455 Found link https://files.pythonhosted.org/packages/d0/12/412167a1f80290555c557a556fb1fc294a6e889924fcf2b2db3a789b11a4/setuptools-62.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.4.0 2024-12-17T10:59:34,456 Found link https://files.pythonhosted.org/packages/0c/f0/f11edc0efc7b00e26a28225621ce7584636bb3a76b1862829d42bc146fbf/setuptools-62.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.4.0 2024-12-17T10:59:34,458 Found link https://files.pythonhosted.org/packages/83/ef/d167612e69d6d708d6d1c7932d5731596cc1f7e5285b8b4f6897a867b9bb/setuptools-62.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.5.0 2024-12-17T10:59:34,459 Found link https://files.pythonhosted.org/packages/6d/72/4d4b2aa376f39e954be948e3e3e2ce3b6d8e2faa1caabfdb4fec207b5456/setuptools-62.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.5.0 2024-12-17T10:59:34,460 Found link https://files.pythonhosted.org/packages/e9/86/b2ede1d87122a6d4da86d84cc35d0e48b4aa2476e4281d06101c772c1961/setuptools-62.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.6.0 2024-12-17T10:59:34,461 Found link https://files.pythonhosted.org/packages/dc/73/88920663229023b724a854d1ab7e3e50a1a28b63eeec399a604ba30f9242/setuptools-62.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 62.6.0 2024-12-17T10:59:34,463 Found link https://files.pythonhosted.org/packages/66/a6/564c67366105c34fd75980a8b1a339e2d98bafc36d0b6c5837b85d75467b/setuptools-63.0.0b1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.0.0b1 2024-12-17T10:59:34,464 Found link https://files.pythonhosted.org/packages/1f/90/439fb6f4ecd969b9e2da514cf7773e5480f8480d715be7374fc9aca65781/setuptools-63.0.0b1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.0.0b1 2024-12-17T10:59:34,465 Found link https://files.pythonhosted.org/packages/df/80/4620a4849ed16c5b0498963e3180d2c3e649660191f8d7d9be5a4bc8a773/setuptools-63.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.0.0 2024-12-17T10:59:34,467 Found link https://files.pythonhosted.org/packages/01/86/85e708ae56bbedbe9935338113421323169cf8b2450229e541a2f5744b73/setuptools-63.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.0.0 2024-12-17T10:59:34,468 Found link https://files.pythonhosted.org/packages/ae/7f/6d816941769a7783be4258dd35e28bbf1a64bb36b1b7e0c773eff07fb0a8/setuptools-63.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.1.0 2024-12-17T10:59:34,469 Found link https://files.pythonhosted.org/packages/67/25/42e2d6664c3e106c33ecad8356a55e3ae5d81708c89098061a97fbff7cee/setuptools-63.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.1.0 2024-12-17T10:59:34,471 Found link https://files.pythonhosted.org/packages/a4/53/bfc6409447ca024558b8b19d055de94c813c3e32c0296c48a0873a161cf5/setuptools-63.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.2.0 2024-12-17T10:59:34,472 Found link https://files.pythonhosted.org/packages/0a/ba/52611dc8278828eb9ec339e6914a0f865f9e2af967214905927835dfac0a/setuptools-63.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.2.0 2024-12-17T10:59:34,473 Found link https://files.pythonhosted.org/packages/22/59/ab3469c21ff2e16011c53dbe3b9b64325bf397625a60f7368347db9bc5e6/setuptools-63.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.3.0 2024-12-17T10:59:34,474 Found link https://files.pythonhosted.org/packages/a8/d9/28490a9ef6592c3471bd1bcacaf5bd0dee2bb05c8a8bcf901e673b2f1732/setuptools-63.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.3.0 2024-12-17T10:59:34,476 Found link https://files.pythonhosted.org/packages/85/c6/1ffbdc6b831ff295a4d6371c87786f254a5283cd4015b6844c28efc136cc/setuptools-63.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.0 2024-12-17T10:59:34,477 Found link https://files.pythonhosted.org/packages/48/b7/92671fba6952de2f0240e6a3251bf9674b2ed0cc6e3d5f756d753404ee15/setuptools-63.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.0 2024-12-17T10:59:34,478 Found link https://files.pythonhosted.org/packages/90/2e/109766d7f3cb854a083dd66bfc0bf2bf9e40f373829efedb4b5e0d104aa3/setuptools-63.4.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.1 2024-12-17T10:59:34,480 Found link https://files.pythonhosted.org/packages/63/2e/e1f3e1b02d7ff0baa356413e93ad8a88706accd6b3538e18204a8a00c42d/setuptools-63.4.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.1 2024-12-17T10:59:34,481 Found link https://files.pythonhosted.org/packages/10/9f/e6b3ae7c925399e5d210fda0be141cfff052bbb935c2d762019067f52d2e/setuptools-63.4.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.2 2024-12-17T10:59:34,482 Found link https://files.pythonhosted.org/packages/00/26/6c26b879cbd65b3c4daf7327a4cb205f8541c695e5d44b0c2c65892c20d1/setuptools-63.4.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.2 2024-12-17T10:59:34,483 Found link https://files.pythonhosted.org/packages/2a/a3/49c29680d6118273b992b40ebe881e8e899b8e26a4e951f37f223da8f862/setuptools-63.4.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.3 2024-12-17T10:59:34,485 Found link https://files.pythonhosted.org/packages/5b/ff/69fd395c5237da934753752b71c38e95e137bd0603d5640df70ddaea8038/setuptools-63.4.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.3 2024-12-17T10:59:34,486 Found link https://files.pythonhosted.org/packages/3e/83/e206edff58159a927c76bbfeef1bf8b39cb12bbb32ae3c6227deb16d0121/setuptools-64.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.0 2024-12-17T10:59:34,488 Found link https://files.pythonhosted.org/packages/55/53/9227eb446c4e5a185bc577a52b00634996206a6411dfed9c78f4c3218a3e/setuptools-64.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.0 2024-12-17T10:59:34,489 Found link https://files.pythonhosted.org/packages/98/71/6db7ed66f195e05baa1f13d0bf8d7a70a2db92f9bb2b2d138997d1429346/setuptools-64.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.1 2024-12-17T10:59:34,490 Found link https://files.pythonhosted.org/packages/95/d0/fdd5d7386308b1b05dbcf7a8c9315379ac8a6187c4171d936d9a506f1428/setuptools-64.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.1 2024-12-17T10:59:34,491 Found link https://files.pythonhosted.org/packages/e4/c3/2fe50dbd45118e02951d8f3207d738d68f271a728bdd33b3a117782692ef/setuptools-64.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.2 2024-12-17T10:59:34,493 Found link https://files.pythonhosted.org/packages/5b/2d/e9188faa5e5350ffe59d200260f73db2525c51734df212cd048b6c8ca0ce/setuptools-64.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.2 2024-12-17T10:59:34,494 Found link https://files.pythonhosted.org/packages/6f/a9/1d019cf4d87be67e4d156f95f258e206833aa6d45c183014d091ef9cb0d3/setuptools-64.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.3 2024-12-17T10:59:34,495 Found link https://files.pythonhosted.org/packages/c1/9c/67d1cb3ede2b167ee271ff22c398e7067715f294994fb18164f40ac981e4/setuptools-64.0.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.3 2024-12-17T10:59:34,497 Found link https://files.pythonhosted.org/packages/a2/dd/d8cdd14320106ff58d4eb6e6553bae7a822e174ad5b05db486332d50d4ec/setuptools-65.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.0 2024-12-17T10:59:34,498 Found link https://files.pythonhosted.org/packages/e2/ed/749424fd3cc1b55bb4836878e86b981e85a6fa7db462f6b6577ce1ad62a7/setuptools-65.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.0 2024-12-17T10:59:34,499 Found link https://files.pythonhosted.org/packages/9d/b9/48de2d69a45354b20ca754e6c61736f1db3707c208ea04908766b184fd23/setuptools-65.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.1 2024-12-17T10:59:34,500 Found link https://files.pythonhosted.org/packages/02/10/be08cf9b821236bcc312a6104fb586bbeb692a50b1714ade91b9e28c2db4/setuptools-65.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.1 2024-12-17T10:59:34,502 Found link https://files.pythonhosted.org/packages/02/70/40276081ce5d29e7610618a857909e4eba264c0c9cfb4ecb613a4f7ad0ef/setuptools-65.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.2 2024-12-17T10:59:34,503 Found link https://files.pythonhosted.org/packages/96/c2/8c6605094cb9a27b593e14377fb89a934342051bc7316a0ce21d47029481/setuptools-65.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.2 2024-12-17T10:59:34,504 Found link https://files.pythonhosted.org/packages/18/1e/7cd4bf0d0c4e109595b5e69621f72c4e01079c533ccb94003dfe361c62ea/setuptools-65.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.1.0 2024-12-17T10:59:34,506 Found link https://files.pythonhosted.org/packages/45/8d/00ecdc169f2ed7d95e1076c63cdf4315d92c875e9cff2e595b6b410fb8d6/setuptools-65.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.1.0 2024-12-17T10:59:34,507 Found link https://files.pythonhosted.org/packages/6d/1e/ff7c90e2a0514cef2ed4fb7d49944d45674fe7c7a305d6553a5025ae09fa/setuptools-65.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.1.1 2024-12-17T10:59:34,508 Found link https://files.pythonhosted.org/packages/a6/0f/a0c589e2ae4aa45000d6917d248e64c8805ef3a35c134a43194e6d7abbd0/setuptools-65.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.1.1 2024-12-17T10:59:34,510 Found link https://files.pythonhosted.org/packages/e5/6f/942e63ec2a5c881df147782b97dc4715ca082dec9de41f43e1013faef710/setuptools-65.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.2.0 2024-12-17T10:59:34,511 Found link https://files.pythonhosted.org/packages/15/a7/b4cab9eca586ed17c66b3aced23ccf945312c50742614039d0cd71c870bd/setuptools-65.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.2.0 2024-12-17T10:59:34,512 Found link https://files.pythonhosted.org/packages/d9/5f/2daccd14278b6b780ae6799f85998377c06019354982391245f4b58a927d/setuptools-65.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.3.0 2024-12-17T10:59:34,514 Found link https://files.pythonhosted.org/packages/cc/83/7ea9d9b3a6ff3225aca2fce5e4df373bee7e0a74c539711a4fbfda53374f/setuptools-65.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.3.0 2024-12-17T10:59:34,515 Found link https://files.pythonhosted.org/packages/d5/e6/e3a70a77dda22766b9ef4ff47ff8320720311e78d11d1401baffca3f6879/setuptools-65.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.4.0 2024-12-17T10:59:34,516 Found link https://files.pythonhosted.org/packages/4c/61/86c94ae2cccb05749abfb1b2961125d40368c8f03ac59275550c45e634f1/setuptools-65.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.4.0 2024-12-17T10:59:34,517 Found link https://files.pythonhosted.org/packages/bd/b4/f120561bc94a04bae5d71ea86fe2c7d97f57ab89635b4739ec4abceda92d/setuptools-65.4.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.4.1 2024-12-17T10:59:34,519 Found link https://files.pythonhosted.org/packages/03/c9/7b050ea4cc4144d0328f15e0b43c839e759c6c639370a3b932ecf4c6358f/setuptools-65.4.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.4.1 2024-12-17T10:59:34,520 Found link https://files.pythonhosted.org/packages/41/82/7f54bbfe5c247a8c9f78d8d1d7c051847bcb78843c397b866dba335c1e88/setuptools-65.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.5.0 2024-12-17T10:59:34,521 Found link https://files.pythonhosted.org/packages/c5/41/247814d8b7a044717164c74080725a6c8f3d2b5fc82b34bd825b617df663/setuptools-65.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.5.0 2024-12-17T10:59:34,522 Found link https://files.pythonhosted.org/packages/b6/40/353c051f77ee5618adaf1fd96f4f6bae9714ed0a22c7142c01c24eb77fe4/setuptools-65.5.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.5.1 2024-12-17T10:59:34,524 Found link https://files.pythonhosted.org/packages/26/f4/ca5cb6df512f453ad50f78900bf7ec6a5491ee44bb49d0f6f76802dbdd43/setuptools-65.5.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.5.1 2024-12-17T10:59:34,525 Found link https://files.pythonhosted.org/packages/1f/97/c03668380f278f1f8b0486d820c142cf224bba1bd78416e1797b52e0e81c/setuptools-65.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.0 2024-12-17T10:59:34,526 Found link https://files.pythonhosted.org/packages/09/b6/33512596fb92ba68f7c45e9bbc5e1bb9b24fbd941f9aece250fb420c2f5c/setuptools-65.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.0 2024-12-17T10:59:34,528 Found link https://files.pythonhosted.org/packages/b2/0f/945bdfe5007ebd4a7ead88d8e95f6f1326d8f3ad206bbb5824b515c61dcd/setuptools-65.6.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.1 2024-12-17T10:59:34,529 Found link https://files.pythonhosted.org/packages/61/1f/3947ca9808e3a31d94afb775b774991721efcc0b96e2fe66e47e3a77a400/setuptools-65.6.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.1 2024-12-17T10:59:34,530 Found link https://files.pythonhosted.org/packages/45/0a/0d9b81fa11d177e057b7f761b367dc409077ffd7ba3dc46d79c78444961c/setuptools-65.6.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.2 2024-12-17T10:59:34,531 Found link https://files.pythonhosted.org/packages/f8/b8/fe1dfb94342906c65acfda3d8f35984c87e0511bf574942c22aed756d0f6/setuptools-65.6.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.2 2024-12-17T10:59:34,533 Found link https://files.pythonhosted.org/packages/ef/e3/29d6e1a07e8d90ace4a522d9689d03e833b67b50d1588e693eec15f26251/setuptools-65.6.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.3 2024-12-17T10:59:34,534 Found link https://files.pythonhosted.org/packages/b6/21/cb9a8d0b2c8597c83fce8e9c02884bce3d4951e41e807fc35791c6b23d9a/setuptools-65.6.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.3 2024-12-17T10:59:34,536 Found link https://files.pythonhosted.org/packages/ff/97/9dc902414912192d68364cc01cf17e826d259ef9753504b7ae1a256f2e35/setuptools-65.7.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.7.0 2024-12-17T10:59:34,537 Found link https://files.pythonhosted.org/packages/a1/29/f2ad3b78b9ebd24afa282eed9add27b47ef52b37291198021154b4b65166/setuptools-65.7.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 65.7.0 2024-12-17T10:59:34,538 Found link https://files.pythonhosted.org/packages/bd/ef/76cffd20061a0c6512dad4ba3537314904c6350738b99526c2f48992ff58/setuptools-66.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 66.0.0 2024-12-17T10:59:34,539 Found link https://files.pythonhosted.org/packages/67/ba/27235b9eebee2492fbf03ac1828a997d3d686031445d491f9cfa36a7085e/setuptools-66.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 66.0.0 2024-12-17T10:59:34,541 Found link https://files.pythonhosted.org/packages/c5/94/00e3d21daa5a47c4f13d278ff08c1b3dbd167231e4a1c4b2c99e4616790e/setuptools-66.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 66.1.0 2024-12-17T10:59:34,542 Found link https://files.pythonhosted.org/packages/34/4d/5c3547ed1dd4cb8623ec6843a49a6a0598b37ec5358551e84b97bc4f5ee8/setuptools-66.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 66.1.0 2024-12-17T10:59:34,543 Found link https://files.pythonhosted.org/packages/c2/8b/abb577ca6ab2c71814d535b1ed1464c5f4aaefe1a31bbeb85013eb9b2401/setuptools-66.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 66.1.1 2024-12-17T10:59:34,544 Found link https://files.pythonhosted.org/packages/3c/7b/00030a938499c8f8345be02ab5b7d748d359ea59c2f020b7b0a21b82f832/setuptools-66.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 66.1.1 2024-12-17T10:59:34,546 Found link https://files.pythonhosted.org/packages/bf/27/969c914650fdf0d08b0b92bdbddfc08bea9df6d86aeefd75ba4730f50bc9/setuptools-67.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.0.0 2024-12-17T10:59:34,547 Found link https://files.pythonhosted.org/packages/fe/db/68d856066c59bd9f05e827c3cf80164d870b8b6af37dc5ad6c87a71d20f2/setuptools-67.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.0.0 2024-12-17T10:59:34,548 Found link https://files.pythonhosted.org/packages/c8/24/157fed9a57108b3e1b6ccd86e95823327f231ef12464b0eca13650eb33ac/setuptools-67.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.1.0 2024-12-17T10:59:34,550 Found link https://files.pythonhosted.org/packages/bf/7c/3a0bb8db53f6b6dec4cb162d307cc5d37162dee65458b2be42817de30fda/setuptools-67.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.1.0 2024-12-17T10:59:34,551 Found link https://files.pythonhosted.org/packages/34/6a/d89fe6b83a7fa4c39686d8a5cda83b48da0b117a13484f0e294c2cc2c337/setuptools-67.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.2.0 2024-12-17T10:59:34,552 Found link https://files.pythonhosted.org/packages/5f/36/7374297692bb9dbd7569a0f84887c7e5e314c41d5d9518cb76fbb130620d/setuptools-67.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.2.0 2024-12-17T10:59:34,554 Found link https://files.pythonhosted.org/packages/87/24/947bdd86115a19054af1c2cdca844340f7e49c5bba0dd82d9b3a4c4061ab/setuptools-67.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.1 2024-12-17T10:59:34,555 Found link https://files.pythonhosted.org/packages/9f/48/c22cae4aa8f5ed6a64fd9d5be995b740230abab7affa31176af34a6e56ce/setuptools-67.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.1 2024-12-17T10:59:34,556 Found link https://files.pythonhosted.org/packages/86/7b/f35d72b7a6acbc27732e88d7ceb7f224b3e0683bf645e1c9e2ac2cd96c0d/setuptools-67.3.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.2 2024-12-17T10:59:34,557 Found link https://files.pythonhosted.org/packages/a3/56/f49e7877e8d8a09faaeecde5ca61169e9cfd46d014def474daa31bf217ca/setuptools-67.3.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.2 2024-12-17T10:59:34,559 Found link https://files.pythonhosted.org/packages/cf/c4/76600761f528b66389955ca299049c8414152712825bb8200eb855d82e89/setuptools-67.3.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.3 2024-12-17T10:59:34,560 Found link https://files.pythonhosted.org/packages/d6/6f/9d257b50d60f67d0b54b88fb39d4a9bade8406d4a926da3e4f05bf04f38b/setuptools-67.3.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.3 2024-12-17T10:59:34,561 Found link https://files.pythonhosted.org/packages/2c/3a/e0340041dad00234d1fe569ed55b602d24eb11a4939b0a2ec844e970a87d/setuptools-67.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.4.0 2024-12-17T10:59:34,563 Found link https://files.pythonhosted.org/packages/fe/31/2c88d37d4f8036c6648745e74ec51f73a6ba945a06e069601900f81fe00a/setuptools-67.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.4.0 2024-12-17T10:59:34,564 Found link https://files.pythonhosted.org/packages/f8/1e/9f5d850734b5acb29b7616b9faa1b59ab6dd159b53b36d305abb8eb416e2/setuptools-67.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.5.0 2024-12-17T10:59:34,565 Found link https://files.pythonhosted.org/packages/1c/d2/03de0cd0d9b8c45a014da08a74419350c127b7c87b794c08d4af1549988c/setuptools-67.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.5.0 2024-12-17T10:59:34,566 Found link https://files.pythonhosted.org/packages/99/02/d6ac140d446e939959e80b7e0c55774fa7a22376847ff5fe191674fd1862/setuptools-67.5.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.5.1 2024-12-17T10:59:34,568 Found link https://files.pythonhosted.org/packages/a4/3a/d60ed296ff8bbc6157ce818765c4c02df8b02fe70c310b7d29127962c5ae/setuptools-67.5.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.5.1 2024-12-17T10:59:34,569 Found link https://files.pythonhosted.org/packages/c3/9e/8a7ba2c9984a060daa6c6f9fff4d576b7ace3936239d6b771541eab972ed/setuptools-67.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.6.0 2024-12-17T10:59:34,570 Found link https://files.pythonhosted.org/packages/25/f3/d68c20919bc774c6cb127f1762f2f2f999d700a58198556e883dd3700e58/setuptools-67.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.6.0 2024-12-17T10:59:34,572 Found link https://files.pythonhosted.org/packages/0b/fc/8781442def77b0aa22f63f266d4dadd486ebc0c5371d6290caf4320da4b7/setuptools-67.6.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.6.1 2024-12-17T10:59:34,573 Found link https://files.pythonhosted.org/packages/cb/46/22ec35f286a77e6b94adf81b4f0d59f402ed981d4251df0ba7b992299146/setuptools-67.6.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.6.1 2024-12-17T10:59:34,574 Found link https://files.pythonhosted.org/packages/17/76/1c4a5644126f4fa9ebf27ae9c353d8068b08d20c171389995134467e2ca7/setuptools-67.7.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.0 2024-12-17T10:59:34,576 Found link https://files.pythonhosted.org/packages/68/86/d82a2a8f3f63f0dad4cb287dbae0cac178efb6267b07e0aef8b072866032/setuptools-67.7.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.0 2024-12-17T10:59:34,577 Found link https://files.pythonhosted.org/packages/47/6a/dfaf9838b6dd1f04537c0a66cf880dd24acd829f8a39d468c11fc0b7d8c6/setuptools-67.7.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.1 2024-12-17T10:59:34,578 Found link https://files.pythonhosted.org/packages/01/18/73f7ca619f72b22300493451350214d3a035e7fa8f17ce31db2da24fe0c9/setuptools-67.7.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.1 2024-12-17T10:59:34,579 Found link https://files.pythonhosted.org/packages/2f/8c/f336a966d4097c7cef6fc699b2ecb83b5fb63fd698198c1b5c7905a74f0f/setuptools-67.7.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.2 2024-12-17T10:59:34,581 Found link https://files.pythonhosted.org/packages/fd/53/e5d7ae40d03e4ed20b7cba317cf9c0c97097c8debb39f9d72d182a6578a2/setuptools-67.7.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.2 2024-12-17T10:59:34,582 Found link https://files.pythonhosted.org/packages/f5/2c/074ab1c5be9c7d523d8d6d69d1f46f450fe7f11713147dc9e779aa4ca4ea/setuptools-67.8.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.8.0 2024-12-17T10:59:34,583 Found link https://files.pythonhosted.org/packages/03/20/630783571e76e5fa5f3e9f29398ca3ace377207b8196b54e0ffdf09f12c1/setuptools-67.8.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 67.8.0 2024-12-17T10:59:34,585 Found link https://files.pythonhosted.org/packages/c7/42/be1c7bbdd83e1bfb160c94b9cafd8e25efc7400346cf7ccdbdb452c467fa/setuptools-68.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 68.0.0 2024-12-17T10:59:34,586 Found link https://files.pythonhosted.org/packages/dc/98/5f896af066c128669229ff1aa81553ac14cfb3e5e74b6b44594132b8540e/setuptools-68.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.7), version: 68.0.0 2024-12-17T10:59:34,587 Found link https://files.pythonhosted.org/packages/b8/49/b3b29c52b09075fb77f69309763a563b4054d5808a3f3b95df3a62ef3d3f/setuptools-68.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.1.0 2024-12-17T10:59:34,588 Found link https://files.pythonhosted.org/packages/83/b0/18310b45f6eec3757c0554dbc1e03f2f7685c8a87831aea6adc1276faacc/setuptools-68.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.1.0 2024-12-17T10:59:34,590 Found link https://files.pythonhosted.org/packages/4f/ab/0bcfebdfc3bfa8554b2b2c97a555569c4c1ebc74ea288741ea8326c51906/setuptools-68.1.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.1.2 2024-12-17T10:59:34,591 Found link https://files.pythonhosted.org/packages/19/20/d8dd9d8becaf3e2d6fdc17cc41870d5ada5ceda518996cf5968c2ca71bd8/setuptools-68.1.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.1.2 2024-12-17T10:59:34,592 Found link https://files.pythonhosted.org/packages/82/3b/0715493246eb08e93506f4da0efe1d05a3c9d9ac3b76e97cc362890e6adf/setuptools-68.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.0 2024-12-17T10:59:34,594 Found link https://files.pythonhosted.org/packages/ac/e0/4ccbb616e5f30d3595fa44ccc66ba5ac38e68885bcd888916d39f8ba480a/setuptools-68.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.0 2024-12-17T10:59:34,595 Found link https://files.pythonhosted.org/packages/95/79/6b47c6a872b40743a480687dc0c79ffb4202710789f3e4d54a84fff8b550/setuptools-68.2.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.1 2024-12-17T10:59:34,596 Found link https://files.pythonhosted.org/packages/e9/37/c6a6eb1ebeea919e4f394d811f234322d8a99eb58d5ee0f6089dbf06c488/setuptools-68.2.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.1 2024-12-17T10:59:34,598 Found link https://files.pythonhosted.org/packages/bb/26/7945080113158354380a12ce26873dd6c1ebd88d47f5bc24e2c5bb38c16a/setuptools-68.2.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.2 2024-12-17T10:59:34,599 Found link https://files.pythonhosted.org/packages/ef/cc/93f7213b2ab5ed383f98ce8020e632ef256b406b8569606c3f160ed8e1c9/setuptools-68.2.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.2 2024-12-17T10:59:34,600 Found link https://files.pythonhosted.org/packages/0f/93/daae527a7ad3ea3a4f7d84d05fd74b7cc637360a7e7b4df1df9a5046be17/setuptools-69.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.0 2024-12-17T10:59:34,602 Found link https://files.pythonhosted.org/packages/91/43/4121cf96ed3a2d68d862663552d8044e1d987d716b6a065ab53cd4d4640f/setuptools-69.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.0 2024-12-17T10:59:34,603 Found link https://files.pythonhosted.org/packages/f9/59/701df637517d6af0434cbb580bfc35a9c536aa7f47e0c2e222f1ef83547c/setuptools-69.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.1 2024-12-17T10:59:34,604 Found link https://files.pythonhosted.org/packages/fb/d0/d5744a7190a984ab728c7d2bd7e39bae2ff523538b233246fd34e2148566/setuptools-69.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.1 2024-12-17T10:59:34,606 Found link https://files.pythonhosted.org/packages/bb/e1/ed2dd0850446b8697ad28d118df885ad04140c64ace06c4bd559f7c8a94f/setuptools-69.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.2 2024-12-17T10:59:34,607 Found link https://files.pythonhosted.org/packages/4b/d9/d0cf66484b7e28a9c42db7e3929caed46f8b80478cd8c9bd38b7be059150/setuptools-69.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.2 2024-12-17T10:59:34,608 Found link https://files.pythonhosted.org/packages/55/3a/5121b58b578a598b269537e09a316ad2a94fdd561a2c6eb75cd68578cc6b/setuptools-69.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.3 2024-12-17T10:59:34,609 Found link https://files.pythonhosted.org/packages/fc/c9/b146ca195403e0182a374e0ea4dbc69136bad3cd55bc293df496d625d0f7/setuptools-69.0.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.3 2024-12-17T10:59:34,611 Found link https://files.pythonhosted.org/packages/bb/0a/203797141ec9727344c7649f6d5f6cf71b89a6c28f8f55d4f18de7a1d352/setuptools-69.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.1.0 2024-12-17T10:59:34,612 Found link https://files.pythonhosted.org/packages/c9/3d/74c56f1c9efd7353807f8f5fa22adccdba99dc72f34311c30a69627a0fad/setuptools-69.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.1.0 2024-12-17T10:59:34,613 Found link https://files.pythonhosted.org/packages/c0/7a/3da654f49c95d0cc6e9549a855b5818e66a917e852ec608e77550c8dc08b/setuptools-69.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.1.1 2024-12-17T10:59:34,615 Found link https://files.pythonhosted.org/packages/c8/1f/e026746e5885a83e1af99002ae63650b7c577af5c424d4c27edcf729ab44/setuptools-69.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.1.1 2024-12-17T10:59:34,616 Found link https://files.pythonhosted.org/packages/92/e1/1c8bb3420105e70bdf357d57dd5567202b4ef8d27f810e98bb962d950834/setuptools-69.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.2.0 2024-12-17T10:59:34,617 Found link https://files.pythonhosted.org/packages/4d/5b/dc575711b6b8f2f866131a40d053e30e962e633b332acf7cd2c24843d83d/setuptools-69.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.2.0 2024-12-17T10:59:34,619 Found link https://files.pythonhosted.org/packages/9a/4b/7b8a217633a4eda8fdf06233a38804adf3c281287728daddef031d15b635/setuptools-69.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.3.0 2024-12-17T10:59:34,620 Found link https://files.pythonhosted.org/packages/5f/dd/50c569f342bc5d22142e2fc5fab1822d256202f404a384f05541f703f2ff/setuptools-69.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.3 2024-12-17T10:59:34,621 Found link https://files.pythonhosted.org/packages/44/d5/f4be34fee66db92c97ad44589dcc939fabaf63520fc47a575576c46e93c1/setuptools-69.3.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.3.1 2024-12-17T10:59:34,622 Found link https://files.pythonhosted.org/packages/43/10/240651b2ba22f3efe75468437350b8ce4ec8ef03243dc8ed92971c2d4343/setuptools-69.3.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.3.1 2024-12-17T10:59:34,624 Found link https://files.pythonhosted.org/packages/cf/2e/988b6fb453899ed638bd99a48f97c3fb57897b8c6b83e439ad781733ef7d/setuptools-69.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.0 2024-12-17T10:59:34,625 Found link https://files.pythonhosted.org/packages/7a/12/dc02a2401dac87cb2d3ea8d3b23eab30db4cd2948d5b048bf912b9fe959a/setuptools-69.4.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4 2024-12-17T10:59:34,626 Found link https://files.pythonhosted.org/packages/2e/86/de057c6e64a115bbbfbef676b6410f206d3994ea43d08015e8ae4803fb2a/setuptools-69.4.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.1 2024-12-17T10:59:34,628 Found link https://files.pythonhosted.org/packages/16/ee/02117b0fd589be4ec35883f58fcfd647ac9ab765e8aaa1ededfda1dc79ce/setuptools-69.4.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.1 2024-12-17T10:59:34,629 Found link https://files.pythonhosted.org/packages/3f/f8/c2a873f02af7ab6ce670e47816d7cfbbaed5fa259cec4210797395c34616/setuptools-69.4.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.2 2024-12-17T10:59:34,630 Found link https://files.pythonhosted.org/packages/8e/26/26c3359c930147a6b745a03c608b9e2a71a05119d38279fdb40d981e9097/setuptools-69.4.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.2 2024-12-17T10:59:34,632 Found link https://files.pythonhosted.org/packages/9a/dd/5be5c6958d2d8fccf26b0274303f2c960a0eba88b84980e71e6f795cdd87/setuptools-69.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.5.0 2024-12-17T10:59:34,633 Found link https://files.pythonhosted.org/packages/76/6c/a1e240d85b63e04b2f6786a39e32ea78ad9ec7a9e8193b5510b63b5add94/setuptools-69.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.5.0 2024-12-17T10:59:34,634 Found link https://files.pythonhosted.org/packages/f7/29/13965af254e3373bceae8fb9a0e6ea0d0e571171b80d6646932131d6439b/setuptools-69.5.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.5.1 2024-12-17T10:59:34,636 Found link https://files.pythonhosted.org/packages/d6/4f/b10f707e14ef7de524fe1f8988a294fb262a29c9b5b12275c7e188864aed/setuptools-69.5.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 69.5.1 2024-12-17T10:59:34,637 Found link https://files.pythonhosted.org/packages/de/88/70c5767a0e43eb4451c2200f07d042a4bcd7639276003a9c54a68cfcc1f8/setuptools-70.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.0.0 2024-12-17T10:59:34,638 Found link https://files.pythonhosted.org/packages/aa/60/5db2249526c9b453c5bb8b9f6965fcab0ddb7f40ad734420b3b421f7da44/setuptools-70.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.0.0 2024-12-17T10:59:34,639 Found link https://files.pythonhosted.org/packages/55/b3/b3a3415d2debd837106ed417f8681d8af63037fed367fa1b85dbfef081f1/setuptools-70.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.1.0 2024-12-17T10:59:34,641 Found link https://files.pythonhosted.org/packages/1c/1c/8a56622f2fc9ebb0df743373ef1a96c8e20410350d12f44ef03c588318c3/setuptools-70.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.1.0 2024-12-17T10:59:34,642 Found link https://files.pythonhosted.org/packages/b3/7a/629889a5d76200287aa5483d753811bd247bbd1b03175186f759e0c7d3a7/setuptools-70.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.1.1 2024-12-17T10:59:34,643 Found link https://files.pythonhosted.org/packages/0d/9d/c587bea18a7e40099857015baee4cece7aca32cd404af953bdeb95ac8e47/setuptools-70.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.1.1 2024-12-17T10:59:34,644 Found link https://files.pythonhosted.org/packages/42/54/2a8ecfcc9a714a6fbf86559a4b0f50b126a4ac4269ea8134f2c75c3e73de/setuptools-70.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.2.0 2024-12-17T10:59:34,646 Found link https://files.pythonhosted.org/packages/8d/e6/2fc95aec377988ff3ca882aa58d4f6ab35ff59a12b1611a9fe3075eb3019/setuptools-70.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.2.0 2024-12-17T10:59:34,647 Found link https://files.pythonhosted.org/packages/ef/15/88e46eb9387e905704b69849618e699dc2f54407d8953cc4ec4b8b46528d/setuptools-70.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.3.0 2024-12-17T10:59:34,648 Found link https://files.pythonhosted.org/packages/65/d8/10a70e86f6c28ae59f101a9de6d77bf70f147180fbf40c3af0f64080adc3/setuptools-70.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 70.3.0 2024-12-17T10:59:34,650 Found link https://files.pythonhosted.org/packages/01/82/a2c6c0a1612c89bdb21dc4d9196ba9e7dcbc2e285afda93ebdf663ba2ada/setuptools-71.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.0 2024-12-17T10:59:34,651 Found link https://files.pythonhosted.org/packages/32/37/8751819aebb61ff15cc438e9d80d7b32d6cef4f266a1145a7037cbbfd693/setuptools-71.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.0 2024-12-17T10:59:34,652 Found link https://files.pythonhosted.org/packages/39/11/6159cc30f99dbdccac3c74d67277505d0e0bfc059e6cc57ef2eefc9b8751/setuptools-71.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.1 2024-12-17T10:59:34,654 Found link https://files.pythonhosted.org/packages/55/a2/640f943c98800be626d5e4d48070e35bb891733218cf6ce562a8df53b9af/setuptools-71.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.1 2024-12-17T10:59:34,655 Found link https://files.pythonhosted.org/packages/ed/d0/0994fa8fed8eb3c1d4c151e650f87d3e2a9aedb6aaf1aebe8dbf018f984c/setuptools-71.0.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.2 2024-12-17T10:59:34,656 Found link https://files.pythonhosted.org/packages/0e/ae/4a643fdc3b2fe390a6accd55117d5c5af9fbe5da7d2d300c8dd52aa35555/setuptools-71.0.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.2 2024-12-17T10:59:34,658 Found link https://files.pythonhosted.org/packages/32/10/e72bb221cdd2f11e649cf38bd7ba8ea6d527c77f330366e10ae9bb798730/setuptools-71.0.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.3 2024-12-17T10:59:34,659 Found link https://files.pythonhosted.org/packages/d1/8e/1d0b941ce1151009c6d98a0a590a608f346d4d272ce95ca09ee2bbb592cd/setuptools-71.0.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.3 2024-12-17T10:59:34,660 Found link https://files.pythonhosted.org/packages/d2/93/40d9bd9c7cf5d5e556894cc2a2c492e6e4ef4eda6ce9806bd1a8c47ae351/setuptools-71.0.4-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.4 2024-12-17T10:59:34,661 Found link https://files.pythonhosted.org/packages/b2/9b/c154d7694227ff8f5ee5bdff2f8cf8a529ba8f53e80806dd984737c59b19/setuptools-71.0.4.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.4 2024-12-17T10:59:34,663 Found link https://files.pythonhosted.org/packages/51/a0/ee460cc54e68afcf33190d198299c9579a5eafeadef0016ae8563237ccb6/setuptools-71.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.1.0 2024-12-17T10:59:34,664 Found link https://files.pythonhosted.org/packages/32/c0/5b8013b5a812701c72e3b1e2b378edaa6514d06bee6704a5ab0d7fa52931/setuptools-71.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 71.1.0 2024-12-17T10:59:34,665 Found link https://files.pythonhosted.org/packages/2f/83/06edd551b4fdf6170dcbafeeed588a8909819e943905c182ebdc98835be8/setuptools-72.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 72.0.0 2024-12-17T10:59:34,666 Found link https://files.pythonhosted.org/packages/8a/8b/ae50f468cdd5e1dc6e6969397bb76e75ca0fd39f7ab8e5a6e8b58ea7102f/setuptools-72.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 72.0.0 2024-12-17T10:59:34,668 Found link https://files.pythonhosted.org/packages/e1/58/e0ef3b9974a04ce9cde2a7a33881ddcb2d68450803745804545cdd8d258f/setuptools-72.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 72.1.0 2024-12-17T10:59:34,669 Found link https://files.pythonhosted.org/packages/5e/11/487b18cc768e2ae25a919f230417983c8d5afa1b6ee0abd8b6db0b89fa1d/setuptools-72.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 72.1.0 2024-12-17T10:59:34,670 Found link https://files.pythonhosted.org/packages/6e/ec/06715d912351edc453e37f93f3fc80dcffd5ca0e70386c87529aca296f05/setuptools-72.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 72.2.0 2024-12-17T10:59:34,672 Found link https://files.pythonhosted.org/packages/ce/ef/013ded5b0d259f3fa636bf35de186f0061c09fbe124020ce6b8db68c83af/setuptools-72.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 72.2.0 2024-12-17T10:59:34,673 Found link https://files.pythonhosted.org/packages/09/e3/93b516fab8b8f420acc7bb75e29759d009df26c093d8de1c70993b13bf25/setuptools-73.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 73.0.0 2024-12-17T10:59:34,674 Found link https://files.pythonhosted.org/packages/98/0b/56dabcf2b37d9152090bcd5d42e28ad312c9ba54fb1446b22dcc809dd84a/setuptools-73.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 73.0.0 2024-12-17T10:59:34,676 Found link https://files.pythonhosted.org/packages/07/6a/0270e295bf30c37567736b7fca10167640898214ff911273af37ddb95770/setuptools-73.0.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 73.0.1 2024-12-17T10:59:34,677 Found link https://files.pythonhosted.org/packages/8d/37/f4d4ce9bc15e61edba3179f9b0f763fc6d439474d28511b11f0d95bab7a2/setuptools-73.0.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 73.0.1 2024-12-17T10:59:34,678 Found link https://files.pythonhosted.org/packages/df/b5/168cec9a10bf93b60b8f9af7f4e61d526e31e1aad8b9be0e30837746d700/setuptools-74.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.0.0 2024-12-17T10:59:34,680 Found link https://files.pythonhosted.org/packages/6a/21/8fd457d5a979109603e0e460c73177c3a9b6b7abcd136d0146156da95895/setuptools-74.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.0.0 2024-12-17T10:59:34,681 Found link https://files.pythonhosted.org/packages/f1/2e/19fefb8477d869bd1d09466542a38410f53288c946046342066cf2905b72/setuptools-74.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.0 2024-12-17T10:59:34,682 Found link https://files.pythonhosted.org/packages/ac/11/0a953274017ca5c33a9831bc5e052e825d174a3551bd18924777794c8162/setuptools-74.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.0 2024-12-17T10:59:34,683 Found link https://files.pythonhosted.org/packages/48/f3/e30ee63caefa90716afdffd7d9ae959cd8d0dbd2d0a0eb9fe1d73ddf806b/setuptools-74.1.1-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.1 2024-12-17T10:59:34,685 Found link https://files.pythonhosted.org/packages/27/cb/e754933c1ca726b0d99980612dc9da2886e76c83968c246cfb50f491a96b/setuptools-74.1.1.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.1 2024-12-17T10:59:34,686 Found link https://files.pythonhosted.org/packages/cb/9c/9ad11ac06b97e55ada655f8a6bea9d1d3f06e120b178cd578d80e558191d/setuptools-74.1.2-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.2 2024-12-17T10:59:34,687 Found link https://files.pythonhosted.org/packages/3e/2c/f0a538a2f91ce633a78daaeb34cbfb93a54bd2132a6de1f6cec028eee6ef/setuptools-74.1.2.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.2 2024-12-17T10:59:34,688 Found link https://files.pythonhosted.org/packages/14/37/166aba5a70924e574eb0aec9f7ec227ac0d7ae72dd2f823675365172120d/setuptools-74.1.3-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.3 2024-12-17T10:59:34,690 Found link https://files.pythonhosted.org/packages/cd/01/e30d66bbb6403b7d41ac1ac0e3c51727c5e8f3558d8f9a9efe4282e90308/setuptools-74.1.3.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.3 2024-12-17T10:59:34,691 Found link https://files.pythonhosted.org/packages/8e/69/f90971743a7cc451b93be8f5eb60b7e506896b7e81e6be6272858b2a9d46/setuptools-75.0.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.0.0 2024-12-17T10:59:34,692 Found link https://files.pythonhosted.org/packages/a7/17/133e1cd1e24373e1898ca3c7330f5c385b46c7091f0451e678f37245591b/setuptools-75.0.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.0.0 2024-12-17T10:59:34,694 Found link https://files.pythonhosted.org/packages/ff/ae/f19306b5a221f6a436d8f2238d5b80925004093fa3edea59835b514d9057/setuptools-75.1.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.1.0 2024-12-17T10:59:34,695 Found link https://files.pythonhosted.org/packages/27/b8/f21073fde99492b33ca357876430822e4800cdf522011f18041351dfa74b/setuptools-75.1.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.1.0 2024-12-17T10:59:34,696 Found link https://files.pythonhosted.org/packages/31/2d/90165d51ecd38f9a02c6832198c13a4e48652485e2ccf863ebb942c531b6/setuptools-75.2.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.2.0 2024-12-17T10:59:34,698 Found link https://files.pythonhosted.org/packages/07/37/b31be7e4b9f13b59cde9dcaeff112d401d49e0dc5b37ed4a9fc8fb12f409/setuptools-75.2.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.2.0 2024-12-17T10:59:34,699 Found link https://files.pythonhosted.org/packages/90/12/282ee9bce8b58130cb762fbc9beabd531549952cac11fc56add11dcb7ea0/setuptools-75.3.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.3.0 2024-12-17T10:59:34,700 Found link https://files.pythonhosted.org/packages/ed/22/a438e0caa4576f8c383fa4d35f1cc01655a46c75be358960d815bfbb12bd/setuptools-75.3.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.8), version: 75.3.0 2024-12-17T10:59:34,701 Found link https://files.pythonhosted.org/packages/21/df/7c6bb83dcb45b35dc35b310d752f254211cde0bcd2a35290ea6e2862b2a9/setuptools-75.4.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.4.0 2024-12-17T10:59:34,703 Found link https://files.pythonhosted.org/packages/e2/73/c1ccf3e057ef6331cc6861412905dc218203bde46dfe8262c1631aa7fb11/setuptools-75.4.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.4.0 2024-12-17T10:59:34,704 Found link https://files.pythonhosted.org/packages/fe/df/88ccbee85aefbca071db004fdc8f8d2507d55d5a9dc27ebb93c92edb1bd8/setuptools-75.5.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.5.0 2024-12-17T10:59:34,705 Found link https://files.pythonhosted.org/packages/c8/db/722a42ffdc226e950c4757b3da7b56ff5c090bb265dccd707f7b8a3c6fee/setuptools-75.5.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.5.0 2024-12-17T10:59:34,707 Found link https://files.pythonhosted.org/packages/55/21/47d163f615df1d30c094f6c8bbb353619274edccf0327b185cc2493c2c33/setuptools-75.6.0-py3-none-any.whl (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.6.0 2024-12-17T10:59:34,708 Found link https://files.pythonhosted.org/packages/43/54/292f26c208734e9a7f067aea4a7e282c080750c4546559b58e2e45413ca0/setuptools-75.6.0.tar.gz (from https://pypi.org/simple/setuptools/) (requires-python:>=3.9), version: 75.6.0 2024-12-17T10:59:34,710 Fetching project page and analyzing links: https://www.piwheels.org/simple/setuptools/ 2024-12-17T10:59:34,711 Getting page https://www.piwheels.org/simple/setuptools/ 2024-12-17T10:59:34,712 Found index url https://www.piwheels.org/simple/ 2024-12-17T10:59:34,714 Looking up "https://www.piwheels.org/simple/setuptools/" in the cache 2024-12-17T10:59:34,714 Request header has "max_age" as 0, cache bypassed 2024-12-17T10:59:34,719 Starting new HTTPS connection (1): www.piwheels.org:443 2024-12-17T10:59:34,888 https://www.piwheels.org:443 "GET /simple/setuptools/ HTTP/1.1" 200 27121 2024-12-17T10:59:34,893 Updating cache with response from "https://www.piwheels.org/simple/setuptools/" 2024-12-17T10:59:34,894 etag object cached for 1209600 seconds 2024-12-17T10:59:34,895 Caching due to etag 2024-12-17T10:59:34,901 Fetched page https://www.piwheels.org/simple/setuptools/ as text/html 2024-12-17T10:59:35,043 Found link https://www.piwheels.org/simple/setuptools/setuptools-75.6.0-py3-none-any.whl#sha256=3b3008f2ed24323391b703117a8029399121f9c97f5ca9ac3ab2082e508f9e7c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 75.6.0 2024-12-17T10:59:35,044 Found link https://www.piwheels.org/simple/setuptools/setuptools-75.5.0-py3-none-any.whl#sha256=67888d86072f29091e65eed27758c12aa965d11b989107f62822a8beb3a4ca75 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 75.5.0 2024-12-17T10:59:35,045 Found link https://www.piwheels.org/simple/setuptools/setuptools-75.4.0-py3-none-any.whl#sha256=705652fd13a759bb3ef1f3248d0b3b2ecf5b9b6cea7e2373ce812ffb82b3e913 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.9), version: 75.4.0 2024-12-17T10:59:35,047 Found link https://www.piwheels.org/simple/setuptools/setuptools-75.3.0-py3-none-any.whl#sha256=3f56facc65e6ab888f2efb59bc8edc3a469d88721f7c7e6d09eeca5a42b72399 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 75.3.0 2024-12-17T10:59:35,049 Found link https://www.piwheels.org/simple/setuptools/setuptools-75.2.0-py3-none-any.whl#sha256=aebdaff49fd7fba199ed9d0f21676b753b2164a0a3ac7e7f6ac90dc4cbadb056 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 75.2.0 2024-12-17T10:59:35,050 Found link https://www.piwheels.org/simple/setuptools/setuptools-75.1.0-py3-none-any.whl#sha256=8d32e2f72308958f2609687a4278931d414ce02ddce193c6d725808d6634b084 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 75.1.0 2024-12-17T10:59:35,052 Found link https://www.piwheels.org/simple/setuptools/setuptools-75.0.0-py3-none-any.whl#sha256=7da87ff4c1a1b0630cb66e3cf15b782e725eac59ea8d1555d57ed78e86a72066 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 75.0.0 2024-12-17T10:59:35,053 Found link https://www.piwheels.org/simple/setuptools/setuptools-74.1.3-py3-none-any.whl#sha256=db1e7b6b298f056e87ace5154d0cc76d438eddeda7350550b5cf4dcaa005a1c7 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.3 2024-12-17T10:59:35,055 Found link https://www.piwheels.org/simple/setuptools/setuptools-74.1.2-py3-none-any.whl#sha256=c1717712ec78b05605032dfc135b09e78095037e7f42777c5ca379c541f6ef67 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.2 2024-12-17T10:59:35,056 Found link https://www.piwheels.org/simple/setuptools/setuptools-74.1.1-py3-none-any.whl#sha256=8c5b1e50d573c6eaa4322765fa682dbeb03c932233a70ff150089efc3d1ace91 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.1 2024-12-17T10:59:35,057 Found link https://www.piwheels.org/simple/setuptools/setuptools-74.1.0-py3-none-any.whl#sha256=c7a717e6746d74148a607ca82ddb89a0162fb3760bf10b9c8f2433adeb5dd653 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 74.1.0 2024-12-17T10:59:35,059 Found link https://www.piwheels.org/simple/setuptools/setuptools-74.0.0-py3-none-any.whl#sha256=fbb38813927e76df332aec1df8166e93993dbb28caa5c573e49332250b59b514 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 74.0.0 2024-12-17T10:59:35,060 Found link https://www.piwheels.org/simple/setuptools/setuptools-73.0.1-py3-none-any.whl#sha256=35c334b2ea49061b8b59f65baefe7eb78ecec78e23f5da628535e69893175c10 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 73.0.1 2024-12-17T10:59:35,062 Found link https://www.piwheels.org/simple/setuptools/setuptools-73.0.0-py3-none-any.whl#sha256=b7380b457e1f5940fccbe7a961cedb06e1de1abaac9119b17ad5e0a989c56778 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 73.0.0 2024-12-17T10:59:35,063 Found link https://www.piwheels.org/simple/setuptools/setuptools-72.2.0-py3-none-any.whl#sha256=8c98ae591e6ec049535c48a2b89691b9c2fd509aae376af8c22b6b5e13af92e0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 72.2.0 2024-12-17T10:59:35,065 Found link https://www.piwheels.org/simple/setuptools/setuptools-72.1.0-py3-none-any.whl#sha256=ef1aeae97fefcf6c3f9846fd7208c6259b759dc7bc68f8799a7289bfe05d9e86 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 72.1.0 2024-12-17T10:59:35,066 Found link https://www.piwheels.org/simple/setuptools/setuptools-72.0.0-py3-none-any.whl#sha256=3ccfb3ac604ec39dc0993d46b0e800f915c29d5471a1dbe78067b0570dc01af7 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 72.0.0 2024-12-17T10:59:35,068 Found link https://www.piwheels.org/simple/setuptools/setuptools-71.1.0-py3-none-any.whl#sha256=c606958cf2ecd5bdfb1fb48f24a8cb10248e97117c72af3885675df7471e1ad2 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 71.1.0 2024-12-17T10:59:35,070 Found link https://www.piwheels.org/simple/setuptools/setuptools-71.0.4-py3-none-any.whl#sha256=e14b598fa8fc722a3b68243ffc5b0464d034c7dd75471617086f4b899ddb7ee6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.4 2024-12-17T10:59:35,071 Found link https://www.piwheels.org/simple/setuptools/setuptools-71.0.3-py3-none-any.whl#sha256=b8f1570fb277c22e08268ae93908c3492c99dabb3a6b83a5c1ab4b6711ff920a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.3 2024-12-17T10:59:35,072 Found link https://www.piwheels.org/simple/setuptools/setuptools-71.0.2-py3-none-any.whl#sha256=2471774980010487516e5968bb004a8ddddd111b385b0886342a6a2ef99dd542 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.2 2024-12-17T10:59:35,074 Found link https://www.piwheels.org/simple/setuptools/setuptools-71.0.1-py3-none-any.whl#sha256=ef66aec820d3fc22d55fe8e8cbdaefc6c010636c13036ec568c82d9b746b53f1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.1 2024-12-17T10:59:35,075 Found link https://www.piwheels.org/simple/setuptools/setuptools-71.0.0-py3-none-any.whl#sha256=b4c56736158b35fb4867239458ff61421efaa263405bb7038e31ec7d5e0c06f7 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 71.0.0 2024-12-17T10:59:35,077 Found link https://www.piwheels.org/simple/setuptools/setuptools-70.3.0-py3-none-any.whl#sha256=3b17f8ad4b19cec9bdacfde99ed6530c4e9da921a41323bad8ee0098f843bdaf (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 70.3.0 2024-12-17T10:59:35,078 Found link https://www.piwheels.org/simple/setuptools/setuptools-70.2.0-py3-none-any.whl#sha256=b14e608024e29376e42ce47c916af02fe3007cf4e50969150676f2df55f7a124 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 70.2.0 2024-12-17T10:59:35,080 Found link https://www.piwheels.org/simple/setuptools/setuptools-70.1.1-py3-none-any.whl#sha256=22ab0d7b799b566fe06add0812f4d0cf9e74c3cfc16690f331f0f4b7fe5e0029 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 70.1.1 2024-12-17T10:59:35,081 Found link https://www.piwheels.org/simple/setuptools/setuptools-70.1.0-py3-none-any.whl#sha256=62c63878b01cfd61d365bfdf7862df588010ef5fb997afaa162c077f1567cfa3 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 70.1.0 2024-12-17T10:59:35,083 Found link https://www.piwheels.org/simple/setuptools/setuptools-70.0.0-py3-none-any.whl#sha256=37027def66f082d87279a1581910acd05d752735c48c7894e3b423c1d54715c9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 70.0.0 2024-12-17T10:59:35,084 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.5.1-py3-none-any.whl#sha256=a7097063ac8aae9f33f7d7758397ec86a8bf1b7baa1b893376485883eac4aa2b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.5.1 2024-12-17T10:59:35,086 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.5.0-py3-none-any.whl#sha256=7e508e59fcf57a01e36ebba5dc46842e453efd0abcae0f9dfb91399dc1f6ccb7 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.5.0 2024-12-17T10:59:35,087 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.4.2-py3-none-any.whl#sha256=ca55f9726d0a755da5a53bb058e6ec8ea1a15a41085bf081c63613d12f071d26 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.2 2024-12-17T10:59:35,089 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.4.1-py3-none-any.whl#sha256=3c580955a03c7fa132f7a3b2186b0572d9b7c77018811aaf7a3ccd606e250e12 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.1 2024-12-17T10:59:35,091 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.4.0-py3-none-any.whl#sha256=70e3afa31eb643e247c21f711562b990bdf22d1684caa311a8cdf71abb52200f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.4.0 2024-12-17T10:59:35,092 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.3.1-py3-none-any.whl#sha256=5823290f0feaba2b00a866bee4ced4324b4ce96258c4e3aaa86aaae42ddc2b99 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.3.1 2024-12-17T10:59:35,093 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.3.0-py3-none-any.whl#sha256=d9b24501058598b4655c531d67cde43a55d65dd1db0913dfaa3fef814606b466 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.3.0 2024-12-17T10:59:35,095 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.2.0-py3-none-any.whl#sha256=d279ffc6227266fdba425aa9742a3e6d0ba4dacfa2b1312f1b65ed3890082e6a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.2.0 2024-12-17T10:59:35,096 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.1.1-py3-none-any.whl#sha256=e80cddb27be3c47ed49d9f27cbe2316414fd14e5be5143f84f8f7d7b89402173 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.1.1 2024-12-17T10:59:35,098 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.1.0-py3-none-any.whl#sha256=0ae54af345d2e69f9bab0d7ef302ead7b2533a361619db78e98c952a35a0165f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.1.0 2024-12-17T10:59:35,099 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.0.3-py3-none-any.whl#sha256=55a27b1207ffd06fc72552920c9ea1ce81541b8b651ae406bf3d3bb153bf316f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.3 2024-12-17T10:59:35,101 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.0.2-py3-none-any.whl#sha256=3bc5ad43195a9eb1e8c3a2ebab28a9c3202db9d1f8e59b29971aa35abb3e0bfc (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.2 2024-12-17T10:59:35,102 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.0.1-py3-none-any.whl#sha256=9c4d043933771b03b0e86846a984b24281a40689d433f11691455b8bce7be14a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.1 2024-12-17T10:59:35,104 Found link https://www.piwheels.org/simple/setuptools/setuptools-69.0.0-py3-none-any.whl#sha256=7a44b57685847980bb37b08c098242577e0acb1a941ae1e01b6b42db9c9bc24b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 69.0.0 2024-12-17T10:59:35,105 Found link https://www.piwheels.org/simple/setuptools/setuptools-68.2.2-py3-none-any.whl#sha256=f0df733ea47683814b07dbe33306d759b45214648a1b5f03bdf033f43f653193 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.2 2024-12-17T10:59:35,107 Found link https://www.piwheels.org/simple/setuptools/setuptools-68.2.1-py3-none-any.whl#sha256=de31ae572b523d234b51ec033bb5a28a4636b450819ef59ff98866b0ea1283d5 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.1 2024-12-17T10:59:35,108 Found link https://www.piwheels.org/simple/setuptools/setuptools-68.2.0-py3-none-any.whl#sha256=21c44bd2b10d2e118de5c29f18cfc80305dcc5587cef781523ae9e08376d222a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 68.2.0 2024-12-17T10:59:35,110 Found link https://www.piwheels.org/simple/setuptools/setuptools-68.1.2-py3-none-any.whl#sha256=9e076b8e4f5535e0e67305a15e9eb418006751b9bf0bb8d0a367d09ad0adf3a1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 68.1.2 2024-12-17T10:59:35,111 Found link https://www.piwheels.org/simple/setuptools/setuptools-68.1.0-py3-none-any.whl#sha256=0637a8df7f9d79ffffa7010fdd3db5ca70836acda6994af5f7edb9524838aa23 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.8), version: 68.1.0 2024-12-17T10:59:35,113 Found link https://www.piwheels.org/simple/setuptools/setuptools-68.0.0-py3-none-any.whl#sha256=8c01015dfe356dcf94962ba8c870437b79e7c7b439cc8706190f0fc1d7595ec1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 68.0.0 2024-12-17T10:59:35,114 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.8.0-py3-none-any.whl#sha256=303b3c7de392e325625b35018195fc49c847a4d3d525dcf465e7ab891c2a9dab (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.8.0 2024-12-17T10:59:35,116 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.7.2-py3-none-any.whl#sha256=38313c1c1dc95bada2ed81cf05fc4dac288884d547e66865f2aaff6afa5c6256 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.2 2024-12-17T10:59:35,117 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.7.1-py3-none-any.whl#sha256=ec553575f60b6c86ab540dda4b08e04af907b4e8eef44857480e0f77f9ce4c70 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.1 2024-12-17T10:59:35,119 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.7.0-py3-none-any.whl#sha256=924ff064f0e1236ba70eebba688ac6303465e3f9c3518440f13b7f886b959785 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.7.0 2024-12-17T10:59:35,120 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.6.1-py3-none-any.whl#sha256=ae060e31efa47ebd031bdf444908164a9c54dbfe734c97afd5d8e52afbad723a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.6.1 2024-12-17T10:59:35,122 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.6.0-py3-none-any.whl#sha256=cf7b2327bdfd9bdbdab13c4633de611ecfaee72baadfde36d00683b47cefbb50 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.6.0 2024-12-17T10:59:35,123 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.5.1-py3-none-any.whl#sha256=0bc5663e192c983a1cdc2a9b0f048cf2fc2cf7e7a709032b3921aa804958884e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.5.1 2024-12-17T10:59:35,125 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.5.0-py3-none-any.whl#sha256=dfba5c5181e728ce87b236088260e3779d700a5dabeb22c6b85fd0395a63cf5a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.5.0 2024-12-17T10:59:35,126 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.4.0-py3-none-any.whl#sha256=a45e29e9bd6090eae5f86d1f0cd5f100ff116493604131fd919dc83c7a9a29e3 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.4.0 2024-12-17T10:59:35,127 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.3.3-py3-none-any.whl#sha256=b06abe490aa88b8b4fb41e886c286b6db453acd8589dc3bf794bd441317bf711 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.3 2024-12-17T10:59:35,129 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.3.2-py3-none-any.whl#sha256=fd35e968f165c0184e9f20420b2e301b8dd5e839e4884edd96e6a770cdbd6525 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.2 2024-12-17T10:59:35,130 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.3.1-py3-none-any.whl#sha256=78d8bc509762dfdd6f5bd096a543960d8eb9913875d7e50c79593f84ebea3518 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.3.1 2024-12-17T10:59:35,132 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.2.0-py3-none-any.whl#sha256=5cd4f6b868a5a5dc1074b06d43af1d61524a2774f2bde32af234142236fb5819 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.2.0 2024-12-17T10:59:35,134 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.1.0-py3-none-any.whl#sha256=8e12f43c46760f7743d74ca8a9b3b0a45cf95cef50ad740958fc084f391cabe8 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.1.0 2024-12-17T10:59:35,135 Found link https://www.piwheels.org/simple/setuptools/setuptools-67.0.0-py3-none-any.whl#sha256=111b43bda59bd9d87d8b1e4437a6d847e0a0e842e59005b7b399c8941a89c6c9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 67.0.0 2024-12-17T10:59:35,137 Found link https://www.piwheels.org/simple/setuptools/setuptools-66.1.1-py3-none-any.whl#sha256=845d2eb3d1e303745a3e2557c130aa5abba834dd6913be3657d1db6dec0ad06a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 66.1.1 2024-12-17T10:59:35,138 Found link https://www.piwheels.org/simple/setuptools/setuptools-66.1.0-py3-none-any.whl#sha256=d306ad7243f8ef8decb0769bd717893617c2e93e9a74a34eda22c8f789d5ff11 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 66.1.0 2024-12-17T10:59:35,139 Found link https://www.piwheels.org/simple/setuptools/setuptools-66.0.0-py3-none-any.whl#sha256=3ddef51d2ef82b1a084aad40047d6756cb0e98df10459c47dae93aa11eeb02e0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 66.0.0 2024-12-17T10:59:35,141 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.7.0-py3-none-any.whl#sha256=6de9315cd4b26897a25e4f4c377e43826c738c2aaa279f6f850406db542fc65b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.7.0 2024-12-17T10:59:35,142 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.6.3-py3-none-any.whl#sha256=ad515432e028cbf9bf9073ec89d24ca2cc6731522022b62d909e1312461977fd (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.3 2024-12-17T10:59:35,144 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.6.2-py3-none-any.whl#sha256=ce009b77629ef2d71f9c5f66752ba4cff23a3efdfa61974fa7f5d6876773e5ba (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.2 2024-12-17T10:59:35,146 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.6.1-py3-none-any.whl#sha256=14fd3094867f9b9b9add924e4ac0d7147ae1b58fa87bc5123874eef8c7b3b022 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.1 2024-12-17T10:59:35,147 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.6.0-py3-none-any.whl#sha256=b784e7f69dfd0c649dcdc7959618fa0796b3def39ade52ea6c9e2ed680e27c49 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.6.0 2024-12-17T10:59:35,149 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.5.1-py3-none-any.whl#sha256=5142de54f515d937b0989408c6b980e8ad5f50bad7c07aa32309c5c83f6606fc (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.5.1 2024-12-17T10:59:35,150 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.5.0-py3-none-any.whl#sha256=04857c3412f611c4f286e0be7cc372cf1174dcba5dc122beca133813e2e6ae6f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.5.0 2024-12-17T10:59:35,152 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.4.1-py3-none-any.whl#sha256=dedd3ff536626958f1723c8150f4ac12b5e973476eaf1bdad5fdf28268b9607d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.4.1 2024-12-17T10:59:35,153 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.4.0-py3-none-any.whl#sha256=907a376f73d880cf77245c549660cee1bf74aa69fb368df6c99869d5880f4c3a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.4.0 2024-12-17T10:59:35,155 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.3.0-py3-none-any.whl#sha256=d4921bf4a5242141989d842094e055a49641e1496040e23b028d8239df3c62fe (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.3.0 2024-12-17T10:59:35,156 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.2.0-py3-none-any.whl#sha256=f13beaf3a31bd6de991b65b3868758a57d5442f4d8b2bd74acad8ef6f7f66a26 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.2.0 2024-12-17T10:59:35,158 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.1.1-py3-none-any.whl#sha256=396ad2a204eaa1c522535fbe0857864760ba412a44504a2a7d46778358b6df44 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.1.1 2024-12-17T10:59:35,159 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.1.0-py3-none-any.whl#sha256=252a29fd5e070717fccffe1494c5fea023564a353be143247fb3401e17332fe9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.1.0 2024-12-17T10:59:35,160 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.0.2-py3-none-any.whl#sha256=5c084d9b55869bcb7c2939d1328413145357da96f36344b0dfe068ae45b51989 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.2 2024-12-17T10:59:35,162 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.0.1-py3-none-any.whl#sha256=8d85581843d74c553a0b1454f9d692b3de8ebd5416306fc027018086825c0cee (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.1 2024-12-17T10:59:35,163 Found link https://www.piwheels.org/simple/setuptools/setuptools-65.0.0-py3-none-any.whl#sha256=b9ef0377a0ec63d8e106343d7c136115f86e774fe0f5a9aba10dbdce970894ce (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 65.0.0 2024-12-17T10:59:35,164 Found link https://www.piwheels.org/simple/setuptools/setuptools-64.0.3-py3-none-any.whl#sha256=3dfd94364bfe7530a39b4421edd58693e8a17ea0368201459954474789630bd1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.3 2024-12-17T10:59:35,166 Found link https://www.piwheels.org/simple/setuptools/setuptools-64.0.2-py3-none-any.whl#sha256=6b731c76cb4a7359688613f77ddc7482f477916f381bfe90e625979d08db82a8 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.2 2024-12-17T10:59:35,167 Found link https://www.piwheels.org/simple/setuptools/setuptools-64.0.1-py3-none-any.whl#sha256=640386b48109ce3ad4b478b46a28238476507a43f19226f644f147f1c9235938 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.1 2024-12-17T10:59:35,168 Found link https://www.piwheels.org/simple/setuptools/setuptools-64.0.0-py3-none-any.whl#sha256=28f8efce8c1213978700b4931c14fe1d8667c5e7e08473c83d806845e0aa92bf (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 64.0.0 2024-12-17T10:59:35,170 Found link https://www.piwheels.org/simple/setuptools/setuptools-63.4.3-py3-none-any.whl#sha256=c86891e1e64a371c1851e969089039bfdd2f32d26cd249be165ba2514303a050 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.3 2024-12-17T10:59:35,171 Found link https://www.piwheels.org/simple/setuptools/setuptools-63.4.2-py3-none-any.whl#sha256=0ea0d5b13ac5e61ad533bd7561000c9d47357e4e06a20cbdb2e3e46eab3e7f6d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.2 2024-12-17T10:59:35,172 Found link https://www.piwheels.org/simple/setuptools/setuptools-63.4.1-py3-none-any.whl#sha256=dc3f7556da9048e44775e0bc09b0b6385db8d008ad16eb3b84abe105a5f3d89b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.1 2024-12-17T10:59:35,174 Found link https://www.piwheels.org/simple/setuptools/setuptools-63.4.0-py3-none-any.whl#sha256=4e149a2bf1bada168dc3ded5f4c9e5a555818b4aaa9210673168e79ab2d374a1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.4.0 2024-12-17T10:59:35,175 Found link https://www.piwheels.org/simple/setuptools/setuptools-63.3.0-py3-none-any.whl#sha256=f36d25ad984eed0506f3d7a21261eab18d72674edcc1c6772640a77e9edeeca1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.3.0 2024-12-17T10:59:35,177 Found link https://www.piwheels.org/simple/setuptools/setuptools-63.2.0-py3-none-any.whl#sha256=f52e972b9c0b6bfea416c7b29431a49a01307523063fcaa995823263d188531a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.2.0 2024-12-17T10:59:35,178 Found link https://www.piwheels.org/simple/setuptools/setuptools-63.1.0-py3-none-any.whl#sha256=39c0bbcad329e30ba00526a60aedd1e81dc7ad080179a815ec94c49c5a8e588b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.1.0 2024-12-17T10:59:35,179 Found link https://www.piwheels.org/simple/setuptools/setuptools-63.0.0-py3-none-any.whl#sha256=e12b84a34cc5b9d9416d03776608700af1778e82059eeb10271f0ffd2e11810b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.0.0 2024-12-17T10:59:35,180 Found link https://www.piwheels.org/simple/setuptools/setuptools-63.0.0b1-py3-none-any.whl#sha256=67625af0d6d1dcf48f99cedc838df8fb676ce12aab67ed33bcc99219f629850e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 63.0.0b1 2024-12-17T10:59:35,182 Found link https://www.piwheels.org/simple/setuptools/setuptools-62.6.0-py3-none-any.whl#sha256=44a1be236d6775c1c2ccb2dab1c7a8a38f155a0e8c705e5dbeb395985e7e7b23 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.6.0 2024-12-17T10:59:35,183 Found link https://www.piwheels.org/simple/setuptools/setuptools-62.5.0-py3-none-any.whl#sha256=99779f6035f17d8d20b7a748d50ca09569ce2453d6c1b6c10a44e5be64a86610 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.5.0 2024-12-17T10:59:35,184 Found link https://www.piwheels.org/simple/setuptools/setuptools-62.4.0-py3-none-any.whl#sha256=cd258b3e442ef2af923131a75c9c3c3b2e70f6bb6e12aef32c40eb477276f0c7 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.4.0 2024-12-17T10:59:35,186 Found link https://www.piwheels.org/simple/setuptools/setuptools-62.3.4-py3-none-any.whl#sha256=f902791900be9160683eead2c814b3848787bc067c4ff753cc5503dc765188a4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.4 2024-12-17T10:59:35,187 Found link https://www.piwheels.org/simple/setuptools/setuptools-62.3.3-py3-none-any.whl#sha256=b5da250995f799c9fe48932ecc3c8e49a9761183b760af203b08283709970458 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.3 2024-12-17T10:59:35,188 Found link https://www.piwheels.org/simple/setuptools/setuptools-62.3.2-py3-none-any.whl#sha256=2142251486ec1881efb6bf2b9987157588b73b3e98ea32cb97131ed8ed99853c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.2 2024-12-17T10:59:35,190 Found link https://www.piwheels.org/simple/setuptools/setuptools-62.3.1-py3-none-any.whl#sha256=1d10b39674a5ff5cb7e38d124cc8809d994ccfee50bcaa70c274d520530d84ba (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.1 2024-12-17T10:59:35,191 Found link https://www.piwheels.org/simple/setuptools/setuptools-62.3.0-py3-none-any.whl#sha256=5870c465ea841be542f2ffc17a01f6a5ec01dc43f4bc52160d93763ab6f80f45 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.3.0 2024-12-17T10:59:35,192 Found link https://www.piwheels.org/simple/setuptools/setuptools-62.2.0-py3-none-any.whl#sha256=a03c617aa41275b807183d5bb3f916d83c5a3cd989da1000cb492d9318688efd (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.2.0 2024-12-17T10:59:35,194 Found link https://www.piwheels.org/simple/setuptools/setuptools-62.1.0-py3-none-any.whl#sha256=96593b29c29afe0b91eb7a5227cb2c05c251913b48ece2ccb5c150141a7b102f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.1.0 2024-12-17T10:59:35,195 Found link https://www.piwheels.org/simple/setuptools/setuptools-62.0.0-py3-none-any.whl#sha256=4d7307657f96775965f70d197cc7a51237ce9e03fc370a697a16df4d18bf6b5a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 62.0.0 2024-12-17T10:59:35,197 Found link https://www.piwheels.org/simple/setuptools/setuptools-61.3.1-py3-none-any.whl#sha256=0873be1e8694e4aa4680aba6640df2705ada94b95a9299a1eb84c6b586e8f965 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 61.3.1 2024-12-17T10:59:35,198 Found link https://www.piwheels.org/simple/setuptools/setuptools-61.3.0-py3-none-any.whl#sha256=18e0b7c6aaab34206b7cc321bf6e22bcb791893afeb8c18670d287f3febf5c88 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 61.3.0 2024-12-17T10:59:35,199 Found link https://www.piwheels.org/simple/setuptools/setuptools-61.2.0-py3-none-any.whl#sha256=4a4588fb8d170de868d9fe89de1c315ef9313d5ea877e791de0884abe263715d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 61.2.0 2024-12-17T10:59:35,201 Found link https://www.piwheels.org/simple/setuptools/setuptools-61.1.1-py3-none-any.whl#sha256=e92a5de11ef918b360a507ac7751f1eca39b90e05db4fae333c900d7df8cfa01 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 61.1.1 2024-12-17T10:59:35,202 Found link https://www.piwheels.org/simple/setuptools/setuptools-61.1.0-py3-none-any.whl#sha256=cecf340b4c4013592f482bd59d445beb5a5695bacb18a18455834e774ec209d2 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 61.1.0 2024-12-17T10:59:35,204 Found link https://www.piwheels.org/simple/setuptools/setuptools-61.0.0-py3-none-any.whl#sha256=1369b7b0664867a75f7a5766fe68dcfb7dd44cd192b58d9396d547af4e88df60 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 61.0.0 2024-12-17T10:59:35,205 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.10.0-py3-none-any.whl#sha256=7bd3384b3e8203d42c64efa4acc388892c5a183a65ee581689d15225ae18e5ea (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.10.0 2024-12-17T10:59:35,207 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.9.3-py3-none-any.whl#sha256=c05b08e7725495dc61f3045db23246554f6ffeb939896b3d694b3cb31c4ec08e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.3 2024-12-17T10:59:35,208 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.9.2-py3-none-any.whl#sha256=6fc29ef21c841d87835dc47a2632fee908218b86f9ba3747e345e98ad9e2351f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.2 2024-12-17T10:59:35,210 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.9.1-py3-none-any.whl#sha256=096cba68ed18ff33c729c0018473e678f014f439c3837fc339e2d29a233dd307 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.1 2024-12-17T10:59:35,211 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.9.0-py3-none-any.whl#sha256=e6c8df111443eeef4e17993edee8717025745459598a309fb007682b7ce4fa77 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.9.0 2024-12-17T10:59:35,213 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.8.2-py3-none-any.whl#sha256=121c3d7b9f51bdabfead1218dbc0eb255d3e2bfe6d641c33ab97d168bec171b6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.2 2024-12-17T10:59:35,214 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.8.1-py3-none-any.whl#sha256=54a0afb242ca7daec744ac74ca756accfd850aa4da4cf482fbeaab581e45b261 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.1 2024-12-17T10:59:35,216 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.8.0-py3-none-any.whl#sha256=ea15bc59757f59fdbba48d762cee1af31b4e3c8837dc391ef1ffffa015858c30 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.8.0 2024-12-17T10:59:35,217 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.7.1-py3-none-any.whl#sha256=1edd7488fa9164584008b980106cea0103ae0db09b450cdf9d494afc1a0144aa (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.7.1 2024-12-17T10:59:35,219 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.7.0-py3-none-any.whl#sha256=98dce8fa7c52a97c5826e0f6b7b5e1fc3271f344387cd40da16ad855ac673999 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.7.0 2024-12-17T10:59:35,220 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.6.0-py3-none-any.whl#sha256=000ac6ced41920b6d29f614dae82619c3db15cd8c74848882db78f37d103f103 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.6.0 2024-12-17T10:59:35,222 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.5.0-py3-none-any.whl#sha256=dac82fcac9068cd04127f607b870a0f568f642147796e84ce93ae53960e6c5b4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.5.0 2024-12-17T10:59:35,223 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.4.0-py3-none-any.whl#sha256=b8328f765f59b4bbd2241fe5d20049a4eeda8bd95cbfb6daec7bf7ee35854d09 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.4.0 2024-12-17T10:59:35,225 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.3.1-py3-none-any.whl#sha256=300df52f3d20d690205ef7de0ce25707c1779a25534a1650e5cbecb35fa3b644 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.3.1 2024-12-17T10:59:35,226 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.3.0-py3-none-any.whl#sha256=67e182811c1c5ba41850138a1186389125ba9b296bf960b3e468914ef750da65 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.3.0 2024-12-17T10:59:35,227 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.2.0-py3-none-any.whl#sha256=2998e8445bb4032d0284ded398418e67952824b8303cfc5a1bf86213586f861f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.2.0 2024-12-17T10:59:35,229 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.1.1-py3-none-any.whl#sha256=11b988f014f910142f82796d94454227d1705091348e5507edf000fd53d6f27f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.1.1 2024-12-17T10:59:35,230 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.1.0-py3-none-any.whl#sha256=bb58dc83b6b79dd9f9ed05a8b7ad4da5226c0946f53408148f23f5221a127a49 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.1.0 2024-12-17T10:59:35,232 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.0.5-py3-none-any.whl#sha256=ba300793890e3ec28937a0e264f204f25db3cf0546c8bdca420dd847629b8a3d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.5 2024-12-17T10:59:35,233 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.0.4-py3-none-any.whl#sha256=721d328f0741ea7669f4e95fbae6bffa9814f5260db3a3fa486e2b05c749bed6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.4 2024-12-17T10:59:35,235 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.0.3-py3-none-any.whl#sha256=311b91c673b1a37c8424d9e71680c6d09283bd74cc708437a144ec618f03ff20 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.3 2024-12-17T10:59:35,236 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.0.2-py3-none-any.whl#sha256=d4d1ffd6295303f4974b754c20976e985bad1ac05699d8eaa4fa6fe1023f4583 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.2 2024-12-17T10:59:35,238 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.0.1-py3-none-any.whl#sha256=83d1d70106a00905a1ade474d3e7d434a2ca9a45e97a542bd8b0dcf438b2eae6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.1 2024-12-17T10:59:35,240 Found link https://www.piwheels.org/simple/setuptools/setuptools-60.0.0-py3-none-any.whl#sha256=745ba258677c51a11038d09e80360f068955b491c30b698351fe57e3e76d2eba (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 60.0.0 2024-12-17T10:59:35,241 Found link https://www.piwheels.org/simple/setuptools/setuptools-59.8.0-py3-none-any.whl#sha256=88ab606e4039e60c5b2e9bed062e2ec9ce212b8b3ac47c8cadb5af850a42acb4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 59.8.0 2024-12-17T10:59:35,242 Found link https://www.piwheels.org/simple/setuptools/setuptools-59.7.0-py3-none-any.whl#sha256=dfac689d028e811da6312f56b33b66d27d0502ba28192dfc5b59726b73cc143c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.7), version: 59.7.0 2024-12-17T10:59:35,244 Found link https://www.piwheels.org/simple/setuptools/setuptools-59.6.0-py3-none-any.whl#sha256=9292604944daf6aafbaed7c9a30d95688ae83ffdf71ba3cf4629a67664f534e0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.6.0 2024-12-17T10:59:35,245 Found link https://www.piwheels.org/simple/setuptools/setuptools-59.5.0-py3-none-any.whl#sha256=817f259cf47a714d6bafd8c2c5da4c0347929cf2cb5165e061b9357db65fff4c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.5.0 2024-12-17T10:59:35,247 Found link https://www.piwheels.org/simple/setuptools/setuptools-59.4.0-py3-none-any.whl#sha256=60b0db188f9c2c5efa183d0eb0c4ac70c2ee5806c09bcdf404a8cd22c5cc7591 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.4.0 2024-12-17T10:59:35,248 Found link https://www.piwheels.org/simple/setuptools/setuptools-59.3.0-py3-none-any.whl#sha256=6650c8fe370deb7a7c3900ec0fd538a7f9c0785acfb665e78b40e06183335f17 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.3.0 2024-12-17T10:59:35,250 Found link https://www.piwheels.org/simple/setuptools/setuptools-59.2.0-py3-none-any.whl#sha256=0fba77cca05f3c7ee7fba4e28e6afff4a2ff2f17ba7beadace2818f8681c1b97 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.2.0 2024-12-17T10:59:35,251 Found link https://www.piwheels.org/simple/setuptools/setuptools-59.1.1-py3-none-any.whl#sha256=85272a5bc29a0cdf7db98b7e1bf05bcae3cc90dda06e0bb809fd37d07b90a9dd (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.1.1 2024-12-17T10:59:35,253 Found link https://www.piwheels.org/simple/setuptools/setuptools-59.1.0-py3-none-any.whl#sha256=f32e58cd4c603d4430cfbce838d7432b91db9835fa3fbcb9dacb971ea6b44762 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.1.0 2024-12-17T10:59:35,254 Found link https://www.piwheels.org/simple/setuptools/setuptools-59.0.1-py3-none-any.whl#sha256=776f808675e112a7999ce83eb33e9e2a86850a3d281a9933333880ebedbb8773 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 59.0.1 2024-12-17T10:59:35,256 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.5.3-py3-none-any.whl#sha256=0bc9c11341c16578dcc0a2b63ebc3c45b84cf4bf2a5e50fb04de196a894e5142 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.3 2024-12-17T10:59:35,257 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.5.2-py3-none-any.whl#sha256=b9edfa579d4783d721c5f01590b8c81d65aee0c7670431d8978d29f1e434d195 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.2 2024-12-17T10:59:35,259 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.5.1-py3-none-any.whl#sha256=6375972d00bb2c556da60624a61665ad0b99808fb74a555864e389c3807e5379 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.1 2024-12-17T10:59:35,261 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.5.0-py3-none-any.whl#sha256=1670d87ebab9f576d3ebe7cafc59457f12a4d21564b6211d4ab9ecd6cf75e690 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.5.0 2024-12-17T10:59:35,262 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.4.0-py3-none-any.whl#sha256=b128a113375d654673e02285c9e56560e4790e7ca3163d911f1524d055a98a8e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.4.0 2024-12-17T10:59:35,264 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.3.0-py3-none-any.whl#sha256=7518d58efefd802cada4299d55b45f5fe4080dfde2b65106d1e2e631e75cbb1b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.3.0 2024-12-17T10:59:35,265 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.2.0-py3-none-any.whl#sha256=eac3ebf8d55717fc2729fdebdc2fda45950cd37e7254d4559357b989d23bc0b4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.2.0 2024-12-17T10:59:35,266 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.1.0-py3-none-any.whl#sha256=5901389799c041b5456aac82eae09a54007cf74181f836e88ce9ae6497f3c390 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.1.0 2024-12-17T10:59:35,268 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.0.4-py3-none-any.whl#sha256=8a81e0430874a40f4addcd502efc9d526a0691a5f2d26c26995f13defdbe2515 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.4 2024-12-17T10:59:35,269 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.0.3-py3-none-any.whl#sha256=1f38b559490c40d05ede3073b9fb846ae076eda09bdcbd61ca0c56125db80f4b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.3 2024-12-17T10:59:35,271 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.0.2-py3-none-any.whl#sha256=1f112ffa4d1a59c6672a55b34fc4fd6e7cab0de2bc81fe61843412958661dd2b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.2 2024-12-17T10:59:35,272 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.0.1-py3-none-any.whl#sha256=d5d08d98dbe8873871fa170b0fbcf675ab659d1e7fc58f38378f92f3166b1ff8 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.1 2024-12-17T10:59:35,274 Found link https://www.piwheels.org/simple/setuptools/setuptools-58.0.0-py3-none-any.whl#sha256=c21767220657e2600b1df1100dc53c3866f84390a772034a843ae853b3c628aa (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 58.0.0 2024-12-17T10:59:35,275 Found link https://www.piwheels.org/simple/setuptools/setuptools-57.5.0-py3-none-any.whl#sha256=291778f86d138ddf51d0e032a5fc7c8ca30e07548deeafb898f4bfde1c408904 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 57.5.0 2024-12-17T10:59:35,277 Found link https://www.piwheels.org/simple/setuptools/setuptools-57.4.0-py3-none-any.whl#sha256=8291152a0c291614911887d1067691a1584a0366baaa2540f4f9f2ca48bda277 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 57.4.0 2024-12-17T10:59:35,278 Found link https://www.piwheels.org/simple/setuptools/setuptools-57.3.0-py3-none-any.whl#sha256=f2ae98c6be779bfbcc101f831f54c676711a704f5313e10bf84f24c25301da08 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 57.3.0 2024-12-17T10:59:35,280 Found link https://www.piwheels.org/simple/setuptools/setuptools-57.2.0-py3-none-any.whl#sha256=b4bb42f3123fbb01e4f5f5ea9ed6d6b5f7021d18b3bc64236477a82aedf2190e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 57.2.0 2024-12-17T10:59:35,282 Found link https://www.piwheels.org/simple/setuptools/setuptools-57.1.0-py3-none-any.whl#sha256=ddae4c1b9220daf1e32ba9d4e3714df6019c5b583755559be84ff8199f7e1fe3 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 57.1.0 2024-12-17T10:59:35,283 Found link https://www.piwheels.org/simple/setuptools/setuptools-57.0.0-py3-none-any.whl#sha256=c8b9f1a457949002e358fea7d3f2a1e1b94ddc0354b2e40afc066bf95d21bf7b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 57.0.0 2024-12-17T10:59:35,284 Found link https://www.piwheels.org/simple/setuptools/setuptools-56.2.0-py3-none-any.whl#sha256=bc30153eec47d82f20c6f5e1a13d4ee725c6deb7013a67557f89bfe5d25235c4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 56.2.0 2024-12-17T10:59:35,286 Found link https://www.piwheels.org/simple/setuptools/setuptools-56.1.0-py3-none-any.whl#sha256=9ceb15de17f8e99dd4903f88e05e04285fa60f364f67bdcc4334aa71604b7a39 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 56.1.0 2024-12-17T10:59:35,287 Found link https://www.piwheels.org/simple/setuptools/setuptools-56.0.0-py3-none-any.whl#sha256=7430499900e443375ba9449a9cc5d78506b801e929fef4a186496012f93683b5 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 56.0.0 2024-12-17T10:59:35,289 Found link https://www.piwheels.org/simple/setuptools/setuptools-54.2.0-py3-none-any.whl#sha256=b726461910b9ba30f077880c228bea22121aec50b172edf39eb7ff026c054a11 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 54.2.0 2024-12-17T10:59:35,290 Found link https://www.piwheels.org/simple/setuptools/setuptools-54.1.3-py3-none-any.whl#sha256=14e36b76e7b4c7e2fe847de59e4c65ec2f7c918c596a4a62c844fe70a21d9e9f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.3 2024-12-17T10:59:35,292 Found link https://www.piwheels.org/simple/setuptools/setuptools-54.1.2-py3-none-any.whl#sha256=dd20743f36b93cbb8724f4d2ccd970dce8b6e6e823a13aa7e5751bb4e674c20b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.2 2024-12-17T10:59:35,293 Found link https://www.piwheels.org/simple/setuptools/setuptools-54.1.1-py3-none-any.whl#sha256=75c5c4479f4961f1ffdb597c98aa4e4077e6813685025e8bdebf7598aa84e859 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.1 2024-12-17T10:59:35,295 Found link https://www.piwheels.org/simple/setuptools/setuptools-54.1.0-py3-none-any.whl#sha256=8c39e8581eb1e70bcfd0acc403cc83b24be02ac544f35f6714edf80beb1087de (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 54.1.0 2024-12-17T10:59:35,296 Found link https://www.piwheels.org/simple/setuptools/setuptools-54.0.0-py3-none-any.whl#sha256=d85b57c41e88b69ab87065c964134ec85b7573cbab0fdaa7ef32330ed764600a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 54.0.0 2024-12-17T10:59:35,298 Found link https://www.piwheels.org/simple/setuptools/setuptools-53.1.0-py3-none-any.whl#sha256=487f7a3e5040445b687f1eadcebcbbd11e83da95cad5e755304e38a3b7a93207 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 53.1.0 2024-12-17T10:59:35,299 Found link https://www.piwheels.org/simple/setuptools/setuptools-53.0.0-py3-none-any.whl#sha256=0e86620d658c5ca87a71a283bd308fcaeb4c33e17792ef6f081aec17c171347f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 53.0.0 2024-12-17T10:59:35,301 Found link https://www.piwheels.org/simple/setuptools/setuptools-52.0.0-py3-none-any.whl#sha256=0a6f1f18249f78cffdad842efadf1ed7b039fa3355d93f3890f56bd66a48cf27 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 52.0.0 2024-12-17T10:59:35,302 Found link https://www.piwheels.org/simple/setuptools/setuptools-51.3.3-py3-none-any.whl#sha256=9f341a0ce18d9fac647177e19cbaef87a49ad3192231290342db2da6ab570d25 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.3 2024-12-17T10:59:35,304 Found link https://www.piwheels.org/simple/setuptools/setuptools-51.3.2-py3-none-any.whl#sha256=c3db0ee767fc63767aab29468193e4d9727bd30bc54dbff1f56d2eda40b3fd63 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.2 2024-12-17T10:59:35,305 Found link https://www.piwheels.org/simple/setuptools/setuptools-51.3.1-py3-none-any.whl#sha256=c40e4153c5143957fffdd9d8989725610ff76a5fc4d52a596c66bb0b3f351e6a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.1 2024-12-17T10:59:35,307 Found link https://www.piwheels.org/simple/setuptools/setuptools-51.3.0-py3-none-any.whl#sha256=215f0003ac42f7bd9044239764f3b8b26946dc544b423de44c072a51c98e464b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.3.0 2024-12-17T10:59:35,308 Found link https://www.piwheels.org/simple/setuptools/setuptools-51.2.0-py3-none-any.whl#sha256=56948bf25c682e166cf2bfe7c1ad63e5745849b50d1ae7b0f8bff5decdcf34f2 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.2.0 2024-12-17T10:59:35,310 Found link https://www.piwheels.org/simple/setuptools/setuptools-51.1.2-py3-none-any.whl#sha256=67d8af2fc9f33e48f8f4387321700a79b27090a5cff154e5ce1a8c72c2eea54f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.2 2024-12-17T10:59:35,311 Found link https://www.piwheels.org/simple/setuptools/setuptools-51.1.1-py3-none-any.whl#sha256=6d119767443a0f770bab9738b86ce9c0a699a7759ff4f61af583ee73d2e528a0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.1 2024-12-17T10:59:35,313 Found link https://www.piwheels.org/simple/setuptools/setuptools-51.1.0.post20201221-py3-none-any.whl#sha256=b19bdbc197e43337d350cc3806497ab6022802175dfb1abea16c0c3afd233f03 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.0.post20201221 2024-12-17T10:59:35,314 Found link https://www.piwheels.org/simple/setuptools/setuptools-51.1.0-py3-none-any.whl#sha256=12b5544f6f31292b4cb4490d608baebb0583d3702e05cf569dbd5993714aa5ae (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.1.0 2024-12-17T10:59:35,316 Found link https://www.piwheels.org/simple/setuptools/setuptools-51.0.0-py3-none-any.whl#sha256=8c177936215945c9a37ef809ada0fab365191952f7a123618432bbfac353c529 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.6), version: 51.0.0 2024-12-17T10:59:35,317 Found link https://www.piwheels.org/simple/setuptools/setuptools-50.3.2-py3-none-any.whl#sha256=2c242a0856fbad7efbe560df4a7add9324f340cf48df43651e9604924466794a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.2 2024-12-17T10:59:35,319 Found link https://www.piwheels.org/simple/setuptools/setuptools-50.3.1-py3-none-any.whl#sha256=8d057d7a928a82cdc985654355fc9e5431def7b6bdfc9e0f32d1e388a63c8ec6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.1 2024-12-17T10:59:35,320 Found link https://www.piwheels.org/simple/setuptools/setuptools-50.3.0-py3-none-any.whl#sha256=c77b3920663a435c9450d9d971c48f5a7478fca8881b2cd2564e59f970f03536 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.3.0 2024-12-17T10:59:35,321 Found link https://www.piwheels.org/simple/setuptools/setuptools-50.2.0-py3-none-any.whl#sha256=b4936e805c5cdf13b8b8494a7ce803f030898e1e02ca6f10a062b1e5e6563c10 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.2.0 2024-12-17T10:59:35,323 Found link https://www.piwheels.org/simple/setuptools/setuptools-50.1.0-py3-none-any.whl#sha256=4537c77e6e7dc170081f8547564551d4ff4e4999717434e1257600bbd3a23296 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.1.0 2024-12-17T10:59:35,325 Found link https://www.piwheels.org/simple/setuptools/setuptools-50.0.3-py3-none-any.whl#sha256=bb3522bc8120a0eaeb209677c0a001df2c9b95054c4ea945710655a07a3bba9f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.3 2024-12-17T10:59:35,326 Found link https://www.piwheels.org/simple/setuptools/setuptools-50.0.2-py3-none-any.whl#sha256=6993f5ddabd29f3a135a54de5a6bad4333a43338eeb81b85cc776a95c86b4142 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.2 2024-12-17T10:59:35,328 Found link https://www.piwheels.org/simple/setuptools/setuptools-50.0.1-py3-none-any.whl#sha256=868105b87d32d3b96bf636e7b6d6b975c7ccad56b134bbe1e08b727ce3065b44 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.1 2024-12-17T10:59:35,329 Found link https://www.piwheels.org/simple/setuptools/setuptools-50.0.0-py3-none-any.whl#sha256=1e842b6dc37a1282f95a05551efe2c4bd09ddca8dd506ed3aa635a9fb6d15309 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 50.0.0 2024-12-17T10:59:35,330 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.6.0-py3-none-any.whl#sha256=4dd5bb0a0a0cff77b46ca5dd3a84857ee48c83e8223886b556613c724994073f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.6.0 2024-12-17T10:59:35,332 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.5.0-py3-none-any.whl#sha256=2275e3ea824991fa5485c59ba718c25013d24da53a44f3757b3c89159e7e381a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.5.0 2024-12-17T10:59:35,333 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.4.0-py3-none-any.whl#sha256=967c4f532255deea2d1f0a4f534d2f230d0d9f2b1205521849b0225ecd0ee3eb (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.4.0 2024-12-17T10:59:35,335 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.3.2-py3-none-any.whl#sha256=c312ba1fcfaf9611ebafb9d65decdb7bb8ed07a715098685f490f4ce4bd2912f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.2 2024-12-17T10:59:35,336 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.3.1-py3-none-any.whl#sha256=b90e630c5d6b118357392245a9a3b34d22e06fe94538b4b0830a7b4b693a0e5c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.1 2024-12-17T10:59:35,338 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.3.0-py3-none-any.whl#sha256=a0565ae167027d0ea0df80daae5f5d0676fa5f85c8cef039ed431c33f21378c0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.3.0 2024-12-17T10:59:35,339 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.2.1-py3-none-any.whl#sha256=a3c99716b007e6dddf4fce473841f8231535422cbc9e4e3c0d914db83d461360 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.2.1 2024-12-17T10:59:35,341 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.2.0-py3-none-any.whl#sha256=1b98f48187e44dacf4f4a6c7d76c88a36f6f89797a0363e29265b4af05fda951 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.2.0 2024-12-17T10:59:35,342 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.1.3-py3-none-any.whl#sha256=e7a489ec4683a1c93f2ca66ac40480965e482cef7d39f21fa33ea44547bfaa8c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.3 2024-12-17T10:59:35,344 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.1.2-py3-none-any.whl#sha256=911a76cdd8ba8ecaeae4492722e0531fe072729f240fb888016acb3da9f3008d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.2 2024-12-17T10:59:35,345 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.1.1-py3-none-any.whl#sha256=182f2ae75f141ec9c98e3e58c8bc8b9a09b42f6161f210386913497e1ecaa766 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.1 2024-12-17T10:59:35,347 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.1.0-py3-none-any.whl#sha256=0b4bb5c7ac2521ba71a8ab66d8371cbf6f5c98e9d7929f4b56e86e15b33ba920 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.1.0 2024-12-17T10:59:35,348 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.0.1-py3-none-any.whl#sha256=a3e01629a5b825c1207ec9996eb2b3d62fa8b2f0a959e1f22d5a914d5da0e4f7 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.0.1 2024-12-17T10:59:35,350 Found link https://www.piwheels.org/simple/setuptools/setuptools-49.0.0-py3-none-any.whl#sha256=0621227dc6beddef7ead90e1127cc05a7790eacf6a5874076da8afc34ea20a0c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 49.0.0 2024-12-17T10:59:35,351 Found link https://www.piwheels.org/simple/setuptools/setuptools-48.0.0-py3-none-any.whl#sha256=229784bd05c38d1d0cf06e6d6adb241ced7e7b883db4edb7a71f9e425b71f8e3 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 48.0.0 2024-12-17T10:59:35,353 Found link https://www.piwheels.org/simple/setuptools/setuptools-47.3.2-py3-none-any.whl#sha256=320a31aebad9d4933ee294b960aacd501767694feee3900ec323f091504a383b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.2 2024-12-17T10:59:35,354 Found link https://www.piwheels.org/simple/setuptools/setuptools-47.3.1-py3-none-any.whl#sha256=4ba6f9789ea243a6b8ba57da81f75a53494456117810436fd9277a74d1c915d1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.1 2024-12-17T10:59:35,356 Found link https://www.piwheels.org/simple/setuptools/setuptools-47.3.0-py3-none-any.whl#sha256=4c9d0e2973a448216ea85a245ac34ffea6566b626c8796758e572217630b312b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.3.0 2024-12-17T10:59:35,357 Found link https://www.piwheels.org/simple/setuptools/setuptools-47.2.0-py3-none-any.whl#sha256=5da578f0979a9a9458e4975a90356e4b5796bf118419f934f68ab529ef480a96 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.2.0 2024-12-17T10:59:35,359 Found link https://www.piwheels.org/simple/setuptools/setuptools-47.1.1-py3-none-any.whl#sha256=17123a2987c433e8ddaec6fbdf5d760a9ec0e45c6e5d57f54a7099bef458d179 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.1.1 2024-12-17T10:59:35,360 Found link https://www.piwheels.org/simple/setuptools/setuptools-47.1.0-py3-none-any.whl#sha256=0e6ed68d292666370a4052af104cef4e027b4da823505b2a326f4dc1cb8eb269 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.1.0 2024-12-17T10:59:35,362 Found link https://www.piwheels.org/simple/setuptools/setuptools-47.0.0-py3-none-any.whl#sha256=32233ece56e0fa5e864f87376a025ab2872dafeeea179b095c1ce84915d9ed3b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 47.0.0 2024-12-17T10:59:35,363 Found link https://www.piwheels.org/simple/setuptools/setuptools-46.4.0-py3-none-any.whl#sha256=473a89080ef08f09d323b130fcb46e8c879c797b09dec82455225f643f2fdbea (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.4.0 2024-12-17T10:59:35,365 Found link https://www.piwheels.org/simple/setuptools/setuptools-46.3.1-py3-none-any.whl#sha256=3e5cbf7376b83ff99c251a7ecfeae2149240d4c9fcad20137e528cb1880d008d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.3.1 2024-12-17T10:59:35,366 Found link https://www.piwheels.org/simple/setuptools/setuptools-46.3.0-py3-none-any.whl#sha256=c5ea7a129a2875dc5f9eb2cf335d7b4b98777153b5be9ef63ceb30193b38f8a0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.3.0 2024-12-17T10:59:35,368 Found link https://www.piwheels.org/simple/setuptools/setuptools-46.2.0-py3-none-any.whl#sha256=c3ca05451d860388f38572f9ff5f4f354ac9c2a1a69b2ba9dfb45a600761a481 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.2.0 2024-12-17T10:59:35,369 Found link https://www.piwheels.org/simple/setuptools/setuptools-46.1.3-py3-none-any.whl#sha256=4fe404eec2738c20ab5841fa2d791902d2a645f32318a7850ef26f8d7215a8ee (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.3 2024-12-17T10:59:35,371 Found link https://www.piwheels.org/simple/setuptools/setuptools-46.1.2-py3-none-any.whl#sha256=62fd202dea4dd78827a72c0c4eccd364f5faf64d438e2124c288bb3ef61e12de (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.2 2024-12-17T10:59:35,372 Found link https://www.piwheels.org/simple/setuptools/setuptools-46.1.1-py3-none-any.whl#sha256=935dcf0e5f967f84187d9abf6f1ba2d8b2e791ae25f915cb43a2e44d21421758 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.1 2024-12-17T10:59:35,374 Found link https://www.piwheels.org/simple/setuptools/setuptools-46.1.0-py3-none-any.whl#sha256=55453a174d4ebe609240ce8e459e993b6e075ca992cb2db014e442ccb9ce0ec0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.1.0 2024-12-17T10:59:35,375 Found link https://www.piwheels.org/simple/setuptools/setuptools-46.0.0-py3-none-any.whl#sha256=693e0504490ed8420522bf6bc3aa4b0da6a9f1c80c68acfb4e959275fd04cd82 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 46.0.0 2024-12-17T10:59:35,376 Found link https://www.piwheels.org/simple/setuptools/setuptools-45.3.0-py3-none-any.whl#sha256=2200fd1d64496f6dd0a43f25e259cffcf13305a350e0583273fe4008c06e1ef1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 45.3.0 2024-12-17T10:59:35,378 Found link https://www.piwheels.org/simple/setuptools/setuptools-45.2.0-py3-none-any.whl#sha256=316484eebff54cc18f322dea09ed031b7e3eb00811b19dcedb09bc09bba7d93d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 45.2.0 2024-12-17T10:59:35,379 Found link https://www.piwheels.org/simple/setuptools/setuptools-45.1.0-py3-none-any.whl#sha256=68e7fd3508687f94367f1aa090a3ed921cd045a60b73d8b0aa1f305199a0ca28 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=3.5), version: 45.1.0 2024-12-17T10:59:35,382 Found link https://www.piwheels.org/simple/setuptools/setuptools-44.1.1-py2.py3-none-any.whl#sha256=27a714c09253134e60a6fa68130f78c7037e5562c4f21f8f318f2ae900d152d5 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.1.1 2024-12-17T10:59:35,384 Found link https://www.piwheels.org/simple/setuptools/setuptools-44.1.0-py2.py3-none-any.whl#sha256=992728077ca19db6598072414fb83e0a284aca1253aaf2e24bb1e55ee6db1a30 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.1.0 2024-12-17T10:59:35,386 Found link https://www.piwheels.org/simple/setuptools/setuptools-44.0.0-py2.py3-none-any.whl#sha256=180081a244d0888b0065e18206950d603f6550721bd6f8c0a10221ed467dd78e (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 44.0.0 2024-12-17T10:59:35,388 Found link https://www.piwheels.org/simple/setuptools/setuptools-43.0.0-py2.py3-none-any.whl#sha256=a67faa51519ef28cd8261aff0e221b6e4c370f8fb8bada8aa3e7ad8945199963 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 43.0.0 2024-12-17T10:59:35,390 Found link https://www.piwheels.org/simple/setuptools/setuptools-42.0.2-py2.py3-none-any.whl#sha256=c8abd0f3574bc23afd2f6fd2c415ba7d9e097c8a99b845473b0d957ba1e2dac6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.2 2024-12-17T10:59:35,393 Found link https://www.piwheels.org/simple/setuptools/setuptools-42.0.1-py2.py3-none-any.whl#sha256=409547a87530bd8a20582a2f0996c2a6651c5855b3a614af05020b35c3867dcb (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.1 2024-12-17T10:59:35,395 Found link https://www.piwheels.org/simple/setuptools/setuptools-42.0.0-py2.py3-none-any.whl#sha256=4248cb506794bececcddeddb1678bc722f9cfcacf02f98f7c0af6b9ed893caf2 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 42.0.0 2024-12-17T10:59:35,397 Found link https://www.piwheels.org/simple/setuptools/setuptools-41.6.0-py2.py3-none-any.whl#sha256=3e8e8505e563631e7cb110d9ad82d135ee866b8146d5efe06e42be07a72db20a (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.6.0 2024-12-17T10:59:35,399 Found link https://www.piwheels.org/simple/setuptools/setuptools-41.5.1-py2.py3-none-any.whl#sha256=9f1b3c6a6b862cf994c47c5b5a212a75cf0a11912d1cd11abfdfe03a4f49f5b2 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.5.1 2024-12-17T10:59:35,401 Found link https://www.piwheels.org/simple/setuptools/setuptools-41.5.0-py2.py3-none-any.whl#sha256=1aaf68966c16fe31be9a87f7c02f4393355159bf96396068f380b70b1fc6860d (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.5.0 2024-12-17T10:59:35,403 Found link https://www.piwheels.org/simple/setuptools/setuptools-41.4.0-py2.py3-none-any.whl#sha256=8d01f7ee4191d9fdcd9cc5796f75199deccb25b154eba82d44d6a042cf873670 (from https://www.piwheels.org/simple/setuptools/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,>=2.7), version: 41.4.0 2024-12-17T10:59:35,405 Found link https://www.piwheels.org/simple/setuptools/setuptools-41.3.0-py2.py3-none-any.whl#sha256=e9832acd9be6f3174f4c34b40e7d913a146727920cbef6465c1c1bd2d21a4ec4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.3.0 2024-12-17T10:59:35,408 Found link https://www.piwheels.org/simple/setuptools/setuptools-41.2.0-py2.py3-none-any.whl#sha256=4380abcf2a4ffd1a5ba22d687c6d690dce83b2b51c70e9c6d09f7e8c7e8040dc (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.2.0 2024-12-17T10:59:35,410 Found link https://www.piwheels.org/simple/setuptools/setuptools-41.1.0-py2.py3-none-any.whl#sha256=bce3560fae29e9efa45fdb6e9fceddb1cde0cccebb050ee134262283b3ccbc7b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.1.0 2024-12-17T10:59:35,412 Found link https://www.piwheels.org/simple/setuptools/setuptools-41.0.1-py2.py3-none-any.whl#sha256=c7769ce668c7a333d84e17fe8b524b1c45e7ee9f7908ad0a73e1eda7e6a5aebf (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.0.1 2024-12-17T10:59:35,414 Found link https://www.piwheels.org/simple/setuptools/setuptools-41.0.0-py2.py3-none-any.whl#sha256=e67486071cd5cdeba783bd0b64f5f30784ff855b35071c8670551fd7fc52d4a1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 41.0.0 2024-12-17T10:59:35,416 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.9.0-py2.py3-none-any.whl#sha256=a96b1bef41915307025ae357fde45c1ccbd2bb0d37b3a8bc239dddd55bd01ca3 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.9.0 2024-12-17T10:59:35,418 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.8.0-py2.py3-none-any.whl#sha256=e8496c0079f3ac30052ffe69b679bd876c5265686127a3159cfa415669b7f9ab (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.8.0 2024-12-17T10:59:35,420 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.7.3-py2.py3-none-any.whl#sha256=4f4acaf06d617dccfd3fbbc9fbd83cf4749759a1fa2bdf589206a3278e0d537a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.3 2024-12-17T10:59:35,422 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.7.2-py2.py3-none-any.whl#sha256=0e81ddffd54b39c5beaff2e198d30c86631ebf0c0af6a0bbbc7441148c596831 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.2 2024-12-17T10:59:35,424 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.7.1-py2.py3-none-any.whl#sha256=252520b7969fb4f2fcaf08c014b2891041d56f31180ec0d581297a28597205ff (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.1 2024-12-17T10:59:35,426 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.7.0-py2.py3-none-any.whl#sha256=5d29d6d5ca47f370959a15f39fddad7ae94a02dadaf0ef5e907f17ef8e518de1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.7.0 2024-12-17T10:59:35,429 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.6.3-py2.py3-none-any.whl#sha256=e2c1ce9a832f34cf7a31ed010aabcab5008eb65ce8f2aadc04622232c14bdd0b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.3 2024-12-17T10:59:35,431 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.6.2-py2.py3-none-any.whl#sha256=88ee6bcd5decec9bd902252e02e641851d785c6e5e75677d2744a9d13fed0b0a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.2 2024-12-17T10:59:35,433 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.6.1-py2.py3-none-any.whl#sha256=d691b548b1faad074630635edc86422896bff80ce1f17ef155d67d9558c12c8b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.1 2024-12-17T10:59:35,435 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.6.0-py2.py3-none-any.whl#sha256=3135d047e1f02c5baffd7a671e07c274f18727455408bc3af6d7b0f0c59e80f4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.6.0 2024-12-17T10:59:35,437 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.5.0-py2.py3-none-any.whl#sha256=e329a5c458c6acb5edc2b5c4ad44280c053ba827dc82fd5e84a83e22bb05460d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.5.0 2024-12-17T10:59:35,439 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.4.3-py2.py3-none-any.whl#sha256=ce4137d58b444bac11a31d4e0c1805c69d89e8ed4e91fde1999674ecc2f6f9ff (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.3 2024-12-17T10:59:35,442 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.4.2-py2.py3-none-any.whl#sha256=c3a8ff6bf3fd43d27242db824c871fc4752fea907c5ce59e00a9c5bb7da908d8 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.2 2024-12-17T10:59:35,444 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.4.1-py2.py3-none-any.whl#sha256=822054653e22ef38eef400895b8ada55657c8db7ad88f7ec954bccff2b3b9b52 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.1 2024-12-17T10:59:35,446 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.4.0-py2.py3-none-any.whl#sha256=22f3247d7009e4d73589184fbf18a52dd703ed4fe0e20e1d59935bdfd355350e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.4.0 2024-12-17T10:59:35,449 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.3.0-py2.py3-none-any.whl#sha256=a61433987d64d2966d4fc246ec405cb84a75118521116082cb12f30a4f13d46a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.3.0 2024-12-17T10:59:35,451 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.2.0-py2.py3-none-any.whl#sha256=ea3796a48a207b46ea36a9d26de4d0cc87c953a683a7b314ea65d666930ea8e6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.2.0 2024-12-17T10:59:35,453 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.1.1-py2.py3-none-any.whl#sha256=92e126c856d02c544e928854ce70a1af062ff1f7343e86c2805261ed8a9c9333 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.1.1 2024-12-17T10:59:35,455 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.1.0-py2.py3-none-any.whl#sha256=6322a764908e4bfcaba35e45224d55098a17c506b655c52c277ddf42b8b18eae (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.1.0 2024-12-17T10:59:35,457 Found link https://www.piwheels.org/simple/setuptools/setuptools-40.0.0-py2.py3-none-any.whl#sha256=d68abee4eed409fbe8c302ac4d8429a1ffef912cd047a903b5701c024048dd49 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*), version: 40.0.0 2024-12-17T10:59:35,459 Found link https://www.piwheels.org/simple/setuptools/setuptools-39.2.0-py2.py3-none-any.whl#sha256=8fca9275c89964f13da985c3656cb00ba029d7f3916b37990927ffdf264e7926 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.2.0 2024-12-17T10:59:35,461 Found link https://www.piwheels.org/simple/setuptools/setuptools-39.1.0-py2.py3-none-any.whl#sha256=0cb8b8625bfdcc2d43ea4b9cdba0b39b2b7befc04f3088897031082aa16ce186 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.1.0 2024-12-17T10:59:35,463 Found link https://www.piwheels.org/simple/setuptools/setuptools-39.0.1-py2.py3-none-any.whl#sha256=8010754433e3211b9cdbbf784b50f30e80bf40fc6b05eb5f865fab83300599b8 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.0.1 2024-12-17T10:59:35,465 Found link https://www.piwheels.org/simple/setuptools/setuptools-39.0.0-py2.py3-none-any.whl#sha256=510ec09e1e2c0cf8cffba7f0480800007f4405a20473893619142ee6b2fa90eb (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 39.0.0 2024-12-17T10:59:35,467 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.7.0-py2.py3-none-any.whl#sha256=e39b4b7c772dc94d3037c002db21ffc429e47059a133e060d5eaa9d613b466df (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.7.0 2024-12-17T10:59:35,469 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.6.1-py2.py3-none-any.whl#sha256=1425a44a8d0c640d607c0941424f6ee8740b15a783c54d7596c8e6189b8c8f2a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.6.1 2024-12-17T10:59:35,470 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.6.0-py2.py3-none-any.whl#sha256=020ca62e457d006b02e69de0b199c26bab9cc9d0d225b6faa2574ad347017ff1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.6.0 2024-12-17T10:59:35,472 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.5.2-py2.py3-none-any.whl#sha256=a69c829c65d733197ab410accbc9f6817bfda52b092217a5e873850e536c6b6b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.2 2024-12-17T10:59:35,475 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.5.1-py2.py3-none-any.whl#sha256=7ffe771abfae419fd104f93400b61c935b5af10bfe4dfeec7a1bd495694eea35 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.1 2024-12-17T10:59:35,477 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.5.0-py2.py3-none-any.whl#sha256=8d6cb73008693d835da37865657d52335e3cf778fa6ba7fcfa8aecdeaec9fe55 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.5.0 2024-12-17T10:59:35,478 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.4.1-py2.py3-none-any.whl#sha256=22f8bcff5ce7fd1867785701769eaba42b79331d0abf890974a9288787dc015b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.4.1 2024-12-17T10:59:35,481 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.4.0-py2.py3-none-any.whl#sha256=155c2ec9fdcc00c3973d966b416e1cf3a1e7ce75f4c09fb760b23f94b935926e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.4.0 2024-12-17T10:59:35,483 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.3.0-py2.py3-none-any.whl#sha256=fda35bd4d6d6047cc4aa66e381c836e8d57d396df97eb577bfca9fbaaf757dc1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.3.0 2024-12-17T10:59:35,485 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.2.5-py2.py3-none-any.whl#sha256=bcf0d4f3e2f7890e658db11e218b8643afffb905a0e2f2a7d5a6a3e949bb87e6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.5 2024-12-17T10:59:35,487 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.2.4-py2.py3-none-any.whl#sha256=ca69216173b631cc29314bbce4d0b7e8a69784c8b6d7ea6b9e4952ac9ec0897d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.4 2024-12-17T10:59:35,488 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.2.3-py2.py3-none-any.whl#sha256=da7567c948c9459842b85dbbb2e3dbef6a90ae8d7476b2db0a10301ea31c9230 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.3 2024-12-17T10:59:35,490 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.2.1-py2.py3-none-any.whl#sha256=4684a40555c8bc108866dac60f663e5a9a2bff8daf4a7ff4bf4338564368cddf (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.1 2024-12-17T10:59:35,492 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.2.0-py2.py3-none-any.whl#sha256=10ef0af745e40fb46ff81d677696096158f0495318db99c0131d33440bb9bb20 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.2.0 2024-12-17T10:59:35,494 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.1.0-py2.py3-none-any.whl#sha256=0e7b1736a524950ad832d5763238a54ea06c055a0f45cfefa3ca92d34d21041c (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.1.0 2024-12-17T10:59:35,496 Found link https://www.piwheels.org/simple/setuptools/setuptools-38.0.0-py2.py3-none-any.whl#sha256=3f66cd359dd836fdfa5f2a9540fdbfcc2f97449ad555324513a8d115b9706a1f (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 38.0.0 2024-12-17T10:59:35,497 Found link https://www.piwheels.org/simple/setuptools/setuptools-37.0.0-py2.py3-none-any.whl#sha256=a1d38d97b3759b3fede089e240b6aefaae50d21361c2c2d4ac92c3de4ebe3d50 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*), version: 37.0.0 2024-12-17T10:59:35,499 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.8.0-py2.py3-none-any.whl#sha256=4b5551b995cf69741c15259612221fdbffa2635182fe2cb92392fda318b7a636 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.8.0 2024-12-17T10:59:35,501 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.7.2-py2.py3-none-any.whl#sha256=bae92a71c82f818deb0b60ff1f7d764b8902cfc24187746b1aa6186918a70db3 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.2 2024-12-17T10:59:35,503 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.7.1-py2.py3-none-any.whl#sha256=eaacfa35eb11199d0b017df416421781a75209817bff3f94820556e36c49bd77 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.1 2024-12-17T10:59:35,505 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.7.0-py2.py3-none-any.whl#sha256=9072de898007cb11b3b0eec5b4c4db7faea2e7ad8c095b5157ae951fbec6b1da (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.7.0 2024-12-17T10:59:35,506 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.6.1-py2.py3-none-any.whl#sha256=198c23b395440c4915621e5fb689757c20a129096b55833a9c82cb1e8792ff12 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.6.1 2024-12-17T10:59:35,508 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.6.0-py2.py3-none-any.whl#sha256=904356c95cf90e6fdc21915afafbc9ad3d11409c7afeee7c85156f469b353efb (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.6.0 2024-12-17T10:59:35,510 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.5.0-py2.py3-none-any.whl#sha256=ef824aefbd20dc364891836b75a19386dcf2f4235bf7d80531a8517ab29d0602 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.5.0 2024-12-17T10:59:35,512 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.4.0-py2.py3-none-any.whl#sha256=4d54c0bfee283e78609169213f9c075827d5837086f58b588b417b093c23464b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.4.0 2024-12-17T10:59:35,513 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.3.0-py2.py3-none-any.whl#sha256=42bafe9efb8f771f6c96bb8e052e1de7474270719d471d596b9d91e53e8befd4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.3.0 2024-12-17T10:59:35,515 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.2.7-py2.py3-none-any.whl#sha256=02b5f3869777dfbfbe3786a057bc6d523445a3e541a0abdf85adbe0b091e96b9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.7 2024-12-17T10:59:35,517 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.2.6-py2.py3-none-any.whl#sha256=d0ac4095a275ad4238f9b10d10421e124847f09342e38e16a715fcbf756000ef (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.6 2024-12-17T10:59:35,519 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.2.5-py2.py3-none-any.whl#sha256=3d218acbc5bbade2c44edbd020bf8720e4f86c5961cfe799c79165df68702b96 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.5 2024-12-17T10:59:35,521 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.2.4-py2.py3-none-any.whl#sha256=88355a63434a5e3c8e1dfb26a2227744512958434c7332c7a4a8847f128f364e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.4 2024-12-17T10:59:35,523 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.2.3-py2.py3-none-any.whl#sha256=92401b0bfee8585dcbe2ef60256d7354ab1986752378014ed25e2fde480ffa59 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.3 2024-12-17T10:59:35,525 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.2.2-py2.py3-none-any.whl#sha256=63bdc8ef07b4c99ff4c265ab9042333807fa66d60eea87df402f3a470fc10d7d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.2 2024-12-17T10:59:35,527 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.2.1-py2.py3-none-any.whl#sha256=493695b7a6913067570b4e23c22b678c7ada44711d7b3c27652df64fd9e2f114 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.1 2024-12-17T10:59:35,529 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.2.0-py2.py3-none-any.whl#sha256=8dbfb44a16b73ea756edfe8805a25338eead94bd2426b64374a7f6a7a125028d (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.2.0 2024-12-17T10:59:35,531 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.1.1-py2.py3-none-any.whl#sha256=96f772b7112e6b45e3ec9094ff7621b1fc42654d6c25bfe19713f282c1b82d6e (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.1.1 2024-12-17T10:59:35,533 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.1.0-py2.py3-none-any.whl#sha256=b5bb0222a2414c2b27750cd35d368fd071c91d412a363bf155f5a3474f62aae5 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.1.0 2024-12-17T10:59:35,535 Found link https://www.piwheels.org/simple/setuptools/setuptools-36.0.1-py2.py3-none-any.whl#sha256=f2900e560efc479938a219433c48f15a4ff4ecfe575a65de385eeb44f2425587 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 36.0.1 2024-12-17T10:59:35,537 Found link https://www.piwheels.org/simple/setuptools/setuptools-35.0.2-py2.py3-none-any.whl#sha256=19d753940f8cdbee7548da318f8b56159aead279ef811a6efc8b8a33d89c86a4 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.2 2024-12-17T10:59:35,538 Found link https://www.piwheels.org/simple/setuptools/setuptools-35.0.1-py2.py3-none-any.whl#sha256=33a7b7910651bea57164c6c6dd66a2b1c5196c0f78ee2ff7319ce7bd031714c0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.1 2024-12-17T10:59:35,540 Found link https://www.piwheels.org/simple/setuptools/setuptools-35.0.0-py2.py3-none-any.whl#sha256=b427014a0cf196e57727e141899c20381051233094783aa6274780a100eb65d9 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 35.0.0 2024-12-17T10:59:35,542 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.4.1-py2.py3-none-any.whl#sha256=1f7aac8b778446406ec5dcd5cc9305b375e7935e38f2fd3b1b70168c21a079d0 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.4.1 2024-12-17T10:59:35,544 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.4.0-py2.py3-none-any.whl#sha256=ef21066d478573a7f92bebb759b6d6fac4c1a4ace08d79f61103eb294337f2df (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.4.0 2024-12-17T10:59:35,545 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.3.3-py2.py3-none-any.whl#sha256=e436d8c9dcf67ea8902bfa7cce1ef698f36bf303f13b4f62a5668891ecd380dd (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.3 2024-12-17T10:59:35,547 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.3.2-py2.py3-none-any.whl#sha256=6483f8412313ec787fa71379147a4605d3b1cc303c3648d02542a9160d3db72b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.2 2024-12-17T10:59:35,549 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.3.1-py2.py3-none-any.whl#sha256=9349b47bcdef2e695065791260f9416b7aae8739fd30c6849f807bce5281d046 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.1 2024-12-17T10:59:35,551 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.3.0-py2.py3-none-any.whl#sha256=ef40d2d360ba1be284a47c51a5a489afa7d8cde5ca39f2321876e00e93fe04cd (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.3.0 2024-12-17T10:59:35,553 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.2.0-py2.py3-none-any.whl#sha256=75d352eeeddd96a3fb702b1da9f8b89e5f8c045dbd86e3894516733eb5f99713 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.2.0 2024-12-17T10:59:35,555 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.1.1-py2.py3-none-any.whl#sha256=5f74aabe68c441b99dca68c22796d5cbf532cb38b0aeada17d1d3988809de6e6 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.1.1 2024-12-17T10:59:35,556 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.1.0-py2.py3-none-any.whl#sha256=edd9d39782fe38b9c533002b2e6fdf06498793cbd29266accdcc519431d4b7ba (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.1.0 2024-12-17T10:59:35,558 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.0.3-py2.py3-none-any.whl#sha256=0af5ba75a129cf082d629d074fb7bf3c8391b62fdfa7b0cff2b6ef5563a15605 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.3 2024-12-17T10:59:35,560 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.0.2-py2.py3-none-any.whl#sha256=f9ac44de8b36a13ce35d2989052a295a548c9fe5a161fb066dff53592200aa12 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.2 2024-12-17T10:59:35,562 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.0.1-py2.py3-none-any.whl#sha256=ccb91bdfd63edd5aca37508d0a5b3097e57f504a0463a9e0e476d85af8e422ea (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.1 2024-12-17T10:59:35,563 Found link https://www.piwheels.org/simple/setuptools/setuptools-34.0.0-py2.py3-none-any.whl#sha256=b2beb0ae830afe12b164bfdc035797c32ceb2463ba3d5ead0dc4d2778b780f60 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 34.0.0 2024-12-17T10:59:35,565 Found link https://www.piwheels.org/simple/setuptools/setuptools-33.1.1-py2.py3-none-any.whl#sha256=4ed8f634b11fbba8c0ba9db01a8d24ad464f97a615889e9780fc74ddec956711 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 33.1.1 2024-12-17T10:59:35,567 Found link https://www.piwheels.org/simple/setuptools/setuptools-33.1.0-py2.py3-none-any.whl#sha256=5aa4f254f89fefe431684fceee2086a636a85001cfc796436b1084d62ce8d367 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 33.1.0 2024-12-17T10:59:35,569 Found link https://www.piwheels.org/simple/setuptools/setuptools-32.3.1-py2.py3-none-any.whl#sha256=1876d17325e5157751e004d7911c0a0c3bb257d509d9d23483ff9f2f12c84315 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.3.1 2024-12-17T10:59:35,571 Found link https://www.piwheels.org/simple/setuptools/setuptools-32.3.0-py2.py3-none-any.whl#sha256=4645615979950bb5b5bc9101582856f2cbdf78480bf8c2ebc9563307f38aa650 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.3.0 2024-12-17T10:59:35,572 Found link https://www.piwheels.org/simple/setuptools/setuptools-32.2.0-py2.py3-none-any.whl#sha256=e18ef9fd6b8742f5007ff1e169a4e7b7c6654038235fab846ce3dcbf82fcdadf (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.2.0 2024-12-17T10:59:35,574 Found link https://www.piwheels.org/simple/setuptools/setuptools-32.1.3-py2.py3-none-any.whl#sha256=8fbb2c58e03eda5a0bf813994dc58c55aa4cff630bf39dae70029d1ed08dfeca (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.3 2024-12-17T10:59:35,576 Found link https://www.piwheels.org/simple/setuptools/setuptools-32.1.2-py2.py3-none-any.whl#sha256=ad1ad62e5ae270469d65ec04641643e68737259454132b7a3c32a29990016b86 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.2 2024-12-17T10:59:35,578 Found link https://www.piwheels.org/simple/setuptools/setuptools-32.1.1-py2.py3-none-any.whl#sha256=3bdd17676c4697af2de5099b12843ef8a71ffc1c08ddbbde5e455823d6a09874 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.1 2024-12-17T10:59:35,579 Found link https://www.piwheels.org/simple/setuptools/setuptools-32.1.0-py2.py3-none-any.whl#sha256=96807339fd9d5611f720d8957dc97df33dfba2fe1ecd33f4907626b52e8b140a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.1.0 2024-12-17T10:59:35,581 Found link https://www.piwheels.org/simple/setuptools/setuptools-32.0.0-py2.py3-none-any.whl#sha256=e1d5a1fd8e7ac66e8f9ed2f0e5c08ac3c8d45a389c167ac0270b6580f365b558 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 32.0.0 2024-12-17T10:59:35,583 Found link https://www.piwheels.org/simple/setuptools/setuptools-31.0.1-py2.py3-none-any.whl#sha256=5ee299f0af69b1ec02afca34603ed89cfd7df0a32b9979b1f06371718385295b (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.1 2024-12-17T10:59:35,585 Found link https://www.piwheels.org/simple/setuptools/setuptools-31.0.0-py2.py3-none-any.whl#sha256=55ca82d7224c7ebae3f8530ca7aaac6d0aaf68131a268f625ac1a98f115c2097 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 31.0.0 2024-12-17T10:59:35,587 Found link https://www.piwheels.org/simple/setuptools/setuptools-30.4.0-py2.py3-none-any.whl#sha256=2a951eefe8619f3071a5b43f851471e3e09ce5ab1128f700fe91df6b546bce15 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.4.0 2024-12-17T10:59:35,588 Found link https://www.piwheels.org/simple/setuptools/setuptools-30.3.0-py2.py3-none-any.whl#sha256=de75ec99622f1808a4ee625d7144b5294bbc2cd2abc723b83b146b93fc76a4de (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.3.0 2024-12-17T10:59:35,590 Found link https://www.piwheels.org/simple/setuptools/setuptools-30.2.1-py2.py3-none-any.whl#sha256=cecbce2822b9756fa2b34dbf511b1c5e26247892bb6387c55396271d1e2ca58a (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.1 2024-12-17T10:59:35,592 Found link https://www.piwheels.org/simple/setuptools/setuptools-30.2.0-py2.py3-none-any.whl#sha256=b7e7b28d6a728ea38953d66e12ef400c3c153c523539f1b3997c5a42f3770ff1 (from https://www.piwheels.org/simple/setuptools/) (requires-python:>=2.6,!=3.0.*,!=3.1.*,!=3.2.*), version: 30.2.0 2024-12-17T10:59:35,593 Found link https://www.piwheels.org/simple/setuptools/setuptools-30.1.0-py2.py3-none-any.whl#sha256=3861f9b31fb4c6e9bdf6e485adcaf982d12dbd45a9108cea7b08817d6fdea18d (from https://www.piwheels.org/simple/setuptools/), version: 30.1.0 2024-12-17T10:59:35,594 Found link https://www.piwheels.org/simple/setuptools/setuptools-30.0.0-py2.py3-none-any.whl#sha256=e7e9afac52a92598bdec609946886d91660fe9f0618634d26de0b785b0a35906 (from https://www.piwheels.org/simple/setuptools/), version: 30.0.0 2024-12-17T10:59:35,595 Found link https://www.piwheels.org/simple/setuptools/setuptools-29.0.1-py2.py3-none-any.whl#sha256=2b55dc2fe3cc72b5d6769f6099af35b061d5a76b4a907cadf8aaae4b41176252 (from https://www.piwheels.org/simple/setuptools/), version: 29.0.1 2024-12-17T10:59:35,596 Found link https://www.piwheels.org/simple/setuptools/setuptools-29.0.0-py2.py3-none-any.whl#sha256=a10889a6d3f6e7dbb9190a07b4ba7086a3cce295d3dc67b114f245d61b107a95 (from https://www.piwheels.org/simple/setuptools/), version: 29.0.0 2024-12-17T10:59:35,597 Found link https://www.piwheels.org/simple/setuptools/setuptools-28.8.1-py2.py3-none-any.whl#sha256=0b15383c7070720e0780ccd75a96b2be1717505c0dd8904a8b69ae30ba0c0615 (from https://www.piwheels.org/simple/setuptools/), version: 28.8.1 2024-12-17T10:59:35,598 Found link https://www.piwheels.org/simple/setuptools/setuptools-28.8.0-py2.py3-none-any.whl#sha256=2e59d06ac798efce29c567ee0e0687514efca529a665b8f364cf497cd10d21b2 (from https://www.piwheels.org/simple/setuptools/), version: 28.8.0 2024-12-17T10:59:35,599 Found link https://www.piwheels.org/simple/setuptools/setuptools-28.7.1-py2.py3-none-any.whl#sha256=5bd5d77813a5b8e30ad84161b3b3262e2b6a6cddc22568d88c5b7fedb404b762 (from https://www.piwheels.org/simple/setuptools/), version: 28.7.1 2024-12-17T10:59:35,600 Found link https://www.piwheels.org/simple/setuptools/setuptools-28.7.0-py2.py3-none-any.whl#sha256=85d983ffe32c6123af7fbcad471af55b44ba8aa1c6e019dbc1bf97e42e43fcb4 (from https://www.piwheels.org/simple/setuptools/), version: 28.7.0 2024-12-17T10:59:35,601 Found link https://www.piwheels.org/simple/setuptools/setuptools-28.6.1-py2.py3-none-any.whl#sha256=2b94b5d44914e8ade6c537678c6a0143a1d7038989b2330c8f3c69b6d839e311 (from https://www.piwheels.org/simple/setuptools/), version: 28.6.1 2024-12-17T10:59:35,603 Found link https://www.piwheels.org/simple/setuptools/setuptools-28.6.0-py2.py3-none-any.whl#sha256=1d2da66e50b74e8c5c925af52b38e18d4373c7969c5ed3c26eb1c3baca8222f9 (from https://www.piwheels.org/simple/setuptools/), version: 28.6.0 2024-12-17T10:59:35,604 Found link https://www.piwheels.org/simple/setuptools/setuptools-28.5.0-py2.py3-none-any.whl#sha256=212eebc95772a3fef67677490d6e0e805af8c36f53e1452d300a57dcfd5799ca (from https://www.piwheels.org/simple/setuptools/), version: 28.5.0 2024-12-17T10:59:35,605 Found link https://www.piwheels.org/simple/setuptools/setuptools-28.4.0-py2.py3-none-any.whl#sha256=4f48567fd9f9fcb8f048fd16012a7fe4e9f8135718964161a876d1547d2f1783 (from https://www.piwheels.org/simple/setuptools/), version: 28.4.0 2024-12-17T10:59:35,606 Found link https://www.piwheels.org/simple/setuptools/setuptools-28.3.0-py2.py3-none-any.whl#sha256=873b8e61eba51c38266ad8499ec10f669ea9299a2e8d217b086cead83194a495 (from https://www.piwheels.org/simple/setuptools/), version: 28.3.0 2024-12-17T10:59:35,607 Found link https://www.piwheels.org/simple/setuptools/setuptools-28.2.0-py2.py3-none-any.whl#sha256=944dc170b3e378c30416c99b51cb7ef2a6d9ab8d5ebd139f7ee0f3d74b5ce3c1 (from https://www.piwheels.org/simple/setuptools/), version: 28.2.0 2024-12-17T10:59:35,608 Found link https://www.piwheels.org/simple/setuptools/setuptools-28.1.0-py2.py3-none-any.whl#sha256=5497cc872ab2c11eddaeab86526f4d4c219f0d89e06cf9d3472fdbcb94d8f579 (from https://www.piwheels.org/simple/setuptools/), version: 28.1.0 2024-12-17T10:59:35,609 Found link https://www.piwheels.org/simple/setuptools/setuptools-28.0.0-py2.py3-none-any.whl#sha256=a622eeec9eff4c9b293e08160c912d5c87f326b54f58365eca1c60ee01a4a62f (from https://www.piwheels.org/simple/setuptools/), version: 28.0.0 2024-12-17T10:59:35,610 Found link https://www.piwheels.org/simple/setuptools/setuptools-27.3.1-py2.py3-none-any.whl#sha256=4c6fb205bdbc4944a3adbd44c81319add3e267844c047f6f4c25324ee1250538 (from https://www.piwheels.org/simple/setuptools/), version: 27.3.1 2024-12-17T10:59:35,611 Found link https://www.piwheels.org/simple/setuptools/setuptools-27.3.0-py2.py3-none-any.whl#sha256=b8a5dd094d4c6d9e5f04094475a164ec1b99f56ac8df63bdd989f320d1d762f8 (from https://www.piwheels.org/simple/setuptools/), version: 27.3.0 2024-12-17T10:59:35,612 Found link https://www.piwheels.org/simple/setuptools/setuptools-27.2.0-py2.py3-none-any.whl#sha256=2b7a63bf9a3645bb4cabe3b04dc97f9e0ac330723626070bc874e0f02830c09a (from https://www.piwheels.org/simple/setuptools/), version: 27.2.0 2024-12-17T10:59:35,613 Found link https://www.piwheels.org/simple/setuptools/setuptools-27.1.2-py2.py3-none-any.whl#sha256=0fd2677f62585315a4e04fdf055e898511c61954dfd488461853928927184e11 (from https://www.piwheels.org/simple/setuptools/), version: 27.1.2 2024-12-17T10:59:35,614 Found link https://www.piwheels.org/simple/setuptools/setuptools-27.1.0-py2.py3-none-any.whl#sha256=1247b7fc94b8db8223a0b8174600d3393bff45f0f7a43b609408ff9546bde4af (from https://www.piwheels.org/simple/setuptools/), version: 27.1.0 2024-12-17T10:59:35,615 Found link https://www.piwheels.org/simple/setuptools/setuptools-27.0.0-py2.py3-none-any.whl#sha256=79f5574164220b07235aa48fa528329a4bc1725e6b62c04b36e0ae455066489a (from https://www.piwheels.org/simple/setuptools/), version: 27.0.0 2024-12-17T10:59:35,616 Found link https://www.piwheels.org/simple/setuptools/setuptools-26.1.1-py2.py3-none-any.whl#sha256=226c9ce65e76c6069e805982b036f36dc4b227b37dd87fc219aef721ec8604ae (from https://www.piwheels.org/simple/setuptools/), version: 26.1.1 2024-12-17T10:59:35,617 Found link https://www.piwheels.org/simple/setuptools/setuptools-26.1.0-py2.py3-none-any.whl#sha256=a59a0e2890b1ca450618b13e1a0bdb14feee6d88653d624d4156f3564303782f (from https://www.piwheels.org/simple/setuptools/), version: 26.1.0 2024-12-17T10:59:35,619 Found link https://www.piwheels.org/simple/setuptools/setuptools-26.0.0-py2.py3-none-any.whl#sha256=9d7e503229e75fd0361d59dcefba232d06b95f20153d4e27c6e77917aec375e6 (from https://www.piwheels.org/simple/setuptools/), version: 26.0.0 2024-12-17T10:59:35,620 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.4.0-py2.py3-none-any.whl#sha256=001a63383f7efae833f46c59cc6b70c96bc9b8f91db80ce83ebb9de3e1d79c01 (from https://www.piwheels.org/simple/setuptools/), version: 25.4.0 2024-12-17T10:59:35,621 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.3.0-py2.py3-none-any.whl#sha256=983fa4b85394e9c386b9bcf2c803a082f78cf213823d30c57cfcfb6ac9435511 (from https://www.piwheels.org/simple/setuptools/), version: 25.3.0 2024-12-17T10:59:35,622 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.2.0-py2.py3-none-any.whl#sha256=2845247c359bb91097ccf8f6be8a69edfa44847f3d2d5def39aa43c3d7f615ca (from https://www.piwheels.org/simple/setuptools/), version: 25.2.0 2024-12-17T10:59:35,623 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.1.6-py2.py3-none-any.whl#sha256=e61bfdbde3bfa53a7cff3a0eed10cc276338ce226a9eab6837db7f632403de7f (from https://www.piwheels.org/simple/setuptools/), version: 25.1.6 2024-12-17T10:59:35,624 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.1.5-py2.py3-none-any.whl#sha256=133810ee71ca699f5960a6d49e55209551ed1ecf9e66abce16d84ef8d8445e26 (from https://www.piwheels.org/simple/setuptools/), version: 25.1.5 2024-12-17T10:59:35,625 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.1.4-py2.py3-none-any.whl#sha256=206e3a787c222ce7c0fa489c594378e37030c4917a4c1dd9f8123a0d0c57302d (from https://www.piwheels.org/simple/setuptools/), version: 25.1.4 2024-12-17T10:59:35,626 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.1.3-py2.py3-none-any.whl#sha256=3aff2272730f806c00fc195bec9bf716ecfd363697721f02d833ffc880dae24d (from https://www.piwheels.org/simple/setuptools/), version: 25.1.3 2024-12-17T10:59:35,627 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.1.2-py2.py3-none-any.whl#sha256=931aba9fe7289ee40ca31324102e0af24086d56adbcf40be0d5896d9941a5ccc (from https://www.piwheels.org/simple/setuptools/), version: 25.1.2 2024-12-17T10:59:35,629 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.1.1-py2.py3-none-any.whl#sha256=1cce93150e00ae1153a2fc0f5d8032d79f0519b0e28fd7c56928daa84ff3213c (from https://www.piwheels.org/simple/setuptools/), version: 25.1.1 2024-12-17T10:59:35,630 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.1.0-py2.py3-none-any.whl#sha256=c7d1ef7e78f19e90d0282f04ebd284d33fbb16eeed4dd9efa7af8975732f9cdb (from https://www.piwheels.org/simple/setuptools/), version: 25.1.0 2024-12-17T10:59:35,631 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.0.2-py2.py3-none-any.whl#sha256=fe014903099c61bf1f30db1573322d7354027a33fd87432541d45b8835d0db99 (from https://www.piwheels.org/simple/setuptools/), version: 25.0.2 2024-12-17T10:59:35,632 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.0.1-py2.py3-none-any.whl#sha256=c91e0d7c383c04d39cc37a7d3c827ae80a7766ccc12d1a8fd845330b2c73ce37 (from https://www.piwheels.org/simple/setuptools/), version: 25.0.1 2024-12-17T10:59:35,633 Found link https://www.piwheels.org/simple/setuptools/setuptools-25.0.0-py2.py3-none-any.whl#sha256=eae82804db00b368f347de98020f5a1c85eef771479dbf6b3844b8d0538a23e3 (from https://www.piwheels.org/simple/setuptools/), version: 25.0.0 2024-12-17T10:59:35,634 Found link https://www.piwheels.org/simple/setuptools/setuptools-24.3.1-py2.py3-none-any.whl#sha256=d5d40e29686c0f37c7c8ef7566d9606f1f3f9697e10410882d46151c0ea918c2 (from https://www.piwheels.org/simple/setuptools/), version: 24.3.1 2024-12-17T10:59:35,635 Found link https://www.piwheels.org/simple/setuptools/setuptools-24.3.0-py2.py3-none-any.whl#sha256=98e67c7215bb3df4d408f0ea6e5826d8a4b3b3b5184e70550f3a77f670b366eb (from https://www.piwheels.org/simple/setuptools/), version: 24.3.0 2024-12-17T10:59:35,636 Found link https://www.piwheels.org/simple/setuptools/setuptools-24.2.1-py2.py3-none-any.whl#sha256=036b07815eb2ea462bc1746cb32366bc414505fa900a40f305124e7d7c6a2fd1 (from https://www.piwheels.org/simple/setuptools/), version: 24.2.1 2024-12-17T10:59:35,637 Found link https://www.piwheels.org/simple/setuptools/setuptools-24.2.0-py2.py3-none-any.whl#sha256=d30e49279709d48a6469f27bea12bc7b6d457f96dd8ee911d8cda28e8c106088 (from https://www.piwheels.org/simple/setuptools/), version: 24.2.0 2024-12-17T10:59:35,638 Found link https://www.piwheels.org/simple/setuptools/setuptools-24.1.1-py2.py3-none-any.whl#sha256=42ef0cb570cdeb04e84b1d846b6f383b0dac45ca4886fc784679d946a1d3edaa (from https://www.piwheels.org/simple/setuptools/), version: 24.1.1 2024-12-17T10:59:35,639 Found link https://www.piwheels.org/simple/setuptools/setuptools-24.1.0-py2.py3-none-any.whl#sha256=ae84c91cd69b0e84fe2b69902954a7f6144e2bbcf100282b21309bf88f77fb86 (from https://www.piwheels.org/simple/setuptools/), version: 24.1.0 2024-12-17T10:59:35,640 Found link https://www.piwheels.org/simple/setuptools/setuptools-24.0.3-py2.py3-none-any.whl#sha256=2c215f4d49eee249b734e6f44499262110f60118cd4055aeed7fd6f03602aad3 (from https://www.piwheels.org/simple/setuptools/), version: 24.0.3 2024-12-17T10:59:35,641 Found link https://www.piwheels.org/simple/setuptools/setuptools-24.0.2-py2.py3-none-any.whl#sha256=7a4c6f7cd44d1ab93392c8cdb9e24cd3b46f650be4fc20f0abd127fdf3fb9623 (from https://www.piwheels.org/simple/setuptools/), version: 24.0.2 2024-12-17T10:59:35,642 Found link https://www.piwheels.org/simple/setuptools/setuptools-24.0.1-py2.py3-none-any.whl#sha256=2d3a49bab23ac66963d41e0ba7be577e37ebdb8802dceca7c472a4367c751e13 (from https://www.piwheels.org/simple/setuptools/), version: 24.0.1 2024-12-17T10:59:35,643 Found link https://www.piwheels.org/simple/setuptools/setuptools-24.0.0-py2.py3-none-any.whl#sha256=a6a661c88e65e2c87b052961df6e28909b6b6fc7c8f6a9f78d6f18710a6104e7 (from https://www.piwheels.org/simple/setuptools/), version: 24.0.0 2024-12-17T10:59:35,644 Found link https://www.piwheels.org/simple/setuptools/setuptools-23.2.1-py2.py3-none-any.whl#sha256=f33a3a67ae0e6db7d1d7835223de5307a10effce8add50bcce8874428e4791c0 (from https://www.piwheels.org/simple/setuptools/), version: 23.2.1 2024-12-17T10:59:35,646 Found link https://www.piwheels.org/simple/setuptools/setuptools-23.2.0-py2.py3-none-any.whl#sha256=189626aee717ff18bda5e8d417edb1857204e9da1476c61c3506f0b7eb1d2797 (from https://www.piwheels.org/simple/setuptools/), version: 23.2.0 2024-12-17T10:59:35,647 Found link https://www.piwheels.org/simple/setuptools/setuptools-23.1.0-py2.py3-none-any.whl#sha256=1188de44d57e476f5ab485407b38692f75077a0eae490e1204c61576b278a153 (from https://www.piwheels.org/simple/setuptools/), version: 23.1.0 2024-12-17T10:59:35,648 Found link https://www.piwheels.org/simple/setuptools/setuptools-23.0.0-py2.py3-none-any.whl#sha256=034d5fdd7d2bf32e88218ffe86cde8af5ecbaa3361d334b2bd48a4060eac3816 (from https://www.piwheels.org/simple/setuptools/), version: 23.0.0 2024-12-17T10:59:35,649 Found link https://www.piwheels.org/simple/setuptools/setuptools-22.0.5-py2.py3-none-any.whl#sha256=d12a016baac1c7451dad0048f5777f99c4e91e9d9724004a9cf447c062e15a33 (from https://www.piwheels.org/simple/setuptools/), version: 22.0.5 2024-12-17T10:59:35,650 Found link https://www.piwheels.org/simple/setuptools/setuptools-22.0.4-py2.py3-none-any.whl#sha256=7ca8ae5283b443a0edbbf1ac8d721b4a3ab874140d0173e217b7a92bceb81bc8 (from https://www.piwheels.org/simple/setuptools/), version: 22.0.4 2024-12-17T10:59:35,651 Found link https://www.piwheels.org/simple/setuptools/setuptools-22.0.2-py2.py3-none-any.whl#sha256=b09ac13b7d40cfedf8cf5c6011d56452fa0310f87d0779b07bce2bd0773554fe (from https://www.piwheels.org/simple/setuptools/), version: 22.0.2 2024-12-17T10:59:35,652 Found link https://www.piwheels.org/simple/setuptools/setuptools-22.0.1-py2.py3-none-any.whl#sha256=5ed3225aec88589ac50ba0f667c01fcb3d135537f160d95438b75dea3faa47b4 (from https://www.piwheels.org/simple/setuptools/), version: 22.0.1 2024-12-17T10:59:35,653 Found link https://www.piwheels.org/simple/setuptools/setuptools-22.0.0-py2.py3-none-any.whl#sha256=e2ca74d691e1797139483c4a77d7e4ee8e4722dc94b13022ae322782f0c1a4fe (from https://www.piwheels.org/simple/setuptools/), version: 22.0.0 2024-12-17T10:59:35,654 Found link https://www.piwheels.org/simple/setuptools/setuptools-21.2.2-py2.py3-none-any.whl#sha256=5f1d8fc7d5208dd6d490a697b3319045118d6f2ce518a7dfe72f02adae1ff13a (from https://www.piwheels.org/simple/setuptools/), version: 21.2.2 2024-12-17T10:59:35,655 Found link https://www.piwheels.org/simple/setuptools/setuptools-21.2.1-py2.py3-none-any.whl#sha256=a2ecb2a5723f6ecb8140f182f6514edc5f5da7dec47f0be65d24aef18c09a746 (from https://www.piwheels.org/simple/setuptools/), version: 21.2.1 2024-12-17T10:59:35,656 Found link https://www.piwheels.org/simple/setuptools/setuptools-21.2.0-py2.py3-none-any.whl#sha256=eb294525cc40dab2d0a66cb0ed840c51604b13b70063d0e125b78563aae3a928 (from https://www.piwheels.org/simple/setuptools/), version: 21.2.0 2024-12-17T10:59:35,657 Found link https://www.piwheels.org/simple/setuptools/setuptools-21.1.0-py2.py3-none-any.whl#sha256=3c0996dfe854075ba944a28380b6768236374eb3c59fb3f7125c04344ac29c3b (from https://www.piwheels.org/simple/setuptools/), version: 21.1.0 2024-12-17T10:59:35,658 Found link https://www.piwheels.org/simple/setuptools/setuptools-21.0.0-py2.py3-none-any.whl#sha256=fb6378f65eb630281227720ae80276f38c1a1f16969eca499435c0ff2a815fe6 (from https://www.piwheels.org/simple/setuptools/), version: 21.0.0 2024-12-17T10:59:35,659 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.10.1-py2.py3-none-any.whl#sha256=a037098401257659ec664ad0818a041b8b29f69172c274e2013d4399326bcb70 (from https://www.piwheels.org/simple/setuptools/), version: 20.10.1 2024-12-17T10:59:35,660 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.9.0-py2.py3-none-any.whl#sha256=f8e38d3002085052bcc934053745152bac9979e6aa5649115794b34cde5fb180 (from https://www.piwheels.org/simple/setuptools/), version: 20.9.0 2024-12-17T10:59:35,661 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.8.1-py2.py3-none-any.whl#sha256=d5bbc1929feeaa81233bdadc0c720d35ac27a3ca7a1f9641f632af822419114d (from https://www.piwheels.org/simple/setuptools/), version: 20.8.1 2024-12-17T10:59:35,662 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.8.0-py2.py3-none-any.whl#sha256=e5e721c335a658db0bb68d03f94dac3d9de873a928fbd7bcbe3a1ec9e0f88102 (from https://www.piwheels.org/simple/setuptools/), version: 20.8.0 2024-12-17T10:59:35,664 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.7.0-py2.py3-none-any.whl#sha256=8917a52aa3a389893221b173a89dae0471022d32bff3ebc31a1072988aa8039d (from https://www.piwheels.org/simple/setuptools/), version: 20.7.0 2024-12-17T10:59:35,665 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.6.8-py2.py3-none-any.whl#sha256=01bb4420af29e5c1799482ede72e38e1242459c21049f6407dd526bd6459e167 (from https://www.piwheels.org/simple/setuptools/), version: 20.6.8 2024-12-17T10:59:35,666 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.6.7-py2.py3-none-any.whl#sha256=9982ee4d279a2541dc1a7efee994ff9c535cfc05315e121e09df7f93da48c442 (from https://www.piwheels.org/simple/setuptools/), version: 20.6.7 2024-12-17T10:59:35,667 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.6.6-py2.py3-none-any.whl#sha256=318a28cea28e00d47fed4fcc0f0be8c933bb963b9d8e21c1047a5b657c967e5f (from https://www.piwheels.org/simple/setuptools/), version: 20.6.6 2024-12-17T10:59:35,668 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.4-py2.py3-none-any.whl#sha256=8c110e7116d78933ab656a850971ba53b20d936e48fb493db1c5afa75051eefa (from https://www.piwheels.org/simple/setuptools/), version: 20.4 2024-12-17T10:59:35,669 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.3.1-py2.py3-none-any.whl#sha256=9553b654fbfef3338c15e9c6751ea4032c3d9f28ef0ed4f73c64c7403cd37b18 (from https://www.piwheels.org/simple/setuptools/), version: 20.3.1 2024-12-17T10:59:35,670 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.3-py2.py3-none-any.whl#sha256=8cf051b5885971d5e5895bf5633257e5864785f062d566002292f1276ec0a92a (from https://www.piwheels.org/simple/setuptools/), version: 20.3 2024-12-17T10:59:35,671 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.2.2-py2.py3-none-any.whl#sha256=fc03457fb87abad49dc09f9c3133863693e7ddb6ca82bb50a739a77379ce5a9a (from https://www.piwheels.org/simple/setuptools/), version: 20.2.2 2024-12-17T10:59:35,672 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.1.1-py2.py3-none-any.whl#sha256=dfdbc643f8900d9e617e48a42ae389aa18fd6fbd2846f24f2a4678b8d9412acb (from https://www.piwheels.org/simple/setuptools/), version: 20.1.1 2024-12-17T10:59:35,673 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.1-py2.py3-none-any.whl#sha256=c54c0d9473139a5c7a70a752b7322a651e0d611e3e5f0ea95632db0024ed64f4 (from https://www.piwheels.org/simple/setuptools/), version: 20.1 2024-12-17T10:59:35,674 Found link https://www.piwheels.org/simple/setuptools/setuptools-20.0-py2.py3-none-any.whl#sha256=4c15b00b76fbb296d7fdee314f21e339fc5f9b913264ce07a9ab2445a3d594a7 (from https://www.piwheels.org/simple/setuptools/), version: 20.0 2024-12-17T10:59:35,675 Found link https://www.piwheels.org/simple/setuptools/setuptools-19.7-py2.py3-none-any.whl#sha256=5bf6fb535b1d7dd73ad15c4c63144b0fe700cfb6014d7c5001e33803c2ba9792 (from https://www.piwheels.org/simple/setuptools/), version: 19.7 2024-12-17T10:59:35,676 Found link https://www.piwheels.org/simple/setuptools/setuptools-19.6.2-py2.py3-none-any.whl#sha256=5e637486db1147880bf6868f861e9339dba8d3452813a330c9feb75104e64b2d (from https://www.piwheels.org/simple/setuptools/), version: 19.6.2 2024-12-17T10:59:35,677 Found link https://www.piwheels.org/simple/setuptools/setuptools-19.6.1-py2.py3-none-any.whl#sha256=056939fdb00377e4043b221bb508afba4b561f9fea04a526a17a4b7c50ea0e39 (from https://www.piwheels.org/simple/setuptools/), version: 19.6.1 2024-12-17T10:59:35,678 Found link https://www.piwheels.org/simple/setuptools/setuptools-19.6-py2.py3-none-any.whl#sha256=57c63a363b37ffa2d64db4ffee26844e3ab81441fc02da4cd5e8cafcff9acb3a (from https://www.piwheels.org/simple/setuptools/), version: 19.6 2024-12-17T10:59:35,679 Found link https://www.piwheels.org/simple/setuptools/setuptools-19.5-py2.py3-none-any.whl#sha256=ec11d91d2a5306be9590b1478eed1772f8868688871d80383f928dc953283f2c (from https://www.piwheels.org/simple/setuptools/), version: 19.5 2024-12-17T10:59:35,680 Found link https://www.piwheels.org/simple/setuptools/setuptools-19.4.1-py2.py3-none-any.whl#sha256=20a0ae47c44790874aaeedaca077e50041c8ea1ccd4ea5c5c715e115f07f3f1b (from https://www.piwheels.org/simple/setuptools/), version: 19.4.1 2024-12-17T10:59:35,681 Found link https://www.piwheels.org/simple/setuptools/setuptools-19.4-py2.py3-none-any.whl#sha256=0801e6d862ca4ce24d918420d62f07ee2fe736dc016e3afa99d2103e7a02e9a6 (from https://www.piwheels.org/simple/setuptools/), version: 19.4 2024-12-17T10:59:35,683 Found link https://www.piwheels.org/simple/setuptools/setuptools-19.3-py2.py3-none-any.whl#sha256=efd3423dc12a494e66fc3d60c6ef136bf1e1ebdf56225257a878fa78e6978054 (from https://www.piwheels.org/simple/setuptools/), version: 19.3 2024-12-17T10:59:35,684 Found link https://www.piwheels.org/simple/setuptools/setuptools-19.2-py2.py3-none-any.whl#sha256=f93207fe24cb3b701ab575a18443dd291546cee7f840c3f7f900c8cda2e0156f (from https://www.piwheels.org/simple/setuptools/), version: 19.2 2024-12-17T10:59:35,685 Found link https://www.piwheels.org/simple/setuptools/setuptools-19.1.1-py2.py3-none-any.whl#sha256=07ec70d6f6d8e3e4e6144bf251188ce8f3a49e564e37e27a710852703e577e33 (from https://www.piwheels.org/simple/setuptools/), version: 19.1.1 2024-12-17T10:59:35,686 Found link https://www.piwheels.org/simple/setuptools/setuptools-19.1-py2.py3-none-any.whl#sha256=91839f2b15ab024ccf662b55a807eb8886ffb3430cbe5ff5ddd52e96d1f14c7f (from https://www.piwheels.org/simple/setuptools/), version: 19.1 2024-12-17T10:59:35,687 Found link https://www.piwheels.org/simple/setuptools/setuptools-19.0-py2.py3-none-any.whl#sha256=af3bde6478ca42257e0f957ab12aeb7dc4a89d9a6b5dcebe3a317c4364309533 (from https://www.piwheels.org/simple/setuptools/), version: 19.0 2024-12-17T10:59:35,688 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.8.1-py2.py3-none-any.whl#sha256=ac794a30440f95b88626c8ece032e8f28bb220127e847b17c230b0c4ef8c13fd (from https://www.piwheels.org/simple/setuptools/), version: 18.8.1 2024-12-17T10:59:35,689 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.8-py2.py3-none-any.whl#sha256=a6335e649ed0e2d3f3f4606fa05efcde457bbc65a962d6ad2344ff13675dc757 (from https://www.piwheels.org/simple/setuptools/), version: 18.8 2024-12-17T10:59:35,690 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.7.1-py2.py3-none-any.whl#sha256=624c3c0462540a18d5930bea79a6ccc3a7eb968e41264c187bf4755078ea2937 (from https://www.piwheels.org/simple/setuptools/), version: 18.7.1 2024-12-17T10:59:35,691 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.7-py2.py3-none-any.whl#sha256=5b80aeba78227e98d51d11684551f2f26cc77192181ffa63a7fa334bfc186473 (from https://www.piwheels.org/simple/setuptools/), version: 18.7 2024-12-17T10:59:35,692 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.6.1-py2.py3-none-any.whl#sha256=5300d684179b43d4294a76cffd23121283ac31a98e8ed9bcc8dc1adcc8bd4c8b (from https://www.piwheels.org/simple/setuptools/), version: 18.6.1 2024-12-17T10:59:35,693 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.6-py2.py3-none-any.whl#sha256=a90688d8a89aedf34945cf3dd97d08bc2684b7aa34997698dd175ceccb093f47 (from https://www.piwheels.org/simple/setuptools/), version: 18.6 2024-12-17T10:59:35,694 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.5-py2.py3-none-any.whl#sha256=fe3f645fbb713949de444504477a71e8ce3219b172220af1a17d1ed92440b469 (from https://www.piwheels.org/simple/setuptools/), version: 18.5 2024-12-17T10:59:35,695 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.4-py2.py3-none-any.whl#sha256=ba3b4ea51ddec70c0977cf16a12c5c578b8d1f8921e59d0b4888378942e5ac79 (from https://www.piwheels.org/simple/setuptools/), version: 18.4 2024-12-17T10:59:35,696 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.3.2-py2.py3-none-any.whl#sha256=818de28dbc4da380ca43c5c8d48d155891a6e10bb0e7ac103feee6b31be2dd25 (from https://www.piwheels.org/simple/setuptools/), version: 18.3.2 2024-12-17T10:59:35,697 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.3.1-py2.py3-none-any.whl#sha256=08e2b4c6d4bd2fa9b75d41d4bb8903967dec91d9ec215bab0c9c2624c54b251b (from https://www.piwheels.org/simple/setuptools/), version: 18.3.1 2024-12-17T10:59:35,698 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.3-py2.py3-none-any.whl#sha256=66747a68dec0dadc8e56b5611330b7c47742da81754af0f3b73e46744b28499e (from https://www.piwheels.org/simple/setuptools/), version: 18.3 2024-12-17T10:59:35,699 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.2-py2.py3-none-any.whl#sha256=04fe25dcc2affa9845518f7df0d98d35b384238665c5405fec88c9ca11750a4a (from https://www.piwheels.org/simple/setuptools/), version: 18.2 2024-12-17T10:59:35,700 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.1-py2.py3-none-any.whl#sha256=5fbb87a9402bdb9a8fc3625463abdb1f0ea6655cc41c71f29fdcec3c4ff9c35d (from https://www.piwheels.org/simple/setuptools/), version: 18.1 2024-12-17T10:59:35,701 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.0.1-py2.py3-none-any.whl#sha256=825814864707c12e3eb7878c9d9cc7189507022d53476b71ef833b3d28df0c9c (from https://www.piwheels.org/simple/setuptools/), version: 18.0.1 2024-12-17T10:59:35,702 Found link https://www.piwheels.org/simple/setuptools/setuptools-18.0-py2.py3-none-any.whl#sha256=e34882c2529a84bd0d66a4e0273300f8080bbfe30bd82bb39935c247731bfda7 (from https://www.piwheels.org/simple/setuptools/), version: 18.0 2024-12-17T10:59:35,703 Found link https://www.piwheels.org/simple/setuptools/setuptools-17.1.1-py2.py3-none-any.whl#sha256=42dc3d14631bb088a20a80761bad6671f8ed819f96cb5b65831fcdcfe5e7676a (from https://www.piwheels.org/simple/setuptools/), version: 17.1.1 2024-12-17T10:59:35,705 Found link https://www.piwheels.org/simple/setuptools/setuptools-17.1-py2.py3-none-any.whl#sha256=f4c0fc949ca92232227559f9e1ccc62f576a9c7e2c6da04a264ddfaa0e4e0e91 (from https://www.piwheels.org/simple/setuptools/), version: 17.1 2024-12-17T10:59:35,706 Found link https://www.piwheels.org/simple/setuptools/setuptools-17.0-py2.py3-none-any.whl#sha256=7c3e88a7cf77a537a8313471c2ea04d6f26f1e53acfcc48210ca7b5cde355aec (from https://www.piwheels.org/simple/setuptools/), version: 17.0 2024-12-17T10:59:35,707 Found link https://www.piwheels.org/simple/setuptools/setuptools-16.0-py2.py3-none-any.whl#sha256=58e31b159cdabf42aced83820981967b1adfd797c1dd55dcfa30e92f8ed931a0 (from https://www.piwheels.org/simple/setuptools/), version: 16.0 2024-12-17T10:59:35,708 Found link https://www.piwheels.org/simple/setuptools/setuptools-15.2-py2.py3-none-any.whl#sha256=6c6157c8268191003743dcf68b548ef5ba7bc836af1ec91123f2c832da620d25 (from https://www.piwheels.org/simple/setuptools/), version: 15.2 2024-12-17T10:59:35,709 Found link https://www.piwheels.org/simple/setuptools/setuptools-15.1-py2.py3-none-any.whl#sha256=86318384560ceca05687e6ff67299b697c4ea4125b9a6b62873efc07d41cbf60 (from https://www.piwheels.org/simple/setuptools/), version: 15.1 2024-12-17T10:59:35,710 Found link https://www.piwheels.org/simple/setuptools/setuptools-15.0-py2.py3-none-any.whl#sha256=225c09cae4f9b80db3fb3d3b211e2af0ad4c501c6f09df38fea9b25c65991f9a (from https://www.piwheels.org/simple/setuptools/), version: 15.0 2024-12-17T10:59:35,711 Found link https://www.piwheels.org/simple/setuptools/setuptools-14.3.1-py2.py3-none-any.whl#sha256=f2c2d184bac05d491fc59e82ddcbf6fa0458faf4ac8f5c86c48ab0bd6956ef21 (from https://www.piwheels.org/simple/setuptools/), version: 14.3.1 2024-12-17T10:59:35,712 Found link https://www.piwheels.org/simple/setuptools/setuptools-14.3-py2.py3-none-any.whl#sha256=86e23bc914e9962f888df9db2c8cd079c88ad51cc3f88068dcf551e4d81273fb (from https://www.piwheels.org/simple/setuptools/), version: 14.3 2024-12-17T10:59:35,713 Found link https://www.piwheels.org/simple/setuptools/setuptools-14.2-py2.py3-none-any.whl#sha256=59d3a2dcb53c58b603a0f2594970f44943fcdd29f15fb079d161e8269cc40627 (from https://www.piwheels.org/simple/setuptools/), version: 14.2 2024-12-17T10:59:35,714 Found link https://www.piwheels.org/simple/setuptools/setuptools-14.1.1-py2.py3-none-any.whl#sha256=ec323c5e29cbfbbe1f988cc2860ed08c63def908150c3d2866e5ef57ed1448c6 (from https://www.piwheels.org/simple/setuptools/), version: 14.1.1 2024-12-17T10:59:35,715 Found link https://www.piwheels.org/simple/setuptools/setuptools-14.1-py2.py3-none-any.whl#sha256=5acff003ca0ebba6f39ef3f339c8caf6e6bfa4ff7acb8968af99c1e46b9bf594 (from https://www.piwheels.org/simple/setuptools/), version: 14.1 2024-12-17T10:59:35,716 Found link https://www.piwheels.org/simple/setuptools/setuptools-14.0-py2.py3-none-any.whl#sha256=057ece816dc7be65dac7d2f3bcece7940013e66491644ac01623003ddad87252 (from https://www.piwheels.org/simple/setuptools/), version: 14.0 2024-12-17T10:59:35,717 Found link https://www.piwheels.org/simple/setuptools/setuptools-13.0.2-py2.py3-none-any.whl#sha256=a89234c23285b3effaea9413afabc527cb937317bbd2e7d66e649ae54c0cdfa5 (from https://www.piwheels.org/simple/setuptools/), version: 13.0.2 2024-12-17T10:59:35,718 Found link https://www.piwheels.org/simple/setuptools/setuptools-13.0.1-py2.py3-none-any.whl#sha256=cf62e27369352ec4d609cd1b157ae0348d32e1d97db8e3a6dc55a32c3c43688d (from https://www.piwheels.org/simple/setuptools/), version: 13.0.1 2024-12-17T10:59:35,719 Found link https://www.piwheels.org/simple/setuptools/setuptools-12.4-py2.py3-none-any.whl#sha256=f3ce0ee03c9af6331f68ed9577a99540d312dbd419c9834dc34c6909ca741bd5 (from https://www.piwheels.org/simple/setuptools/), version: 12.4 2024-12-17T10:59:35,720 Found link https://www.piwheels.org/simple/setuptools/setuptools-12.3-py2.py3-none-any.whl#sha256=b2dd9cbcab51330ef7103dab8835ee762143cc7d6ab973948522463194036096 (from https://www.piwheels.org/simple/setuptools/), version: 12.3 2024-12-17T10:59:35,721 Found link https://www.piwheels.org/simple/setuptools/setuptools-12.2-py2.py3-none-any.whl#sha256=818308bc29880c13e82bbc192cfe1c3e2cb0c245111bb184b04b7990eefcaa7d (from https://www.piwheels.org/simple/setuptools/), version: 12.2 2024-12-17T10:59:35,722 Found link https://www.piwheels.org/simple/setuptools/setuptools-12.1-py2.py3-none-any.whl#sha256=d99879e786656d61e8e6dc91a29c4c838d27cb8008dc760433d3b1e3db9a0c8b (from https://www.piwheels.org/simple/setuptools/), version: 12.1 2024-12-17T10:59:35,724 Found link https://www.piwheels.org/simple/setuptools/setuptools-12.0.5-py2.py3-none-any.whl#sha256=8fe96cb82abceb5bdae864641469d941bedd14b993a90ecdf54e0425a83952c1 (from https://www.piwheels.org/simple/setuptools/), version: 12.0.5 2024-12-17T10:59:35,725 Found link https://www.piwheels.org/simple/setuptools/setuptools-12.0.4-py2.py3-none-any.whl#sha256=6f4e3036ce3edd0d218cbf59026892528dc43951748c684fdf0c08fe21344f6f (from https://www.piwheels.org/simple/setuptools/), version: 12.0.4 2024-12-17T10:59:35,726 Found link https://www.piwheels.org/simple/setuptools/setuptools-12.0.3-py2.py3-none-any.whl#sha256=04fbfe87a72638a4c4dc43db6b3b6cca9b6d8c06354dee6058a2986a35a930a2 (from https://www.piwheels.org/simple/setuptools/), version: 12.0.3 2024-12-17T10:59:35,727 Found link https://www.piwheels.org/simple/setuptools/setuptools-12.0.2-py2.py3-none-any.whl#sha256=3901bc6d3ec8b8fe6a75b1ecd24d7a9046fcd06e1b3aa7a4b1522f7e1803bf72 (from https://www.piwheels.org/simple/setuptools/), version: 12.0.2 2024-12-17T10:59:35,728 Found link https://www.piwheels.org/simple/setuptools/setuptools-12.0.1-py2.py3-none-any.whl#sha256=2528465702121db95f6a5235eb3e0ed6cf9526ad40d05a9898afb53b44a04397 (from https://www.piwheels.org/simple/setuptools/), version: 12.0.1 2024-12-17T10:59:35,729 Found link https://www.piwheels.org/simple/setuptools/setuptools-12.0-py2.py3-none-any.whl#sha256=78b43c5c9e7b60ef524e1bfeea6a4c065e40ad9f80d7af2f0ae88e4b122735b1 (from https://www.piwheels.org/simple/setuptools/), version: 12.0 2024-12-17T10:59:35,730 Found link https://www.piwheels.org/simple/setuptools/setuptools-11.3.1-py2.py3-none-any.whl#sha256=8207d09210de058fca832c4636c9bc650047e9566848c7e489257bbce59b24cc (from https://www.piwheels.org/simple/setuptools/), version: 11.3.1 2024-12-17T10:59:35,731 Found link https://www.piwheels.org/simple/setuptools/setuptools-11.3-py2.py3-none-any.whl#sha256=088434bdfa3a0280b8f92d86b4bb496131caacb01d955005253b36216a73e008 (from https://www.piwheels.org/simple/setuptools/), version: 11.3 2024-12-17T10:59:35,732 Found link https://www.piwheels.org/simple/setuptools/setuptools-11.2-py2.py3-none-any.whl#sha256=22352c4e2ed175ad12d5082e26e0f06cfa3802640169726736a94158b19a8b69 (from https://www.piwheels.org/simple/setuptools/), version: 11.2 2024-12-17T10:59:35,733 Found link https://www.piwheels.org/simple/setuptools/setuptools-11.1-py2.py3-none-any.whl#sha256=6abc3a03d4c3168c31fc88c7a584d3bcf6783b5366f3dde77b34d0ac8cee52f9 (from https://www.piwheels.org/simple/setuptools/), version: 11.1 2024-12-17T10:59:35,734 Found link https://www.piwheels.org/simple/setuptools/setuptools-11.0-py2.py3-none-any.whl#sha256=2120692cd49873eaa5b359b3d690d02d4a989ab9c0065d5a39f00f2b6fe5bd21 (from https://www.piwheels.org/simple/setuptools/), version: 11.0 2024-12-17T10:59:35,735 Found link https://www.piwheels.org/simple/setuptools/setuptools-10.2.1-py2.py3-none-any.whl#sha256=ced9c5cbd9a1126a9058f3dfd864835cde05a7fdd87b4275f609091c0726fe74 (from https://www.piwheels.org/simple/setuptools/), version: 10.2.1 2024-12-17T10:59:35,736 Found link https://www.piwheels.org/simple/setuptools/setuptools-10.2-py2.py3-none-any.whl#sha256=42e737877de374a7594350b42dbf15325363ac56ec14417b89cf230d52eeb92d (from https://www.piwheels.org/simple/setuptools/), version: 10.2 2024-12-17T10:59:35,737 Found link https://www.piwheels.org/simple/setuptools/setuptools-10.1-py2.py3-none-any.whl#sha256=cc1ae4ab6c610df8f4041867a0785a22b62320a2a8290986093e6a13ebe2f33d (from https://www.piwheels.org/simple/setuptools/), version: 10.1 2024-12-17T10:59:35,738 Found link https://www.piwheels.org/simple/setuptools/setuptools-10.0.1-py2.py3-none-any.whl#sha256=fccc3d1663533d269fbdeff61921083609cb4d0dc215201df884c94408eb2314 (from https://www.piwheels.org/simple/setuptools/), version: 10.0.1 2024-12-17T10:59:35,739 Found link https://www.piwheels.org/simple/setuptools/setuptools-10.0-py2.py3-none-any.whl#sha256=1b57e7326d6d62af4ce6bfb5f914455da14b156fa6def0fe50fb3b13f5cee513 (from https://www.piwheels.org/simple/setuptools/), version: 10.0 2024-12-17T10:59:35,740 Found link https://www.piwheels.org/simple/setuptools/setuptools-9.1-py2.py3-none-any.whl#sha256=958e42d4f1ea13bd90fc963816eaa840df33cd349f2e05446e60a4f160e3b54e (from https://www.piwheels.org/simple/setuptools/), version: 9.1 2024-12-17T10:59:35,741 Found link https://www.piwheels.org/simple/setuptools/setuptools-9.0.1-py2.py3-none-any.whl#sha256=acab7553c7c75261ad4c32ba058244a188a6fa9a988187ce4d1522962319fa23 (from https://www.piwheels.org/simple/setuptools/), version: 9.0.1 2024-12-17T10:59:35,743 Found link https://www.piwheels.org/simple/setuptools/setuptools-9.0-py2.py3-none-any.whl#sha256=3e53620c4b1794ad449bd8647578b7f87c7761fa2cee1ce207a4e8b54f239a91 (from https://www.piwheels.org/simple/setuptools/), version: 9.0 2024-12-17T10:59:35,744 Found link https://www.piwheels.org/simple/setuptools/setuptools-8.3-py2.py3-none-any.whl#sha256=525457fc79543234a99aca787b43e23a25eb4f4dfd87afa51667b6766a02fcb4 (from https://www.piwheels.org/simple/setuptools/), version: 8.3 2024-12-17T10:59:35,745 Found link https://www.piwheels.org/simple/setuptools/setuptools-8.2.1-py2.py3-none-any.whl#sha256=16f658027b9e3dc2cbc5c5d3084ebe6a0f845bf7cf248f0f41f19282b458e9c5 (from https://www.piwheels.org/simple/setuptools/), version: 8.2.1 2024-12-17T10:59:35,746 Found link https://www.piwheels.org/simple/setuptools/setuptools-8.2-py2.py3-none-any.whl#sha256=7060f908c42e6cde9b12a4311722ba243d8a5670c33ad620d84098267e867670 (from https://www.piwheels.org/simple/setuptools/), version: 8.2 2024-12-17T10:59:35,747 Found link https://www.piwheels.org/simple/setuptools/setuptools-8.1-py2.py3-none-any.whl#sha256=bce61812d77f68e484653e523f713a16ba53e012a0eb2a0eb61507363a2f8abf (from https://www.piwheels.org/simple/setuptools/), version: 8.1 2024-12-17T10:59:35,748 Found link https://www.piwheels.org/simple/setuptools/setuptools-8.0.4-py2.py3-none-any.whl#sha256=8eadb148a033f13543bfb94da8dd532f59c2032353fb1419a4f21b6ea29cab0a (from https://www.piwheels.org/simple/setuptools/), version: 8.0.4 2024-12-17T10:59:35,749 Found link https://www.piwheels.org/simple/setuptools/setuptools-8.0.3-py2.py3-none-any.whl#sha256=9968af3d938e2ac73a75120b84233f6584610cf64b5be2566438e63b75df93a7 (from https://www.piwheels.org/simple/setuptools/), version: 8.0.3 2024-12-17T10:59:35,750 Found link https://www.piwheels.org/simple/setuptools/setuptools-8.0.2-py2.py3-none-any.whl#sha256=50373b5fa0ffcf9757522af8c6be44427524ac82b0985f9c6e7701ddb182d624 (from https://www.piwheels.org/simple/setuptools/), version: 8.0.2 2024-12-17T10:59:35,751 Found link https://www.piwheels.org/simple/setuptools/setuptools-8.0.1-py2.py3-none-any.whl#sha256=2c88b0c4288ca55cb1fc8dc9b28e0c157d1b10deb11d956942151e115c961737 (from https://www.piwheels.org/simple/setuptools/), version: 8.0.1 2024-12-17T10:59:35,752 Found link https://www.piwheels.org/simple/setuptools/setuptools-8.0-py2.py3-none-any.whl#sha256=5fd965e705e8aa78979b0c0bb17e01e01f6940056ba96e35039963631e41dfcf (from https://www.piwheels.org/simple/setuptools/), version: 8.0 2024-12-17T10:59:35,753 Found link https://www.piwheels.org/simple/setuptools/setuptools-7.0-py2.py3-none-any.whl#sha256=dc1ff5558d0e4dd8c422a4639350f6748f0811cfae5f0aa219401f3a35306a20 (from https://www.piwheels.org/simple/setuptools/), version: 7.0 2024-12-17T10:59:35,754 Found link https://www.piwheels.org/simple/setuptools/setuptools-6.1-py2.py3-none-any.whl#sha256=aff52519bce6009b34ba6394484e118503a6c884feaaa3d7ae92d74facbe370e (from https://www.piwheels.org/simple/setuptools/), version: 6.1 2024-12-17T10:59:35,755 Found link https://www.piwheels.org/simple/setuptools/setuptools-6.0.2-py2.py3-none-any.whl#sha256=7d86cdb76057f4d237050e552a8aa372fa8a1214327d8e8ad66a11920e734d16 (from https://www.piwheels.org/simple/setuptools/), version: 6.0.2 2024-12-17T10:59:35,756 Found link https://www.piwheels.org/simple/setuptools/setuptools-6.0.1-py2.py3-none-any.whl#sha256=7f0740d6dbf8aafd397d43a4eecd72ce6c0fbd007e6877ab9a5ffe6d896b95b7 (from https://www.piwheels.org/simple/setuptools/), version: 6.0.1 2024-12-17T10:59:35,757 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.8-py2.py3-none-any.whl#sha256=487cfc157fc7a26b1467a2ce793a7769f066c2ad814a110cdcde876675fcb7cb (from https://www.piwheels.org/simple/setuptools/), version: 5.8 2024-12-17T10:59:35,758 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.7-py2.py3-none-any.whl#sha256=fb97faa2ec56b9e14df4d10b1ca07117ef396dcd820c3b11f554c5599aafe1a4 (from https://www.piwheels.org/simple/setuptools/), version: 5.7 2024-12-17T10:59:35,759 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.6-py2.py3-none-any.whl#sha256=387fb155aa9a11dbbfa34cce6c8eca0b2d91490f6c48075efe27acf7d6fb1c9f (from https://www.piwheels.org/simple/setuptools/), version: 5.6 2024-12-17T10:59:35,760 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.5.1-py2.py3-none-any.whl#sha256=36c4a1e29cb7cfb0fb517993208d8b4d83a1ced92e3f075e46653e8248828d05 (from https://www.piwheels.org/simple/setuptools/), version: 5.5.1 2024-12-17T10:59:35,762 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.5-py2.py3-none-any.whl#sha256=888b1bbc2de1b3efbcb3ae4ebe8c47ec7ab9e4577a1e56064ac7cccd38013a88 (from https://www.piwheels.org/simple/setuptools/), version: 5.5 2024-12-17T10:59:35,763 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.4.2-py2.py3-none-any.whl#sha256=343d6635c50de94a5d640c9eb8d9531676bc0ef6bbc32cc216ce2b2f8e5a8e61 (from https://www.piwheels.org/simple/setuptools/), version: 5.4.2 2024-12-17T10:59:35,764 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.4.1-py2.py3-none-any.whl#sha256=4f2e50cb2f2585e90637dd0dce289ea7c3b42d549a89fc8e9420a160fc8d5f34 (from https://www.piwheels.org/simple/setuptools/), version: 5.4.1 2024-12-17T10:59:35,765 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.4-py2.py3-none-any.whl#sha256=a1c22b481962d230d62b3b2200a231151dd9d0f7cb6346bb9fe5aea97bbe5a95 (from https://www.piwheels.org/simple/setuptools/), version: 5.4 2024-12-17T10:59:35,766 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.3-py2.py3-none-any.whl#sha256=993b7cfb4a73b7f16054a27547ad3d1ccc6040446a8cde13c9860cdaf51f6525 (from https://www.piwheels.org/simple/setuptools/), version: 5.3 2024-12-17T10:59:35,767 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.2-py2.py3-none-any.whl#sha256=df9f3e7a4b0030dd747b5d0db0db1db6595d6d3839df13d356d9e91dd6076ae8 (from https://www.piwheels.org/simple/setuptools/), version: 5.2 2024-12-17T10:59:35,768 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.1-py2.py3-none-any.whl#sha256=cf73ae34664926a6d7dfb225682751a1e10daad28e343a49339d0bf315c7a158 (from https://www.piwheels.org/simple/setuptools/), version: 5.1 2024-12-17T10:59:35,769 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.0.2-py2.py3-none-any.whl#sha256=057386b5c4cfd2c648c89333378cdd51bf045635dea5b99d4df3dab72f187979 (from https://www.piwheels.org/simple/setuptools/), version: 5.0.2 2024-12-17T10:59:35,770 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.0.1-py2.py3-none-any.whl#sha256=1b7ac064ca58494c96805333cbf5b0bc8123589d8d01a7119e47effdf8933c46 (from https://www.piwheels.org/simple/setuptools/), version: 5.0.1 2024-12-17T10:59:35,771 Found link https://www.piwheels.org/simple/setuptools/setuptools-5.0-py2.py3-none-any.whl#sha256=ec5f6a89f285af6b1582b1ed3e34be46b44d99946eb196c63fc45ce40b0bc6f4 (from https://www.piwheels.org/simple/setuptools/), version: 5.0 2024-12-17T10:59:35,772 Found link https://www.piwheels.org/simple/setuptools/setuptools-4.0.1-py2.py3-none-any.whl#sha256=6bf65ee21c7a0cdda1af58725ef7b4ce69dc58ae3719e9bda97b8fd3832ec52a (from https://www.piwheels.org/simple/setuptools/), version: 4.0.1 2024-12-17T10:59:35,773 Found link https://www.piwheels.org/simple/setuptools/setuptools-4.0-py2.py3-none-any.whl#sha256=27e5bc1fe77161dd8ff5c6fcf9d427abeaa6d077b1c13febf422a035c05e9780 (from https://www.piwheels.org/simple/setuptools/), version: 4.0 2024-12-17T10:59:35,774 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.8.1-py2.py3-none-any.whl#sha256=4523f87032f91ee2fab6a368ca002ac73fafe3987e923fbdaf465ab8269eb5de (from https://www.piwheels.org/simple/setuptools/), version: 3.8.1 2024-12-17T10:59:35,775 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.8-py2.py3-none-any.whl#sha256=d325c3412a34b33e30d4f3c1f7f8e15f4e1e331e46c5a85bab0aaf9c751331ae (from https://www.piwheels.org/simple/setuptools/), version: 3.8 2024-12-17T10:59:35,776 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.7.1-py2.py3-none-any.whl#sha256=0612e99e260fe8936e4da3aa798b3e0707e161542a3070827be0b10543de0e52 (from https://www.piwheels.org/simple/setuptools/), version: 3.7.1 2024-12-17T10:59:35,778 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.7-py2.py3-none-any.whl#sha256=d90b7b46c6894115e7ab32f6d3af8fd6d9cabeb10a6a91d51afee2bd4703b0f6 (from https://www.piwheels.org/simple/setuptools/), version: 3.7 2024-12-17T10:59:35,779 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.6-py2.py3-none-any.whl#sha256=32708c733c231d0bf2b5c1b5203410efdea80d97979249389f776a085d3b6d6e (from https://www.piwheels.org/simple/setuptools/), version: 3.6 2024-12-17T10:59:35,780 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.5.2-py2.py3-none-any.whl#sha256=00fc3cd7f7e205699c51aedc4141fa22cc52b8a336c888a21ec5322210569be8 (from https://www.piwheels.org/simple/setuptools/), version: 3.5.2 2024-12-17T10:59:35,781 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.5.1-py2.py3-none-any.whl#sha256=61aefd4283245fcd844b24fc5bfe38c1be0f42fd37b0a65a08ab2f6b1e8801bb (from https://www.piwheels.org/simple/setuptools/), version: 3.5.1 2024-12-17T10:59:35,782 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.5-py2.py3-none-any.whl#sha256=bca9bae73ee13ff9a071634431735dd08f643cebc47dcbc0e1401d5c11b3fdb7 (from https://www.piwheels.org/simple/setuptools/), version: 3.5 2024-12-17T10:59:35,783 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.4.4-py2.py3-none-any.whl#sha256=0e6b645d6ceadc0182ceed9b0c60e3ab40372dba4e22d108731ccbd9a82669c4 (from https://www.piwheels.org/simple/setuptools/), version: 3.4.4 2024-12-17T10:59:35,784 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.4.3-py2.py3-none-any.whl#sha256=705345e8f8136daac132e03d6d9b3a1fb733d0fe1740b7666a64e376b062f5a6 (from https://www.piwheels.org/simple/setuptools/), version: 3.4.3 2024-12-17T10:59:35,785 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.4.2-py2.py3-none-any.whl#sha256=233c0c47afa2684d5686597fd67476869c6184acf718c7bda44757b86d561e66 (from https://www.piwheels.org/simple/setuptools/), version: 3.4.2 2024-12-17T10:59:35,786 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.4.1-py2.py3-none-any.whl#sha256=6cb23adbf91ad6153b400e3ce4a8518073087fc1713d3398f47abfa4fa9675bd (from https://www.piwheels.org/simple/setuptools/), version: 3.4.1 2024-12-17T10:59:35,787 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.4-py2.py3-none-any.whl#sha256=a9ad18120dc79d95020d36b3e1d2fa64d427380be5e01df0d621de5c502e9eb0 (from https://www.piwheels.org/simple/setuptools/), version: 3.4 2024-12-17T10:59:35,788 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.3-py2.py3-none-any.whl#sha256=4705222d7b1d308f67bd4a34ff2fb8a35b8a42f68ccb4a60586a2dd979665875 (from https://www.piwheels.org/simple/setuptools/), version: 3.3 2024-12-17T10:59:35,789 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.2-py2.py3-none-any.whl#sha256=900a1d2cc619603ab456b4d1e3ee050ddd99515ebc81335de6431b469d6cbbda (from https://www.piwheels.org/simple/setuptools/), version: 3.2 2024-12-17T10:59:35,790 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.1-py2.py3-none-any.whl#sha256=9779604672ce638b155bf0e99612e70ef54432e049494c05caa6269c1cd1bc68 (from https://www.piwheels.org/simple/setuptools/), version: 3.1 2024-12-17T10:59:35,791 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.0.2-py2.py3-none-any.whl#sha256=5dea82cde5d879826c679fed99f6702553149e60fdae8a09b34406995527e99f (from https://www.piwheels.org/simple/setuptools/), version: 3.0.2 2024-12-17T10:59:35,792 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.0.1-py2.py3-none-any.whl#sha256=c654a89a39737f262892073f1401376b8e56b353674018aa85c722c013f3d40f (from https://www.piwheels.org/simple/setuptools/), version: 3.0.1 2024-12-17T10:59:35,793 Found link https://www.piwheels.org/simple/setuptools/setuptools-3.0-py2.py3-none-any.whl#sha256=e597098d2dbd0d725ddd1d2b176291cc48befa1b27aebe3240c875c7f3a809ea (from https://www.piwheels.org/simple/setuptools/), version: 3.0 2024-12-17T10:59:35,795 Found link https://www.piwheels.org/simple/setuptools/setuptools-2.2-py2.py3-none-any.whl#sha256=1703355d9dc055415b41955cede439962cf857709649b51fe29c193c8d78ed61 (from https://www.piwheels.org/simple/setuptools/), version: 2.2 2024-12-17T10:59:35,796 Found link https://www.piwheels.org/simple/setuptools/setuptools-2.1.2-py2.py3-none-any.whl#sha256=c1cb8c6df460f849757bfb9de768eafb1ee053c4bf0ce488e6972ea4a4bd35ac (from https://www.piwheels.org/simple/setuptools/), version: 2.1.2 2024-12-17T10:59:35,797 Found link https://www.piwheels.org/simple/setuptools/setuptools-2.1.1-py2.py3-none-any.whl#sha256=10f9e8b54cfb47d85cad42be3f89ed3c086a0ce8800ac85d59c7903690afeaf1 (from https://www.piwheels.org/simple/setuptools/), version: 2.1.1 2024-12-17T10:59:35,798 Found link https://www.piwheels.org/simple/setuptools/setuptools-2.1-py2.py3-none-any.whl#sha256=2a826d4e7b02699ce7e6152800a7befa4451b7e69c9dedc31fdc406e51fb8009 (from https://www.piwheels.org/simple/setuptools/), version: 2.1 2024-12-17T10:59:35,799 Found link https://www.piwheels.org/simple/setuptools/setuptools-2.0.2-py2.py3-none-any.whl#sha256=d2d0cfd92521be413693a47aef47f3c1b166841a0f00afa95d67bb8737ec5c76 (from https://www.piwheels.org/simple/setuptools/), version: 2.0.2 2024-12-17T10:59:35,800 Found link https://www.piwheels.org/simple/setuptools/setuptools-2.0.1-py2.py3-none-any.whl#sha256=0d951adc315091e44adae71ed89923642a9d5bd0a6e5abdc1775369e715cce9a (from https://www.piwheels.org/simple/setuptools/), version: 2.0.1 2024-12-17T10:59:35,801 Found link https://www.piwheels.org/simple/setuptools/setuptools-2.0-py2.py3-none-any.whl#sha256=dc4393cf8750f275d66423eecc3a07b79c20544cf5a0922c393f1a1c44f2944c (from https://www.piwheels.org/simple/setuptools/), version: 2.0 2024-12-17T10:59:35,802 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.4.2-py2.py3-none-any.whl#sha256=12ed8d497220eff8b0898444e241fde164c6f22f0924a34e44158223e081683a (from https://www.piwheels.org/simple/setuptools/), version: 1.4.2 2024-12-17T10:59:35,803 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.4.1-py2.py3-none-any.whl#sha256=de082c454445c500c6a496b897fae83ebbb37a4a7c1f90394680b58bd33ca068 (from https://www.piwheels.org/simple/setuptools/), version: 1.4.1 2024-12-17T10:59:35,804 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.4-py2.py3-none-any.whl#sha256=63933d1d44f58e2022f63e582691e2760e870d6441bee2c878cc5907f6841a78 (from https://www.piwheels.org/simple/setuptools/), version: 1.4 2024-12-17T10:59:35,805 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.3.2-py2.py3-none-any.whl#sha256=5a42a408f155eae1ab72ede1d0655ef928c0f7f08534834b84545e9e0fbfde88 (from https://www.piwheels.org/simple/setuptools/), version: 1.3.2 2024-12-17T10:59:35,806 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.3.1-py2.py3-none-any.whl#sha256=3d312aa90f8e64427a85a3550bb6fe07ddf720f5f733bc6a26c6b21c5957d5f8 (from https://www.piwheels.org/simple/setuptools/), version: 1.3.1 2024-12-17T10:59:35,807 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.3-py2.py3-none-any.whl#sha256=5c6c4244bf43fbdc7e8121069387e1d294ff8c34c0112c5d64ef840d2fcf57bc (from https://www.piwheels.org/simple/setuptools/), version: 1.3 2024-12-17T10:59:35,809 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.2-py2.py3-none-any.whl#sha256=9c2febf9ddc39f91c58c60ff65717fc59d4950bcbb7ef06b236c7e16f667b102 (from https://www.piwheels.org/simple/setuptools/), version: 1.2 2024-12-17T10:59:35,810 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.1.7-py2.py3-none-any.whl#sha256=e60a653aa95e8a92ceb8010bff005ed5410f5ff4cdfa10f5efd431728aea2e41 (from https://www.piwheels.org/simple/setuptools/), version: 1.1.7 2024-12-17T10:59:35,811 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.1.6-py2.py3-none-any.whl#sha256=8372714e9de5d39847f49eecc3f077217211aa6990c27533df5dc707a085c5c3 (from https://www.piwheels.org/simple/setuptools/), version: 1.1.6 2024-12-17T10:59:35,812 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.1.5-py2.py3-none-any.whl#sha256=56b41669b9736e15cf2df0436437755d6725a2228bc48cc7c0875f03626ceea0 (from https://www.piwheels.org/simple/setuptools/), version: 1.1.5 2024-12-17T10:59:35,813 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.1.4-py2.py3-none-any.whl#sha256=6969f7478d9169acf562ff9249acd0b8c7b66c214b4fc1dffb1356d4010950a2 (from https://www.piwheels.org/simple/setuptools/), version: 1.1.4 2024-12-17T10:59:35,814 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.1.3-py2.py3-none-any.whl#sha256=eaf4094fc630031095bdedc12a112dd6d59529ef025cffabce2c74c8c42a3578 (from https://www.piwheels.org/simple/setuptools/), version: 1.1.3 2024-12-17T10:59:35,815 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.1.2-py2.py3-none-any.whl#sha256=ad7c7204f6f2ff606a4c70e675a6ca8e9e5fe30c5bd02f5f0d6dc66f42da587e (from https://www.piwheels.org/simple/setuptools/), version: 1.1.2 2024-12-17T10:59:35,816 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.1.1-py2.py3-none-any.whl#sha256=8ec837cc3209c54bb275c937c43103a2d42be2909ccfabdec445c5ce06ee2413 (from https://www.piwheels.org/simple/setuptools/), version: 1.1.1 2024-12-17T10:59:35,817 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.1-py2.py3-none-any.whl#sha256=d5b91db3ddfd99ed5ccdccbfedd2e0f0d0b4b18f15a96f01f6970a42cf06cf7c (from https://www.piwheels.org/simple/setuptools/), version: 1.1 2024-12-17T10:59:35,818 Found link https://www.piwheels.org/simple/setuptools/setuptools-1.0-py2.py3-none-any.whl#sha256=51599758af4090dd95abc67815806e7af4a85dc533452a6f31a66f98e8927afd (from https://www.piwheels.org/simple/setuptools/), version: 1.0 2024-12-17T10:59:35,819 Found link https://www.piwheels.org/simple/setuptools/setuptools-0.9.8-py2.py3-none-any.whl#sha256=bf8e39b012d0146a4aeaf541353f5b9b9630bbcb5ac27505849ac896bcff2f6a (from https://www.piwheels.org/simple/setuptools/), version: 0.9.8 2024-12-17T10:59:35,820 Found link https://www.piwheels.org/simple/setuptools/setuptools-0.9.7-py3-none-any.whl#sha256=f6b58d0a10e855fb85432c9cc51cab71af61ecc772387e0bb2a8bdb93c5914ed (from https://www.piwheels.org/simple/setuptools/), version: 0.9.7 2024-12-17T10:59:35,821 Found link https://www.piwheels.org/simple/setuptools/setuptools-0.9.5-py3-none-any.whl#sha256=022f89fe01d35ce6630a20130d7456e71e5ba95d656e1d7df5cbdb6c83445886 (from https://www.piwheels.org/simple/setuptools/), version: 0.9.5 2024-12-17T10:59:35,822 Found link https://www.piwheels.org/simple/setuptools/setuptools-0.8-py3-none-any.whl#sha256=1794daaa2a7dba56071c2609dbac21aac2d8b55f96180e0cdb62735685d2dfa2 (from https://www.piwheels.org/simple/setuptools/), version: 0.8 2024-12-17T10:59:35,823 Skipping link: not a file: https://www.piwheels.org/simple/setuptools/ 2024-12-17T10:59:35,825 Skipping link: not a file: https://pypi.org/simple/setuptools/ 2024-12-17T10:59:36,033 Given no hashes to check 743 links for project 'setuptools': discarding no candidates 2024-12-17T10:59:36,115 Collecting setuptools>=40.8.0 2024-12-17T10:59:36,116 Created temporary directory: /tmp/pip-unpack-9g_oo1e9 2024-12-17T10:59:36,118 Found index url https://www.piwheels.org/simple/ 2024-12-17T10:59:36,120 Looking up "https://www.piwheels.org/simple/setuptools/setuptools-75.6.0-py3-none-any.whl" in the cache 2024-12-17T10:59:36,123 Current age based on date: 39 2024-12-17T10:59:36,131 https://www.piwheels.org:443 "GET /simple/setuptools/setuptools-75.6.0-py3-none-any.whl HTTP/1.1" 304 0 2024-12-17T10:59:36,137 Using cached https://www.piwheels.org/simple/setuptools/setuptools-75.6.0-py3-none-any.whl (1.2 MB) 2024-12-17T10:59:36,221 2 location(s) to search for versions of wheel: 2024-12-17T10:59:36,222 * https://pypi.org/simple/wheel/ 2024-12-17T10:59:36,223 * https://www.piwheels.org/simple/wheel/ 2024-12-17T10:59:36,223 Fetching project page and analyzing links: https://pypi.org/simple/wheel/ 2024-12-17T10:59:36,224 Getting page https://pypi.org/simple/wheel/ 2024-12-17T10:59:36,225 Found index url https://pypi.org/simple/ 2024-12-17T10:59:36,227 Looking up "https://pypi.org/simple/wheel/" in the cache 2024-12-17T10:59:36,228 Request header has "max_age" as 0, cache bypassed 2024-12-17T10:59:36,234 https://pypi.org:443 "GET /simple/wheel/ HTTP/1.1" 304 0 2024-12-17T10:59:36,241 Fetched page https://pypi.org/simple/wheel/ as application/vnd.pypi.simple.v1+json 2024-12-17T10:59:36,268 Found link https://files.pythonhosted.org/packages/51/15/d31364732deb6e7d1490f8a08f011997b52b4b106d592d36e917404be613/wheel-0.1.tar.gz (from https://pypi.org/simple/wheel/), version: 0.1 2024-12-17T10:59:36,269 Found link https://files.pythonhosted.org/packages/e2/1e/aedf6a9c6c0a588f96e9fe6e953de0c9f9084baad05f3ed0bd4a9b4a469f/wheel-0.2.tar.gz (from https://pypi.org/simple/wheel/), version: 0.2 2024-12-17T10:59:36,270 Found link https://files.pythonhosted.org/packages/87/cc/7e2672fda46ece9fd8880fe8784ec8013f87879fc35b785cbc53e7e85700/wheel-0.3.tar.gz (from https://pypi.org/simple/wheel/), version: 0.3 2024-12-17T10:59:36,271 Found link https://files.pythonhosted.org/packages/c4/27/39e87b69a9a65cc89b6d83d21e7deca97bc31c7d0de492e63b4139890d11/wheel-0.4.tar.gz (from https://pypi.org/simple/wheel/), version: 0.4 2024-12-17T10:59:36,272 Found link https://files.pythonhosted.org/packages/91/9f/23da62e10213c4a9e7b6a41913bca5592f7bf14de5181f07eed6ea65dedb/wheel-0.4.1.tar.gz (from https://pypi.org/simple/wheel/), version: 0.4.1 2024-12-17T10:59:36,273 Found link https://files.pythonhosted.org/packages/37/81/ed812d6e0cb7b75e184015601ab4a83fed37606899595ba28d511ba349ee/wheel-0.4.2.tar.gz (from https://pypi.org/simple/wheel/), version: 0.4.2 2024-12-17T10:59:36,274 Found link https://files.pythonhosted.org/packages/a6/58/3ecc315c7809b9b44de37b615498b4fb51982c37d92be1b83640ddf94323/wheel-0.5.tar.gz (from https://pypi.org/simple/wheel/), version: 0.5 2024-12-17T10:59:36,275 Found link https://files.pythonhosted.org/packages/53/26/1880f84340dd8717105fc3e5c199479829fcfb3108b2afea92b5b0ae0e09/wheel-0.6.tar.gz (from https://pypi.org/simple/wheel/), version: 0.6 2024-12-17T10:59:36,276 Found link https://files.pythonhosted.org/packages/1d/79/49416a92ca1ae8c30f9a489b6349c795794aa209cde2e7d0afd5614cbfa6/wheel-0.7.tar.gz (from https://pypi.org/simple/wheel/), version: 0.7 2024-12-17T10:59:36,277 Skipping link: none of the wheel's tags (py27-none-any) are compatible (run pip debug --verbose to show compatible tags): https://files.pythonhosted.org/packages/0b/86/3c1687aba2d15cec12ed2dc9bb5276e9fb6d3d43ce7376e91fabdb400c0a/wheel-0.8-py27-none-any.whl (from https://pypi.org/simple/wheel/) 2024-12-17T10:59:36,278 Found link https://files.pythonhosted.org/packages/27/22/83e4db59ad3ef6a1616c5db5c712b1d19803808d1e84001eae8e38c88db1/wheel-0.8.tar.gz (from https://pypi.org/simple/wheel/), version: 0.8 2024-12-17T10:59:36,279 Skipping link: none of the wheel's tags (py27-none-any) are compatible (run pip debug --verbose to show compatible tags): https://files.pythonhosted.org/packages/98/53/d87853d5490feb0ec9295e645ce0fa631ed95c2020d3411103561563e045/wheel-0.9-py27-none-any.whl (from https://pypi.org/simple/wheel/) 2024-12-17T10:59:36,280 Found link https://files.pythonhosted.org/packages/34/4b/aa762fd3c034baa7fdc266bf8f54e442c9d1b0aedce74ff32d287af25db3/wheel-0.9-py32-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.9 2024-12-17T10:59:36,281 Found link https://files.pythonhosted.org/packages/fc/62/48c826c3d7c15367a855ebab08b37a72ee9f33f41d4536fb16b6aa124acd/wheel-0.9.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9 2024-12-17T10:59:36,282 Found link https://files.pythonhosted.org/packages/2a/52/28470f5d856acec391d04cf4570664d4174ee5e0482f3d3cab584c5e2ea5/wheel-0.9.1.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.1 2024-12-17T10:59:36,283 Found link https://files.pythonhosted.org/packages/a9/cf/8223ae8f72eac39e409d555da52a1b744b27f632da4dcb1513312a3ff570/wheel-0.9.2.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.2 2024-12-17T10:59:36,284 Found link https://files.pythonhosted.org/packages/b6/54/617e21cd9d8151f6cfc9f9bf1b6cde2f430f70ff2b66ccef477ada7f0c12/wheel-0.9.3.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.3 2024-12-17T10:59:36,285 Found link https://files.pythonhosted.org/packages/16/84/d42d28af9502073272b59c52dfc90091bf8efa1277dac1b8730aaa3eb867/wheel-0.9.4.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.4 2024-12-17T10:59:36,286 Found link https://files.pythonhosted.org/packages/28/46/8ebdfe69b7ad35adf20b0e9335a0ec5790f9999d7c99fe5d180a55f9f963/wheel-0.9.5-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.9.5 2024-12-17T10:59:36,287 Found link https://files.pythonhosted.org/packages/cf/04/7cd10c6b78b55972a651e04affebc02fa4c0b45d943996540033b246eb42/wheel-0.9.5.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.5 2024-12-17T10:59:36,288 Skipping link: none of the wheel's tags (py27-none-any) are compatible (run pip debug --verbose to show compatible tags): https://files.pythonhosted.org/packages/34/da/0fb28917ed602bda9807eda0e9a9202a53d97a2b2ae4b0392fd9015dbcfd/wheel-0.9.6-py27-none-any.whl (from https://pypi.org/simple/wheel/) 2024-12-17T10:59:36,289 Found link https://files.pythonhosted.org/packages/02/c5/0f17dc19cc58f15bc3e1d8d0ccf68277180b3898028e16ba15bda2010545/wheel-0.9.6.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.6 2024-12-17T10:59:36,290 Skipping link: none of the wheel's tags (py27-none-any) are compatible (run pip debug --verbose to show compatible tags): https://files.pythonhosted.org/packages/9a/2a/4a9de088db2a97bf5eec6f274875c369c50d634eb2096efccf80902e6d33/wheel-0.9.7-py27-none-any.whl (from https://pypi.org/simple/wheel/) 2024-12-17T10:59:36,291 Found link https://files.pythonhosted.org/packages/8d/47/0398c7707a3c6fe46d4d326bc063ce698beac7e6ab5af505f462bf50602d/wheel-0.9.7.tar.gz (from https://pypi.org/simple/wheel/), version: 0.9.7 2024-12-17T10:59:36,292 Found link https://files.pythonhosted.org/packages/55/c3/6147192b7e74f476b529aa56d2a68d1decfffae084276869b990a70b3053/wheel-0.10.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.10.0 2024-12-17T10:59:36,293 Found link https://files.pythonhosted.org/packages/7d/23/7b42140d7c5de5cf184c99b9921066494fd1ac5049864aba84031df97447/wheel-0.10.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.10.0 2024-12-17T10:59:36,294 Found link https://files.pythonhosted.org/packages/bf/46/446356d9ee7bbcac41b9784720fe8d2312e62db7639a3cb37d3c35e766b2/wheel-0.10.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.10.1 2024-12-17T10:59:36,295 Found link https://files.pythonhosted.org/packages/48/67/928da8e188fb605c6723cb597dc2bcc269dad9aca725411f4e351bf84c0e/wheel-0.10.1.tar.gz (from https://pypi.org/simple/wheel/), version: 0.10.1 2024-12-17T10:59:36,296 Found link https://files.pythonhosted.org/packages/cd/09/5471330c7f308a02256964f8935d1e5e95824f814c14b5396d7970c38378/wheel-0.10.2-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.10.2 2024-12-17T10:59:36,297 Found link https://files.pythonhosted.org/packages/47/cc/2b9c2ec868d1dcefb995b6689f4fd7ecd271bd4e6572fbb046a8b126c20d/wheel-0.10.2.tar.gz (from https://pypi.org/simple/wheel/), version: 0.10.2 2024-12-17T10:59:36,299 Found link https://files.pythonhosted.org/packages/54/8c/cde887de967cd0cffa166b01ad763171930ca86015a009427ba3fb7925ea/wheel-0.10.3-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.10.3 2024-12-17T10:59:36,300 Found link https://files.pythonhosted.org/packages/db/9e/7a4ceefae0950a291ff1cdf9aa927bbe61d5a67b187ae3aa11eba61a8138/wheel-0.10.3.tar.gz (from https://pypi.org/simple/wheel/), version: 0.10.3 2024-12-17T10:59:36,301 Found link https://files.pythonhosted.org/packages/f0/c8/53fa58a736b1f842bf4e29e61fd89f97bbf75b9bef09c06575fe31f660e0/wheel-0.11.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.11.0 2024-12-17T10:59:36,302 Found link https://files.pythonhosted.org/packages/00/6c/c02fa934c0df8f8aa870f25cccff1c041afba456e659e655feb2b7cdb050/wheel-0.11.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.11.0 2024-12-17T10:59:36,303 Found link https://files.pythonhosted.org/packages/fc/44/c7fabd874dc798e1734637b04aaba0d4c0cec1364fd3b09ca91f9372d866/wheel-0.12.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.12.0 2024-12-17T10:59:36,304 Found link https://files.pythonhosted.org/packages/04/c4/98dc250c85a6a7807236cc11c0ae154326797b4ee654445ad817645915b7/wheel-0.12.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.12.0 2024-12-17T10:59:36,305 Found link https://files.pythonhosted.org/packages/d0/f9/16c9e3f338309ee4d88435b4ed23aa43d8719b1c7d2ed9281aec6146d678/wheel-0.13.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.13.0 2024-12-17T10:59:36,306 Found link https://files.pythonhosted.org/packages/62/41/93774ef38ee9805ee46411873f53eea0a15cfc31f6bb9b8fbe58cdc1ba30/wheel-0.13.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.13.0 2024-12-17T10:59:36,307 Found link https://files.pythonhosted.org/packages/49/1e/64bd498334aa061ecc281b92285d0eb6cbf8cedd12ed9ac8c9723362ef86/wheel-0.14.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.14.0 2024-12-17T10:59:36,308 Found link https://files.pythonhosted.org/packages/6a/ea/df18b5c87d11e29401af01320a2e3613effd4de3dfafe4353d9187fe5d8d/wheel-0.14.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.14.0 2024-12-17T10:59:36,309 Found link https://files.pythonhosted.org/packages/4d/ae/38ff18147dc73de82fd5dd4fd1f2ecdaef6dccc0365ae2e460c404e83ef7/wheel-0.15.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.15.0 2024-12-17T10:59:36,310 Found link https://files.pythonhosted.org/packages/82/07/d9680d331deb1247cf28804422a0e3050870481ac43234437f72547aacb4/wheel-0.15.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.15.0 2024-12-17T10:59:36,311 Found link https://files.pythonhosted.org/packages/16/7b/f4e0e59f5b8bd3756d9d2d4a4493700b420991cfd20218fd7b9077f95e83/wheel-0.16.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.16.0 2024-12-17T10:59:36,312 Found link https://files.pythonhosted.org/packages/4d/31/bcc5270aa8f08764ab73de32bdc1b95a16b043bff42e8f808da3b344ff80/wheel-0.16.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.16.0 2024-12-17T10:59:36,313 Found link https://files.pythonhosted.org/packages/92/9c/6c4474034690084808c05c1bde6bd00d37ae777f7f94beb40aeb98b3a9e0/wheel-0.17.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.17.0 2024-12-17T10:59:36,314 Found link https://files.pythonhosted.org/packages/16/f8/b06811f631f11f892ec88f6c073b96ab1c1a34f2993e7a460334f44b3637/wheel-0.17.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.17.0 2024-12-17T10:59:36,315 Found link https://files.pythonhosted.org/packages/ca/8e/f363a37db72b9ba3ae0eea72ba380a38d3e5b966adfd8c7a78eb0c54234c/wheel-0.18.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.18.0 2024-12-17T10:59:36,316 Found link https://files.pythonhosted.org/packages/a3/eb/b4eb495e767d5f6be823f27d9e891eee154d4cded6d97941a1361468421c/wheel-0.18.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.18.0 2024-12-17T10:59:36,317 Found link https://files.pythonhosted.org/packages/b8/58/9130ace9b544470908a68abcfb9201c383d2f734426bf7892badb37c5541/wheel-0.19.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.19.0 2024-12-17T10:59:36,318 Found link https://files.pythonhosted.org/packages/b9/28/1ce455559c7502c082ccc876a22ec6fd61cc6910da0bc620d910cbe8fa11/wheel-0.19.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.19.0 2024-12-17T10:59:36,319 Found link https://files.pythonhosted.org/packages/0d/e6/60c6e03ae967d076e72ec5298cd136d658e4b8eb6773d6aef3ff1abc8d04/wheel-0.21.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.21.0 2024-12-17T10:59:36,320 Found link https://files.pythonhosted.org/packages/2a/a3/7a0a7d058bcaf0b08a50e7d55d5426522374ee466316489cc853d0d26dc1/wheel-0.21.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.21.0 2024-12-17T10:59:36,321 Found link https://files.pythonhosted.org/packages/d0/2f/dd989a40d4e1b85cf0826eb79b630efa52389eae5ee2760a74848156aa9a/wheel-0.22.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.22.0 2024-12-17T10:59:36,322 Found link https://files.pythonhosted.org/packages/df/cc/212d1a8cb8fadc3a6b923b1a1392cf2911d606117537ac62ae6897bde95b/wheel-0.22.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.22.0 2024-12-17T10:59:36,323 Found link https://files.pythonhosted.org/packages/a9/67/43036e2db1a344ad24ba468b6262826b3837ce629b7b4c09c18d3e2b5800/wheel-0.23.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.23.0 2024-12-17T10:59:36,324 Found link https://files.pythonhosted.org/packages/24/dc/2b7134bce04139b67727bfc441ef77e8558df07103c12275e3617ffe6c57/wheel-0.23.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.23.0 2024-12-17T10:59:36,325 Found link https://files.pythonhosted.org/packages/e8/14/eaaac12b0432c984a27ad0050a5a0bedc6135df35a0f5f1f35228faf12d4/wheel-0.24.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.24.0 2024-12-17T10:59:36,326 Found link https://files.pythonhosted.org/packages/aa/35/b7d0fcdfcf2151327afa6bea68839aed1f1914a4225b24750bb8baf057c8/wheel-0.24.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.24.0 2024-12-17T10:59:36,327 Found link https://files.pythonhosted.org/packages/2d/14/a561f8a503bd62bb1df33694b183cf3f280f6fba7bda589670efe65f09e9/wheel-0.25.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.25.0 2024-12-17T10:59:36,328 Found link https://files.pythonhosted.org/packages/59/7b/00b6746e26e7c4ed9a2628418f5ff0d45c5e02b5317e65128173515739a2/wheel-0.25.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.25.0 2024-12-17T10:59:36,329 Found link https://files.pythonhosted.org/packages/d9/6f/cfb45d489703e4843b30c28e01ab39c87b0648bfa11a6c4a959f426fe217/wheel-0.26.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.26.0 2024-12-17T10:59:36,330 Found link https://files.pythonhosted.org/packages/91/66/ddc9410feba81767f53c87e78f958f884536cf37ca991b90ec2890706dcf/wheel-0.26.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.26.0 2024-12-17T10:59:36,331 Found link https://files.pythonhosted.org/packages/d9/e0/f0fd2f9d4777c56766752a03bc0e420dc65d50186c71ebaf73255156bd9a/wheel-0.27.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.27.0 2024-12-17T10:59:36,332 Found link https://files.pythonhosted.org/packages/be/3d/73e36a9f4afaea62c4d91b858d061e8c7e0074dd67e5e80618b644756dc7/wheel-0.27.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.27.0 2024-12-17T10:59:36,333 Found link https://files.pythonhosted.org/packages/c8/72/d51052bb24c9e551e292e87fc7376bad9ae5fa198b294f4ab4e2619f530c/wheel-0.28.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.28.0 2024-12-17T10:59:36,334 Found link https://files.pythonhosted.org/packages/8f/c6/c524fe41283b2820f85a8e38cedd19ebb6454365281549dcf98ae32feb85/wheel-0.28.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.28.0 2024-12-17T10:59:36,335 Found link https://files.pythonhosted.org/packages/8a/e9/8468cd68b582b06ef554be0b96b59f59779627131aad48f8a5bce4b13450/wheel-0.29.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.29.0 2024-12-17T10:59:36,336 Found link https://files.pythonhosted.org/packages/c9/1d/bd19e691fd4cfe908c76c429fe6e4436c9e83583c4414b54f6c85471954a/wheel-0.29.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.29.0 2024-12-17T10:59:36,338 Found link https://files.pythonhosted.org/packages/83/53/e120833aa2350db333df89a40dea3b310dd9dabf6f29eaa18934a597dc79/wheel-0.30.0a0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.30.0a0 2024-12-17T10:59:36,339 Found link https://files.pythonhosted.org/packages/a7/37/947b4329c4a3c72093b6c8e9b4be8c7f10c32dbb78848d3a234ce01c059d/wheel-0.30.0a0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.30.0a0 2024-12-17T10:59:36,340 Found link https://files.pythonhosted.org/packages/0c/80/16a85b47702a1f47a63c104c91abdd0a6704ee8ae3b4ce4afc49bc39f9d9/wheel-0.30.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/), version: 0.30.0 2024-12-17T10:59:36,341 Found link https://files.pythonhosted.org/packages/fa/b4/f9886517624a4dcb81a1d766f68034344b7565db69f13d52697222daeb72/wheel-0.30.0.tar.gz (from https://pypi.org/simple/wheel/), version: 0.30.0 2024-12-17T10:59:36,343 Found link https://files.pythonhosted.org/packages/1b/d2/22cde5ea9af055f81814f9f2545f5ed8a053eb749c08d186b369959189a8/wheel-0.31.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.31.0 2024-12-17T10:59:36,345 Found link https://files.pythonhosted.org/packages/5d/c1/45947333669b31bc6b4933308dd07c2aa2fedcec0a95b14eedae993bd449/wheel-0.31.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.31.0 2024-12-17T10:59:36,346 Found link https://files.pythonhosted.org/packages/81/30/e935244ca6165187ae8be876b6316ae201b71485538ffac1d718843025a9/wheel-0.31.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.31.1 2024-12-17T10:59:36,348 Found link https://files.pythonhosted.org/packages/2a/fb/aefe5d5dbc3f4fe1e815bcdb05cbaab19744d201bbc9b59cfa06ec7fc789/wheel-0.31.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.31.1 2024-12-17T10:59:36,350 Found link https://files.pythonhosted.org/packages/b3/bb/42354ce8c08f66ae0cd0f4a841f40ed41d709ac9c28f292bfeb383236a4a/wheel-0.32.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.0 2024-12-17T10:59:36,352 Found link https://files.pythonhosted.org/packages/68/f0/545cbeae75f248c4ad7c2d062672cd7e046dd325a81b74fc02c62450d133/wheel-0.32.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.0 2024-12-17T10:59:36,354 Found link https://files.pythonhosted.org/packages/fc/e9/05316a1eec70c2bfc1c823a259546475bd7636ba6d27ec80575da523bc34/wheel-0.32.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.1 2024-12-17T10:59:36,356 Found link https://files.pythonhosted.org/packages/e2/d0/bb5eedd650e777039d984b209d229b97fa2161916c920245a85c1ef07667/wheel-0.32.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.1 2024-12-17T10:59:36,358 Found link https://files.pythonhosted.org/packages/5a/9b/6aebe9e2636d35d1a93772fa644c828303e1d5d124e8a88f156f42ac4b87/wheel-0.32.2-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.2 2024-12-17T10:59:36,360 Found link https://files.pythonhosted.org/packages/c2/00/21e3ecc8a9d484f9de995471c061aa3d8f02ae54bdfd9cbdddb59138c809/wheel-0.32.2.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.2 2024-12-17T10:59:36,362 Found link https://files.pythonhosted.org/packages/ff/47/1dfa4795e24fd6f93d5d58602dd716c3f101cfd5a77cd9acbe519b44a0a9/wheel-0.32.3-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.3 2024-12-17T10:59:36,364 Found link https://files.pythonhosted.org/packages/d8/55/221a530d66bf78e72996453d1e2dedef526063546e131d70bed548d80588/wheel-0.32.3.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.3 2024-12-17T10:59:36,365 Found link https://files.pythonhosted.org/packages/7c/d7/20bd3c501f53fdb0b7387e75c03bd1fce748a1c3dd342fc53744e28e3de1/wheel-0.33.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.0 2024-12-17T10:59:36,367 Found link https://files.pythonhosted.org/packages/d9/7d/86df15e317027f6e87aa68ea854abf8437e796b4c0fadd3ae5ee67b77cb2/wheel-0.33.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.0 2024-12-17T10:59:36,369 Found link https://files.pythonhosted.org/packages/96/ba/a4702cbb6a3a485239fbe9525443446203f00771af9ac000fa3ef2788201/wheel-0.33.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.1 2024-12-17T10:59:36,371 Found link https://files.pythonhosted.org/packages/b7/cf/1ea0f5b3ce55cacde1e84cdde6cee1ebaff51bd9a3e6c7ba4082199af6f6/wheel-0.33.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.1 2024-12-17T10:59:36,373 Found link https://files.pythonhosted.org/packages/bb/10/44230dd6bf3563b8f227dbf344c908d412ad2ff48066476672f3a72e174e/wheel-0.33.4-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.4 2024-12-17T10:59:36,375 Found link https://files.pythonhosted.org/packages/1d/b0/f478e80aeace42fe251225a86752799174a94314c4a80ebfc5bf0ab1153a/wheel-0.33.4.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.4 2024-12-17T10:59:36,377 Found link https://files.pythonhosted.org/packages/65/55/8d1fab74c43c0b4bcfcaad988888b4bd03234dde245f9536d165f26e103f/wheel-0.33.5-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.5 2024-12-17T10:59:36,379 Found link https://files.pythonhosted.org/packages/18/50/3289ccedef5251e9b1de59946038aacc46da1c7810589c9271381f7d1d0b/wheel-0.33.5.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.5 2024-12-17T10:59:36,381 Found link https://files.pythonhosted.org/packages/00/83/b4a77d044e78ad1a45610eb88f745be2fd2c6d658f9798a15e384b7d57c9/wheel-0.33.6-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.6 2024-12-17T10:59:36,383 Found link https://files.pythonhosted.org/packages/59/b0/11710a598e1e148fb7cbf9220fd2a0b82c98e94efbdecb299cb25e7f0b39/wheel-0.33.6.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.6 2024-12-17T10:59:36,387 Found link https://files.pythonhosted.org/packages/58/2b/2a307602a01ade0a4ef1774213f978aac87d1f4b9a875942c8cead888871/wheel-0.34.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.34.0 2024-12-17T10:59:36,389 Found link https://files.pythonhosted.org/packages/15/39/728ccb81172c73f14084948b2d4561d5e51649dcf4b21d1f207b7363b1d7/wheel-0.34.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.34.0 2024-12-17T10:59:36,391 Found link https://files.pythonhosted.org/packages/81/44/db78754a73d9a88c5bd1bb692b40004410970e88aa0c5dff20b57f231505/wheel-0.34.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.1 2024-12-17T10:59:36,393 Found link https://files.pythonhosted.org/packages/f9/85/120a5ad1565398efb1184eacaa597e925abbf8fff8cc748877add71257f1/wheel-0.34.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.1 2024-12-17T10:59:36,395 Found link https://files.pythonhosted.org/packages/8c/23/848298cccf8e40f5bbb59009b32848a4c38f4e7f3364297ab3c3e2e2cd14/wheel-0.34.2-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.2 2024-12-17T10:59:36,397 Found link https://files.pythonhosted.org/packages/75/28/521c6dc7fef23a68368efefdcd682f5b3d1d58c2b90b06dc1d0b805b51ae/wheel-0.34.2.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.2 2024-12-17T10:59:36,399 Found link https://files.pythonhosted.org/packages/85/37/7252beacf7e60cffe3bc5a97f94e3ccf22a927e87697d377cfe16abea7cf/wheel-0.35.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.0 2024-12-17T10:59:36,401 Found link https://files.pythonhosted.org/packages/5b/e1/fa6dccd0d461520fbaa98d47cdf1ba26d5a2666e24b454d0e27387420e4b/wheel-0.35.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.0 2024-12-17T10:59:36,403 Found link https://files.pythonhosted.org/packages/a7/00/3df031b3ecd5444d572141321537080b40c1c25e1caa3d86cdd12e5e919c/wheel-0.35.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.1 2024-12-17T10:59:36,405 Found link https://files.pythonhosted.org/packages/83/72/611c121b6bd15479cb62f1a425b2e3372e121b324228df28e64cc28b01c2/wheel-0.35.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.1 2024-12-17T10:59:36,407 Found link https://files.pythonhosted.org/packages/84/e8/3caa0d932d0edd9c9611065831fd06cf05c53671f78a0fa553a635da7e2f/wheel-0.36.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.0 2024-12-17T10:59:36,409 Found link https://files.pythonhosted.org/packages/57/73/1911bfa69482de2a6327db4ca5eda87ae7599160018910007d6d6a1d3ada/wheel-0.36.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.0 2024-12-17T10:59:36,411 Found link https://files.pythonhosted.org/packages/c9/0b/e0fd299d93cd9331657f415085a4956422959897b333e3791dde40bd711d/wheel-0.36.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.1 2024-12-17T10:59:36,413 Found link https://files.pythonhosted.org/packages/d4/cf/732e05dce1e37b63d54d1836160b6e24fb36eeff2313e93315ad047c7d90/wheel-0.36.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.1 2024-12-17T10:59:36,415 Found link https://files.pythonhosted.org/packages/65/63/39d04c74222770ed1589c0eaba06c05891801219272420b40311cd60c880/wheel-0.36.2-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.2 2024-12-17T10:59:36,417 Found link https://files.pythonhosted.org/packages/ed/46/e298a50dde405e1c202e316fa6a3015ff9288423661d7ea5e8f22f589071/wheel-0.36.2.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.2 2024-12-17T10:59:36,419 Found link https://files.pythonhosted.org/packages/04/80/cad93b40262f5d09f6de82adbee452fd43cdff60830b56a74c5930f7e277/wheel-0.37.0-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.37.0 2024-12-17T10:59:36,421 Found link https://files.pythonhosted.org/packages/4e/be/8139f127b4db2f79c8b117c80af56a3078cc4824b5b94250c7f81a70e03b/wheel-0.37.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.37.0 2024-12-17T10:59:36,423 Found link https://files.pythonhosted.org/packages/27/d6/003e593296a85fd6ed616ed962795b2f87709c3eee2bca4f6d0fe55c6d00/wheel-0.37.1-py2.py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.37.1 2024-12-17T10:59:36,426 Found link https://files.pythonhosted.org/packages/c0/6c/9f840c2e55b67b90745af06a540964b73589256cb10cc10057c87ac78fc2/wheel-0.37.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.37.1 2024-12-17T10:59:36,427 Found link https://files.pythonhosted.org/packages/bb/ae/02bad7c64ca060e037869584242729796a5eda0376bb944a3e03f4d9491b/wheel-0.38.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.0 2024-12-17T10:59:36,428 Found link https://files.pythonhosted.org/packages/46/57/f39f082f448205ec06a771fe30eec77ed650c0c8e3f7d7f193e12efb4fd4/wheel-0.38.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.0 2024-12-17T10:59:36,429 Found link https://files.pythonhosted.org/packages/84/a8/4dab22a963a756e5b54ce0ab5c900c54329cff38e163fe3c67c858240ec6/wheel-0.38.1-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.1 2024-12-17T10:59:36,431 Found link https://files.pythonhosted.org/packages/7a/b0/29c0c8c6f8cebeb0de4c17bc44365cba0b35cb4246e4a27a7e12ecf92d73/wheel-0.38.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.1 2024-12-17T10:59:36,432 Found link https://files.pythonhosted.org/packages/46/3a/73fcaf6487aa9a9b02ee9df30a24bdc2c1f0292fe559811936d67a9053c1/wheel-0.38.2-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.2 2024-12-17T10:59:36,433 Found link https://files.pythonhosted.org/packages/a4/5b/0718aa11e3360f97feb81ddcb19cbb9306df0a17bef7c360f8939d2629b8/wheel-0.38.2.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.2 2024-12-17T10:59:36,435 Found link https://files.pythonhosted.org/packages/3b/48/7a4e6e610cfbc71d727ac58ddc9abe0daf5772b81d5630a4aef9e919ad46/wheel-0.38.3-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.3 2024-12-17T10:59:36,436 Found link https://files.pythonhosted.org/packages/2e/c6/af5def6796940a8bd602d815f7f495f32d833c81b38d055ca0b23ab3b804/wheel-0.38.3.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.3 2024-12-17T10:59:36,437 Found link https://files.pythonhosted.org/packages/bd/7c/d38a0b30ce22fc26ed7dbc087c6d00851fb3395e9d0dac40bec1f905030c/wheel-0.38.4-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.4 2024-12-17T10:59:36,438 Found link https://files.pythonhosted.org/packages/a2/b8/6a06ff0f13a00fc3c3e7d222a995526cbca26c1ad107691b6b1badbbabf1/wheel-0.38.4.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.4 2024-12-17T10:59:36,440 Found link https://files.pythonhosted.org/packages/61/86/cc8d1ff2ca31a312a25a708c891cf9facbad4eae493b3872638db6785eb5/wheel-0.40.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.40.0 2024-12-17T10:59:36,441 Found link https://files.pythonhosted.org/packages/fc/ef/0335f7217dd1e8096a9e8383e1d472aa14717878ffe07c4772e68b6e8735/wheel-0.40.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.40.0 2024-12-17T10:59:36,442 Found link https://files.pythonhosted.org/packages/17/11/f139e25018ea2218aeedbedcf85cd0dd8abeed29a38ac1fda7f5a8889382/wheel-0.41.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.0 2024-12-17T10:59:36,444 Found link https://files.pythonhosted.org/packages/ec/34/903929e15b2657335b2ce8723d92fc804d3569b7ac0f1f8877ed1a7b2024/wheel-0.41.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.0 2024-12-17T10:59:36,445 Found link https://files.pythonhosted.org/packages/28/f5/6955d7b3a5d71ce6bac104f9cf98c1b0513ad656cdaca8ea7d579196f771/wheel-0.41.1-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.1 2024-12-17T10:59:36,446 Found link https://files.pythonhosted.org/packages/c9/3d/02a14af2b413d7abf856083f327744d286f4468365cddace393a43d9d540/wheel-0.41.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.1 2024-12-17T10:59:36,448 Found link https://files.pythonhosted.org/packages/b8/8b/31273bf66016be6ad22bb7345c37ff350276cfd46e389a0c2ac5da9d9073/wheel-0.41.2-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.2 2024-12-17T10:59:36,449 Found link https://files.pythonhosted.org/packages/a4/99/78c4f3bd50619d772168bec6a0f34379b02c19c9cced0ed833ecd021fd0d/wheel-0.41.2.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.2 2024-12-17T10:59:36,450 Found link https://files.pythonhosted.org/packages/fa/7f/4c07234086edbce4a0a446209dc0cb08a19bb206a3ea53b2f56a403f983b/wheel-0.41.3-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.3 2024-12-17T10:59:36,452 Found link https://files.pythonhosted.org/packages/fb/d0/0b4c18a0b85c20233b0c3bc33f792aefd7f12a5832b4da77419949ff6fd9/wheel-0.41.3.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.3 2024-12-17T10:59:36,453 Found link https://files.pythonhosted.org/packages/c7/c3/55076fc728723ef927521abaa1955213d094933dc36d4a2008d5101e1af5/wheel-0.42.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.42.0 2024-12-17T10:59:36,454 Found link https://files.pythonhosted.org/packages/b0/b4/bc2baae3970c282fae6c2cb8e0f179923dceb7eaffb0e76170628f9af97b/wheel-0.42.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.7), version: 0.42.0 2024-12-17T10:59:36,455 Found link https://files.pythonhosted.org/packages/7d/cd/d7460c9a869b16c3dd4e1e403cce337df165368c71d6af229a74699622ce/wheel-0.43.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.43.0 2024-12-17T10:59:36,457 Found link https://files.pythonhosted.org/packages/b8/d6/ac9cd92ea2ad502ff7c1ab683806a9deb34711a1e2bd8a59814e8fc27e69/wheel-0.43.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.43.0 2024-12-17T10:59:36,458 Found link https://files.pythonhosted.org/packages/1b/d1/9babe2ccaecff775992753d8686970b1e2755d21c8a63be73aba7a4e7d77/wheel-0.44.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.44.0 2024-12-17T10:59:36,459 Found link https://files.pythonhosted.org/packages/b7/a0/95e9e962c5fd9da11c1e28aa4c0d8210ab277b1ada951d2aee336b505813/wheel-0.44.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.44.0 2024-12-17T10:59:36,461 Found link https://files.pythonhosted.org/packages/92/81/65ae90d584a73ca976d8f1eb83e2f58447a4055a9fb3ae69b28721070bdf/wheel-0.45.0-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.45.0 2024-12-17T10:59:36,462 Found link https://files.pythonhosted.org/packages/e7/52/fd4516fb8f7d11a08e3f9cd69eb1558f098ab67e79f32d920c4974ee550f/wheel-0.45.0.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.45.0 2024-12-17T10:59:36,463 Found link https://files.pythonhosted.org/packages/0b/2c/87f3254fd8ffd29e4c02732eee68a83a1d3c346ae39bc6822dcbcb697f2b/wheel-0.45.1-py3-none-any.whl (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.45.1 2024-12-17T10:59:36,464 Found link https://files.pythonhosted.org/packages/8a/98/2d9906746cdc6a6ef809ae6338005b3f21bb568bea3165cfc6a243fdc25c/wheel-0.45.1.tar.gz (from https://pypi.org/simple/wheel/) (requires-python:>=3.8), version: 0.45.1 2024-12-17T10:59:36,466 Fetching project page and analyzing links: https://www.piwheels.org/simple/wheel/ 2024-12-17T10:59:36,467 Getting page https://www.piwheels.org/simple/wheel/ 2024-12-17T10:59:36,468 Found index url https://www.piwheels.org/simple/ 2024-12-17T10:59:36,470 Looking up "https://www.piwheels.org/simple/wheel/" in the cache 2024-12-17T10:59:36,470 Request header has "max_age" as 0, cache bypassed 2024-12-17T10:59:36,479 https://www.piwheels.org:443 "GET /simple/wheel/ HTTP/1.1" 200 4001 2024-12-17T10:59:36,482 Updating cache with response from "https://www.piwheels.org/simple/wheel/" 2024-12-17T10:59:36,482 etag object cached for 1209600 seconds 2024-12-17T10:59:36,483 Caching due to etag 2024-12-17T10:59:36,489 Fetched page https://www.piwheels.org/simple/wheel/ as text/html 2024-12-17T10:59:36,510 Found link https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl#sha256=708e7481cc80179af0e556bbf0cc00b8444c7321e2700b8d8580231d13017248 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.8), version: 0.45.1 2024-12-17T10:59:36,512 Found link https://www.piwheels.org/simple/wheel/wheel-0.45.0-py3-none-any.whl#sha256=52f0baa5e6522155090a09c6bd95718cc46956d1b51d537ea5454249edb671c7 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.8), version: 0.45.0 2024-12-17T10:59:36,513 Found link https://www.piwheels.org/simple/wheel/wheel-0.44.0-py3-none-any.whl#sha256=2376a90c98cc337d18623527a97c31797bd02bad0033d41547043a1cbfbe448f (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.8), version: 0.44.0 2024-12-17T10:59:36,514 Found link https://www.piwheels.org/simple/wheel/wheel-0.43.0-py3-none-any.whl#sha256=55c570405f142630c6b9f72fe09d9b67cf1477fcf543ae5b8dcb1f5b7377da81 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.8), version: 0.43.0 2024-12-17T10:59:36,516 Found link https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl#sha256=177f9c9b0d45c47873b619f5b650346d632cdc35fb5e4d25058e09c9e581433d (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.42.0 2024-12-17T10:59:36,517 Found link https://www.piwheels.org/simple/wheel/wheel-0.41.3-py3-none-any.whl#sha256=488609bc63a29322326e05560731bf7bfea8e48ad646e1f5e40d366607de0942 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.3 2024-12-17T10:59:36,518 Found link https://www.piwheels.org/simple/wheel/wheel-0.41.2-py3-none-any.whl#sha256=75909db2664838d015e3d9139004ee16711748a52c8f336b52882266540215d8 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.2 2024-12-17T10:59:36,520 Found link https://www.piwheels.org/simple/wheel/wheel-0.41.1-py3-none-any.whl#sha256=473219bd4cbedc62cea0cb309089b593e47c15c4a2531015f94e4e3b9a0f6981 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.1 2024-12-17T10:59:36,521 Found link https://www.piwheels.org/simple/wheel/wheel-0.41.0-py3-none-any.whl#sha256=7e9be3bbd0078f6147d82ed9ed957e323e7708f57e134743d2edef3a7b7972a9 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.41.0 2024-12-17T10:59:36,522 Found link https://www.piwheels.org/simple/wheel/wheel-0.40.0-py3-none-any.whl#sha256=d236b20e7cb522daf2390fa84c55eea81c5c30190f90f29ae2ca1ad8355bf247 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.40.0 2024-12-17T10:59:36,524 Found link https://www.piwheels.org/simple/wheel/wheel-0.38.4-py3-none-any.whl#sha256=d39864d37aca18cbff3fdc1bef75e6e7a96278d4e1935fb8d6387c4a35900577 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.4 2024-12-17T10:59:36,525 Found link https://www.piwheels.org/simple/wheel/wheel-0.38.3-py3-none-any.whl#sha256=be9b37cb7550f11224d0442525944a08ee9bb92edd441232c49f6bf9b27022da (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.3 2024-12-17T10:59:36,526 Found link https://www.piwheels.org/simple/wheel/wheel-0.38.2-py3-none-any.whl#sha256=021900d9c142cbedc1a7e31f5988a358ba2f0d7a2147b2122f0f493884b4495f (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.2 2024-12-17T10:59:36,528 Found link https://www.piwheels.org/simple/wheel/wheel-0.38.1-py3-none-any.whl#sha256=2d48d4de56433936bec89b8389c5784c736ccd3c23f9507d8dc8359655c31ce9 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.1 2024-12-17T10:59:36,529 Found link https://www.piwheels.org/simple/wheel/wheel-0.38.0-py3-none-any.whl#sha256=08ee5812b1b7a10d6aaebeb1268ef409cd24204b2020e8bd8d69b2f7894f27fe (from https://www.piwheels.org/simple/wheel/) (requires-python:>=3.7), version: 0.38.0 2024-12-17T10:59:36,531 Found link https://www.piwheels.org/simple/wheel/wheel-0.37.1-py2.py3-none-any.whl#sha256=d322578b482f35eefbbfa86aabf139a6b3b806b4bd19f9d909b6ccf2a8f9684d (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.37.1 2024-12-17T10:59:36,533 Found link https://www.piwheels.org/simple/wheel/wheel-0.37.0-py2.py3-none-any.whl#sha256=48c6df128edf9d8137efa9dcd8dc0217a276f0828db5eec9a36f3e5abe5b7f9a (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.37.0 2024-12-17T10:59:36,535 Found link https://www.piwheels.org/simple/wheel/wheel-0.36.2-py2.py3-none-any.whl#sha256=78b5b185f0e5763c26ca1e324373aadd49182ca90e825f7853f4b2509215dc0e (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.2 2024-12-17T10:59:36,537 Found link https://www.piwheels.org/simple/wheel/wheel-0.36.1-py2.py3-none-any.whl#sha256=906864fb722c0ab5f2f9c35b2c65e3af3c009402c108a709c0aca27bc2c9187b (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.1 2024-12-17T10:59:36,539 Found link https://www.piwheels.org/simple/wheel/wheel-0.36.0-py2.py3-none-any.whl#sha256=645f81da70dcd993844005762acbb7e8628306bec414c90539d276fbd4fc7cbe (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.36.0 2024-12-17T10:59:36,541 Found link https://www.piwheels.org/simple/wheel/wheel-0.35.1-py2.py3-none-any.whl#sha256=497add53525d16c173c2c1c733b8f655510e909ea78cc0e29d374243544b77a2 (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.1 2024-12-17T10:59:36,543 Found link https://www.piwheels.org/simple/wheel/wheel-0.35.0-py2.py3-none-any.whl#sha256=64a0d73747636637479b8b8741f9304bee7a568c80e4029eeb9529ef134b471d (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.35.0 2024-12-17T10:59:36,545 Found link https://www.piwheels.org/simple/wheel/wheel-0.34.2-py2.py3-none-any.whl#sha256=df277cb51e61359aba502208d680f90c0493adec6f0e848af94948778aed386e (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.2 2024-12-17T10:59:36,547 Found link https://www.piwheels.org/simple/wheel/wheel-0.34.1-py2.py3-none-any.whl#sha256=48e082fac9a549bb30abcb71360db41e9e999f63bfc9933fdb7339ba7205330f (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*), version: 0.34.1 2024-12-17T10:59:36,549 Found link https://www.piwheels.org/simple/wheel/wheel-0.34.0-py2.py3-none-any.whl#sha256=98a7bd648493d21da3463c52c437e81061c61b4dcca63d56c6d041c9f747abeb (from https://www.piwheels.org/simple/wheel/) (requires-python:!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,>=2.7), version: 0.34.0 2024-12-17T10:59:36,551 Found link https://www.piwheels.org/simple/wheel/wheel-0.33.6-py2.py3-none-any.whl#sha256=f4da1763d3becf2e2cd92a14a7c920f0f00eca30fdde9ea992c836685b9faf28 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.6 2024-12-17T10:59:36,553 Found link https://www.piwheels.org/simple/wheel/wheel-0.33.5-py2.py3-none-any.whl#sha256=fd85f7f5ba5b13376fc0ba78dc34f7d7dd2ee944b15d4bac7a34b7a25ee226af (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.5 2024-12-17T10:59:36,555 Found link https://www.piwheels.org/simple/wheel/wheel-0.33.4-py2.py3-none-any.whl#sha256=5e79117472686ac0c4aef5bad5172ea73a1c2d1646b808c35926bd26bdfb0c08 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.4 2024-12-17T10:59:36,557 Found link https://www.piwheels.org/simple/wheel/wheel-0.33.1-py2.py3-none-any.whl#sha256=8eb4a788b3aec8abf5ff68d4165441bc57420c9f64ca5f471f58c3969fe08668 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.1 2024-12-17T10:59:36,559 Found link https://www.piwheels.org/simple/wheel/wheel-0.33.0-py2.py3-none-any.whl#sha256=b79ffea026bc0dbd940868347ae9eee36789b6496b6623bd2dec7c7c540a8f99 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.33.0 2024-12-17T10:59:36,561 Found link https://www.piwheels.org/simple/wheel/wheel-0.32.3-py2.py3-none-any.whl#sha256=1e53cdb3f808d5ccd0df57f964263752aa74ea7359526d3da6c02114ec1e1d44 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.3 2024-12-17T10:59:36,563 Found link https://www.piwheels.org/simple/wheel/wheel-0.32.2-py2.py3-none-any.whl#sha256=c93e2d711f5f9841e17f53b0e6c0ff85593f3b416b6eec7a9452041a59a42688 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.2 2024-12-17T10:59:36,565 Found link https://www.piwheels.org/simple/wheel/wheel-0.32.1-py2.py3-none-any.whl#sha256=9fa1f772f1a2df2bd00ddb4fa57e1cc349301e1facb98fbe62329803a9ff1196 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.1 2024-12-17T10:59:36,567 Found link https://www.piwheels.org/simple/wheel/wheel-0.32.0-py2.py3-none-any.whl#sha256=3970f4130b7f8bf8167ca09215c8cc2f49a87c3d46506adfc60cb08c47ab0949 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.32.0 2024-12-17T10:59:36,569 Found link https://www.piwheels.org/simple/wheel/wheel-0.31.1-py2.py3-none-any.whl#sha256=80044e51ec5bbf6c894ba0bc48d26a8c20a9ba629f4ca19ea26ecfcf87685f5f (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.31.1 2024-12-17T10:59:36,571 Found link https://www.piwheels.org/simple/wheel/wheel-0.31.0-py2.py3-none-any.whl#sha256=9cdc8ab2cc9c3c2e2727a4b67c22881dbb0e1c503d592992594c5e131c867107 (from https://www.piwheels.org/simple/wheel/) (requires-python:>=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*), version: 0.31.0 2024-12-17T10:59:36,572 Found link https://www.piwheels.org/simple/wheel/wheel-0.30.0-py2.py3-none-any.whl#sha256=e721e53864f084f956f40f96124a74da0631ac13fbbd1ba99e8e2b5e9cafdf64 (from https://www.piwheels.org/simple/wheel/), version: 0.30.0 2024-12-17T10:59:36,573 Found link https://www.piwheels.org/simple/wheel/wheel-0.30.0a0-py2.py3-none-any.whl#sha256=cd19aa9325d3af1c641b0a23502b12696159171d2a2f4b84308df9a075c2a4a0 (from https://www.piwheels.org/simple/wheel/), version: 0.30.0a0 2024-12-17T10:59:36,574 Found link https://www.piwheels.org/simple/wheel/wheel-0.29.0-py2.py3-none-any.whl#sha256=ea8033fc9905804e652f75474d33410a07404c1a78dd3c949a66863bd1050ebd (from https://www.piwheels.org/simple/wheel/), version: 0.29.0 2024-12-17T10:59:36,575 Found link https://www.piwheels.org/simple/wheel/wheel-0.28.0-py2.py3-none-any.whl#sha256=7a83f0fd22ccf4137673f21a4fbd6b522e3c826add9568adbf63eb17fb9ec90c (from https://www.piwheels.org/simple/wheel/), version: 0.28.0 2024-12-17T10:59:36,576 Found link https://www.piwheels.org/simple/wheel/wheel-0.27.0-py2.py3-none-any.whl#sha256=b2e5cf1b3e5ca7873956bea1fadc160850a89fdb96a22515e72b5e3b61bb9c6a (from https://www.piwheels.org/simple/wheel/), version: 0.27.0 2024-12-17T10:59:36,577 Found link https://www.piwheels.org/simple/wheel/wheel-0.26.0-py2.py3-none-any.whl#sha256=c92ed3a2dd87c54a9e20024fb0a206fe591c352c745fff21e8f8c6cdac2086ea (from https://www.piwheels.org/simple/wheel/), version: 0.26.0 2024-12-17T10:59:36,578 Found link https://www.piwheels.org/simple/wheel/wheel-0.25.0-py2.py3-none-any.whl#sha256=11d74730000531808916fcc069fb7bb5906caa0dba978b126cc807be8d4319f4 (from https://www.piwheels.org/simple/wheel/), version: 0.25.0 2024-12-17T10:59:36,579 Found link https://www.piwheels.org/simple/wheel/wheel-0.24.0-py2.py3-none-any.whl#sha256=53a8b47d3db4ded8db41a1e9bbb77a1625074e7a4879bd0ebf97d6cb01576383 (from https://www.piwheels.org/simple/wheel/), version: 0.24.0 2024-12-17T10:59:36,580 Found link https://www.piwheels.org/simple/wheel/wheel-0.23.0-py2.py3-none-any.whl#sha256=cbc6b2e274557b5e8ee8b61ca4c0c781702956a80cdbeb7ec0446834b5078082 (from https://www.piwheels.org/simple/wheel/), version: 0.23.0 2024-12-17T10:59:36,581 Found link https://www.piwheels.org/simple/wheel/wheel-0.22.0-py2.py3-none-any.whl#sha256=4ac0ec6404ef2dd3412fcdb1560206eaca86a4c73ff29895989320faca54be61 (from https://www.piwheels.org/simple/wheel/), version: 0.22.0 2024-12-17T10:59:36,582 Found link https://www.piwheels.org/simple/wheel/wheel-0.21.0-py2.py3-none-any.whl#sha256=b0798123cd67a763637991812ab866f609a81516228273e89270d4bc91b276cd (from https://www.piwheels.org/simple/wheel/), version: 0.21.0 2024-12-17T10:59:36,583 Found link https://www.piwheels.org/simple/wheel/wheel-0.19.0-py2.py3-none-any.whl#sha256=c4393edc51986db56f4ee7ef542e1e183caef570d5e5a6b9021333b21a40683e (from https://www.piwheels.org/simple/wheel/), version: 0.19.0 2024-12-17T10:59:36,584 Found link https://www.piwheels.org/simple/wheel/wheel-0.18.0-py2.py3-none-any.whl#sha256=50464317d6baf354a78df94b7a842ce1fe4e5752c9dd3a97c38e3219eeb5fbe8 (from https://www.piwheels.org/simple/wheel/), version: 0.18.0 2024-12-17T10:59:36,586 Found link https://www.piwheels.org/simple/wheel/wheel-0.17.0-py2.py3-none-any.whl#sha256=b5affc730154325831d35b4fec11cc2647846443fbbca85dcb056cc0e5f015c7 (from https://www.piwheels.org/simple/wheel/), version: 0.17.0 2024-12-17T10:59:36,587 Found link https://www.piwheels.org/simple/wheel/wheel-0.16.0-py2.py3-none-any.whl#sha256=1451499fcc03da0de54eb0d8803f96b2cc94e1cb1f4294e260516442d64531d5 (from https://www.piwheels.org/simple/wheel/), version: 0.16.0 2024-12-17T10:59:36,588 Found link https://www.piwheels.org/simple/wheel/wheel-0.15.0-py2.py3-none-any.whl#sha256=c719c414d4a192ee70c85e330421bd022fda91552e40ab74078cfeeeda3a35a1 (from https://www.piwheels.org/simple/wheel/), version: 0.15.0 2024-12-17T10:59:36,589 Found link https://www.piwheels.org/simple/wheel/wheel-0.14.0-py2.py3-none-any.whl#sha256=41a973fa2d0a3b007d8afdfa6ca39f6b2f48b336a642c020ea2ffe5ea2ebf426 (from https://www.piwheels.org/simple/wheel/), version: 0.14.0 2024-12-17T10:59:36,590 Found link https://www.piwheels.org/simple/wheel/wheel-0.13.0-py2.py3-none-any.whl#sha256=e22c0ee13924fa775a62d493da2abdc5fd8a1f757fa5ca012d4a0c892f5c76ce (from https://www.piwheels.org/simple/wheel/), version: 0.13.0 2024-12-17T10:59:36,591 Found link https://www.piwheels.org/simple/wheel/wheel-0.12.0-py2.py3-none-any.whl#sha256=351b5f218032c8822410ecc419e41f5e7c40df4813dc9b17f9bd51a5688225f6 (from https://www.piwheels.org/simple/wheel/), version: 0.12.0 2024-12-17T10:59:36,592 Found link https://www.piwheels.org/simple/wheel/wheel-0.11.0-py2.py3-none-any.whl#sha256=10a60ecaff2bde8bc58a04c3bd3e7518fefa4a6d7e7a297780c637f4c75530e9 (from https://www.piwheels.org/simple/wheel/), version: 0.11.0 2024-12-17T10:59:36,593 Found link https://www.piwheels.org/simple/wheel/wheel-0.10.3-py2.py3-none-any.whl#sha256=456f150509b57b16a2dfd9c882d8204990fafa55ad9f6410cd6cbb8795237c40 (from https://www.piwheels.org/simple/wheel/), version: 0.10.3 2024-12-17T10:59:36,594 Found link https://www.piwheels.org/simple/wheel/wheel-0.10.2-py2.py3-none-any.whl#sha256=abfdc3fb4427901d7faff5c570508089c382ef750a39a520c6ce0f2e2d0b6c94 (from https://www.piwheels.org/simple/wheel/), version: 0.10.2 2024-12-17T10:59:36,595 Found link https://www.piwheels.org/simple/wheel/wheel-0.10.1-py2.py3-none-any.whl#sha256=28f16c298102f35850945fad51d46fd094e6c2ba50bd8cdd4e2a7ec1093afbc1 (from https://www.piwheels.org/simple/wheel/), version: 0.10.1 2024-12-17T10:59:36,596 Found link https://www.piwheels.org/simple/wheel/wheel-0.10.0-py2.py3-none-any.whl#sha256=dbdb989fd7a99eace561be0443f1c00784a46ac6f6e10233877919a95af3c05a (from https://www.piwheels.org/simple/wheel/), version: 0.10.0 2024-12-17T10:59:36,597 Found link https://www.piwheels.org/simple/wheel/wheel-0.9.7-py34-none-any.whl#sha256=2406406008b1d0da37317df1909a155c1cf96a9ae4a3e663823f1a90d5aec89c (from https://www.piwheels.org/simple/wheel/), version: 0.9.7 2024-12-17T10:59:36,598 Found link https://www.piwheels.org/simple/wheel/wheel-0.9.5-py2.py3-none-any.whl#sha256=2fafe3ab14e79a5cd4e3e3c8ec901a16e69ba9977ff528e1357afb79fd6adbf4 (from https://www.piwheels.org/simple/wheel/), version: 0.9.5 2024-12-17T10:59:36,599 Found link https://www.piwheels.org/simple/wheel/wheel-0.9.4-py34-none-any.whl#sha256=8ff3695583cc355e20d14dfaf74816de5fc2c8b99ae2d7190bd5d37a98698d24 (from https://www.piwheels.org/simple/wheel/), version: 0.9.4 2024-12-17T10:59:36,600 Found link https://www.piwheels.org/simple/wheel/wheel-0.9.3-py34-none-any.whl#sha256=c0b9af7ba84a118d162ec37fc78d0c58b823578a82d4c3813d00ee678bf0562c (from https://www.piwheels.org/simple/wheel/), version: 0.9.3 2024-12-17T10:59:36,601 Found link https://www.piwheels.org/simple/wheel/wheel-0.9.2-py34-none-any.whl#sha256=27d25bc64b16359de9488c4523b59de2bf609c9e507a7596847e4daaf2c2a2b9 (from https://www.piwheels.org/simple/wheel/), version: 0.9.2 2024-12-17T10:59:36,602 Found link https://www.piwheels.org/simple/wheel/wheel-0.9.1-py34-none-any.whl#sha256=c5b5b97b7eba57e6adf1223dd97221321dd75776d403e0394911491f35341195 (from https://www.piwheels.org/simple/wheel/), version: 0.9.1 2024-12-17T10:59:36,603 Found link https://www.piwheels.org/simple/wheel/wheel-0.9-py32-none-any.whl#sha256=4698c1d702ca4aa52225920ca53bce0f29576574cf5b7bfa06396487e6deca57 (from https://www.piwheels.org/simple/wheel/), version: 0.9 2024-12-17T10:59:36,604 Found link https://www.piwheels.org/simple/wheel/wheel-0.8-py34-none-any.whl#sha256=5c7cbf9b2fc839a7858a7bceb9788f87829ca7963806e0d6a50e7f61c9cab83d (from https://www.piwheels.org/simple/wheel/), version: 0.8 2024-12-17T10:59:36,605 Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://www.piwheels.org/simple/wheel/wheel-0.7-py34-noabi-noarch.whl#sha256=19a8d0d2ed586b8b67c22b4c865aeeed398ea1214113179d256b14078a8c0e78 (from https://www.piwheels.org/simple/wheel/) 2024-12-17T10:59:36,606 Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://www.piwheels.org/simple/wheel/wheel-0.6-py34-noabi-noarch.whl#sha256=905534a6b3bec28519ad305b902eeefe4f8e4c524c1f8dc2a671c59ca286e7fb (from https://www.piwheels.org/simple/wheel/) 2024-12-17T10:59:36,607 Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://www.piwheels.org/simple/wheel/wheel-0.5-py34-noabi-noarch.whl#sha256=83f89c21452c9c6ad964d4cce90d41885273b0a95c7b8c44c1ba89fd89c47b7f (from https://www.piwheels.org/simple/wheel/) 2024-12-17T10:59:36,608 Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://www.piwheels.org/simple/wheel/wheel-0.4.2-py34-noabi-noarch.whl#sha256=d9fa12e187f892153b8d544eea6efdfe3454c98ebc5fc55ef678721c8b5c8c42 (from https://www.piwheels.org/simple/wheel/) 2024-12-17T10:59:36,609 Skipping link: invalid wheel filename: https://www.piwheels.org/simple/wheel/wheel_0.4.1-py34-noabi-noarch.whl#sha256=cab5b976203de1a697913a41e64252a352e26734a30c8b49700673f4a8e8f46c (from https://www.piwheels.org/simple/wheel/) 2024-12-17T10:59:36,610 Skipping link: invalid wheel filename: https://www.piwheels.org/simple/wheel/wheel_0.4-py34-noabi-noarch.whl#sha256=84fdd11c0d960611e5821a93b6d041bd6af3c07863a075b8026f10dcd675624d (from https://www.piwheels.org/simple/wheel/) 2024-12-17T10:59:36,611 Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://www.piwheels.org/simple/wheel/wheel-0.3-py34-noabi-noarch.whl#sha256=3a90e79b373e2478c9f126c2a5b922bbeb15010b7381d0fafedfc8a3c56ede9c (from https://www.piwheels.org/simple/wheel/) 2024-12-17T10:59:36,612 Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://www.piwheels.org/simple/wheel/wheel-0.2-py34-noabi-noarch.whl#sha256=0a939ef0343814a3321be3f624fbb14c88e6a2c148e56dd6c19e3f0cc6f550c8 (from https://www.piwheels.org/simple/wheel/) 2024-12-17T10:59:36,613 Skipping link: none of the wheel's tags (py34-noabi-noarch) are compatible (run pip debug --verbose to show compatible tags): https://www.piwheels.org/simple/wheel/wheel-0.1-py34-noabi-noarch.whl#sha256=2925b4da54f70d40cead292dc7921052acbfff72bb331b93237ccc839bff06c9 (from https://www.piwheels.org/simple/wheel/) 2024-12-17T10:59:36,613 Skipping link: not a file: https://www.piwheels.org/simple/wheel/ 2024-12-17T10:59:36,614 Skipping link: not a file: https://pypi.org/simple/wheel/ 2024-12-17T10:59:36,623 Given no hashes to check 205 links for project 'wheel': discarding no candidates 2024-12-17T10:59:36,646 Collecting wheel 2024-12-17T10:59:36,647 Created temporary directory: /tmp/pip-unpack-9nrzsgfv 2024-12-17T10:59:36,649 Found index url https://www.piwheels.org/simple/ 2024-12-17T10:59:36,651 Looking up "https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl" in the cache 2024-12-17T10:59:36,654 Current age based on date: 299 2024-12-17T10:59:36,660 https://www.piwheels.org:443 "GET /simple/wheel/wheel-0.45.1-py3-none-any.whl HTTP/1.1" 304 0 2024-12-17T10:59:36,664 Using cached https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl (72 kB) 2024-12-17T10:59:36,683 Created temporary directory: /tmp/pip-unpack-wi2qt39m 2024-12-17T10:59:37,220 Installing collected packages: wheel, setuptools 2024-12-17T10:59:37,457 Creating /tmp/pip-build-env-qxfn50b7/overlay/local/bin 2024-12-17T10:59:37,459 changing mode of /tmp/pip-build-env-qxfn50b7/overlay/local/bin/wheel to 755 2024-12-17T10:59:41,349 Successfully installed setuptools-75.6.0 wheel-0.45.1 2024-12-17T10:59:41,350 Removed build tracker: '/tmp/pip-build-tracker-v_j8oion' 2024-12-17T10:59:41,607 Installing build dependencies: finished with status 'done' 2024-12-17T10:59:41,611 Getting requirements to build wheel: started 2024-12-17T10:59:41,612 Running command Getting requirements to build wheel 2024-12-17T10:59:42,613 running egg_info 2024-12-17T10:59:42,621 writing lm_eval.egg-info/PKG-INFO 2024-12-17T10:59:42,649 writing dependency_links to lm_eval.egg-info/dependency_links.txt 2024-12-17T10:59:42,651 writing entry points to lm_eval.egg-info/entry_points.txt 2024-12-17T10:59:42,666 writing requirements to lm_eval.egg-info/requires.txt 2024-12-17T10:59:42,668 writing top-level names to lm_eval.egg-info/top_level.txt 2024-12-17T10:59:43,674 reading manifest file 'lm_eval.egg-info/SOURCES.txt' 2024-12-17T10:59:43,877 adding license file 'LICENSE.md' 2024-12-17T10:59:44,086 writing manifest file 'lm_eval.egg-info/SOURCES.txt' 2024-12-17T10:59:44,200 Getting requirements to build wheel: finished with status 'done' 2024-12-17T10:59:44,204 Created temporary directory: /tmp/pip-modern-metadata-r1_8zy2n 2024-12-17T10:59:44,206 Preparing metadata (pyproject.toml): started 2024-12-17T10:59:44,207 Running command Preparing metadata (pyproject.toml) 2024-12-17T10:59:45,032 running dist_info 2024-12-17T10:59:45,044 creating /tmp/pip-modern-metadata-r1_8zy2n/lm_eval.egg-info 2024-12-17T10:59:45,045 writing /tmp/pip-modern-metadata-r1_8zy2n/lm_eval.egg-info/PKG-INFO 2024-12-17T10:59:45,072 writing dependency_links to /tmp/pip-modern-metadata-r1_8zy2n/lm_eval.egg-info/dependency_links.txt 2024-12-17T10:59:45,074 writing entry points to /tmp/pip-modern-metadata-r1_8zy2n/lm_eval.egg-info/entry_points.txt 2024-12-17T10:59:45,089 writing requirements to /tmp/pip-modern-metadata-r1_8zy2n/lm_eval.egg-info/requires.txt 2024-12-17T10:59:45,090 writing top-level names to /tmp/pip-modern-metadata-r1_8zy2n/lm_eval.egg-info/top_level.txt 2024-12-17T10:59:45,091 writing manifest file '/tmp/pip-modern-metadata-r1_8zy2n/lm_eval.egg-info/SOURCES.txt' 2024-12-17T10:59:45,957 reading manifest file '/tmp/pip-modern-metadata-r1_8zy2n/lm_eval.egg-info/SOURCES.txt' 2024-12-17T10:59:45,959 adding license file 'LICENSE.md' 2024-12-17T10:59:46,101 writing manifest file '/tmp/pip-modern-metadata-r1_8zy2n/lm_eval.egg-info/SOURCES.txt' 2024-12-17T10:59:46,109 creating '/tmp/pip-modern-metadata-r1_8zy2n/lm_eval-0.4.7.dist-info' 2024-12-17T10:59:46,252 Preparing metadata (pyproject.toml): finished with status 'done' 2024-12-17T10:59:46,260 Source in /tmp/pip-wheel-fycsc461/lm-eval_38aa1ea8f83642d99df2e3740093dd5e has version 0.4.7, which satisfies requirement lm-eval==0.4.7 from https://files.pythonhosted.org/packages/53/c9/b5d03d5b2bf6819008e377844999fbd04ab00dff0c43728957f1c90a53c5/lm_eval-0.4.7.tar.gz 2024-12-17T10:59:46,261 Removed lm-eval==0.4.7 from https://files.pythonhosted.org/packages/53/c9/b5d03d5b2bf6819008e377844999fbd04ab00dff0c43728957f1c90a53c5/lm_eval-0.4.7.tar.gz from build tracker '/tmp/pip-build-tracker-v_j8oion' 2024-12-17T10:59:46,327 Created temporary directory: /tmp/pip-unpack-xz_dt4mb 2024-12-17T10:59:46,328 Created temporary directory: /tmp/pip-unpack-cxj3l2tl 2024-12-17T10:59:46,328 Building wheels for collected packages: lm-eval 2024-12-17T10:59:46,333 Created temporary directory: /tmp/pip-wheel-gii7g1u5 2024-12-17T10:59:46,333 Destination directory: /tmp/pip-wheel-gii7g1u5 2024-12-17T10:59:46,335 Building wheel for lm-eval (pyproject.toml): started 2024-12-17T10:59:46,337 Running command Building wheel for lm-eval (pyproject.toml) 2024-12-17T10:59:47,137 running bdist_wheel 2024-12-17T10:59:47,158 running build 2024-12-17T10:59:47,159 running build_py 2024-12-17T10:59:47,166 creating build/lib/lm_eval 2024-12-17T10:59:47,168 copying lm_eval/evaluator_utils.py -> build/lib/lm_eval 2024-12-17T10:59:47,172 copying lm_eval/__main__.py -> build/lib/lm_eval 2024-12-17T10:59:47,174 copying lm_eval/evaluator.py -> build/lib/lm_eval 2024-12-17T10:59:47,177 copying lm_eval/utils.py -> build/lib/lm_eval 2024-12-17T10:59:47,180 copying lm_eval/__init__.py -> build/lib/lm_eval 2024-12-17T10:59:47,182 creating build/lib/lm_eval/api 2024-12-17T10:59:47,183 copying lm_eval/api/model.py -> build/lib/lm_eval/api 2024-12-17T10:59:47,186 copying lm_eval/api/group.py -> build/lib/lm_eval/api 2024-12-17T10:59:47,188 copying lm_eval/api/metrics.py -> build/lib/lm_eval/api 2024-12-17T10:59:47,190 copying lm_eval/api/instance.py -> build/lib/lm_eval/api 2024-12-17T10:59:47,192 copying lm_eval/api/filter.py -> build/lib/lm_eval/api 2024-12-17T10:59:47,194 copying lm_eval/api/samplers.py -> build/lib/lm_eval/api 2024-12-17T10:59:47,196 copying lm_eval/api/task.py -> build/lib/lm_eval/api 2024-12-17T10:59:47,200 copying lm_eval/api/__init__.py -> build/lib/lm_eval/api 2024-12-17T10:59:47,202 copying lm_eval/api/registry.py -> build/lib/lm_eval/api 2024-12-17T10:59:47,204 creating build/lib/lm_eval/loggers 2024-12-17T10:59:47,206 copying lm_eval/loggers/wandb_logger.py -> build/lib/lm_eval/loggers 2024-12-17T10:59:47,208 copying lm_eval/loggers/evaluation_tracker.py -> build/lib/lm_eval/loggers 2024-12-17T10:59:47,211 copying lm_eval/loggers/utils.py -> build/lib/lm_eval/loggers 2024-12-17T10:59:47,213 copying lm_eval/loggers/__init__.py -> build/lib/lm_eval/loggers 2024-12-17T10:59:47,216 creating build/lib/lm_eval/tasks 2024-12-17T10:59:47,217 copying lm_eval/tasks/__init__.py -> build/lib/lm_eval/tasks 2024-12-17T10:59:47,220 creating build/lib/lm_eval/prompts 2024-12-17T10:59:47,221 copying lm_eval/prompts/__init__.py -> build/lib/lm_eval/prompts 2024-12-17T10:59:47,225 creating build/lib/lm_eval/decontamination 2024-12-17T10:59:47,226 copying lm_eval/decontamination/decontaminate.py -> build/lib/lm_eval/decontamination 2024-12-17T10:59:47,229 copying lm_eval/decontamination/archiver.py -> build/lib/lm_eval/decontamination 2024-12-17T10:59:47,231 copying lm_eval/decontamination/__init__.py -> build/lib/lm_eval/decontamination 2024-12-17T10:59:47,232 copying lm_eval/decontamination/janitor.py -> build/lib/lm_eval/decontamination 2024-12-17T10:59:47,235 creating build/lib/lm_eval/caching 2024-12-17T10:59:47,236 copying lm_eval/caching/cache.py -> build/lib/lm_eval/caching 2024-12-17T10:59:47,238 copying lm_eval/caching/__init__.py -> build/lib/lm_eval/caching 2024-12-17T10:59:47,240 creating build/lib/lm_eval/models 2024-12-17T10:59:47,241 copying lm_eval/models/neuron_optimum.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,244 copying lm_eval/models/textsynth.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,247 copying lm_eval/models/optimum_lm.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,248 copying lm_eval/models/api_models.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,251 copying lm_eval/models/ibm_watsonx_ai.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,254 copying lm_eval/models/vllm_vlms.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,256 copying lm_eval/models/dummy.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,258 copying lm_eval/models/hf_vlms.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,260 copying lm_eval/models/anthropic_llms.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,263 copying lm_eval/models/openai_completions.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,265 copying lm_eval/models/nemo_lm.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,268 copying lm_eval/models/optimum_ipex.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,270 copying lm_eval/models/gguf.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,272 copying lm_eval/models/mamba_lm.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,274 copying lm_eval/models/utils.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,277 copying lm_eval/models/vllm_causallms.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,280 copying lm_eval/models/huggingface.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,283 copying lm_eval/models/neuralmagic.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,285 copying lm_eval/models/__init__.py -> build/lib/lm_eval/models 2024-12-17T10:59:47,288 creating build/lib/lm_eval/filters 2024-12-17T10:59:47,289 copying lm_eval/filters/selection.py -> build/lib/lm_eval/filters 2024-12-17T10:59:47,290 copying lm_eval/filters/extraction.py -> build/lib/lm_eval/filters 2024-12-17T10:59:47,293 copying lm_eval/filters/transformation.py -> build/lib/lm_eval/filters 2024-12-17T10:59:47,295 copying lm_eval/filters/__init__.py -> build/lib/lm_eval/filters 2024-12-17T10:59:47,296 copying lm_eval/filters/decontamination.py -> build/lib/lm_eval/filters 2024-12-17T10:59:47,299 creating build/lib/lm_eval/tasks/medmcqa 2024-12-17T10:59:47,300 copying lm_eval/tasks/medmcqa/utils_medmcqa.py -> build/lib/lm_eval/tasks/medmcqa 2024-12-17T10:59:47,302 creating build/lib/lm_eval/tasks/coqa 2024-12-17T10:59:47,303 copying lm_eval/tasks/coqa/utils.py -> build/lib/lm_eval/tasks/coqa 2024-12-17T10:59:47,307 creating build/lib/lm_eval/tasks/bigbench 2024-12-17T10:59:47,308 copying lm_eval/tasks/bigbench/push_bigbench_dataset.py -> build/lib/lm_eval/tasks/bigbench 2024-12-17T10:59:47,310 copying lm_eval/tasks/bigbench/generate_tasks.py -> build/lib/lm_eval/tasks/bigbench 2024-12-17T10:59:47,314 creating build/lib/lm_eval/tasks/translation 2024-12-17T10:59:47,315 copying lm_eval/tasks/translation/utils.py -> build/lib/lm_eval/tasks/translation 2024-12-17T10:59:47,318 creating build/lib/lm_eval/tasks/mgsm 2024-12-17T10:59:47,319 copying lm_eval/tasks/mgsm/utils.py -> build/lib/lm_eval/tasks/mgsm 2024-12-17T10:59:47,322 creating build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:47,323 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:47,325 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:47,327 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:47,328 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:47,331 creating build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:47,331 copying lm_eval/tasks/catalan_bench/utils.py -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:47,334 creating build/lib/lm_eval/tasks/medqa 2024-12-17T10:59:47,335 copying lm_eval/tasks/medqa/preprocess_medqa.py -> build/lib/lm_eval/tasks/medqa 2024-12-17T10:59:47,339 creating build/lib/lm_eval/tasks/squadv2 2024-12-17T10:59:47,340 copying lm_eval/tasks/squadv2/task.py -> build/lib/lm_eval/tasks/squadv2 2024-12-17T10:59:47,342 creating build/lib/lm_eval/tasks/logiqa2 2024-12-17T10:59:47,343 copying lm_eval/tasks/logiqa2/utils_logiqa2.py -> build/lib/lm_eval/tasks/logiqa2 2024-12-17T10:59:47,346 creating build/lib/lm_eval/tasks/squad_completion 2024-12-17T10:59:47,347 copying lm_eval/tasks/squad_completion/task.py -> build/lib/lm_eval/tasks/squad_completion 2024-12-17T10:59:47,350 creating build/lib/lm_eval/tasks/score 2024-12-17T10:59:47,351 copying lm_eval/tasks/score/utils.py -> build/lib/lm_eval/tasks/score 2024-12-17T10:59:47,354 copying lm_eval/tasks/score/non_greedy_summarizer.py -> build/lib/lm_eval/tasks/score 2024-12-17T10:59:47,357 creating build/lib/lm_eval/tasks/mathqa 2024-12-17T10:59:47,358 copying lm_eval/tasks/mathqa/utils.py -> build/lib/lm_eval/tasks/mathqa 2024-12-17T10:59:47,360 creating build/lib/lm_eval/tasks/logiqa 2024-12-17T10:59:47,361 copying lm_eval/tasks/logiqa/utils_logiqa.py -> build/lib/lm_eval/tasks/logiqa 2024-12-17T10:59:47,363 creating build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:47,365 copying lm_eval/tasks/paloma/paloma_utils.py -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:47,368 creating build/lib/lm_eval/tasks/race 2024-12-17T10:59:47,369 copying lm_eval/tasks/race/preprocess_race.py -> build/lib/lm_eval/tasks/race 2024-12-17T10:59:47,372 creating build/lib/lm_eval/tasks/lingoly 2024-12-17T10:59:47,373 copying lm_eval/tasks/lingoly/script.py -> build/lib/lm_eval/tasks/lingoly 2024-12-17T10:59:47,375 copying lm_eval/tasks/lingoly/utils.py -> build/lib/lm_eval/tasks/lingoly 2024-12-17T10:59:47,377 creating build/lib/lm_eval/tasks/xwinograd 2024-12-17T10:59:47,378 copying lm_eval/tasks/xwinograd/utils.py -> build/lib/lm_eval/tasks/xwinograd 2024-12-17T10:59:47,381 creating build/lib/lm_eval/tasks/csatqa 2024-12-17T10:59:47,382 copying lm_eval/tasks/csatqa/_generate_configs.py -> build/lib/lm_eval/tasks/csatqa 2024-12-17T10:59:47,384 copying lm_eval/tasks/csatqa/utils.py -> build/lib/lm_eval/tasks/csatqa 2024-12-17T10:59:47,387 creating build/lib/lm_eval/tasks/qa4mre 2024-12-17T10:59:47,387 copying lm_eval/tasks/qa4mre/preprocess_qa4mre.py -> build/lib/lm_eval/tasks/qa4mre 2024-12-17T10:59:47,390 creating build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:47,391 copying lm_eval/tasks/metabench/process_docs_permute.py -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:47,394 copying lm_eval/tasks/metabench/process_docs.py -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:47,397 creating build/lib/lm_eval/tasks/bbh 2024-12-17T10:59:47,398 copying lm_eval/tasks/bbh/_generate_configs.py -> build/lib/lm_eval/tasks/bbh 2024-12-17T10:59:47,400 creating build/lib/lm_eval/tasks/spanish_bench 2024-12-17T10:59:47,401 copying lm_eval/tasks/spanish_bench/utils.py -> build/lib/lm_eval/tasks/spanish_bench 2024-12-17T10:59:47,405 creating build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:47,406 copying lm_eval/tasks/unitxt/task.py -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:47,410 creating build/lib/lm_eval/tasks/qasper 2024-12-17T10:59:47,411 copying lm_eval/tasks/qasper/metrics.py -> build/lib/lm_eval/tasks/qasper 2024-12-17T10:59:47,413 copying lm_eval/tasks/qasper/utils.py -> build/lib/lm_eval/tasks/qasper 2024-12-17T10:59:47,415 creating build/lib/lm_eval/tasks/eq_bench 2024-12-17T10:59:47,416 copying lm_eval/tasks/eq_bench/utils.py -> build/lib/lm_eval/tasks/eq_bench 2024-12-17T10:59:47,419 creating build/lib/lm_eval/tasks/noticia 2024-12-17T10:59:47,419 copying lm_eval/tasks/noticia/utils.py -> build/lib/lm_eval/tasks/noticia 2024-12-17T10:59:47,422 creating build/lib/lm_eval/tasks/wikitext 2024-12-17T10:59:47,423 copying lm_eval/tasks/wikitext/preprocess_wikitext.py -> build/lib/lm_eval/tasks/wikitext 2024-12-17T10:59:47,426 creating build/lib/lm_eval/tasks/copal_id 2024-12-17T10:59:47,427 copying lm_eval/tasks/copal_id/utils.py -> build/lib/lm_eval/tasks/copal_id 2024-12-17T10:59:47,430 creating build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:47,431 copying lm_eval/tasks/blimp/generate_configs.py -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:47,434 creating build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:47,435 copying lm_eval/tasks/arabicmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:47,437 copying lm_eval/tasks/arabicmmlu/utils.py -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:47,440 creating build/lib/lm_eval/tasks/fda 2024-12-17T10:59:47,441 copying lm_eval/tasks/fda/task.py -> build/lib/lm_eval/tasks/fda 2024-12-17T10:59:47,443 creating build/lib/lm_eval/tasks/afrimmlu 2024-12-17T10:59:47,444 copying lm_eval/tasks/afrimmlu/utils.py -> build/lib/lm_eval/tasks/afrimmlu 2024-12-17T10:59:47,447 creating build/lib/lm_eval/tasks/scrolls 2024-12-17T10:59:47,448 copying lm_eval/tasks/scrolls/task.py -> build/lib/lm_eval/tasks/scrolls 2024-12-17T10:59:47,452 creating build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:47,455 copying lm_eval/tasks/xnli/utils.py -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:47,458 creating build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:47,459 copying lm_eval/tasks/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:47,461 creating build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:47,462 copying lm_eval/tasks/mmmu/utils.py -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:47,465 creating build/lib/lm_eval/tasks/eus_trivia 2024-12-17T10:59:47,466 copying lm_eval/tasks/eus_trivia/utils.py -> build/lib/lm_eval/tasks/eus_trivia 2024-12-17T10:59:47,469 creating build/lib/lm_eval/tasks/winogrande 2024-12-17T10:59:47,470 copying lm_eval/tasks/winogrande/preprocess_winogrande.py -> build/lib/lm_eval/tasks/winogrande 2024-12-17T10:59:47,473 creating build/lib/lm_eval/tasks/afrixnli 2024-12-17T10:59:47,474 copying lm_eval/tasks/afrixnli/utils.py -> build/lib/lm_eval/tasks/afrixnli 2024-12-17T10:59:47,477 creating build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:47,478 copying lm_eval/tasks/belebele/_generate_configs.py -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:47,480 creating build/lib/lm_eval/tasks/minerva_math 2024-12-17T10:59:47,482 copying lm_eval/tasks/minerva_math/utils.py -> build/lib/lm_eval/tasks/minerva_math 2024-12-17T10:59:47,485 creating build/lib/lm_eval/tasks/wsc273 2024-12-17T10:59:47,486 copying lm_eval/tasks/wsc273/utils.py -> build/lib/lm_eval/tasks/wsc273 2024-12-17T10:59:47,488 creating build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:47,489 copying lm_eval/tasks/cmmlu/_generate_configs.py -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:47,492 creating build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:47,493 copying lm_eval/tasks/med_concepts_qa/_generate_configs.py -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:47,496 creating build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:47,497 copying lm_eval/tasks/xcopa/utils.py -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:47,499 creating build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:47,500 copying lm_eval/tasks/crows_pairs/utils.py -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:47,503 creating build/lib/lm_eval/tasks/drop 2024-12-17T10:59:47,504 copying lm_eval/tasks/drop/utils.py -> build/lib/lm_eval/tasks/drop 2024-12-17T10:59:47,507 creating build/lib/lm_eval/tasks/ifeval 2024-12-17T10:59:47,508 copying lm_eval/tasks/ifeval/utils.py -> build/lib/lm_eval/tasks/ifeval 2024-12-17T10:59:47,511 copying lm_eval/tasks/ifeval/instructions_util.py -> build/lib/lm_eval/tasks/ifeval 2024-12-17T10:59:47,513 copying lm_eval/tasks/ifeval/instructions.py -> build/lib/lm_eval/tasks/ifeval 2024-12-17T10:59:47,516 copying lm_eval/tasks/ifeval/instructions_registry.py -> build/lib/lm_eval/tasks/ifeval 2024-12-17T10:59:47,520 creating build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:47,521 copying lm_eval/tasks/ceval/_generate_configs.py -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:47,524 creating build/lib/lm_eval/tasks/realtoxicityprompts 2024-12-17T10:59:47,525 copying lm_eval/tasks/realtoxicityprompts/metric.py -> build/lib/lm_eval/tasks/realtoxicityprompts 2024-12-17T10:59:47,527 creating build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:47,528 copying lm_eval/tasks/eus_exams/utils.py -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:47,530 copying lm_eval/tasks/eus_exams/configs.py -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:47,533 creating build/lib/lm_eval/tasks/hendrycks_ethics 2024-12-17T10:59:47,534 copying lm_eval/tasks/hendrycks_ethics/utils.py -> build/lib/lm_eval/tasks/hendrycks_ethics 2024-12-17T10:59:47,537 creating build/lib/lm_eval/tasks/mutual 2024-12-17T10:59:47,538 copying lm_eval/tasks/mutual/utils.py -> build/lib/lm_eval/tasks/mutual 2024-12-17T10:59:47,540 creating build/lib/lm_eval/tasks/webqs 2024-12-17T10:59:47,542 copying lm_eval/tasks/webqs/utils.py -> build/lib/lm_eval/tasks/webqs 2024-12-17T10:59:47,544 creating build/lib/lm_eval/tasks/glianorex 2024-12-17T10:59:47,545 copying lm_eval/tasks/glianorex/preprocess_glianorex.py -> build/lib/lm_eval/tasks/glianorex 2024-12-17T10:59:47,548 creating build/lib/lm_eval/tasks/paws-x 2024-12-17T10:59:47,549 copying lm_eval/tasks/paws-x/_generate_config.py -> build/lib/lm_eval/tasks/paws-x 2024-12-17T10:59:47,552 creating build/lib/lm_eval/tasks/basqueglue 2024-12-17T10:59:47,553 copying lm_eval/tasks/basqueglue/utils.py -> build/lib/lm_eval/tasks/basqueglue 2024-12-17T10:59:47,555 creating build/lib/lm_eval/tasks/wmt2016 2024-12-17T10:59:47,556 copying lm_eval/tasks/wmt2016/metrics.py -> build/lib/lm_eval/tasks/wmt2016 2024-12-17T10:59:47,559 creating build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:47,560 copying lm_eval/tasks/french_bench/utils.py -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:47,562 copying lm_eval/tasks/french_bench/preprocess_wikitext.py -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:47,564 creating build/lib/lm_eval/tasks/eus_reading 2024-12-17T10:59:47,565 copying lm_eval/tasks/eus_reading/utils.py -> build/lib/lm_eval/tasks/eus_reading 2024-12-17T10:59:47,568 creating build/lib/lm_eval/tasks/kobest 2024-12-17T10:59:47,569 copying lm_eval/tasks/kobest/utils.py -> build/lib/lm_eval/tasks/kobest 2024-12-17T10:59:47,571 creating build/lib/lm_eval/tasks/hendrycks_math 2024-12-17T10:59:47,572 copying lm_eval/tasks/hendrycks_math/utils.py -> build/lib/lm_eval/tasks/hendrycks_math 2024-12-17T10:59:47,575 creating build/lib/lm_eval/tasks/truthfulqa 2024-12-17T10:59:47,576 copying lm_eval/tasks/truthfulqa/utils.py -> build/lib/lm_eval/tasks/truthfulqa 2024-12-17T10:59:47,579 creating build/lib/lm_eval/tasks/toxigen 2024-12-17T10:59:47,581 copying lm_eval/tasks/toxigen/utils.py -> build/lib/lm_eval/tasks/toxigen 2024-12-17T10:59:47,583 creating build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:47,584 copying lm_eval/tasks/aclue/_generate_configs.py -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:47,586 creating build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:47,587 copying lm_eval/tasks/xquad/utils.py -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:47,589 creating build/lib/lm_eval/tasks/basque_bench 2024-12-17T10:59:47,590 copying lm_eval/tasks/basque_bench/utils.py -> build/lib/lm_eval/tasks/basque_bench 2024-12-17T10:59:47,592 creating build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:47,593 copying lm_eval/tasks/agieval/utils.py -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:47,596 creating build/lib/lm_eval/tasks/mmlusr 2024-12-17T10:59:47,597 copying lm_eval/tasks/mmlusr/config.py -> build/lib/lm_eval/tasks/mmlusr 2024-12-17T10:59:47,600 creating build/lib/lm_eval/tasks/swde 2024-12-17T10:59:47,601 copying lm_eval/tasks/swde/task.py -> build/lib/lm_eval/tasks/swde 2024-12-17T10:59:47,603 creating build/lib/lm_eval/tasks/pubmedqa 2024-12-17T10:59:47,604 copying lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py -> build/lib/lm_eval/tasks/pubmedqa 2024-12-17T10:59:47,606 creating build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:47,607 copying lm_eval/tasks/tinyBenchmarks/utils_winogrande.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:47,609 copying lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:47,611 copying lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:47,613 copying lm_eval/tasks/tinyBenchmarks/agg_functions.py -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:47,616 creating build/lib/lm_eval/tasks/afrimgsm 2024-12-17T10:59:47,617 copying lm_eval/tasks/afrimgsm/utils.py -> build/lib/lm_eval/tasks/afrimgsm 2024-12-17T10:59:47,621 creating build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:47,622 copying lm_eval/tasks/galician_bench/utils.py -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:47,625 creating build/lib/lm_eval/tasks/mmlu 2024-12-17T10:59:47,626 copying lm_eval/tasks/mmlu/_generate_configs.py -> build/lib/lm_eval/tasks/mmlu 2024-12-17T10:59:47,629 creating build/lib/lm_eval/tasks/hellaswag 2024-12-17T10:59:47,630 copying lm_eval/tasks/hellaswag/utils.py -> build/lib/lm_eval/tasks/hellaswag 2024-12-17T10:59:47,635 creating build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:47,636 copying lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:47,640 creating build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:47,641 copying lm_eval/tasks/score/agi_eval/utils_agieval.py -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:47,644 creating build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:47,645 copying lm_eval/tasks/score/math/utils_math.py -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:47,647 copying lm_eval/tasks/score/math/math_grader.py -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:47,650 creating build/lib/lm_eval/tasks/score/mmlu_pro 2024-12-17T10:59:47,651 copying lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py -> build/lib/lm_eval/tasks/score/mmlu_pro 2024-12-17T10:59:47,657 creating build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:47,659 copying lm_eval/tasks/tmmluplus/default/_generate_configs.py -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:47,662 copying lm_eval/tasks/tmmluplus/default/utils.py -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:47,665 creating build/lib/lm_eval/tasks/leaderboard/math 2024-12-17T10:59:47,666 copying lm_eval/tasks/leaderboard/math/utils.py -> build/lib/lm_eval/tasks/leaderboard/math 2024-12-17T10:59:47,669 creating build/lib/lm_eval/tasks/leaderboard/musr 2024-12-17T10:59:47,670 copying lm_eval/tasks/leaderboard/musr/utils.py -> build/lib/lm_eval/tasks/leaderboard/musr 2024-12-17T10:59:47,672 creating build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2024-12-17T10:59:47,673 copying lm_eval/tasks/leaderboard/mmlu_pro/utils.py -> build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2024-12-17T10:59:47,675 creating build/lib/lm_eval/tasks/leaderboard/ifeval 2024-12-17T10:59:47,676 copying lm_eval/tasks/leaderboard/ifeval/utils.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2024-12-17T10:59:47,679 copying lm_eval/tasks/leaderboard/ifeval/instructions_util.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2024-12-17T10:59:47,681 copying lm_eval/tasks/leaderboard/ifeval/instructions.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2024-12-17T10:59:47,685 copying lm_eval/tasks/leaderboard/ifeval/instructions_registry.py -> build/lib/lm_eval/tasks/leaderboard/ifeval 2024-12-17T10:59:47,687 creating build/lib/lm_eval/tasks/leaderboard/gpqa 2024-12-17T10:59:47,688 copying lm_eval/tasks/leaderboard/gpqa/utils.py -> build/lib/lm_eval/tasks/leaderboard/gpqa 2024-12-17T10:59:47,691 creating build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:47,692 copying lm_eval/tasks/bbh/cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:47,695 creating build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:47,696 copying lm_eval/tasks/bbh/zeroshot/utils.py -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:47,700 creating build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:47,701 copying lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:47,706 creating build/lib/lm_eval/tasks/glue/mnli 2024-12-17T10:59:47,707 copying lm_eval/tasks/glue/mnli/utils.py -> build/lib/lm_eval/tasks/glue/mnli 2024-12-17T10:59:47,710 creating build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:47,711 copying lm_eval/tasks/okapi/hellaswag_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:47,714 creating build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:47,715 copying lm_eval/tasks/okapi/arc_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:47,718 creating build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:47,719 copying lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:47,721 creating build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:47,722 copying lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:47,725 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2024-12-17T10:59:47,726 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2024-12-17T10:59:47,729 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:47,730 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:47,732 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2024-12-17T10:59:47,733 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2024-12-17T10:59:47,735 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2024-12-17T10:59:47,736 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2024-12-17T10:59:47,739 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2024-12-17T10:59:47,740 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2024-12-17T10:59:47,742 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2024-12-17T10:59:47,743 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2024-12-17T10:59:47,746 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2024-12-17T10:59:47,747 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2024-12-17T10:59:47,750 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:47,751 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:47,754 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2024-12-17T10:59:47,755 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2024-12-17T10:59:47,757 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2024-12-17T10:59:47,758 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2024-12-17T10:59:47,761 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2024-12-17T10:59:47,761 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2024-12-17T10:59:47,764 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2024-12-17T10:59:47,765 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2024-12-17T10:59:47,767 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T10:59:47,768 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T10:59:47,771 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2024-12-17T10:59:47,772 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2024-12-17T10:59:47,774 creating build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2024-12-17T10:59:47,775 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2024-12-17T10:59:47,778 creating build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:47,779 copying lm_eval/tasks/tmlu/default/_generate_configs.py -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:47,782 copying lm_eval/tasks/tmlu/default/utils.py -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:47,784 creating build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:47,786 copying lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:47,788 creating build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:47,789 copying lm_eval/tasks/afrimmlu/translate/utils.py -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:47,792 creating build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:47,792 copying lm_eval/tasks/afrimmlu/direct/utils.py -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:47,795 creating build/lib/lm_eval/tasks/super_glue/wsc 2024-12-17T10:59:47,796 copying lm_eval/tasks/super_glue/wsc/preprocess_wsc.py -> build/lib/lm_eval/tasks/super_glue/wsc 2024-12-17T10:59:47,798 copying lm_eval/tasks/super_glue/wsc/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/wsc 2024-12-17T10:59:47,800 creating build/lib/lm_eval/tasks/super_glue/copa 2024-12-17T10:59:47,802 copying lm_eval/tasks/super_glue/copa/utils.py -> build/lib/lm_eval/tasks/super_glue/copa 2024-12-17T10:59:47,804 creating build/lib/lm_eval/tasks/super_glue/cb 2024-12-17T10:59:47,805 copying lm_eval/tasks/super_glue/cb/aggregate.py -> build/lib/lm_eval/tasks/super_glue/cb 2024-12-17T10:59:47,814 copying lm_eval/tasks/super_glue/cb/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/cb 2024-12-17T10:59:47,817 creating build/lib/lm_eval/tasks/super_glue/record 2024-12-17T10:59:47,818 copying lm_eval/tasks/super_glue/record/util.py -> build/lib/lm_eval/tasks/super_glue/record 2024-12-17T10:59:47,820 copying lm_eval/tasks/super_glue/record/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/record 2024-12-17T10:59:47,822 creating build/lib/lm_eval/tasks/super_glue/multirc 2024-12-17T10:59:47,823 copying lm_eval/tasks/super_glue/multirc/t5_utils.py -> build/lib/lm_eval/tasks/super_glue/multirc 2024-12-17T10:59:47,826 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:47,827 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:47,830 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:47,831 copying lm_eval/tasks/afrixnli/anli prompt/translate/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:47,834 creating build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:47,836 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:47,839 creating build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:47,840 copying lm_eval/tasks/afrixnli/lai prompt/translate/utils.py -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:47,842 creating build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:47,843 copying lm_eval/tasks/afrixnli/lai prompt/direct/utils.py -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:47,846 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2024-12-17T10:59:47,847 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2024-12-17T10:59:47,850 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2024-12-17T10:59:47,851 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2024-12-17T10:59:47,854 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2024-12-17T10:59:47,855 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2024-12-17T10:59:47,857 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2024-12-17T10:59:47,858 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2024-12-17T10:59:47,860 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2024-12-17T10:59:47,861 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2024-12-17T10:59:47,864 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T10:59:47,864 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T10:59:47,867 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2024-12-17T10:59:47,868 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2024-12-17T10:59:47,870 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2024-12-17T10:59:47,871 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2024-12-17T10:59:47,873 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2024-12-17T10:59:47,874 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2024-12-17T10:59:47,877 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2024-12-17T10:59:47,878 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2024-12-17T10:59:47,880 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:47,881 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:47,884 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2024-12-17T10:59:47,885 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2024-12-17T10:59:47,887 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:47,888 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:47,891 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2024-12-17T10:59:47,892 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2024-12-17T10:59:47,894 creating build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2024-12-17T10:59:47,895 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2024-12-17T10:59:47,898 creating build/lib/lm_eval/tasks/code_x_glue/code-text 2024-12-17T10:59:47,899 copying lm_eval/tasks/code_x_glue/code-text/utils.py -> build/lib/lm_eval/tasks/code_x_glue/code-text 2024-12-17T10:59:47,902 copying lm_eval/tasks/code_x_glue/code-text/bleu.py -> build/lib/lm_eval/tasks/code_x_glue/code-text 2024-12-17T10:59:47,905 creating build/lib/lm_eval/tasks/gpqa/n_shot 2024-12-17T10:59:47,906 copying lm_eval/tasks/gpqa/n_shot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/n_shot 2024-12-17T10:59:47,908 copying lm_eval/tasks/gpqa/n_shot/utils.py -> build/lib/lm_eval/tasks/gpqa/n_shot 2024-12-17T10:59:47,911 creating build/lib/lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T10:59:47,912 copying lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T10:59:47,914 copying lm_eval/tasks/gpqa/cot_n_shot/utils.py -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T10:59:47,917 creating build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T10:59:47,918 copying lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T10:59:47,921 copying lm_eval/tasks/gpqa/cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T10:59:47,923 creating build/lib/lm_eval/tasks/gpqa/zeroshot 2024-12-17T10:59:47,924 copying lm_eval/tasks/gpqa/zeroshot/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/zeroshot 2024-12-17T10:59:47,926 copying lm_eval/tasks/gpqa/zeroshot/utils.py -> build/lib/lm_eval/tasks/gpqa/zeroshot 2024-12-17T10:59:47,928 creating build/lib/lm_eval/tasks/gpqa/generative 2024-12-17T10:59:47,929 copying lm_eval/tasks/gpqa/generative/_generate_configs.py -> build/lib/lm_eval/tasks/gpqa/generative 2024-12-17T10:59:47,931 copying lm_eval/tasks/gpqa/generative/utils.py -> build/lib/lm_eval/tasks/gpqa/generative 2024-12-17T10:59:47,934 creating build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:47,935 copying lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:47,938 creating build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:47,939 copying lm_eval/tasks/mmlusr/question_and_answer/utils.py -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:47,942 creating build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:47,942 copying lm_eval/tasks/mmlusr/answer_only/utils.py -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:47,945 creating build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:47,946 copying lm_eval/tasks/mmlusr/question_only/utils.py -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:47,953 creating build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:47,954 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:47,957 creating build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:47,958 copying lm_eval/tasks/model_written_evals/persona/_generate_configs.py -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:47,960 creating build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:47,962 copying lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:47,966 creating build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:47,967 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:47,971 creating build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:47,973 copying lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:47,978 running egg_info 2024-12-17T10:59:47,989 writing lm_eval.egg-info/PKG-INFO 2024-12-17T10:59:48,016 writing dependency_links to lm_eval.egg-info/dependency_links.txt 2024-12-17T10:59:48,017 writing entry points to lm_eval.egg-info/entry_points.txt 2024-12-17T10:59:48,032 writing requirements to lm_eval.egg-info/requires.txt 2024-12-17T10:59:48,033 writing top-level names to lm_eval.egg-info/top_level.txt 2024-12-17T10:59:50,398 reading manifest file 'lm_eval.egg-info/SOURCES.txt' 2024-12-17T10:59:50,601 adding license file 'LICENSE.md' 2024-12-17T10:59:50,811 writing manifest file 'lm_eval.egg-info/SOURCES.txt' 2024-12-17T10:59:51,714 copying lm_eval/tasks/medmcqa/medmcqa.yaml -> build/lib/lm_eval/tasks/medmcqa 2024-12-17T10:59:51,716 copying lm_eval/tasks/coqa/default.yaml -> build/lib/lm_eval/tasks/coqa 2024-12-17T10:59:51,718 creating build/lib/lm_eval/tasks/kormedmcqa 2024-12-17T10:59:51,719 copying lm_eval/tasks/kormedmcqa/kormedmcqa_doctor.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2024-12-17T10:59:51,721 copying lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2024-12-17T10:59:51,723 copying lm_eval/tasks/kormedmcqa/kormedmcqa_nurse.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2024-12-17T10:59:51,725 copying lm_eval/tasks/kormedmcqa/kormedmcqa_pharm.yaml -> build/lib/lm_eval/tasks/kormedmcqa 2024-12-17T10:59:51,727 creating build/lib/lm_eval/tasks/gsm_plus 2024-12-17T10:59:51,728 copying lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml -> build/lib/lm_eval/tasks/gsm_plus 2024-12-17T10:59:51,730 copying lm_eval/tasks/gsm_plus/gsm_plus.yaml -> build/lib/lm_eval/tasks/gsm_plus 2024-12-17T10:59:51,732 creating build/lib/lm_eval/tasks/lambada 2024-12-17T10:59:51,733 copying lm_eval/tasks/lambada/lambada_openai.yaml -> build/lib/lm_eval/tasks/lambada 2024-12-17T10:59:51,735 copying lm_eval/tasks/lambada/lambada_standard.yaml -> build/lib/lm_eval/tasks/lambada 2024-12-17T10:59:51,737 creating build/lib/lm_eval/tasks/openbookqa 2024-12-17T10:59:51,739 copying lm_eval/tasks/openbookqa/openbookqa.yaml -> build/lib/lm_eval/tasks/openbookqa 2024-12-17T10:59:51,741 creating build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,742 copying lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,744 copying lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,746 copying lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,748 copying lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,751 copying lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,753 copying lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,755 copying lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,757 copying lm_eval/tasks/bigbench/generate_until/question_selection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,759 copying lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,762 copying lm_eval/tasks/bigbench/generate_until/crass_ai.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,764 copying lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,766 copying lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,768 copying lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,771 copying lm_eval/tasks/bigbench/generate_until/timedial.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,773 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,775 copying lm_eval/tasks/bigbench/generate_until/codenames.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,777 copying lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,779 copying lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,782 copying lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,784 copying lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,786 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,788 copying lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,790 copying lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,792 copying lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,794 copying lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,797 copying lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,799 copying lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,801 copying lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,804 copying lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,806 copying lm_eval/tasks/bigbench/generate_until/snarks.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,814 copying lm_eval/tasks/bigbench/generate_until/code_line_description.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,816 copying lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,818 copying lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,820 copying lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,823 copying lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,825 copying lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,827 copying lm_eval/tasks/bigbench/generate_until/social_support.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,829 copying lm_eval/tasks/bigbench/generate_until/implicatures.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,832 copying lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,834 copying lm_eval/tasks/bigbench/generate_until/color.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,836 copying lm_eval/tasks/bigbench/generate_until/multiemo.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,839 copying lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,841 copying lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,843 copying lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,845 copying lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,847 copying lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,850 copying lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,852 copying lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,854 copying lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,856 copying lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,858 copying lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,860 copying lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,862 copying lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,864 copying lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,867 copying lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,869 copying lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,871 copying lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,874 copying lm_eval/tasks/bigbench/generate_until/object_counting.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,876 copying lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,878 copying lm_eval/tasks/bigbench/generate_until/date_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,880 copying lm_eval/tasks/bigbench/generate_until/social_iqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,882 copying lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,884 copying lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,886 copying lm_eval/tasks/bigbench/generate_until/word_sorting.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,888 copying lm_eval/tasks/bigbench/generate_until/arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,891 copying lm_eval/tasks/bigbench/generate_until/topical_chat.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,893 copying lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,895 copying lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,897 copying lm_eval/tasks/bigbench/generate_until/misconceptions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,899 copying lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,902 copying lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,904 copying lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,906 copying lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,908 copying lm_eval/tasks/bigbench/generate_until/fact_checker.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,910 copying lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,912 copying lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,914 copying lm_eval/tasks/bigbench/generate_until/physics_questions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,916 copying lm_eval/tasks/bigbench/generate_until/operators.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,918 copying lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,920 copying lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,922 copying lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,924 copying lm_eval/tasks/bigbench/generate_until/language_games.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,926 copying lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,928 copying lm_eval/tasks/bigbench/generate_until/kannada.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,930 copying lm_eval/tasks/bigbench/generate_until/anachronisms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,933 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,935 copying lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,937 copying lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,939 copying lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,941 copying lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,943 copying lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,945 copying lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,948 copying lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,950 copying lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,952 copying lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,954 copying lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,956 copying lm_eval/tasks/bigbench/generate_until/tense.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,959 copying lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,961 copying lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,963 copying lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,965 copying lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,967 copying lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,970 copying lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,972 copying lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,974 copying lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,976 copying lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,978 copying lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,980 copying lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,982 copying lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,984 copying lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,987 copying lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,989 copying lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,992 copying lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,994 copying lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:51,996 copying lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,000 copying lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,002 copying lm_eval/tasks/bigbench/generate_until/gem.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,006 copying lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,010 copying lm_eval/tasks/bigbench/generate_until/list_functions.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,013 copying lm_eval/tasks/bigbench/generate_until/navigate.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,016 copying lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,019 copying lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,023 copying lm_eval/tasks/bigbench/generate_until/logical_args.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,027 copying lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,031 copying lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,034 copying lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,036 copying lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,039 copying lm_eval/tasks/bigbench/generate_until/winowhy.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,042 copying lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,045 copying lm_eval/tasks/bigbench/generate_until/cryptonite.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,049 copying lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,053 copying lm_eval/tasks/bigbench/generate_until/irony_identification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,059 copying lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,065 copying lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,070 copying lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,072 copying lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,074 copying lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,076 copying lm_eval/tasks/bigbench/generate_until/language_identification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,079 copying lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,081 copying lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,083 copying lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,085 copying lm_eval/tasks/bigbench/generate_until/physics.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,087 copying lm_eval/tasks/bigbench/generate_until/ruin_names.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,089 copying lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,092 copying lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,094 copying lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,096 copying lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,098 copying lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,100 copying lm_eval/tasks/bigbench/generate_until/strange_stories.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,103 copying lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,105 copying lm_eval/tasks/bigbench/generate_until/strategyqa.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,107 copying lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,109 copying lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,111 copying lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,114 copying lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,116 copying lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,118 copying lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,120 copying lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,122 copying lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,124 copying lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,127 copying lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,129 copying lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,131 copying lm_eval/tasks/bigbench/generate_until/rephrase.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,133 copying lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,135 copying lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,137 copying lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,139 copying lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/generate_until 2024-12-17T10:59:52,142 creating build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,143 copying lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,145 copying lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,147 copying lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,149 copying lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,151 copying lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,153 copying lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,156 copying lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,158 copying lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,160 copying lm_eval/tasks/bigbench/multiple_choice/timedial.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,162 copying lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,164 copying lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,167 copying lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,169 copying lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,172 copying lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,175 copying lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,179 copying lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,184 copying lm_eval/tasks/bigbench/multiple_choice/snarks.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,188 copying lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,190 copying lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,192 copying lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,194 copying lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,196 copying lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,198 copying lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,200 copying lm_eval/tasks/bigbench/multiple_choice/social_support.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,202 copying lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,204 copying lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,206 copying lm_eval/tasks/bigbench/multiple_choice/color.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,208 copying lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,210 copying lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,213 copying lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,215 copying lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,218 copying lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,220 copying lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,222 copying lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,224 copying lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,226 copying lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,228 copying lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,230 copying lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,232 copying lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,235 copying lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,237 copying lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,240 copying lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,242 copying lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,244 copying lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,246 copying lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,248 copying lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,250 copying lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,252 copying lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,254 copying lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,256 copying lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,258 copying lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,260 copying lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,263 copying lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,265 copying lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,267 copying lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,269 copying lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,271 copying lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,273 copying lm_eval/tasks/bigbench/multiple_choice/kannada.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,275 copying lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,277 copying lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,279 copying lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,282 copying lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,284 copying lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,286 copying lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,288 copying lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,291 copying lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,293 copying lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,295 copying lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,298 copying lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,300 copying lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,303 copying lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,306 copying lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,308 copying lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,311 copying lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,313 copying lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,316 copying lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,318 copying lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,321 copying lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,323 copying lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,326 copying lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,328 copying lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,330 copying lm_eval/tasks/bigbench/multiple_choice/navigate.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,333 copying lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,335 copying lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,338 copying lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,341 copying lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,343 copying lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,346 copying lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,348 copying lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,351 copying lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,353 copying lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,356 copying lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,358 copying lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,361 copying lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,363 copying lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,366 copying lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,369 copying lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,371 copying lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,374 copying lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,376 copying lm_eval/tasks/bigbench/multiple_choice/physics.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,378 copying lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,381 copying lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,383 copying lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,386 copying lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,388 copying lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,390 copying lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,393 copying lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,395 copying lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,398 copying lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,400 copying lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,402 copying lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,406 copying lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,408 copying lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,410 copying lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,413 copying lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,415 copying lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,418 copying lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,420 copying lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,422 copying lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml -> build/lib/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T10:59:52,425 copying lm_eval/tasks/translation/wmt14_en-fr.yaml -> build/lib/lm_eval/tasks/translation 2024-12-17T10:59:52,427 copying lm_eval/tasks/translation/iwslt2017_en-ar.yaml -> build/lib/lm_eval/tasks/translation 2024-12-17T10:59:52,430 copying lm_eval/tasks/translation/wmt16_ro-en.yaml -> build/lib/lm_eval/tasks/translation 2024-12-17T10:59:52,432 copying lm_eval/tasks/translation/wmt16_en-de.yaml -> build/lib/lm_eval/tasks/translation 2024-12-17T10:59:52,434 copying lm_eval/tasks/translation/iwslt2017_ar-en.yaml -> build/lib/lm_eval/tasks/translation 2024-12-17T10:59:52,437 copying lm_eval/tasks/translation/wmt14_fr-en.yaml -> build/lib/lm_eval/tasks/translation 2024-12-17T10:59:52,439 copying lm_eval/tasks/translation/wmt16_en-ro.yaml -> build/lib/lm_eval/tasks/translation 2024-12-17T10:59:52,442 copying lm_eval/tasks/translation/wmt16_de-en.yaml -> build/lib/lm_eval/tasks/translation 2024-12-17T10:59:52,444 creating build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T10:59:52,446 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T10:59:52,448 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T10:59:52,450 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T10:59:52,453 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T10:59:52,455 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T10:59:52,457 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T10:59:52,460 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T10:59:52,462 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T10:59:52,465 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T10:59:52,467 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T10:59:52,469 copying lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T10:59:52,472 creating build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T10:59:52,473 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T10:59:52,475 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T10:59:52,478 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T10:59:52,480 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T10:59:52,483 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T10:59:52,485 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T10:59:52,487 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T10:59:52,490 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T10:59:52,492 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T10:59:52,494 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T10:59:52,496 copying lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T10:59:52,499 creating build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T10:59:52,500 copying lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T10:59:52,502 copying lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T10:59:52,505 copying lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T10:59:52,507 copying lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T10:59:52,510 copying lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T10:59:52,512 copying lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T10:59:52,515 copying lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T10:59:52,518 copying lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T10:59:52,520 copying lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T10:59:52,522 copying lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T10:59:52,525 copying lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml -> build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T10:59:52,527 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:52,530 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:52,532 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:52,534 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:52,537 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:52,540 copying lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:52,542 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:52,546 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:52,548 copying lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T10:59:52,550 copying lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,553 copying lm_eval/tasks/catalan_bench/parafraseja.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,555 copying lm_eval/tasks/catalan_bench/siqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,558 copying lm_eval/tasks/catalan_bench/arc_ca_easy.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,560 copying lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,563 copying lm_eval/tasks/catalan_bench/wnli_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,565 copying lm_eval/tasks/catalan_bench/openbookqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,567 copying lm_eval/tasks/catalan_bench/catalanqa.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,570 copying lm_eval/tasks/catalan_bench/catalan_bench.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,572 copying lm_eval/tasks/catalan_bench/xnli_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,575 copying lm_eval/tasks/catalan_bench/coqcat.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,577 copying lm_eval/tasks/catalan_bench/paws_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,579 copying lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,582 copying lm_eval/tasks/catalan_bench/cabreu_extractive.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,584 copying lm_eval/tasks/catalan_bench/xquad_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,587 copying lm_eval/tasks/catalan_bench/catcola.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,589 copying lm_eval/tasks/catalan_bench/cabreu_extreme.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,591 copying lm_eval/tasks/catalan_bench/piqa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,594 copying lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,597 copying lm_eval/tasks/catalan_bench/copa_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,599 copying lm_eval/tasks/catalan_bench/teca.yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T10:59:52,602 copying lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,605 copying lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,607 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,609 copying lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,612 copying lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,614 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,616 copying lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,619 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,621 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,623 copying lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,626 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,628 copying lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,631 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,634 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,636 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,639 copying lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,642 copying lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T10:59:52,644 creating build/lib/lm_eval/tasks/catalan_bench/phrases_va 2024-12-17T10:59:52,645 copying lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2024-12-17T10:59:52,649 copying lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2024-12-17T10:59:52,651 copying lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml -> build/lib/lm_eval/tasks/catalan_bench/phrases_va 2024-12-17T10:59:52,654 copying lm_eval/tasks/medqa/medqa.yaml -> build/lib/lm_eval/tasks/medqa 2024-12-17T10:59:52,656 creating build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,657 copying lm_eval/tasks/xstorycloze/default_sw.yaml -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,660 copying lm_eval/tasks/xstorycloze/default_es.yaml -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,663 copying lm_eval/tasks/xstorycloze/default_my.yaml -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,665 copying lm_eval/tasks/xstorycloze/default_en.yaml -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,667 copying lm_eval/tasks/xstorycloze/default_zh.yaml -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,670 copying lm_eval/tasks/xstorycloze/default_eu.yaml -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,672 copying lm_eval/tasks/xstorycloze/default_te.yaml -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,675 copying lm_eval/tasks/xstorycloze/_xstorycloze.yaml -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,677 copying lm_eval/tasks/xstorycloze/default_id.yaml -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,680 copying lm_eval/tasks/xstorycloze/default_ar.yaml -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,682 copying lm_eval/tasks/xstorycloze/default_hi.yaml -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,684 copying lm_eval/tasks/xstorycloze/default_ru.yaml -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T10:59:52,687 creating build/lib/lm_eval/tasks/nq_open 2024-12-17T10:59:52,688 copying lm_eval/tasks/nq_open/nq_open.yaml -> build/lib/lm_eval/tasks/nq_open 2024-12-17T10:59:52,690 creating build/lib/lm_eval/tasks/haerae 2024-12-17T10:59:52,691 copying lm_eval/tasks/haerae/_haerae.yaml -> build/lib/lm_eval/tasks/haerae 2024-12-17T10:59:52,694 copying lm_eval/tasks/haerae/haerae_hi.yaml -> build/lib/lm_eval/tasks/haerae 2024-12-17T10:59:52,696 copying lm_eval/tasks/haerae/haerae_gk.yaml -> build/lib/lm_eval/tasks/haerae 2024-12-17T10:59:52,698 copying lm_eval/tasks/haerae/haerae_rw.yaml -> build/lib/lm_eval/tasks/haerae 2024-12-17T10:59:52,700 copying lm_eval/tasks/haerae/haerae_sn.yaml -> build/lib/lm_eval/tasks/haerae 2024-12-17T10:59:52,703 copying lm_eval/tasks/haerae/haerae_lw.yaml -> build/lib/lm_eval/tasks/haerae 2024-12-17T10:59:52,706 copying lm_eval/tasks/squadv2/squadv2.yaml -> build/lib/lm_eval/tasks/squadv2 2024-12-17T10:59:52,708 copying lm_eval/tasks/logiqa2/logieval.yaml -> build/lib/lm_eval/tasks/logiqa2 2024-12-17T10:59:52,711 copying lm_eval/tasks/logiqa2/logiqa2.yaml -> build/lib/lm_eval/tasks/logiqa2 2024-12-17T10:59:52,714 creating build/lib/lm_eval/tasks/aexams 2024-12-17T10:59:52,716 copying lm_eval/tasks/aexams/aexams_IslamicStudies.yaml -> build/lib/lm_eval/tasks/aexams 2024-12-17T10:59:52,719 copying lm_eval/tasks/aexams/aexams_Physics.yaml -> build/lib/lm_eval/tasks/aexams 2024-12-17T10:59:52,723 copying lm_eval/tasks/aexams/aexams_Science.yaml -> build/lib/lm_eval/tasks/aexams 2024-12-17T10:59:52,726 copying lm_eval/tasks/aexams/aexams_Social.yaml -> build/lib/lm_eval/tasks/aexams 2024-12-17T10:59:52,729 copying lm_eval/tasks/aexams/aexams_Biology.yaml -> build/lib/lm_eval/tasks/aexams 2024-12-17T10:59:52,732 copying lm_eval/tasks/aexams/_aexams.yaml -> build/lib/lm_eval/tasks/aexams 2024-12-17T10:59:52,735 copying lm_eval/tasks/squad_completion/squad_completion.yaml -> build/lib/lm_eval/tasks/squad_completion 2024-12-17T10:59:52,738 creating build/lib/lm_eval/tasks/xnli_eu 2024-12-17T10:59:52,740 copying lm_eval/tasks/xnli_eu/xnli_eu_native.yaml -> build/lib/lm_eval/tasks/xnli_eu 2024-12-17T10:59:52,743 copying lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml -> build/lib/lm_eval/tasks/xnli_eu 2024-12-17T10:59:52,746 copying lm_eval/tasks/xnli_eu/xnli_eu.yaml -> build/lib/lm_eval/tasks/xnli_eu 2024-12-17T10:59:52,749 copying lm_eval/tasks/score/score_robustness.yaml -> build/lib/lm_eval/tasks/score 2024-12-17T10:59:52,752 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,755 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,758 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,761 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,764 copying lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,768 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,770 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,773 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,776 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,779 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,782 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,784 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,787 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,790 copying lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,793 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,795 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,798 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,800 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,803 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,806 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,808 copying lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,810 copying lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,812 copying lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,814 copying lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,816 copying lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T10:59:52,819 copying lm_eval/tasks/score/math/score_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,821 copying lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,823 copying lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,825 copying lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,827 copying lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,835 copying lm_eval/tasks/score/math/score_prompt_robustness_math.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,838 copying lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,840 copying lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,842 copying lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,844 copying lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,846 copying lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,848 copying lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,851 copying lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,853 copying lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,855 copying lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,857 copying lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,859 copying lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml -> build/lib/lm_eval/tasks/score/math 2024-12-17T10:59:52,861 copying lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2024-12-17T10:59:52,863 copying lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2024-12-17T10:59:52,865 copying lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml -> build/lib/lm_eval/tasks/score/mmlu_pro 2024-12-17T10:59:52,867 creating build/lib/lm_eval/tasks/siqa 2024-12-17T10:59:52,868 copying lm_eval/tasks/siqa/siqa.yaml -> build/lib/lm_eval/tasks/siqa 2024-12-17T10:59:52,871 copying lm_eval/tasks/mathqa/mathqa.yaml -> build/lib/lm_eval/tasks/mathqa 2024-12-17T10:59:52,873 copying lm_eval/tasks/logiqa/logiqa.yaml -> build/lib/lm_eval/tasks/logiqa 2024-12-17T10:59:52,875 copying lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,876 copying lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,878 copying lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,880 copying lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,882 copying lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,884 copying lm_eval/tasks/paloma/paloma_redpajama.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,887 copying lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,888 copying lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,891 copying lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,893 copying lm_eval/tasks/paloma/paloma_c4_en.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,895 copying lm_eval/tasks/paloma/paloma_c4_100_domains.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,897 copying lm_eval/tasks/paloma/paloma_gab.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,899 copying lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,901 copying lm_eval/tasks/paloma/paloma_wikitext_103.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,903 copying lm_eval/tasks/paloma/paloma_ptb.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,906 copying lm_eval/tasks/paloma/paloma_mc4.yaml -> build/lib/lm_eval/tasks/paloma 2024-12-17T10:59:52,908 creating build/lib/lm_eval/tasks/polemo2 2024-12-17T10:59:52,909 copying lm_eval/tasks/polemo2/polemo2_in.yaml -> build/lib/lm_eval/tasks/polemo2 2024-12-17T10:59:52,911 copying lm_eval/tasks/polemo2/polemo2_out.yaml -> build/lib/lm_eval/tasks/polemo2 2024-12-17T10:59:52,913 creating build/lib/lm_eval/tasks/babi 2024-12-17T10:59:52,914 copying lm_eval/tasks/babi/babi.yaml -> build/lib/lm_eval/tasks/babi 2024-12-17T10:59:52,916 creating build/lib/lm_eval/tasks/asdiv 2024-12-17T10:59:52,917 copying lm_eval/tasks/asdiv/asdiv-cot-llama.yaml -> build/lib/lm_eval/tasks/asdiv 2024-12-17T10:59:52,920 copying lm_eval/tasks/asdiv/default.yaml -> build/lib/lm_eval/tasks/asdiv 2024-12-17T10:59:52,921 creating build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,923 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,925 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,927 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,929 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,931 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,933 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,935 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,937 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,939 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,941 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,943 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,945 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,947 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,949 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,951 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,954 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,956 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,958 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,960 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,962 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,964 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,967 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,969 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,971 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,973 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,975 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,978 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,980 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,983 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,986 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,989 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,992 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,994 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,996 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:52,998 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:53,000 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:53,002 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:53,004 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:53,006 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:53,008 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:53,010 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:53,012 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:53,014 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:53,016 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:53,018 copying lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T10:59:53,020 creating build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,021 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,023 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,026 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,028 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,031 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,034 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,036 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,038 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,040 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,042 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,044 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,047 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,049 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,051 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,054 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,056 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,059 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,061 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,063 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,064 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,067 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,069 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,071 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,073 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,075 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,077 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,080 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,082 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,084 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,086 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,088 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,090 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,092 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,094 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,096 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,099 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,101 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,104 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,106 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,108 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,110 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,112 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,114 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,117 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,120 copying lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T10:59:53,122 creating build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,123 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,126 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,128 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,131 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,134 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,136 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,139 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,143 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,146 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,149 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,151 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,154 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,157 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,159 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,164 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,168 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,171 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,173 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,176 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,180 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,182 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,185 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,188 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,190 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,193 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,196 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,200 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,204 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,207 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,210 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,212 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,215 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,218 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,220 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,224 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,227 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,229 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,231 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,234 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,238 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,242 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,246 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,249 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,252 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,256 copying lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T10:59:53,263 creating build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,264 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,266 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,269 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,271 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,273 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,275 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,277 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,280 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,283 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,285 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,287 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,290 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,292 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,294 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,296 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,298 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,301 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,303 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,305 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,307 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,310 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,312 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,315 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,317 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,319 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,320 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,323 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,325 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,328 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,332 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,334 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,337 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,339 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,342 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,345 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,347 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,351 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,355 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,357 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,359 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,361 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,363 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,365 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,367 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,369 copying lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T10:59:53,371 copying lm_eval/tasks/race/race.yaml -> build/lib/lm_eval/tasks/race 2024-12-17T10:59:53,373 copying lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,375 copying lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,377 copying lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,380 copying lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,382 copying lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,384 copying lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,386 copying lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,390 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,394 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,396 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,398 copying lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,400 copying lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,403 copying lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,406 copying lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,408 copying lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,410 copying lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,412 copying lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,414 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,417 copying lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,419 copying lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,421 copying lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,424 copying lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,428 copying lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,432 copying lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,438 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,444 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,452 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,455 copying lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,457 copying lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,459 copying lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,461 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,462 copying lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,464 copying lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,467 copying lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,469 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,472 copying lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,475 copying lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,477 copying lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,479 copying lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,481 copying lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,483 copying lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,485 copying lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,487 copying lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,490 copying lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,492 copying lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,494 copying lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,496 copying lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,500 copying lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,503 copying lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,505 copying lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,507 copying lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,510 copying lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,513 copying lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,516 copying lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,519 copying lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,522 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,525 copying lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,528 copying lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,530 copying lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,533 copying lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,536 copying lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,538 copying lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,541 copying lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,544 copying lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,547 copying lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,550 copying lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,553 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,555 copying lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,558 copying lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,561 copying lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,564 copying lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,566 copying lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T10:59:53,569 copying lm_eval/tasks/lingoly/lingoly_nocontext.yaml -> build/lib/lm_eval/tasks/lingoly 2024-12-17T10:59:53,572 copying lm_eval/tasks/lingoly/lingoly_group.yaml -> build/lib/lm_eval/tasks/lingoly 2024-12-17T10:59:53,575 copying lm_eval/tasks/lingoly/lingoly_context.yaml -> build/lib/lm_eval/tasks/lingoly 2024-12-17T10:59:53,577 copying lm_eval/tasks/xwinograd/xwinograd_zh.yaml -> build/lib/lm_eval/tasks/xwinograd 2024-12-17T10:59:53,580 copying lm_eval/tasks/xwinograd/xwinograd_fr.yaml -> build/lib/lm_eval/tasks/xwinograd 2024-12-17T10:59:53,583 copying lm_eval/tasks/xwinograd/xwinograd_jp.yaml -> build/lib/lm_eval/tasks/xwinograd 2024-12-17T10:59:53,586 copying lm_eval/tasks/xwinograd/_xwinograd.yaml -> build/lib/lm_eval/tasks/xwinograd 2024-12-17T10:59:53,589 copying lm_eval/tasks/xwinograd/xwinograd_en.yaml -> build/lib/lm_eval/tasks/xwinograd 2024-12-17T10:59:53,591 copying lm_eval/tasks/xwinograd/xwinograd_ru.yaml -> build/lib/lm_eval/tasks/xwinograd 2024-12-17T10:59:53,594 copying lm_eval/tasks/xwinograd/xwinograd_pt.yaml -> build/lib/lm_eval/tasks/xwinograd 2024-12-17T10:59:53,596 copying lm_eval/tasks/csatqa/_csatqa.yaml -> build/lib/lm_eval/tasks/csatqa 2024-12-17T10:59:53,599 copying lm_eval/tasks/csatqa/csatqa_li.yaml -> build/lib/lm_eval/tasks/csatqa 2024-12-17T10:59:53,601 copying lm_eval/tasks/csatqa/csatqa_rcss.yaml -> build/lib/lm_eval/tasks/csatqa 2024-12-17T10:59:53,604 copying lm_eval/tasks/csatqa/csatqa_gr.yaml -> build/lib/lm_eval/tasks/csatqa 2024-12-17T10:59:53,607 copying lm_eval/tasks/csatqa/csatqa_wr.yaml -> build/lib/lm_eval/tasks/csatqa 2024-12-17T10:59:53,610 copying lm_eval/tasks/csatqa/csatqa_rch.yaml -> build/lib/lm_eval/tasks/csatqa 2024-12-17T10:59:53,612 copying lm_eval/tasks/csatqa/csatqa_rcs.yaml -> build/lib/lm_eval/tasks/csatqa 2024-12-17T10:59:53,614 copying lm_eval/tasks/leaderboard/leaderboard.yaml -> build/lib/lm_eval/tasks/leaderboard 2024-12-17T10:59:53,616 creating build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,617 copying lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,620 copying lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,622 copying lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,625 copying lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,627 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,629 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,631 copying lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,634 copying lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,636 copying lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,638 copying lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,640 copying lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,642 copying lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,645 copying lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,647 copying lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,649 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,651 copying lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,654 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,656 copying lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,658 copying lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,660 copying lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,663 copying lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,665 copying lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,667 copying lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,669 copying lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,671 copying lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T10:59:53,674 copying lm_eval/tasks/leaderboard/math/math_geometry.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2024-12-17T10:59:53,675 copying lm_eval/tasks/leaderboard/math/math_precalculus.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2024-12-17T10:59:53,678 copying lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2024-12-17T10:59:53,681 copying lm_eval/tasks/leaderboard/math/math_prealgebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2024-12-17T10:59:53,683 copying lm_eval/tasks/leaderboard/math/math_num_theory.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2024-12-17T10:59:53,686 copying lm_eval/tasks/leaderboard/math/math_algebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2024-12-17T10:59:53,688 copying lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2024-12-17T10:59:53,690 copying lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/leaderboard/math 2024-12-17T10:59:53,692 copying lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2024-12-17T10:59:53,694 copying lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2024-12-17T10:59:53,696 copying lm_eval/tasks/leaderboard/musr/_musr.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2024-12-17T10:59:53,698 copying lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2024-12-17T10:59:53,700 copying lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml -> build/lib/lm_eval/tasks/leaderboard/mmlu_pro 2024-12-17T10:59:53,702 copying lm_eval/tasks/leaderboard/ifeval/ifeval.yaml -> build/lib/lm_eval/tasks/leaderboard/ifeval 2024-12-17T10:59:53,704 copying lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml -> build/lib/lm_eval/tasks/leaderboard/ifeval 2024-12-17T10:59:53,706 copying lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2024-12-17T10:59:53,708 copying lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2024-12-17T10:59:53,710 copying lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2024-12-17T10:59:53,712 copying lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2024-12-17T10:59:53,715 copying lm_eval/tasks/qa4mre/qa4mre_2012.yaml -> build/lib/lm_eval/tasks/qa4mre 2024-12-17T10:59:53,717 copying lm_eval/tasks/qa4mre/qa4mre_2011.yaml -> build/lib/lm_eval/tasks/qa4mre 2024-12-17T10:59:53,719 copying lm_eval/tasks/qa4mre/qa4mre_2013.yaml -> build/lib/lm_eval/tasks/qa4mre 2024-12-17T10:59:53,721 copying lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,723 copying lm_eval/tasks/metabench/metabench_truthfulqa.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,725 copying lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,727 copying lm_eval/tasks/metabench/metabench_arc.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,729 copying lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,731 copying lm_eval/tasks/metabench/metabench_hellaswag.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,733 copying lm_eval/tasks/metabench/metabench.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,735 copying lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,737 copying lm_eval/tasks/metabench/metabench_arc_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,739 copying lm_eval/tasks/metabench/metabench_mmlu.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,741 copying lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,742 copying lm_eval/tasks/metabench/metabench_permute.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,744 copying lm_eval/tasks/metabench/metabench_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,746 copying lm_eval/tasks/metabench/metabench_winogrande.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,748 copying lm_eval/tasks/metabench/metabench_gsm8k.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,750 copying lm_eval/tasks/metabench/metabench_arc_permute.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,752 copying lm_eval/tasks/metabench/metabench_winogrande_permute.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,754 copying lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,756 copying lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,758 copying lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,760 copying lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,762 copying lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,764 copying lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,766 copying lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,768 copying lm_eval/tasks/metabench/metabench_secondary_permute.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,770 copying lm_eval/tasks/metabench/metabench_mmlu_permute.yaml -> build/lib/lm_eval/tasks/metabench 2024-12-17T10:59:53,772 creating build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,773 copying lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,777 copying lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,779 copying lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,782 copying lm_eval/tasks/bbh/fewshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,785 copying lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,788 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,791 copying lm_eval/tasks/bbh/fewshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,793 copying lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,796 copying lm_eval/tasks/bbh/fewshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,798 copying lm_eval/tasks/bbh/fewshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,801 copying lm_eval/tasks/bbh/fewshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,803 copying lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,806 copying lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,808 copying lm_eval/tasks/bbh/fewshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,810 copying lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,813 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,815 copying lm_eval/tasks/bbh/fewshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,817 copying lm_eval/tasks/bbh/fewshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,820 copying lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,822 copying lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,825 copying lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,827 copying lm_eval/tasks/bbh/fewshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,830 copying lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,833 copying lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,835 copying lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,837 copying lm_eval/tasks/bbh/fewshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,840 copying lm_eval/tasks/bbh/fewshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,842 copying lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T10:59:53,844 creating build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,846 copying lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,848 copying lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,851 copying lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,854 copying lm_eval/tasks/bbh/cot_fewshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,856 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,859 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,861 copying lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,864 copying lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,867 copying lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,870 copying lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,873 copying lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,877 copying lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,880 copying lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,882 copying lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,886 copying lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,888 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,890 copying lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,893 copying lm_eval/tasks/bbh/cot_fewshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,895 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,898 copying lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,900 copying lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,903 copying lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,905 copying lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,907 copying lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,910 copying lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,912 copying lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,915 copying lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,918 copying lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,921 copying lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T10:59:53,924 copying lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,927 copying lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,929 copying lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,931 copying lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,934 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,936 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,938 copying lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,941 copying lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,943 copying lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,945 copying lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,948 copying lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,950 copying lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,952 copying lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,955 copying lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,957 copying lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,961 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,964 copying lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,967 copying lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,970 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,972 copying lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,975 copying lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,978 copying lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,981 copying lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,984 copying lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,987 copying lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,990 copying lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,993 copying lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,995 copying lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T10:59:53,998 copying lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,001 copying lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,003 copying lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,006 copying lm_eval/tasks/bbh/zeroshot/snarks.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,008 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,010 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,012 copying lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,015 copying lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,017 copying lm_eval/tasks/bbh/zeroshot/object_counting.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,020 copying lm_eval/tasks/bbh/zeroshot/date_understanding.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,022 copying lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,024 copying lm_eval/tasks/bbh/zeroshot/word_sorting.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,027 copying lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,029 copying lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,031 copying lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,035 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,038 copying lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,040 copying lm_eval/tasks/bbh/zeroshot/navigate.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,043 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,045 copying lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,047 copying lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,050 copying lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,052 copying lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,055 copying lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,057 copying lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,060 copying lm_eval/tasks/bbh/zeroshot/ruin_names.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,064 copying lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,067 copying lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T10:59:54,070 creating build/lib/lm_eval/tasks/benchmarks 2024-12-17T10:59:54,071 copying lm_eval/tasks/benchmarks/t0_eval.yaml -> build/lib/lm_eval/tasks/benchmarks 2024-12-17T10:59:54,075 copying lm_eval/tasks/benchmarks/minerva_math.yaml -> build/lib/lm_eval/tasks/benchmarks 2024-12-17T10:59:54,077 copying lm_eval/tasks/benchmarks/openllm.yaml -> build/lib/lm_eval/tasks/benchmarks 2024-12-17T10:59:54,080 copying lm_eval/tasks/benchmarks/pythia.yaml -> build/lib/lm_eval/tasks/benchmarks 2024-12-17T10:59:54,082 creating build/lib/lm_eval/tasks/benchmarks/multimedqa 2024-12-17T10:59:54,083 copying lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml -> build/lib/lm_eval/tasks/benchmarks/multimedqa 2024-12-17T10:59:54,086 creating build/lib/lm_eval/tasks/benchmarks/flan 2024-12-17T10:59:54,087 copying lm_eval/tasks/benchmarks/flan/flan_held_in.yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2024-12-17T10:59:54,090 copying lm_eval/tasks/benchmarks/flan/flan_held_out.yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2024-12-17T10:59:54,093 copying lm_eval/tasks/spanish_bench/escola.yaml -> build/lib/lm_eval/tasks/spanish_bench 2024-12-17T10:59:54,095 copying lm_eval/tasks/spanish_bench/copa_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2024-12-17T10:59:54,097 copying lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2024-12-17T10:59:54,100 copying lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2024-12-17T10:59:54,102 copying lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2024-12-17T10:59:54,104 copying lm_eval/tasks/spanish_bench/openbookqa_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2024-12-17T10:59:54,107 copying lm_eval/tasks/spanish_bench/xlsum_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2024-12-17T10:59:54,109 copying lm_eval/tasks/spanish_bench/wnli_es.yaml -> build/lib/lm_eval/tasks/spanish_bench 2024-12-17T10:59:54,111 copying lm_eval/tasks/spanish_bench/spanish_bench.yaml -> build/lib/lm_eval/tasks/spanish_bench 2024-12-17T10:59:54,115 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,118 copying lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,120 copying lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,122 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,125 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,128 copying lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,130 copying lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,132 copying lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,134 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,137 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,139 copying lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,141 copying lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,143 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,146 copying lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,148 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,150 copying lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,153 copying lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T10:59:54,157 creating build/lib/lm_eval/tasks/spanish_bench/phrases_es 2024-12-17T10:59:54,158 copying lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2024-12-17T10:59:54,161 copying lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2024-12-17T10:59:54,164 copying lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common.yaml -> build/lib/lm_eval/tasks/spanish_bench/phrases_es 2024-12-17T10:59:54,166 creating build/lib/lm_eval/tasks/mela 2024-12-17T10:59:54,168 copying lm_eval/tasks/mela/mela_de.yaml -> build/lib/lm_eval/tasks/mela 2024-12-17T10:59:54,170 copying lm_eval/tasks/mela/mela_ru.yaml -> build/lib/lm_eval/tasks/mela 2024-12-17T10:59:54,172 copying lm_eval/tasks/mela/mela_zh.yaml -> build/lib/lm_eval/tasks/mela 2024-12-17T10:59:54,175 copying lm_eval/tasks/mela/mela_it.yaml -> build/lib/lm_eval/tasks/mela 2024-12-17T10:59:54,177 copying lm_eval/tasks/mela/_mela.yaml -> build/lib/lm_eval/tasks/mela 2024-12-17T10:59:54,179 copying lm_eval/tasks/mela/mela_en.yaml -> build/lib/lm_eval/tasks/mela 2024-12-17T10:59:54,183 copying lm_eval/tasks/mela/mela_fr.yaml -> build/lib/lm_eval/tasks/mela 2024-12-17T10:59:54,186 copying lm_eval/tasks/mela/mela_ja.yaml -> build/lib/lm_eval/tasks/mela 2024-12-17T10:59:54,188 copying lm_eval/tasks/mela/mela_es.yaml -> build/lib/lm_eval/tasks/mela 2024-12-17T10:59:54,191 copying lm_eval/tasks/mela/mela_is.yaml -> build/lib/lm_eval/tasks/mela 2024-12-17T10:59:54,193 copying lm_eval/tasks/mela/mela_ar.yaml -> build/lib/lm_eval/tasks/mela 2024-12-17T10:59:54,196 creating build/lib/lm_eval/tasks/lambada_multilingual 2024-12-17T10:59:54,198 copying lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2024-12-17T10:59:54,201 copying lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2024-12-17T10:59:54,204 copying lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2024-12-17T10:59:54,207 copying lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2024-12-17T10:59:54,210 copying lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml -> build/lib/lm_eval/tasks/lambada_multilingual 2024-12-17T10:59:54,212 creating build/lib/lm_eval/tasks/lambada_cloze 2024-12-17T10:59:54,213 copying lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml -> build/lib/lm_eval/tasks/lambada_cloze 2024-12-17T10:59:54,216 copying lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml -> build/lib/lm_eval/tasks/lambada_cloze 2024-12-17T10:59:54,219 creating build/lib/lm_eval/tasks/eus_proficiency 2024-12-17T10:59:54,220 copying lm_eval/tasks/eus_proficiency/eus_proficiency.yaml -> build/lib/lm_eval/tasks/eus_proficiency 2024-12-17T10:59:54,223 copying lm_eval/tasks/unitxt/ledgar.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,226 copying lm_eval/tasks/unitxt/stsb.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,230 copying lm_eval/tasks/unitxt/coedit_gec.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,233 copying lm_eval/tasks/unitxt/doc_vqa.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,236 copying lm_eval/tasks/unitxt/20_newsgroups.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,239 copying lm_eval/tasks/unitxt/dbpedia_14.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,243 copying lm_eval/tasks/unitxt/argument_topic.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,246 copying lm_eval/tasks/unitxt/cnn_dailymail.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,249 copying lm_eval/tasks/unitxt/ethos_binary.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,252 copying lm_eval/tasks/unitxt/yahoo_answers_topics.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,255 copying lm_eval/tasks/unitxt/financial_tweets.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,258 copying lm_eval/tasks/unitxt/ag_news.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,260 copying lm_eval/tasks/unitxt/unfair_tos.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,263 copying lm_eval/tasks/unitxt/banking77.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,266 copying lm_eval/tasks/unitxt/atis.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,269 copying lm_eval/tasks/unitxt/medical_abstracts.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,272 copying lm_eval/tasks/unitxt/law_stack_exchange.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,274 copying lm_eval/tasks/unitxt/xsum.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,277 copying lm_eval/tasks/unitxt/claim_stance_topic.yaml -> build/lib/lm_eval/tasks/unitxt 2024-12-17T10:59:54,280 creating build/lib/lm_eval/tasks/glue/sst2 2024-12-17T10:59:54,282 copying lm_eval/tasks/glue/sst2/default.yaml -> build/lib/lm_eval/tasks/glue/sst2 2024-12-17T10:59:54,285 creating build/lib/lm_eval/tasks/glue/mrpc 2024-12-17T10:59:54,287 copying lm_eval/tasks/glue/mrpc/default.yaml -> build/lib/lm_eval/tasks/glue/mrpc 2024-12-17T10:59:54,290 creating build/lib/lm_eval/tasks/glue/qnli 2024-12-17T10:59:54,291 copying lm_eval/tasks/glue/qnli/default.yaml -> build/lib/lm_eval/tasks/glue/qnli 2024-12-17T10:59:54,295 creating build/lib/lm_eval/tasks/glue/wnli 2024-12-17T10:59:54,296 copying lm_eval/tasks/glue/wnli/default.yaml -> build/lib/lm_eval/tasks/glue/wnli 2024-12-17T10:59:54,299 creating build/lib/lm_eval/tasks/glue/qqp 2024-12-17T10:59:54,301 copying lm_eval/tasks/glue/qqp/default.yaml -> build/lib/lm_eval/tasks/glue/qqp 2024-12-17T10:59:54,304 creating build/lib/lm_eval/tasks/glue/rte 2024-12-17T10:59:54,306 copying lm_eval/tasks/glue/rte/default.yaml -> build/lib/lm_eval/tasks/glue/rte 2024-12-17T10:59:54,309 copying lm_eval/tasks/glue/mnli/mismatch.yaml -> build/lib/lm_eval/tasks/glue/mnli 2024-12-17T10:59:54,312 copying lm_eval/tasks/glue/mnli/default.yaml -> build/lib/lm_eval/tasks/glue/mnli 2024-12-17T10:59:54,314 creating build/lib/lm_eval/tasks/glue/cola 2024-12-17T10:59:54,315 copying lm_eval/tasks/glue/cola/default.yaml -> build/lib/lm_eval/tasks/glue/cola 2024-12-17T10:59:54,318 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,321 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,323 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,326 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,328 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,331 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,333 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,335 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,338 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,340 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,343 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,345 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,347 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,349 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,352 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,354 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,356 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,359 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,361 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,363 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,366 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,368 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,370 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,373 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,375 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,377 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,380 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,382 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,384 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,387 copying lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T10:59:54,389 copying lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,391 copying lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,394 copying lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,396 copying lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,398 copying lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,400 copying lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,403 copying lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,405 copying lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,407 copying lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,410 copying lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,412 copying lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,414 copying lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,417 copying lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,419 copying lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,422 copying lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,424 copying lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,426 copying lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,428 copying lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,431 copying lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,434 copying lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,436 copying lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,438 copying lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,440 copying lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,443 copying lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,445 copying lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,448 copying lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,450 copying lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,453 copying lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,455 copying lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,458 copying lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,460 copying lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T10:59:54,462 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,464 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,467 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,469 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,471 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,474 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,476 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,478 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,481 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,483 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,486 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,488 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,490 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,493 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,495 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,498 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,500 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,502 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,505 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,507 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,510 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,512 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,515 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,517 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,520 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,522 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,525 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,527 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,529 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,532 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,534 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,536 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,539 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,541 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,543 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,546 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,548 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,550 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,553 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,555 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,558 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,560 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,563 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,566 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,568 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,570 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,573 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,576 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,578 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,580 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,583 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,585 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,588 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,590 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,593 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,595 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,597 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,599 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,602 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,604 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,606 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,609 copying lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T10:59:54,611 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,613 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,616 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,618 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,621 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,623 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,625 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,628 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,630 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,633 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,635 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,638 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,640 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,643 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,645 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,647 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,650 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,652 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,655 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,657 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,659 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,662 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,664 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,666 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,669 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,671 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,674 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,676 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,679 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,681 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,683 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,686 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,688 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,690 copying lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T10:59:54,692 creating build/lib/lm_eval/tasks/prost 2024-12-17T10:59:54,694 copying lm_eval/tasks/prost/corypaik_prost.yaml -> build/lib/lm_eval/tasks/prost 2024-12-17T10:59:54,696 copying lm_eval/tasks/qasper/bool.yaml -> build/lib/lm_eval/tasks/qasper 2024-12-17T10:59:54,699 copying lm_eval/tasks/qasper/freeform.yaml -> build/lib/lm_eval/tasks/qasper 2024-12-17T10:59:54,701 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete 2024-12-17T10:59:54,704 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2024-12-17T10:59:54,706 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2024-12-17T10:59:54,708 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,711 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,714 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,716 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,719 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,721 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,724 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,726 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,729 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,731 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,734 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,736 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,738 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,741 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,743 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,746 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,748 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,751 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,754 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,756 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,759 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,761 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,763 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,766 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,768 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,771 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,774 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,776 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,778 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,781 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,784 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,786 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,789 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,791 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,794 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,796 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,799 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,801 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,804 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,806 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,808 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,811 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,814 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,816 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,819 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,822 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,824 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,826 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,829 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,831 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,834 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,837 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,839 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,842 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,844 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,846 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,849 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,851 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T10:59:54,853 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2024-12-17T10:59:54,856 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2024-12-17T10:59:54,858 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2024-12-17T10:59:54,861 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2024-12-17T10:59:54,863 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2024-12-17T10:59:54,866 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2024-12-17T10:59:54,868 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2024-12-17T10:59:54,871 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2024-12-17T10:59:54,873 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2024-12-17T10:59:54,876 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2024-12-17T10:59:54,879 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,882 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,884 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,887 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,889 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,891 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,894 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,896 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,898 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,901 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,903 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,906 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,908 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,911 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,913 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,916 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,918 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,921 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,923 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,926 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,928 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,931 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,933 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,936 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,938 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,940 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,943 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,945 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,948 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,950 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,952 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,955 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,957 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,959 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,962 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,964 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,967 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,969 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,971 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,974 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,976 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,979 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,981 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,983 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,986 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,988 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,991 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,993 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,995 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:54,998 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:55,000 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:55,003 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:55,005 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:55,008 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:55,010 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:55,013 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:55,015 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:55,018 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:55,020 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T10:59:55,023 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2024-12-17T10:59:55,025 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2024-12-17T10:59:55,027 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2024-12-17T10:59:55,030 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2024-12-17T10:59:55,032 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2024-12-17T10:59:55,035 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2024-12-17T10:59:55,037 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2024-12-17T10:59:55,039 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2024-12-17T10:59:55,042 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T10:59:55,044 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T10:59:55,046 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T10:59:55,049 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T10:59:55,051 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T10:59:55,053 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T10:59:55,056 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T10:59:55,058 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T10:59:55,060 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T10:59:55,063 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T10:59:55,065 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2024-12-17T10:59:55,068 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2024-12-17T10:59:55,070 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2024-12-17T10:59:55,073 copying lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2024-12-17T10:59:55,075 copying lm_eval/tasks/eq_bench/default.yaml -> build/lib/lm_eval/tasks/eq_bench 2024-12-17T10:59:55,077 copying lm_eval/tasks/noticia/noticia.yaml -> build/lib/lm_eval/tasks/noticia 2024-12-17T10:59:55,080 copying lm_eval/tasks/wikitext/wikitext.yaml -> build/lib/lm_eval/tasks/wikitext 2024-12-17T10:59:55,082 creating build/lib/lm_eval/tasks/wmdp 2024-12-17T10:59:55,084 copying lm_eval/tasks/wmdp/wmdp_bio.yaml -> build/lib/lm_eval/tasks/wmdp 2024-12-17T10:59:55,086 copying lm_eval/tasks/wmdp/wmdp_chem.yaml -> build/lib/lm_eval/tasks/wmdp 2024-12-17T10:59:55,088 copying lm_eval/tasks/wmdp/wmdp_cyber.yaml -> build/lib/lm_eval/tasks/wmdp 2024-12-17T10:59:55,091 copying lm_eval/tasks/wmdp/_wmdp.yaml -> build/lib/lm_eval/tasks/wmdp 2024-12-17T10:59:55,093 creating build/lib/lm_eval/tasks/triviaqa 2024-12-17T10:59:55,095 copying lm_eval/tasks/triviaqa/default.yaml -> build/lib/lm_eval/tasks/triviaqa 2024-12-17T10:59:55,097 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,100 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,102 copying lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,105 copying lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,107 copying lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,110 copying lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,112 copying lm_eval/tasks/tmlu/default/tmlu_accountant.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,115 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,118 copying lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,121 copying lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,124 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,126 copying lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,129 copying lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,131 copying lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,133 copying lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,136 copying lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,138 copying lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,140 copying lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,143 copying lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,145 copying lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,148 copying lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,150 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,153 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,155 copying lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,158 copying lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,161 copying lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,163 copying lm_eval/tasks/tmlu/default/_tmlu.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,166 copying lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,168 copying lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,171 copying lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,173 copying lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,175 copying lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T10:59:55,178 creating build/lib/lm_eval/tasks/pile_10k 2024-12-17T10:59:55,179 copying lm_eval/tasks/pile_10k/pile_10k.yaml -> build/lib/lm_eval/tasks/pile_10k 2024-12-17T10:59:55,182 copying lm_eval/tasks/copal_id/colloquial.yaml -> build/lib/lm_eval/tasks/copal_id 2024-12-17T10:59:55,184 copying lm_eval/tasks/copal_id/standard.yaml -> build/lib/lm_eval/tasks/copal_id 2024-12-17T10:59:55,186 copying lm_eval/tasks/blimp/causative.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,189 copying lm_eval/tasks/blimp/adjunct_island.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,191 copying lm_eval/tasks/blimp/left_branch_island_simple_question.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,194 copying lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,196 copying lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,199 copying lm_eval/tasks/blimp/principle_A_reconstruction.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,202 copying lm_eval/tasks/blimp/existential_there_object_raising.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,205 copying lm_eval/tasks/blimp/wh_questions_object_gap.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,207 copying lm_eval/tasks/blimp/passive_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,210 copying lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,212 copying lm_eval/tasks/blimp/existential_there_subject_raising.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,215 copying lm_eval/tasks/blimp/only_npi_scope.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,217 copying lm_eval/tasks/blimp/principle_A_case_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,219 copying lm_eval/tasks/blimp/only_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,222 copying lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,224 copying lm_eval/tasks/blimp/left_branch_island_echo_question.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,227 copying lm_eval/tasks/blimp/principle_A_domain_3.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,229 copying lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,231 copying lm_eval/tasks/blimp/principle_A_domain_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,233 copying lm_eval/tasks/blimp/tough_vs_raising_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,236 copying lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,238 copying lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,240 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,243 copying lm_eval/tasks/blimp/npi_present_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,245 copying lm_eval/tasks/blimp/complex_NP_island.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,247 copying lm_eval/tasks/blimp/principle_A_domain_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,251 copying lm_eval/tasks/blimp/animate_subject_trans.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,254 copying lm_eval/tasks/blimp/sentential_subject_island.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,256 copying lm_eval/tasks/blimp/superlative_quantifiers_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,259 copying lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,261 copying lm_eval/tasks/blimp/drop_argument.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,263 copying lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,266 copying lm_eval/tasks/blimp/anaphor_number_agreement.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,268 copying lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,271 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,273 copying lm_eval/tasks/blimp/principle_A_c_command.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,276 copying lm_eval/tasks/blimp/transitive.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,278 copying lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,281 copying lm_eval/tasks/blimp/superlative_quantifiers_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,283 copying lm_eval/tasks/blimp/wh_questions_subject_gap.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,285 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,288 copying lm_eval/tasks/blimp/tough_vs_raising_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,291 copying lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,294 copying lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,296 copying lm_eval/tasks/blimp/inchoative.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,299 copying lm_eval/tasks/blimp/wh_island.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,303 copying lm_eval/tasks/blimp/passive_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,307 copying lm_eval/tasks/blimp/intransitive.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,309 copying lm_eval/tasks/blimp/expletive_it_object_raising.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,312 copying lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,314 copying lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,316 copying lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,319 copying lm_eval/tasks/blimp/animate_subject_passive.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,321 copying lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,323 copying lm_eval/tasks/blimp/principle_A_case_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,326 copying lm_eval/tasks/blimp/anaphor_gender_agreement.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,328 copying lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,331 copying lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,333 copying lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,336 copying lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,338 copying lm_eval/tasks/blimp/npi_present_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,340 copying lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,343 copying lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,346 copying lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,349 copying lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,351 copying lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,354 copying lm_eval/tasks/blimp/_blimp.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,356 copying lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T10:59:55,359 copying lm_eval/tasks/arabicmmlu/arabicmmlu_high_history.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,361 copying lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,363 copying lm_eval/tasks/arabicmmlu/arabicmmlu_high_physics.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,366 copying lm_eval/tasks/arabicmmlu/arabicmmlu_primary_math.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,368 copying lm_eval/tasks/arabicmmlu/arabicmmlu_middle_social_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,371 copying lm_eval/tasks/arabicmmlu/arabicmmlu_primary_general_knowledge.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,373 copying lm_eval/tasks/arabicmmlu/arabicmmlu_middle_islamic_studies.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,375 copying lm_eval/tasks/arabicmmlu/arabicmmlu_univ_economics.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,378 copying lm_eval/tasks/arabicmmlu/arabicmmlu_univ_political_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,380 copying lm_eval/tasks/arabicmmlu/arabicmmlu_high_islamic_studies.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,383 copying lm_eval/tasks/arabicmmlu/arabicmmlu_univ_management.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,385 copying lm_eval/tasks/arabicmmlu/arabicmmlu_high_economics.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,387 copying lm_eval/tasks/arabicmmlu/arabicmmlu_middle_civics.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,390 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,392 copying lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,397 copying lm_eval/tasks/arabicmmlu/arabicmmlu_primary_computer_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,402 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,404 copying lm_eval/tasks/arabicmmlu/arabicmmlu_high_civics.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,406 copying lm_eval/tasks/arabicmmlu/arabicmmlu_middle_arabic_language.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,409 copying lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,411 copying lm_eval/tasks/arabicmmlu/arabicmmlu_middle_general_knowledge.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,414 copying lm_eval/tasks/arabicmmlu/arabicmmlu_primary_arabic_language.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,416 copying lm_eval/tasks/arabicmmlu/arabicmmlu_primary_social_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,418 copying lm_eval/tasks/arabicmmlu/arabicmmlu_high_biology.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,420 copying lm_eval/tasks/arabicmmlu/arabicmmlu_middle_geography.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,423 copying lm_eval/tasks/arabicmmlu/arabicmmlu_primary_natural_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,425 copying lm_eval/tasks/arabicmmlu/arabicmmlu_middle_history.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,427 copying lm_eval/tasks/arabicmmlu/arabicmmlu_univ_computer_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,429 copying lm_eval/tasks/arabicmmlu/arabicmmlu_primary_islamic_studies.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,432 copying lm_eval/tasks/arabicmmlu/arabicmmlu_prof_law.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,434 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,437 copying lm_eval/tasks/arabicmmlu/arabicmmlu_middle_natural_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,440 copying lm_eval/tasks/arabicmmlu/arabicmmlu_primary_history.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,442 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,444 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,447 copying lm_eval/tasks/arabicmmlu/arabicmmlu_middle_computer_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,449 copying lm_eval/tasks/arabicmmlu/arabicmmlu_high_computer_science.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,451 copying lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,454 copying lm_eval/tasks/arabicmmlu/arabicmmlu_high_philosophy.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,456 copying lm_eval/tasks/arabicmmlu/arabicmmlu_univ_accounting.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,459 copying lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,461 copying lm_eval/tasks/arabicmmlu/arabicmmlu_high_geography.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,463 copying lm_eval/tasks/arabicmmlu/arabicmmlu_middle_economics.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,466 copying lm_eval/tasks/arabicmmlu/arabicmmlu_primary_geography.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,468 copying lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,471 copying lm_eval/tasks/arabicmmlu/arabicmmlu_high_arabic_language.yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T10:59:55,473 copying lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2024-12-17T10:59:55,476 copying lm_eval/tasks/portuguese_bench/assin_entailment.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2024-12-17T10:59:55,478 copying lm_eval/tasks/portuguese_bench/portuguese_bench.yaml -> build/lib/lm_eval/tasks/portuguese_bench 2024-12-17T10:59:55,480 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,483 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,486 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,489 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,492 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,494 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,496 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,499 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,501 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,503 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,506 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,508 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,511 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,513 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,515 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,518 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,520 copying lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T10:59:55,522 creating build/lib/lm_eval/tasks/arc 2024-12-17T10:59:55,524 copying lm_eval/tasks/arc/arc_easy.yaml -> build/lib/lm_eval/tasks/arc 2024-12-17T10:59:55,526 copying lm_eval/tasks/arc/arc_challenge.yaml -> build/lib/lm_eval/tasks/arc 2024-12-17T10:59:55,529 copying lm_eval/tasks/fda/fda.yaml -> build/lib/lm_eval/tasks/fda 2024-12-17T10:59:55,533 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,539 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,542 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,546 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,548 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,551 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,554 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,556 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,559 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,563 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,566 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,569 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,571 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,578 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,598 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,600 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,603 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,606 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T10:59:55,609 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,611 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,614 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,617 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,621 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,624 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,627 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,629 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,632 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,635 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,638 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,641 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,643 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,646 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,648 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,650 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,652 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,654 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T10:59:55,657 creating build/lib/lm_eval/tasks/arithmetic 2024-12-17T10:59:55,658 copying lm_eval/tasks/arithmetic/arithmetic_5ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2024-12-17T10:59:55,661 copying lm_eval/tasks/arithmetic/arithmetic_3da.yaml -> build/lib/lm_eval/tasks/arithmetic 2024-12-17T10:59:55,664 copying lm_eval/tasks/arithmetic/arithmetic_2ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2024-12-17T10:59:55,668 copying lm_eval/tasks/arithmetic/arithmetic_4ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2024-12-17T10:59:55,672 copying lm_eval/tasks/arithmetic/arithmetic_1dc.yaml -> build/lib/lm_eval/tasks/arithmetic 2024-12-17T10:59:55,675 copying lm_eval/tasks/arithmetic/arithmetic_4da.yaml -> build/lib/lm_eval/tasks/arithmetic 2024-12-17T10:59:55,677 copying lm_eval/tasks/arithmetic/arithmetic_5da.yaml -> build/lib/lm_eval/tasks/arithmetic 2024-12-17T10:59:55,679 copying lm_eval/tasks/arithmetic/arithmetic_2dm.yaml -> build/lib/lm_eval/tasks/arithmetic 2024-12-17T10:59:55,682 copying lm_eval/tasks/arithmetic/arithmetic_2da.yaml -> build/lib/lm_eval/tasks/arithmetic 2024-12-17T10:59:55,684 copying lm_eval/tasks/arithmetic/arithmetic_3ds.yaml -> build/lib/lm_eval/tasks/arithmetic 2024-12-17T10:59:55,686 copying lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml -> build/lib/lm_eval/tasks/scrolls 2024-12-17T10:59:55,688 copying lm_eval/tasks/scrolls/scrolls_qasper.yaml -> build/lib/lm_eval/tasks/scrolls 2024-12-17T10:59:55,690 copying lm_eval/tasks/scrolls/scrolls_contractnli.yaml -> build/lib/lm_eval/tasks/scrolls 2024-12-17T10:59:55,693 copying lm_eval/tasks/scrolls/scrolls_govreport.yaml -> build/lib/lm_eval/tasks/scrolls 2024-12-17T10:59:55,695 copying lm_eval/tasks/scrolls/scrolls_quality.yaml -> build/lib/lm_eval/tasks/scrolls 2024-12-17T10:59:55,697 copying lm_eval/tasks/scrolls/scrolls_qmsum.yaml -> build/lib/lm_eval/tasks/scrolls 2024-12-17T10:59:55,699 copying lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml -> build/lib/lm_eval/tasks/scrolls 2024-12-17T10:59:55,702 copying lm_eval/tasks/super_glue/wsc/default.yaml -> build/lib/lm_eval/tasks/super_glue/wsc 2024-12-17T10:59:55,704 copying lm_eval/tasks/super_glue/wsc/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/wsc 2024-12-17T10:59:55,706 copying lm_eval/tasks/super_glue/copa/default.yaml -> build/lib/lm_eval/tasks/super_glue/copa 2024-12-17T10:59:55,708 copying lm_eval/tasks/super_glue/copa/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/copa 2024-12-17T10:59:55,711 copying lm_eval/tasks/super_glue/cb/default.yaml -> build/lib/lm_eval/tasks/super_glue/cb 2024-12-17T10:59:55,713 copying lm_eval/tasks/super_glue/cb/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/cb 2024-12-17T10:59:55,715 creating build/lib/lm_eval/tasks/super_glue/wic 2024-12-17T10:59:55,716 copying lm_eval/tasks/super_glue/wic/default.yaml -> build/lib/lm_eval/tasks/super_glue/wic 2024-12-17T10:59:55,719 copying lm_eval/tasks/super_glue/wic/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/wic 2024-12-17T10:59:55,721 creating build/lib/lm_eval/tasks/super_glue/rte 2024-12-17T10:59:55,722 copying lm_eval/tasks/super_glue/rte/default.yaml -> build/lib/lm_eval/tasks/super_glue/rte 2024-12-17T10:59:55,724 copying lm_eval/tasks/super_glue/rte/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/rte 2024-12-17T10:59:55,726 creating build/lib/lm_eval/tasks/super_glue/boolq 2024-12-17T10:59:55,727 copying lm_eval/tasks/super_glue/boolq/default.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2024-12-17T10:59:55,730 copying lm_eval/tasks/super_glue/boolq/seq2seq.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2024-12-17T10:59:55,731 copying lm_eval/tasks/super_glue/boolq/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/boolq 2024-12-17T10:59:55,734 copying lm_eval/tasks/super_glue/record/default.yaml -> build/lib/lm_eval/tasks/super_glue/record 2024-12-17T10:59:55,736 copying lm_eval/tasks/super_glue/record/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/record 2024-12-17T10:59:55,738 copying lm_eval/tasks/super_glue/multirc/default.yaml -> build/lib/lm_eval/tasks/super_glue/multirc 2024-12-17T10:59:55,740 copying lm_eval/tasks/super_glue/multirc/t5-prompt.yaml -> build/lib/lm_eval/tasks/super_glue/multirc 2024-12-17T10:59:55,742 creating build/lib/lm_eval/tasks/fld 2024-12-17T10:59:55,743 copying lm_eval/tasks/fld/fld_logical_formula_default.yaml -> build/lib/lm_eval/tasks/fld 2024-12-17T10:59:55,745 copying lm_eval/tasks/fld/fld_logical_formula_star.yaml -> build/lib/lm_eval/tasks/fld 2024-12-17T10:59:55,748 copying lm_eval/tasks/fld/fld_default.yaml -> build/lib/lm_eval/tasks/fld 2024-12-17T10:59:55,750 copying lm_eval/tasks/fld/fld_star.yaml -> build/lib/lm_eval/tasks/fld 2024-12-17T10:59:55,752 copying lm_eval/tasks/xnli/xnli_es.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,754 copying lm_eval/tasks/xnli/xnli_ur.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,757 copying lm_eval/tasks/xnli/xnli_de.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,759 copying lm_eval/tasks/xnli/xnli_el.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,762 copying lm_eval/tasks/xnli/xnli_th.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,764 copying lm_eval/tasks/xnli/xnli_fr.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,766 copying lm_eval/tasks/xnli/xnli_vi.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,768 copying lm_eval/tasks/xnli/xnli_sw.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,770 copying lm_eval/tasks/xnli/xnli_en.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,772 copying lm_eval/tasks/xnli/xnli_hi.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,774 copying lm_eval/tasks/xnli/xnli_ar.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,776 copying lm_eval/tasks/xnli/xnli_zh.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,778 copying lm_eval/tasks/xnli/_xnli.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,780 copying lm_eval/tasks/xnli/xnli_ru.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,782 copying lm_eval/tasks/xnli/xnli_bg.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,784 copying lm_eval/tasks/xnli/xnli_tr.yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T10:59:55,786 copying lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,788 copying lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,791 copying lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,793 copying lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,795 copying lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,798 copying lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,800 copying lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,802 copying lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,804 copying lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,807 copying lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,810 copying lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,812 copying lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,814 copying lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,816 copying lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,818 copying lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T10:59:55,820 copying lm_eval/tasks/mmmu/_business.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,822 copying lm_eval/tasks/mmmu/mmmu_economics.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,824 copying lm_eval/tasks/mmmu/_art_and_design.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,826 copying lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,828 copying lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,830 copying lm_eval/tasks/mmmu/mmmu_marketing.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,832 copying lm_eval/tasks/mmmu/_tech_and_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,834 copying lm_eval/tasks/mmmu/mmmu_materials.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,836 copying lm_eval/tasks/mmmu/mmmu_computer_science.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,838 copying lm_eval/tasks/mmmu/mmmu_psychology.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,840 copying lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,843 copying lm_eval/tasks/mmmu/mmmu_manage.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,845 copying lm_eval/tasks/mmmu/mmmu_design.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,847 copying lm_eval/tasks/mmmu/mmmu_art.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,850 copying lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,851 copying lm_eval/tasks/mmmu/mmmu_literature.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,854 copying lm_eval/tasks/mmmu/mmmu_music.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,856 copying lm_eval/tasks/mmmu/_science.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,858 copying lm_eval/tasks/mmmu/mmmu_sociology.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,860 copying lm_eval/tasks/mmmu/mmmu_agriculture.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,862 copying lm_eval/tasks/mmmu/mmmu_math.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,864 copying lm_eval/tasks/mmmu/mmmu_public_health.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,866 copying lm_eval/tasks/mmmu/mmmu_electronics.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,868 copying lm_eval/tasks/mmmu/mmmu_history.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,870 copying lm_eval/tasks/mmmu/_mmmu.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,872 copying lm_eval/tasks/mmmu/mmmu_chemistry.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,874 copying lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,876 copying lm_eval/tasks/mmmu/mmmu_biology.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,878 copying lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,880 copying lm_eval/tasks/mmmu/mmmu_art_theory.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,883 copying lm_eval/tasks/mmmu/mmmu_finance.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,885 copying lm_eval/tasks/mmmu/mmmu_geography.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,887 copying lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,889 copying lm_eval/tasks/mmmu/mmmu_pharmacy.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,892 copying lm_eval/tasks/mmmu/_health_and_medicine.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,894 copying lm_eval/tasks/mmmu/mmmu_accounting.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,896 copying lm_eval/tasks/mmmu/mmmu_physics.yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T10:59:55,898 copying lm_eval/tasks/eus_trivia/eus_trivia.yaml -> build/lib/lm_eval/tasks/eus_trivia 2024-12-17T10:59:55,900 creating build/lib/lm_eval/tasks/sciq 2024-12-17T10:59:55,901 copying lm_eval/tasks/sciq/sciq.yaml -> build/lib/lm_eval/tasks/sciq 2024-12-17T10:59:55,904 copying lm_eval/tasks/winogrande/default.yaml -> build/lib/lm_eval/tasks/winogrande 2024-12-17T10:59:55,907 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,910 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,912 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,914 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,916 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,918 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,920 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,923 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,925 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,927 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,929 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,932 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,934 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,936 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,938 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,940 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,943 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,945 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T10:59:55,947 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,949 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,951 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,953 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,955 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,957 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,959 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,961 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,963 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,965 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,967 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,970 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,972 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,974 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,976 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,978 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,980 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T10:59:55,982 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:55,984 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:55,986 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:55,989 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:55,991 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:55,993 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:55,995 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:55,998 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:56,000 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:56,003 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:56,005 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:56,007 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:56,009 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:56,011 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:56,013 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:56,015 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:56,017 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:56,019 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T10:59:56,021 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,023 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,025 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,027 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,029 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,031 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,033 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,036 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,038 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,040 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,042 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,044 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,046 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,049 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,051 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,053 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,055 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T10:59:56,057 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,059 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,061 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,063 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,065 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,067 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,069 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,071 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,073 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,075 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,078 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,084 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,086 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,089 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,092 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,095 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,098 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,100 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T10:59:56,102 copying lm_eval/tasks/belebele/belebele_xho_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,104 copying lm_eval/tasks/belebele/belebele_kor_Hang.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,107 copying lm_eval/tasks/belebele/belebele_spa_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,109 copying lm_eval/tasks/belebele/belebele_ita_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,111 copying lm_eval/tasks/belebele/belebele_luo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,113 copying lm_eval/tasks/belebele/belebele_ssw_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,115 copying lm_eval/tasks/belebele/belebele_grn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,117 copying lm_eval/tasks/belebele/belebele_kin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,119 copying lm_eval/tasks/belebele/belebele_urd_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,121 copying lm_eval/tasks/belebele/belebele_swe_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,124 copying lm_eval/tasks/belebele/belebele_amh_Ethi.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,126 copying lm_eval/tasks/belebele/belebele_lao_Laoo.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,128 copying lm_eval/tasks/belebele/belebele_lug_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,130 copying lm_eval/tasks/belebele/belebele_nya_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,131 copying lm_eval/tasks/belebele/belebele_npi_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,134 copying lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,135 copying lm_eval/tasks/belebele/belebele_war_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,138 copying lm_eval/tasks/belebele/belebele_shn_Mymr.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,140 copying lm_eval/tasks/belebele/belebele_gaz_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,142 copying lm_eval/tasks/belebele/belebele_ell_Grek.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,144 copying lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,146 copying lm_eval/tasks/belebele/belebele_hrv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,148 copying lm_eval/tasks/belebele/belebele_isl_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,150 copying lm_eval/tasks/belebele/belebele_ilo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,152 copying lm_eval/tasks/belebele/belebele_kea_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,154 copying lm_eval/tasks/belebele/belebele_bod_Tibt.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,156 copying lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,158 copying lm_eval/tasks/belebele/belebele_deu_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,160 copying lm_eval/tasks/belebele/belebele_cat_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,163 copying lm_eval/tasks/belebele/belebele_lin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,165 copying lm_eval/tasks/belebele/belebele_jav_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,167 copying lm_eval/tasks/belebele/belebele_heb_Hebr.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,170 copying lm_eval/tasks/belebele/belebele_slk_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,172 copying lm_eval/tasks/belebele/belebele_hye_Armn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,174 copying lm_eval/tasks/belebele/belebele_guj_Gujr.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,176 copying lm_eval/tasks/belebele/belebele_arz_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,178 copying lm_eval/tasks/belebele/belebele_zsm_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,180 copying lm_eval/tasks/belebele/belebele_pbt_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,183 copying lm_eval/tasks/belebele/belebele_hin_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,188 copying lm_eval/tasks/belebele/belebele_ary_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,192 copying lm_eval/tasks/belebele/belebele_kan_Knda.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,194 copying lm_eval/tasks/belebele/belebele_azj_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,196 copying lm_eval/tasks/belebele/belebele_sun_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,198 copying lm_eval/tasks/belebele/belebele_tgl_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,200 copying lm_eval/tasks/belebele/belebele_sot_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,202 copying lm_eval/tasks/belebele/belebele_hat_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,204 copying lm_eval/tasks/belebele/belebele_ben_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,206 copying lm_eval/tasks/belebele/belebele_bam_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,208 copying lm_eval/tasks/belebele/belebele_pol_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,210 copying lm_eval/tasks/belebele/belebele_eng_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,212 copying lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,214 copying lm_eval/tasks/belebele/belebele_fra_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,216 copying lm_eval/tasks/belebele/belebele_hau_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,218 copying lm_eval/tasks/belebele/belebele_apc_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,221 copying lm_eval/tasks/belebele/belebele_por_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,223 copying lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,225 copying lm_eval/tasks/belebele/belebele_ibo_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,227 copying lm_eval/tasks/belebele/belebele_acm_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,229 copying lm_eval/tasks/belebele/belebele_wol_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,231 copying lm_eval/tasks/belebele/belebele_ckb_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,233 copying lm_eval/tasks/belebele/belebele_mal_Mlym.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,235 copying lm_eval/tasks/belebele/belebele_kac_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,237 copying lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,239 copying lm_eval/tasks/belebele/belebele_sna_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,241 copying lm_eval/tasks/belebele/belebele_ind_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,243 copying lm_eval/tasks/belebele/belebele_yor_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,246 copying lm_eval/tasks/belebele/belebele_ben_Beng.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,248 copying lm_eval/tasks/belebele/belebele_ory_Orya.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,250 copying lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,252 copying lm_eval/tasks/belebele/belebele_tam_Taml.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,254 copying lm_eval/tasks/belebele/belebele_tel_Telu.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,257 copying lm_eval/tasks/belebele/belebele_afr_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,259 copying lm_eval/tasks/belebele/_belebele.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,262 copying lm_eval/tasks/belebele/belebele_mri_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,265 copying lm_eval/tasks/belebele/belebele_dan_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,268 copying lm_eval/tasks/belebele/belebele_lvs_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,270 copying lm_eval/tasks/belebele/belebele_tur_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,273 copying lm_eval/tasks/belebele/belebele_arb_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,275 copying lm_eval/tasks/belebele/belebele_urd_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,277 copying lm_eval/tasks/belebele/belebele_snd_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,279 copying lm_eval/tasks/belebele/belebele_swh_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,281 copying lm_eval/tasks/belebele/belebele_arb_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,282 copying lm_eval/tasks/belebele/belebele_hun_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,284 copying lm_eval/tasks/belebele/belebele_tir_Ethi.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,286 copying lm_eval/tasks/belebele/belebele_ars_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,288 copying lm_eval/tasks/belebele/belebele_mya_Mymr.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,291 copying lm_eval/tasks/belebele/belebele_kat_Geor.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,293 copying lm_eval/tasks/belebele/belebele_slv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,295 copying lm_eval/tasks/belebele/belebele_ceb_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,297 copying lm_eval/tasks/belebele/belebele_plt_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,299 copying lm_eval/tasks/belebele/belebele_khm_Khmr.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,300 copying lm_eval/tasks/belebele/belebele_zul_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,303 copying lm_eval/tasks/belebele/belebele_uzn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,305 copying lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,307 copying lm_eval/tasks/belebele/belebele_som_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,309 copying lm_eval/tasks/belebele/belebele_mar_Deva.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,311 copying lm_eval/tasks/belebele/belebele_tsn_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,313 copying lm_eval/tasks/belebele/belebele_zho_Hant.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,315 copying lm_eval/tasks/belebele/belebele_sin_Sinh.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,317 copying lm_eval/tasks/belebele/belebele_fuv_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,319 copying lm_eval/tasks/belebele/belebele_asm_Beng.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,321 copying lm_eval/tasks/belebele/belebele_ces_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,324 copying lm_eval/tasks/belebele/belebele_eus_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,326 copying lm_eval/tasks/belebele/belebele_zho_Hans.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,328 copying lm_eval/tasks/belebele/belebele_sin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,330 copying lm_eval/tasks/belebele/belebele_mlt_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,332 copying lm_eval/tasks/belebele/belebele_nld_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,335 copying lm_eval/tasks/belebele/belebele_tha_Thai.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,337 copying lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,339 copying lm_eval/tasks/belebele/belebele_pan_Guru.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,342 copying lm_eval/tasks/belebele/belebele_nob_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,344 copying lm_eval/tasks/belebele/belebele_npi_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,346 copying lm_eval/tasks/belebele/belebele_est_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,348 copying lm_eval/tasks/belebele/belebele_lit_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,351 copying lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,354 copying lm_eval/tasks/belebele/belebele_pes_Arab.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,356 copying lm_eval/tasks/belebele/belebele_tso_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,358 copying lm_eval/tasks/belebele/belebele_als_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,360 copying lm_eval/tasks/belebele/belebele_ron_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,363 copying lm_eval/tasks/belebele/belebele_vie_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,365 copying lm_eval/tasks/belebele/belebele_nso_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,367 copying lm_eval/tasks/belebele/belebele_fin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,369 copying lm_eval/tasks/belebele/belebele_hin_Latn.yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T10:59:56,371 copying lm_eval/tasks/minerva_math/minerva_math_algebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2024-12-17T10:59:56,373 copying lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2024-12-17T10:59:56,375 copying lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/minerva_math 2024-12-17T10:59:56,377 copying lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/minerva_math 2024-12-17T10:59:56,379 copying lm_eval/tasks/minerva_math/minerva_math_geometry.yaml -> build/lib/lm_eval/tasks/minerva_math 2024-12-17T10:59:56,381 copying lm_eval/tasks/minerva_math/minerva_math_precalc.yaml -> build/lib/lm_eval/tasks/minerva_math 2024-12-17T10:59:56,384 copying lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml -> build/lib/lm_eval/tasks/minerva_math 2024-12-17T10:59:56,386 creating build/lib/lm_eval/tasks/mc_taco 2024-12-17T10:59:56,387 copying lm_eval/tasks/mc_taco/default.yaml -> build/lib/lm_eval/tasks/mc_taco 2024-12-17T10:59:56,389 copying lm_eval/tasks/wsc273/default.yaml -> build/lib/lm_eval/tasks/wsc273 2024-12-17T10:59:56,391 copying lm_eval/tasks/cmmlu/cmmlu_default_conceptual_physics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,393 copying lm_eval/tasks/cmmlu/cmmlu_default_high_school_physics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,395 copying lm_eval/tasks/cmmlu/cmmlu_default_business_ethics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,397 copying lm_eval/tasks/cmmlu/cmmlu_arts.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,399 copying lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,401 copying lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,404 copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_civil_service_exam.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,406 copying lm_eval/tasks/cmmlu/cmmlu_default_ancient_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,408 copying lm_eval/tasks/cmmlu/cmmlu_default_professional_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,410 copying lm_eval/tasks/cmmlu/cmmlu_security_study.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,413 copying lm_eval/tasks/cmmlu/cmmlu_default_education.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,415 copying lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,417 copying lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,419 copying lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,422 copying lm_eval/tasks/cmmlu/_cmmlu.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,424 copying lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,426 copying lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,428 copying lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,430 copying lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,432 copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_driving_rule.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,435 copying lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,436 copying lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,439 copying lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,441 copying lm_eval/tasks/cmmlu/cmmlu_default_college_medical_statistics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,443 copying lm_eval/tasks/cmmlu/cmmlu_marketing.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,444 copying lm_eval/tasks/cmmlu/cmmlu_college_education.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,446 copying lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,449 copying lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,451 copying lm_eval/tasks/cmmlu/cmmlu_default_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,453 copying lm_eval/tasks/cmmlu/cmmlu_default_sports_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,455 copying lm_eval/tasks/cmmlu/cmmlu_default_traditional_chinese_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,458 copying lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,460 copying lm_eval/tasks/cmmlu/cmmlu_default_astronomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,462 copying lm_eval/tasks/cmmlu/cmmlu_default_food_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,464 copying lm_eval/tasks/cmmlu/cmmlu_default_professional_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,466 copying lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,468 copying lm_eval/tasks/cmmlu/cmmlu_default_security_study.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,470 copying lm_eval/tasks/cmmlu/cmmlu_default_professional_accounting.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,472 copying lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,474 copying lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,476 copying lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,478 copying lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,480 copying lm_eval/tasks/cmmlu/cmmlu_default_global_facts.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,482 copying lm_eval/tasks/cmmlu/cmmlu_default_management.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,484 copying lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,486 copying lm_eval/tasks/cmmlu/cmmlu_default_arts.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,488 copying lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,491 copying lm_eval/tasks/cmmlu/cmmlu_international_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,493 copying lm_eval/tasks/cmmlu/cmmlu_default_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,495 copying lm_eval/tasks/cmmlu/cmmlu_default_economics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,497 copying lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,499 copying lm_eval/tasks/cmmlu/cmmlu_default_marketing.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,501 copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_food_culture.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,503 copying lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,506 copying lm_eval/tasks/cmmlu/cmmlu_default_machine_learning.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,507 copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_teacher_qualification.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,510 copying lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,512 copying lm_eval/tasks/cmmlu/cmmlu_default_elementary_information_and_technology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,514 copying lm_eval/tasks/cmmlu/cmmlu_default_philosophy.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,516 copying lm_eval/tasks/cmmlu/cmmlu_default_college_actuarial_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,518 copying lm_eval/tasks/cmmlu/cmmlu_default_human_sexuality.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,520 copying lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,522 copying lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,524 copying lm_eval/tasks/cmmlu/cmmlu_default_sociology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,526 copying lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,528 copying lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,530 copying lm_eval/tasks/cmmlu/cmmlu_default_virology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,532 copying lm_eval/tasks/cmmlu/cmmlu_economics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,535 copying lm_eval/tasks/cmmlu/cmmlu_default_jurisprudence.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,537 copying lm_eval/tasks/cmmlu/cmmlu_food_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,539 copying lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,541 copying lm_eval/tasks/cmmlu/cmmlu_default_anatomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,543 copying lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,545 copying lm_eval/tasks/cmmlu/cmmlu_default_marxist_theory.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,548 copying lm_eval/tasks/cmmlu/cmmlu_default_genetics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,550 copying lm_eval/tasks/cmmlu/cmmlu_default_journalism.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,552 copying lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,554 copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_literature.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,556 copying lm_eval/tasks/cmmlu/cmmlu_default_construction_project_management.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,559 copying lm_eval/tasks/cmmlu/cmmlu_default_modern_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,561 copying lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,563 copying lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,565 copying lm_eval/tasks/cmmlu/cmmlu_default_college_engineering_hydrology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,567 copying lm_eval/tasks/cmmlu/cmmlu_default_nutrition.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,569 copying lm_eval/tasks/cmmlu/cmmlu_education.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,571 copying lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,574 copying lm_eval/tasks/cmmlu/cmmlu_default_public_relations.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,575 copying lm_eval/tasks/cmmlu/cmmlu_sociology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,578 copying lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,579 copying lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,582 copying lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,583 copying lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,585 copying lm_eval/tasks/cmmlu/cmmlu_default_electrical_engineering.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,587 copying lm_eval/tasks/cmmlu/cmmlu_default_computer_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,590 copying lm_eval/tasks/cmmlu/cmmlu_default_computer_security.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,591 copying lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,594 copying lm_eval/tasks/cmmlu/cmmlu_virology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,596 copying lm_eval/tasks/cmmlu/cmmlu_default_high_school_biology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,598 copying lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,600 copying lm_eval/tasks/cmmlu/cmmlu_college_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,602 copying lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,604 copying lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,607 copying lm_eval/tasks/cmmlu/cmmlu_default_world_religions.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,609 copying lm_eval/tasks/cmmlu/cmmlu_default_college_medicine.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,611 copying lm_eval/tasks/cmmlu/cmmlu_world_history.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,613 copying lm_eval/tasks/cmmlu/cmmlu_default_elementary_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,615 copying lm_eval/tasks/cmmlu/cmmlu_default_agronomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,617 copying lm_eval/tasks/cmmlu/cmmlu_default_college_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,619 copying lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,621 copying lm_eval/tasks/cmmlu/cmmlu_default_college_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,623 copying lm_eval/tasks/cmmlu/cmmlu_default_college_education.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,626 copying lm_eval/tasks/cmmlu/cmmlu_default_elementary_commonsense.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,628 copying lm_eval/tasks/cmmlu/cmmlu_default_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,630 copying lm_eval/tasks/cmmlu/cmmlu_genetics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,632 copying lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,634 copying lm_eval/tasks/cmmlu/cmmlu_default_world_history.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,637 copying lm_eval/tasks/cmmlu/cmmlu_management.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,639 copying lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,641 copying lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,643 copying lm_eval/tasks/cmmlu/cmmlu_default_legal_and_moral_basis.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,645 copying lm_eval/tasks/cmmlu/cmmlu_logical.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,647 copying lm_eval/tasks/cmmlu/cmmlu_default_professional_psychology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,649 copying lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,651 copying lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,653 copying lm_eval/tasks/cmmlu/cmmlu_default_logical.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,655 copying lm_eval/tasks/cmmlu/cmmlu_journalism.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,657 copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_foreign_policy.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,659 copying lm_eval/tasks/cmmlu/cmmlu_default_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,661 copying lm_eval/tasks/cmmlu/cmmlu_default_high_school_geography.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,663 copying lm_eval/tasks/cmmlu/cmmlu_default_international_law.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,665 copying lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,667 copying lm_eval/tasks/cmmlu/cmmlu_default_high_school_politics.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,669 copying lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,671 copying lm_eval/tasks/cmmlu/cmmlu_default_ethnology.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,673 copying lm_eval/tasks/cmmlu/cmmlu_default_chinese_history.yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T10:59:56,675 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,677 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,679 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,681 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,683 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,685 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,687 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,689 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,691 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,693 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,695 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,698 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,700 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,702 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,704 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,706 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,708 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,710 copying lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,712 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,714 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,716 copying lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T10:59:56,718 copying lm_eval/tasks/xcopa/default_qu.yaml -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:56,720 copying lm_eval/tasks/xcopa/default_sw.yaml -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:56,722 copying lm_eval/tasks/xcopa/default_tr.yaml -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:56,724 copying lm_eval/tasks/xcopa/default_zh.yaml -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:56,726 copying lm_eval/tasks/xcopa/default_vi.yaml -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:56,728 copying lm_eval/tasks/xcopa/_xcopa.yaml -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:56,730 copying lm_eval/tasks/xcopa/default_ht.yaml -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:56,732 copying lm_eval/tasks/xcopa/default_et.yaml -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:56,734 copying lm_eval/tasks/xcopa/default_it.yaml -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:56,736 copying lm_eval/tasks/xcopa/default_ta.yaml -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:56,738 copying lm_eval/tasks/xcopa/default_th.yaml -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:56,740 copying lm_eval/tasks/xcopa/default_id.yaml -> build/lib/lm_eval/tasks/xcopa 2024-12-17T10:59:56,742 copying lm_eval/tasks/crows_pairs/crows_pairs_french.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,744 copying lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,747 copying lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,749 copying lm_eval/tasks/crows_pairs/crows_pairs_english.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,751 copying lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,753 copying lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,755 copying lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,758 copying lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,760 copying lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,762 copying lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,764 copying lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,767 copying lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,769 copying lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,771 copying lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,773 copying lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,775 copying lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,777 copying lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,779 copying lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,781 copying lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,783 copying lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,786 copying lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,788 copying lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T10:59:56,790 creating build/lib/lm_eval/tasks/unscramble 2024-12-17T10:59:56,791 copying lm_eval/tasks/unscramble/anagrams2.yaml -> build/lib/lm_eval/tasks/unscramble 2024-12-17T10:59:56,793 copying lm_eval/tasks/unscramble/random_insertion.yaml -> build/lib/lm_eval/tasks/unscramble 2024-12-17T10:59:56,795 copying lm_eval/tasks/unscramble/cycle_letters.yaml -> build/lib/lm_eval/tasks/unscramble 2024-12-17T10:59:56,797 copying lm_eval/tasks/unscramble/reversed_words.yaml -> build/lib/lm_eval/tasks/unscramble 2024-12-17T10:59:56,799 copying lm_eval/tasks/unscramble/anagrams1.yaml -> build/lib/lm_eval/tasks/unscramble 2024-12-17T10:59:56,802 creating build/lib/lm_eval/tasks/anli 2024-12-17T10:59:56,803 copying lm_eval/tasks/anli/anli_r2.yaml -> build/lib/lm_eval/tasks/anli 2024-12-17T10:59:56,805 copying lm_eval/tasks/anli/anli_r1.yaml -> build/lib/lm_eval/tasks/anli 2024-12-17T10:59:56,807 copying lm_eval/tasks/anli/anli_r3.yaml -> build/lib/lm_eval/tasks/anli 2024-12-17T10:59:56,809 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light 2024-12-17T10:59:56,811 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2024-12-17T10:59:56,813 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2024-12-17T10:59:56,815 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2024-12-17T10:59:56,818 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2024-12-17T10:59:56,820 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2024-12-17T10:59:56,822 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2024-12-17T10:59:56,824 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2024-12-17T10:59:56,826 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2024-12-17T10:59:56,828 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2024-12-17T10:59:56,835 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2024-12-17T10:59:56,838 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T10:59:56,840 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T10:59:56,842 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T10:59:56,844 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T10:59:56,846 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T10:59:56,848 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T10:59:56,850 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T10:59:56,852 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T10:59:56,855 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T10:59:56,857 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T10:59:56,859 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2024-12-17T10:59:56,861 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2024-12-17T10:59:56,864 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2024-12-17T10:59:56,866 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2024-12-17T10:59:56,868 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2024-12-17T10:59:56,870 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2024-12-17T10:59:56,873 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2024-12-17T10:59:56,875 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2024-12-17T10:59:56,877 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,879 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,881 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,883 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,885 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,887 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,889 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,891 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,894 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,896 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,898 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,900 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,902 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,904 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,906 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,908 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,910 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,912 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,914 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,916 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,918 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,920 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,922 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,924 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,926 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,929 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,931 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,933 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,935 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,937 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,939 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,941 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,944 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,946 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,948 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,950 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,952 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,954 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,956 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,958 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,960 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,962 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,964 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,966 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,969 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,971 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,974 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,976 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,978 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,980 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,983 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,985 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,987 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,989 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,991 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,994 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,996 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:56,998 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:57,000 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T10:59:57,002 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2024-12-17T10:59:57,004 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2024-12-17T10:59:57,007 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,009 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,011 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,013 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,015 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,018 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,020 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,024 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,026 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,028 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,030 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,033 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,035 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,037 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,039 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,041 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,043 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,046 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,048 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,050 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,052 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,055 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,057 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,059 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,061 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,063 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,065 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,068 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,070 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,072 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,074 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,076 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,079 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,081 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,084 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,086 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,088 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,090 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,092 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,095 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,098 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,100 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,102 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,104 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,106 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,109 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,111 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,113 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,115 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,118 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,121 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,123 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,126 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,128 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,131 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,133 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,135 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,138 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T10:59:57,140 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2024-12-17T10:59:57,142 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2024-12-17T10:59:57,144 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2024-12-17T10:59:57,146 copying lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml -> build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2024-12-17T10:59:57,148 copying lm_eval/tasks/drop/default.yaml -> build/lib/lm_eval/tasks/drop 2024-12-17T10:59:57,150 copying lm_eval/tasks/ifeval/ifeval.yaml -> build/lib/lm_eval/tasks/ifeval 2024-12-17T10:59:57,152 copying lm_eval/tasks/ceval/ceval-valid_law.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,155 copying lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,157 copying lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,160 copying lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,163 copying lm_eval/tasks/ceval/ceval-valid_education_science.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,166 copying lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,169 copying lm_eval/tasks/ceval/ceval-valid_accountant.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,171 copying lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,174 copying lm_eval/tasks/ceval/ceval-valid_sports_science.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,176 copying lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,178 copying lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,180 copying lm_eval/tasks/ceval/ceval-valid_physician.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,182 copying lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,184 copying lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,186 copying lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,188 copying lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,190 copying lm_eval/tasks/ceval/ceval-valid_operating_system.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,192 copying lm_eval/tasks/ceval/ceval-valid_business_administration.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,194 copying lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,195 copying lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,198 copying lm_eval/tasks/ceval/ceval-valid_art_studies.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,200 copying lm_eval/tasks/ceval/ceval-valid_computer_network.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,202 copying lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,204 copying lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,206 copying lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,208 copying lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,210 copying lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,213 copying lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,215 copying lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,217 copying lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,219 copying lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,221 copying lm_eval/tasks/ceval/ceval-valid_marxism.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,223 copying lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,225 copying lm_eval/tasks/ceval/ceval-valid_college_physics.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,227 copying lm_eval/tasks/ceval/_ceval-valid.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,229 copying lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,231 copying lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,234 copying lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,236 copying lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,238 copying lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,240 copying lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,244 copying lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,247 copying lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,249 copying lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,252 copying lm_eval/tasks/ceval/ceval-valid_college_economics.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,254 copying lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,256 copying lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,259 copying lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,262 copying lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,264 copying lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,266 copying lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,268 copying lm_eval/tasks/ceval/ceval-valid_logic.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,270 copying lm_eval/tasks/ceval/ceval-valid_college_programming.yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T10:59:57,272 copying lm_eval/tasks/code_x_glue/code-text/java.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2024-12-17T10:59:57,274 copying lm_eval/tasks/code_x_glue/code-text/go.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2024-12-17T10:59:57,276 copying lm_eval/tasks/code_x_glue/code-text/python.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2024-12-17T10:59:57,278 copying lm_eval/tasks/code_x_glue/code-text/ruby.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2024-12-17T10:59:57,280 copying lm_eval/tasks/code_x_glue/code-text/javascript.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2024-12-17T10:59:57,282 copying lm_eval/tasks/code_x_glue/code-text/php.yaml -> build/lib/lm_eval/tasks/code_x_glue/code-text 2024-12-17T10:59:57,284 copying lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml -> build/lib/lm_eval/tasks/realtoxicityprompts 2024-12-17T10:59:57,286 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,288 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,290 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,292 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,295 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,297 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,300 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,304 copying lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,306 copying lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,308 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,311 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,313 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,315 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,317 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,319 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,322 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,324 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,326 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,328 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,330 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,332 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,334 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,336 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,338 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,340 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,343 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,345 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,347 copying lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,350 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,352 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,355 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,357 copying lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,359 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,362 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,364 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,366 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,368 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,370 copying lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,372 copying lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,374 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,376 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,379 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,381 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,383 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,386 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,388 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,391 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,394 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,396 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,398 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,399 copying lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,402 copying lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,404 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,406 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,407 copying lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,410 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,412 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,414 copying lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,416 copying lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,418 copying lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,420 copying lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,422 copying lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T10:59:57,424 creating build/lib/lm_eval/tasks/gsm8k 2024-12-17T10:59:57,426 copying lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml -> build/lib/lm_eval/tasks/gsm8k 2024-12-17T10:59:57,428 copying lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml -> build/lib/lm_eval/tasks/gsm8k 2024-12-17T10:59:57,431 copying lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml -> build/lib/lm_eval/tasks/gsm8k 2024-12-17T10:59:57,434 copying lm_eval/tasks/gsm8k/gsm8k-cot.yaml -> build/lib/lm_eval/tasks/gsm8k 2024-12-17T10:59:57,436 copying lm_eval/tasks/gsm8k/gsm8k.yaml -> build/lib/lm_eval/tasks/gsm8k 2024-12-17T10:59:57,438 creating build/lib/lm_eval/tasks/headqa 2024-12-17T10:59:57,439 copying lm_eval/tasks/headqa/headqa_en.yaml -> build/lib/lm_eval/tasks/headqa 2024-12-17T10:59:57,442 copying lm_eval/tasks/headqa/headqa_es.yaml -> build/lib/lm_eval/tasks/headqa 2024-12-17T10:59:57,445 copying lm_eval/tasks/hendrycks_ethics/justice.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2024-12-17T10:59:57,447 copying lm_eval/tasks/hendrycks_ethics/commonsense.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2024-12-17T10:59:57,451 copying lm_eval/tasks/hendrycks_ethics/virtue.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2024-12-17T10:59:57,455 copying lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2024-12-17T10:59:57,458 copying lm_eval/tasks/hendrycks_ethics/deontology.yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2024-12-17T10:59:57,460 creating build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,461 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,463 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,465 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,468 copying lm_eval/tasks/bertaqa/bertaqa_en.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,470 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,472 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,475 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,477 copying lm_eval/tasks/bertaqa/bertaqa_eu.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,479 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,481 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,483 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,485 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,487 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,491 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,496 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,500 copying lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T10:59:57,504 copying lm_eval/tasks/mutual/mutual.yaml -> build/lib/lm_eval/tasks/mutual 2024-12-17T10:59:57,506 copying lm_eval/tasks/mutual/multual_plus.yaml -> build/lib/lm_eval/tasks/mutual 2024-12-17T10:59:57,508 copying lm_eval/tasks/webqs/webqs.yaml -> build/lib/lm_eval/tasks/webqs 2024-12-17T10:59:57,510 creating build/lib/lm_eval/tasks/alghafa/copa_ar 2024-12-17T10:59:57,512 copying lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml -> build/lib/lm_eval/tasks/alghafa/copa_ar 2024-12-17T10:59:57,514 creating build/lib/lm_eval/tasks/alghafa/piqa_ar 2024-12-17T10:59:57,515 copying lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml -> build/lib/lm_eval/tasks/alghafa/piqa_ar 2024-12-17T10:59:57,518 copying lm_eval/tasks/glianorex/glianorex_en.yaml -> build/lib/lm_eval/tasks/glianorex 2024-12-17T10:59:57,520 copying lm_eval/tasks/glianorex/glianorex_fr.yaml -> build/lib/lm_eval/tasks/glianorex 2024-12-17T10:59:57,522 copying lm_eval/tasks/glianorex/glianorex.yaml -> build/lib/lm_eval/tasks/glianorex 2024-12-17T10:59:57,524 copying lm_eval/tasks/paws-x/paws_ko.yaml -> build/lib/lm_eval/tasks/paws-x 2024-12-17T10:59:57,526 copying lm_eval/tasks/paws-x/paws_en.yaml -> build/lib/lm_eval/tasks/paws-x 2024-12-17T10:59:57,529 copying lm_eval/tasks/paws-x/paws_de.yaml -> build/lib/lm_eval/tasks/paws-x 2024-12-17T10:59:57,531 copying lm_eval/tasks/paws-x/_pawsx.yaml -> build/lib/lm_eval/tasks/paws-x 2024-12-17T10:59:57,533 copying lm_eval/tasks/paws-x/paws_zh.yaml -> build/lib/lm_eval/tasks/paws-x 2024-12-17T10:59:57,536 copying lm_eval/tasks/paws-x/paws_fr.yaml -> build/lib/lm_eval/tasks/paws-x 2024-12-17T10:59:57,540 copying lm_eval/tasks/paws-x/paws_es.yaml -> build/lib/lm_eval/tasks/paws-x 2024-12-17T10:59:57,543 copying lm_eval/tasks/paws-x/paws_ja.yaml -> build/lib/lm_eval/tasks/paws-x 2024-12-17T10:59:57,546 copying lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2024-12-17T10:59:57,548 copying lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2024-12-17T10:59:57,550 copying lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2024-12-17T10:59:57,553 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T10:59:57,556 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T10:59:57,559 copying lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T10:59:57,562 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T10:59:57,564 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T10:59:57,567 copying lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T10:59:57,569 copying lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2024-12-17T10:59:57,571 copying lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2024-12-17T10:59:57,573 copying lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2024-12-17T10:59:57,576 copying lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2024-12-17T10:59:57,578 copying lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2024-12-17T10:59:57,581 copying lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml -> build/lib/lm_eval/tasks/gpqa/generative 2024-12-17T10:59:57,584 creating build/lib/lm_eval/tasks/piqa 2024-12-17T10:59:57,585 copying lm_eval/tasks/piqa/piqa.yaml -> build/lib/lm_eval/tasks/piqa 2024-12-17T10:59:57,587 copying lm_eval/tasks/basqueglue/coref.yaml -> build/lib/lm_eval/tasks/basqueglue 2024-12-17T10:59:57,589 copying lm_eval/tasks/basqueglue/qnli.yaml -> build/lib/lm_eval/tasks/basqueglue 2024-12-17T10:59:57,591 copying lm_eval/tasks/basqueglue/bhtc.yaml -> build/lib/lm_eval/tasks/basqueglue 2024-12-17T10:59:57,594 copying lm_eval/tasks/basqueglue/vaxx.yaml -> build/lib/lm_eval/tasks/basqueglue 2024-12-17T10:59:57,596 copying lm_eval/tasks/basqueglue/wic.yaml -> build/lib/lm_eval/tasks/basqueglue 2024-12-17T10:59:57,599 copying lm_eval/tasks/basqueglue/bec.yaml -> build/lib/lm_eval/tasks/basqueglue 2024-12-17T10:59:57,603 copying lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml -> build/lib/lm_eval/tasks/wmt2016 2024-12-17T10:59:57,605 copying lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,607 copying lm_eval/tasks/french_bench/french_bench_trivia.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,609 copying lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,611 copying lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,614 copying lm_eval/tasks/french_bench/french_bench_fquadv2.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,616 copying lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,618 copying lm_eval/tasks/french_bench/french_bench_grammar.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,620 copying lm_eval/tasks/french_bench/french_bench_hellaswag.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,622 copying lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,624 copying lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,627 copying lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,631 copying lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,634 copying lm_eval/tasks/french_bench/french_bench_reading_comp.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,638 copying lm_eval/tasks/french_bench/french_bench_boolqa.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,640 copying lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,644 copying lm_eval/tasks/french_bench/french_bench_xnli.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,648 copying lm_eval/tasks/french_bench/french_bench_multifquad.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,650 copying lm_eval/tasks/french_bench/french_bench_vocab.yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T10:59:57,655 creating build/lib/lm_eval/tasks/turkishmmlu/config 2024-12-17T10:59:57,656 copying lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2024-12-17T10:59:57,659 copying lm_eval/tasks/turkishmmlu/config/Mathematics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2024-12-17T10:59:57,661 copying lm_eval/tasks/turkishmmlu/config/History.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2024-12-17T10:59:57,664 copying lm_eval/tasks/turkishmmlu/config/Philosophy.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2024-12-17T10:59:57,666 copying lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2024-12-17T10:59:57,668 copying lm_eval/tasks/turkishmmlu/config/Chemistry.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2024-12-17T10:59:57,671 copying lm_eval/tasks/turkishmmlu/config/Geography.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2024-12-17T10:59:57,674 copying lm_eval/tasks/turkishmmlu/config/Physics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2024-12-17T10:59:57,676 copying lm_eval/tasks/turkishmmlu/config/Biology.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2024-12-17T10:59:57,679 creating build/lib/lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T10:59:57,680 copying lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T10:59:57,683 copying lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T10:59:57,686 copying lm_eval/tasks/turkishmmlu/config_cot/History.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T10:59:57,688 copying lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T10:59:57,691 copying lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T10:59:57,694 copying lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T10:59:57,696 copying lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T10:59:57,699 copying lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T10:59:57,702 copying lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T10:59:57,705 copying lm_eval/tasks/eus_reading/eus_reading.yaml -> build/lib/lm_eval/tasks/eus_reading 2024-12-17T10:59:57,707 creating build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T10:59:57,708 copying lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T10:59:57,710 copying lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T10:59:57,713 copying lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T10:59:57,715 copying lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T10:59:57,717 copying lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T10:59:57,721 copying lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T10:59:57,723 copying lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T10:59:57,726 copying lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T10:59:57,728 copying lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T10:59:57,730 copying lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T10:59:57,732 copying lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T10:59:57,734 copying lm_eval/tasks/kobest/kobest_hellaswag.yaml -> build/lib/lm_eval/tasks/kobest 2024-12-17T10:59:57,736 copying lm_eval/tasks/kobest/kobest_wic.yaml -> build/lib/lm_eval/tasks/kobest 2024-12-17T10:59:57,738 copying lm_eval/tasks/kobest/kobest_boolq.yaml -> build/lib/lm_eval/tasks/kobest 2024-12-17T10:59:57,740 copying lm_eval/tasks/kobest/kobest_copa.yaml -> build/lib/lm_eval/tasks/kobest 2024-12-17T10:59:57,742 copying lm_eval/tasks/kobest/kobest_sentineg.yaml -> build/lib/lm_eval/tasks/kobest 2024-12-17T10:59:57,744 copying lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2024-12-17T10:59:57,746 copying lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2024-12-17T10:59:57,748 copying lm_eval/tasks/hendrycks_math/hendrycks_math.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2024-12-17T10:59:57,751 copying lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2024-12-17T10:59:57,753 copying lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2024-12-17T10:59:57,755 copying lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2024-12-17T10:59:57,758 copying lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2024-12-17T10:59:57,760 copying lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml -> build/lib/lm_eval/tasks/hendrycks_math 2024-12-17T10:59:57,764 copying lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml -> build/lib/lm_eval/tasks/truthfulqa 2024-12-17T10:59:57,769 copying lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml -> build/lib/lm_eval/tasks/truthfulqa 2024-12-17T10:59:57,776 copying lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml -> build/lib/lm_eval/tasks/truthfulqa 2024-12-17T10:59:57,778 creating build/lib/lm_eval/tasks/swag 2024-12-17T10:59:57,779 copying lm_eval/tasks/swag/swag.yaml -> build/lib/lm_eval/tasks/swag 2024-12-17T10:59:57,784 copying lm_eval/tasks/toxigen/toxigen.yaml -> build/lib/lm_eval/tasks/toxigen 2024-12-17T10:59:57,787 copying lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,790 copying lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,792 copying lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,794 copying lm_eval/tasks/aclue/aclue_couplet_prediction.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,797 copying lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,800 copying lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,802 copying lm_eval/tasks/aclue/aclue_ancient_medical.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,804 copying lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,806 copying lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,808 copying lm_eval/tasks/aclue/_aclue.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,811 copying lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,813 copying lm_eval/tasks/aclue/aclue_reading_comprehension.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,815 copying lm_eval/tasks/aclue/aclue_ancient_literature.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,817 copying lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,819 copying lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,821 copying lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T10:59:57,823 copying lm_eval/tasks/xquad/xquad_zh.yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:57,825 copying lm_eval/tasks/xquad/xquad_th.yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:57,827 copying lm_eval/tasks/xquad/xquad_ar.yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:57,830 copying lm_eval/tasks/xquad/xquad_tr.yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:57,833 copying lm_eval/tasks/xquad/xquad_ru.yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:57,835 copying lm_eval/tasks/xquad/xquad_vi.yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:57,837 copying lm_eval/tasks/xquad/xquad_es.yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:57,840 copying lm_eval/tasks/xquad/xquad_de.yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:57,842 copying lm_eval/tasks/xquad/xquad_en.yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:57,845 copying lm_eval/tasks/xquad/xquad_ro.yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:57,848 copying lm_eval/tasks/xquad/xquad_hi.yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:57,850 copying lm_eval/tasks/xquad/xquad_el.yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T10:59:57,853 copying lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2024-12-17T10:59:57,855 copying lm_eval/tasks/basque_bench/basque_bench.yaml -> build/lib/lm_eval/tasks/basque_bench 2024-12-17T10:59:57,859 copying lm_eval/tasks/basque_bench/wnli_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2024-12-17T10:59:57,863 copying lm_eval/tasks/basque_bench/xcopa_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2024-12-17T10:59:57,869 copying lm_eval/tasks/basque_bench/mgsm_cot_native_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2024-12-17T10:59:57,873 copying lm_eval/tasks/basque_bench/piqa_eu.yaml -> build/lib/lm_eval/tasks/basque_bench 2024-12-17T10:59:57,876 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,879 copying lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,881 copying lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,884 copying lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,887 copying lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,889 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,892 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,895 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,897 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,900 copying lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,903 copying lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,906 copying lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,908 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,911 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,915 copying lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,918 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,923 copying lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T10:59:57,928 copying lm_eval/tasks/agieval/gaokao-physics.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,931 copying lm_eval/tasks/agieval/gaokao-biology.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,934 copying lm_eval/tasks/agieval/gaokao-english.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,937 copying lm_eval/tasks/agieval/agieval.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,940 copying lm_eval/tasks/agieval/logiqa-zh.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,943 copying lm_eval/tasks/agieval/sat-math.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,946 copying lm_eval/tasks/agieval/agieval_nous.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,950 copying lm_eval/tasks/agieval/lsat-ar.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,955 copying lm_eval/tasks/agieval/gaokao-history.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,961 copying lm_eval/tasks/agieval/sat-en.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,969 copying lm_eval/tasks/agieval/math.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,977 copying lm_eval/tasks/agieval/gaokao-geography.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,979 copying lm_eval/tasks/agieval/gaokao-chemistry.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,982 copying lm_eval/tasks/agieval/gaokao-chinese.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,985 copying lm_eval/tasks/agieval/sat-en-without-passage.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,987 copying lm_eval/tasks/agieval/gaokao-mathqa.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,990 copying lm_eval/tasks/agieval/agieval_en.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,993 copying lm_eval/tasks/agieval/aqua-rat.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,996 copying lm_eval/tasks/agieval/jec-qa-kd.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:57,999 copying lm_eval/tasks/agieval/logiqa-en.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:58,002 copying lm_eval/tasks/agieval/lsat-lr.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:58,006 copying lm_eval/tasks/agieval/lsat-rc.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:58,008 copying lm_eval/tasks/agieval/gaokao-mathcloze.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:58,010 copying lm_eval/tasks/agieval/jec-qa-ca.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:58,013 copying lm_eval/tasks/agieval/agieval_cn.yaml -> build/lib/lm_eval/tasks/agieval 2024-12-17T10:59:58,016 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,019 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,023 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,028 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,033 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,036 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,038 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,042 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,047 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,049 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,051 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,054 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,056 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,060 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,064 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,070 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,078 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,087 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,098 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,112 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,123 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,129 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,131 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,134 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,137 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,140 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,145 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,148 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,152 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,155 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,158 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,162 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,170 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,173 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,177 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,180 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,183 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,186 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,189 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,194 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,198 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,203 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,206 copying lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,210 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,213 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,217 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,222 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,226 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,232 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,237 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,243 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,246 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,249 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,251 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,255 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,259 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,263 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,268 copying lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T10:59:58,270 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,272 copying lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,274 copying lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,277 copying lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,279 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,281 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,283 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,286 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,288 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,290 copying lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,292 copying lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,295 copying lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,297 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,300 copying lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,303 copying lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,305 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,309 copying lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,313 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,315 copying lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,318 copying lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,320 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,323 copying lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,325 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,327 copying lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,329 copying lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,331 copying lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,333 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,335 copying lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,338 copying lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,340 copying lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,342 copying lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,344 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,346 copying lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,348 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,351 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,353 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,355 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,357 copying lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,359 copying lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,362 copying lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,364 copying lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,366 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,368 copying lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,370 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,372 copying lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,375 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,377 copying lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,379 copying lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,381 copying lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,383 copying lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,385 copying lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,387 copying lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,389 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,391 copying lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,393 copying lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,395 copying lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,398 copying lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,400 copying lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T10:59:58,402 copying lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,404 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,406 copying lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,408 copying lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,411 copying lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,413 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,415 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,417 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,419 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,421 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,423 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,426 copying lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,428 copying lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,430 copying lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,432 copying lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,434 copying lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,436 copying lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,438 copying lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,440 copying lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,443 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,445 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,446 copying lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,448 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,450 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,452 copying lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,454 copying lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,457 copying lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,458 copying lm_eval/tasks/mmlusr/question_only/_question_only.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,460 copying lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,462 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,464 copying lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,467 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,469 copying lm_eval/tasks/mmlusr/question_only/question_only_management.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,471 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,474 copying lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,476 copying lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,479 copying lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,481 copying lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,483 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,486 copying lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,488 copying lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,490 copying lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,492 copying lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,494 copying lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,496 copying lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,498 copying lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,500 copying lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,502 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,504 copying lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,506 copying lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,508 copying lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,510 copying lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,512 copying lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,514 copying lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,517 copying lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,519 copying lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,521 copying lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,523 copying lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T10:59:58,526 copying lm_eval/tasks/swde/swde.yaml -> build/lib/lm_eval/tasks/swde 2024-12-17T10:59:58,528 copying lm_eval/tasks/pubmedqa/pubmedqa.yaml -> build/lib/lm_eval/tasks/pubmedqa 2024-12-17T10:59:58,530 copying lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:58,532 copying lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:58,534 copying lm_eval/tasks/tinyBenchmarks/tinyArc.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:58,536 copying lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:58,538 copying lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:58,540 copying lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:58,542 copying lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:58,544 copying lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T10:59:58,546 creating build/lib/lm_eval/tasks/kbl/reasoning 2024-12-17T10:59:58,548 copying lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2024-12-17T10:59:58,550 copying lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2024-12-17T10:59:58,552 copying lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2024-12-17T10:59:58,555 copying lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2024-12-17T10:59:58,557 creating build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,558 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,560 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,562 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,564 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,567 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,568 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,570 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,572 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,575 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,577 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,579 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,581 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,583 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,586 copying lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T10:59:58,588 creating build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,589 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,591 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,593 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,595 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,597 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,599 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,602 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,604 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,606 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,608 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,610 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,612 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,614 copying lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T10:59:58,616 creating build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,617 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,619 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,621 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,623 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,625 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,627 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,629 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,631 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,633 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,635 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,637 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,639 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,641 copying lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T10:59:58,643 creating build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,644 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,646 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,648 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,651 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,653 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,655 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,657 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,659 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,661 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,663 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,665 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,667 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,669 copying lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T10:59:58,671 creating build/lib/lm_eval/tasks/kbl/knowledge 2024-12-17T10:59:58,672 copying lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2024-12-17T10:59:58,674 copying lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2024-12-17T10:59:58,676 copying lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2024-12-17T10:59:58,678 copying lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2024-12-17T10:59:58,680 copying lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2024-12-17T10:59:58,682 copying lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2024-12-17T10:59:58,684 copying lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2024-12-17T10:59:58,686 creating build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,687 copying lm_eval/tasks/pile/pile_pubmed-central.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,689 copying lm_eval/tasks/pile/pile_opensubtitles.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,691 copying lm_eval/tasks/pile/pile_github.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,693 copying lm_eval/tasks/pile/pile_freelaw.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,695 copying lm_eval/tasks/pile/pile_youtubesubtitles.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,697 copying lm_eval/tasks/pile/pile_arxiv.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,699 copying lm_eval/tasks/pile/pile_hackernews.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,701 copying lm_eval/tasks/pile/pile_europarl.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,703 copying lm_eval/tasks/pile/pile_gutenberg.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,705 copying lm_eval/tasks/pile/pile_enron.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,707 copying lm_eval/tasks/pile/pile_philpapers.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,709 copying lm_eval/tasks/pile/pile_ubuntu-irc.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,711 copying lm_eval/tasks/pile/pile_dm-mathematics.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,713 copying lm_eval/tasks/pile/pile_nih-exporter.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,715 copying lm_eval/tasks/pile/pile_stackexchange.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,717 copying lm_eval/tasks/pile/pile_pubmed-abstracts.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,719 copying lm_eval/tasks/pile/pile_bookcorpus2.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,721 copying lm_eval/tasks/pile/pile_wikipedia.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,723 copying lm_eval/tasks/pile/pile_pile-cc.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,725 copying lm_eval/tasks/pile/pile_books3.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,727 copying lm_eval/tasks/pile/pile_uspto.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,729 copying lm_eval/tasks/pile/pile_openwebtext2.yaml -> build/lib/lm_eval/tasks/pile 2024-12-17T10:59:58,732 creating build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,733 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,735 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,737 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,739 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,741 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,743 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,745 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,747 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,749 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,751 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,753 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,755 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,758 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,760 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,762 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,764 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,767 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,769 copying lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T10:59:58,771 creating build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,772 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,775 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,777 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,779 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,781 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,784 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,786 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,788 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,791 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,793 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,795 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,798 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,800 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,802 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,804 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,807 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,809 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,811 copying lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T10:59:58,813 creating build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,814 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_twi.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,816 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_swa.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,818 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_zul.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,820 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_orm.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,823 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_ewe.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,825 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_fra.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,828 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_ibo.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,831 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_eng.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,834 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_yor.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,838 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_xho.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,842 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_kin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,845 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_lin.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,848 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_sna.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,852 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_wol.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,855 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_amh.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,859 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_sot.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,863 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_hau.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,867 copying lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_lug.yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T10:59:58,871 creating build/lib/lm_eval/tasks/model_written_evals/winogenerated 2024-12-17T10:59:58,872 copying lm_eval/tasks/model_written_evals/winogenerated/winogenerated.yaml -> build/lib/lm_eval/tasks/model_written_evals/winogenerated 2024-12-17T10:59:58,876 creating build/lib/lm_eval/tasks/model_written_evals/sycophancy 2024-12-17T10:59:58,878 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2024-12-17T10:59:58,882 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2024-12-17T10:59:58,886 copying lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml -> build/lib/lm_eval/tasks/model_written_evals/sycophancy 2024-12-17T10:59:58,890 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,893 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,896 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,899 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,901 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,903 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,905 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,908 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,910 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,912 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,914 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,916 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,918 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,920 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,922 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,924 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,926 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,928 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,930 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,932 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,934 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,936 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,939 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,941 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,943 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,945 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,947 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,949 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,951 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,953 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,955 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,957 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,959 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,961 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,963 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,965 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,967 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,970 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,972 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,974 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,976 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,978 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,980 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,982 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,984 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,986 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,989 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,991 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,992 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T10:59:58,994 copying lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:58,996 copying lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:58,998 copying lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,000 copying lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,002 copying lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,005 copying lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,007 copying lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,008 copying lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,011 copying lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,013 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,015 copying lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,017 copying lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,019 copying lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,021 copying lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,023 copying lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,026 copying lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,028 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,030 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,032 copying lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,034 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,036 copying lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,039 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,041 copying lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,043 copying lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,045 copying lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,047 copying lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,049 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,051 copying lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,053 copying lm_eval/tasks/model_written_evals/persona/risk-averse.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,055 copying lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,057 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,059 copying lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,061 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,063 copying lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,064 copying lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,066 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,068 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,070 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,072 copying lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,074 copying lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,077 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,079 copying lm_eval/tasks/model_written_evals/persona/extraversion.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,081 copying lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,083 copying lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,085 copying lm_eval/tasks/model_written_evals/persona/self-replication.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,087 copying lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,089 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,091 copying lm_eval/tasks/model_written_evals/persona/openness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,093 copying lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,095 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,097 copying lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,099 copying lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,101 copying lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,103 copying lm_eval/tasks/model_written_evals/persona/neuroticism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,105 copying lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,107 copying lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,109 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,111 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,113 copying lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,114 copying lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,116 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,119 copying lm_eval/tasks/model_written_evals/persona/has-disability.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,121 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,123 copying lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,125 copying lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,127 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,129 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,131 copying lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,134 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,136 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,138 copying lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,140 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,142 copying lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,144 copying lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,146 copying lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,148 copying lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,150 copying lm_eval/tasks/model_written_evals/persona/psychopathy.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,152 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,154 copying lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,156 copying lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,159 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,161 copying lm_eval/tasks/model_written_evals/persona/agreeableness.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,163 copying lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,164 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,166 copying lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,169 copying lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,171 copying lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,173 copying lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,175 copying lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,177 copying lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,179 copying lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,181 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,183 copying lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,185 copying lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,187 copying lm_eval/tasks/model_written_evals/persona/narcissism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,189 copying lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,191 copying lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,194 copying lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,195 copying lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,198 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,200 copying lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,202 copying lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,204 copying lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,206 copying lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,208 copying lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,210 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,212 copying lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,214 copying lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,216 copying lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,218 copying lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,220 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,222 copying lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,224 copying lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,226 copying lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,228 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,230 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,233 copying lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,235 copying lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,237 copying lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,238 copying lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,240 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,242 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,244 copying lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,246 copying lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,248 copying lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,250 copying lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,252 copying lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,254 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,256 copying lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,258 copying lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,260 copying lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,262 copying lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,264 copying lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,266 copying lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,268 copying lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T10:59:59,270 creating build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,271 copying lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,273 copying lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,275 copying lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,278 copying lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,280 copying lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,282 copying lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,284 copying lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,286 copying lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,288 copying lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,290 copying lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,292 copying lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,294 copying lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T10:59:59,296 creating build/lib/lm_eval/tasks/storycloze 2024-12-17T10:59:59,297 copying lm_eval/tasks/storycloze/storycloze_2016.yaml -> build/lib/lm_eval/tasks/storycloze 2024-12-17T10:59:59,299 copying lm_eval/tasks/storycloze/storycloze_2018.yaml -> build/lib/lm_eval/tasks/storycloze 2024-12-17T10:59:59,301 creating build/lib/lm_eval/tasks/commonsense_qa 2024-12-17T10:59:59,302 copying lm_eval/tasks/commonsense_qa/default.yaml -> build/lib/lm_eval/tasks/commonsense_qa 2024-12-17T10:59:59,304 copying lm_eval/tasks/galician_bench/paws_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,306 copying lm_eval/tasks/galician_bench/xnli_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,308 copying lm_eval/tasks/galician_bench/galician_bench.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,310 copying lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,313 copying lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,315 copying lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,317 copying lm_eval/tasks/galician_bench/openbookqa_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,319 copying lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,321 copying lm_eval/tasks/galician_bench/galcola.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,323 copying lm_eval/tasks/galician_bench/summarization_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,325 copying lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,328 copying lm_eval/tasks/galician_bench/xstorycloze_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,330 copying lm_eval/tasks/galician_bench/parafrases_gl.yaml -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T10:59:59,332 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,334 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,336 copying lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,338 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,340 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,342 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,344 copying lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,346 copying lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,349 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,351 copying lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,353 copying lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,355 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,357 copying lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,359 copying lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,360 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,363 copying lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,364 copying lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T10:59:59,366 creating build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,367 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,370 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,373 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,375 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,378 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,380 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,383 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,386 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,389 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,392 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,395 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,397 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,400 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,403 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,406 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,408 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,411 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,414 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,416 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,419 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,422 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,425 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,427 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,430 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,433 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,435 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,438 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,440 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,443 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,445 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,448 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,450 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,453 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,456 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,459 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,461 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,465 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,467 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,470 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,473 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,476 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,478 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,481 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,484 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,487 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,489 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,492 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,494 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,497 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,499 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,502 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,505 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,507 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,510 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,513 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,516 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,519 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,521 copying lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T10:59:59,524 creating build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,525 copying lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,528 copying lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,530 copying lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,532 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,535 copying lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,537 copying lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,540 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,542 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,544 copying lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,547 copying lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,549 copying lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,551 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,553 copying lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,555 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,557 copying lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,559 copying lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,561 copying lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,563 copying lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,566 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,568 copying lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,570 copying lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,572 copying lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,574 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,576 copying lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,578 copying lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,580 copying lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,583 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,585 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,587 copying lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,589 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,591 copying lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,593 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,595 copying lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,597 copying lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,599 copying lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,601 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,603 copying lm_eval/tasks/mmlu/continuation/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,605 copying lm_eval/tasks/mmlu/continuation/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,607 copying lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,609 copying lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,611 copying lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,614 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,616 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,618 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,620 copying lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,622 copying lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,624 copying lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,626 copying lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,629 copying lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,631 copying lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,633 copying lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,635 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,637 copying lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,639 copying lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,641 copying lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,643 copying lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,645 copying lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,647 copying lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T10:59:59,649 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,651 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,653 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,656 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,659 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,662 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,665 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,668 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,671 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,674 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,677 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,679 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,682 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,685 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,688 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,691 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,694 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,697 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,699 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,702 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,705 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,707 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,710 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,712 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,715 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,718 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,721 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,723 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,726 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,728 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,731 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,734 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,736 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,739 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,742 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,745 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,747 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,750 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,753 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,755 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,758 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,760 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,762 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,764 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,766 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,768 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,770 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,772 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,774 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,776 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,778 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,780 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,782 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,784 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,786 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,788 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,790 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,792 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T10:59:59,794 creating build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,795 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,797 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,799 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,802 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,804 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,806 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,808 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,810 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,812 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,814 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,816 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,818 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,821 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,823 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,825 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,826 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,828 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,830 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,832 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,835 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,836 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,839 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,841 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,843 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,846 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,848 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,850 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,852 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,854 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,856 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,858 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,860 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,862 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,864 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,867 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,869 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,871 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,873 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,875 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,877 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,879 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,881 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,883 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,885 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,888 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,890 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,892 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,894 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,896 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,898 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,900 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,902 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,904 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,906 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,908 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,910 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,912 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,914 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T10:59:59,916 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,919 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,921 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,923 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,925 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,928 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,930 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,932 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,934 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,936 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,938 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,940 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,944 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,947 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,949 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,950 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,953 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,955 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,957 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,959 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,961 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,963 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,965 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,967 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,969 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,971 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,973 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,975 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,977 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,980 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,982 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,984 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,986 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,989 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,990 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,992 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,994 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,997 copying lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T10:59:59,999 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,000 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,003 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,005 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,007 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,009 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,011 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,013 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,015 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,017 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,019 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,021 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,023 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,026 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,028 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,030 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,032 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,035 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,037 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,039 copying lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:00,041 creating build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,042 copying lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,044 copying lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,046 copying lm_eval/tasks/mmlu/default/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,048 copying lm_eval/tasks/mmlu/default/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,050 copying lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,052 copying lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,054 copying lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,056 copying lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,058 copying lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,060 copying lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,062 copying lm_eval/tasks/mmlu/default/_mmlu_stem.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,064 copying lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,066 copying lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,068 copying lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,070 copying lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,072 copying lm_eval/tasks/mmlu/default/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,074 copying lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,077 copying lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,079 copying lm_eval/tasks/mmlu/default/_mmlu_other.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,081 copying lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,083 copying lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,085 copying lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,087 copying lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,089 copying lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,091 copying lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,093 copying lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,095 copying lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,097 copying lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,099 copying lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,102 copying lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,104 copying lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,106 copying lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,107 copying lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,110 copying lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,112 copying lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,114 copying lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,116 copying lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,118 copying lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,120 copying lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,122 copying lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,124 copying lm_eval/tasks/mmlu/default/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,127 copying lm_eval/tasks/mmlu/default/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,128 copying lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,130 copying lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,133 copying lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,135 copying lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,137 copying lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,139 copying lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,141 copying lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,143 copying lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,145 copying lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,147 copying lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,149 copying lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,151 copying lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,153 copying lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,155 copying lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,157 copying lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,160 copying lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,162 copying lm_eval/tasks/mmlu/default/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,164 copying lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,166 copying lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,168 copying lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:00,170 creating build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,171 copying lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,173 copying lm_eval/tasks/mmlu/generative/mmlu_virology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,175 copying lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,177 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,179 copying lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,181 copying lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,184 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,186 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,188 copying lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,190 copying lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,192 copying lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,194 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,196 copying lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,198 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,201 copying lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,203 copying lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,205 copying lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,207 copying lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,209 copying lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,211 copying lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,214 copying lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,216 copying lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,218 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,220 copying lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,222 copying lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,225 copying lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,227 copying lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,229 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,231 copying lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,233 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,235 copying lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,237 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,240 copying lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,242 copying lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,244 copying lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,246 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,248 copying lm_eval/tasks/mmlu/generative/mmlu_management.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,250 copying lm_eval/tasks/mmlu/generative/_mmlu.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,252 copying lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,254 copying lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,256 copying lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,259 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,261 copying lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,263 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,266 copying lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,268 copying lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,270 copying lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,272 copying lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,274 copying lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,276 copying lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,278 copying lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,280 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,282 copying lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,284 copying lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,286 copying lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,288 copying lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,291 copying lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,293 copying lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:00,295 creating build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:00,296 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:00,298 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:00,300 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:00,303 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:00,305 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:00,307 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:00,309 copying lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:00,311 copying lm_eval/tasks/hellaswag/hellaswag.yaml -> build/lib/lm_eval/tasks/hellaswag 2024-12-17T11:00:00,313 copying lm_eval/tasks/README.md -> build/lib/lm_eval/tasks 2024-12-17T11:00:00,318 copying lm_eval/tasks/coqa/README.md -> build/lib/lm_eval/tasks/coqa 2024-12-17T11:00:00,321 copying lm_eval/tasks/kormedmcqa/README.md -> build/lib/lm_eval/tasks/kormedmcqa 2024-12-17T11:00:00,323 copying lm_eval/tasks/gsm_plus/README.md -> build/lib/lm_eval/tasks/gsm_plus 2024-12-17T11:00:00,326 copying lm_eval/tasks/lambada/README.md -> build/lib/lm_eval/tasks/lambada 2024-12-17T11:00:00,328 copying lm_eval/tasks/openbookqa/README.md -> build/lib/lm_eval/tasks/openbookqa 2024-12-17T11:00:00,331 copying lm_eval/tasks/bigbench/README.md -> build/lib/lm_eval/tasks/bigbench 2024-12-17T11:00:00,333 copying lm_eval/tasks/bigbench/multiple_choice_template_a_yaml -> build/lib/lm_eval/tasks/bigbench 2024-12-17T11:00:00,335 copying lm_eval/tasks/bigbench/generate_until_template_yaml -> build/lib/lm_eval/tasks/bigbench 2024-12-17T11:00:00,339 copying lm_eval/tasks/bigbench/multiple_choice_template_b_yaml -> build/lib/lm_eval/tasks/bigbench 2024-12-17T11:00:00,340 copying lm_eval/tasks/translation/README.md -> build/lib/lm_eval/tasks/translation 2024-12-17T11:00:00,342 copying lm_eval/tasks/translation/wmt_common_yaml -> build/lib/lm_eval/tasks/translation 2024-12-17T11:00:00,345 copying lm_eval/tasks/mgsm/README.md -> build/lib/lm_eval/tasks/mgsm 2024-12-17T11:00:00,347 copying lm_eval/tasks/mgsm/gen_yaml.sh -> build/lib/lm_eval/tasks/mgsm 2024-12-17T11:00:00,350 copying lm_eval/tasks/mgsm/en_cot/cot_yaml -> build/lib/lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:00,352 copying lm_eval/tasks/mgsm/native_cot/cot_yaml -> build/lib/lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:00,354 copying lm_eval/tasks/mgsm/direct/direct_yaml -> build/lib/lm_eval/tasks/mgsm/direct 2024-12-17T11:00:00,356 copying lm_eval/tasks/japanese_leaderboard/README.md -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:00,360 copying lm_eval/tasks/japanese_leaderboard/requirements.txt -> build/lib/lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:00,364 copying lm_eval/tasks/catalan_bench/README.md -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T11:00:00,367 copying lm_eval/tasks/catalan_bench/_arc_ca_common_yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T11:00:00,369 copying lm_eval/tasks/catalan_bench/_cabreu_common_yaml -> build/lib/lm_eval/tasks/catalan_bench 2024-12-17T11:00:00,371 copying lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml -> build/lib/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:00,375 copying lm_eval/tasks/xstorycloze/README.md -> build/lib/lm_eval/tasks/xstorycloze 2024-12-17T11:00:00,377 copying lm_eval/tasks/nq_open/README.md -> build/lib/lm_eval/tasks/nq_open 2024-12-17T11:00:00,379 copying lm_eval/tasks/haerae/README.md -> build/lib/lm_eval/tasks/haerae 2024-12-17T11:00:00,382 copying lm_eval/tasks/haerae/_default_haerae_yaml -> build/lib/lm_eval/tasks/haerae 2024-12-17T11:00:00,384 copying lm_eval/tasks/squadv2/README.md -> build/lib/lm_eval/tasks/squadv2 2024-12-17T11:00:00,388 copying lm_eval/tasks/logiqa2/README.md -> build/lib/lm_eval/tasks/logiqa2 2024-12-17T11:00:00,391 copying lm_eval/tasks/aexams/README.md -> build/lib/lm_eval/tasks/aexams 2024-12-17T11:00:00,393 copying lm_eval/tasks/aexams/_default_template_yaml -> build/lib/lm_eval/tasks/aexams 2024-12-17T11:00:00,395 copying lm_eval/tasks/squad_completion/README.md -> build/lib/lm_eval/tasks/squad_completion 2024-12-17T11:00:00,398 copying lm_eval/tasks/xnli_eu/README.md -> build/lib/lm_eval/tasks/xnli_eu 2024-12-17T11:00:00,402 copying lm_eval/tasks/xnli_eu/xnli_common_yaml -> build/lib/lm_eval/tasks/xnli_eu 2024-12-17T11:00:00,406 copying lm_eval/tasks/score/README.md -> build/lib/lm_eval/tasks/score 2024-12-17T11:00:00,410 copying lm_eval/tasks/score/NON_GREEDY.md -> build/lib/lm_eval/tasks/score 2024-12-17T11:00:00,412 copying lm_eval/tasks/score/non_greedy.sh -> build/lib/lm_eval/tasks/score 2024-12-17T11:00:00,416 copying lm_eval/tasks/score/agi_eval/prompt_templates.json -> build/lib/lm_eval/tasks/score/agi_eval 2024-12-17T11:00:00,419 copying lm_eval/tasks/score/math/to_be_fixed_questions.json -> build/lib/lm_eval/tasks/score/math 2024-12-17T11:00:00,422 copying lm_eval/tasks/score/math/prompt_templates.json -> build/lib/lm_eval/tasks/score/math 2024-12-17T11:00:00,425 copying lm_eval/tasks/score/mmlu_pro/prompt_templates.json -> build/lib/lm_eval/tasks/score/mmlu_pro 2024-12-17T11:00:00,428 copying lm_eval/tasks/siqa/README.md -> build/lib/lm_eval/tasks/siqa 2024-12-17T11:00:00,430 copying lm_eval/tasks/mathqa/README.md -> build/lib/lm_eval/tasks/mathqa 2024-12-17T11:00:00,433 copying lm_eval/tasks/logiqa/README.md -> build/lib/lm_eval/tasks/logiqa 2024-12-17T11:00:00,436 copying lm_eval/tasks/paloma/README.md -> build/lib/lm_eval/tasks/paloma 2024-12-17T11:00:00,439 copying lm_eval/tasks/paloma/_paloma_template -> build/lib/lm_eval/tasks/paloma 2024-12-17T11:00:00,441 copying lm_eval/tasks/polemo2/README.md -> build/lib/lm_eval/tasks/polemo2 2024-12-17T11:00:00,443 copying lm_eval/tasks/babi/README.md -> build/lib/lm_eval/tasks/babi 2024-12-17T11:00:00,445 copying lm_eval/tasks/asdiv/README.md -> build/lib/lm_eval/tasks/asdiv 2024-12-17T11:00:00,448 copying lm_eval/tasks/kmmlu/README.md -> build/lib/lm_eval/tasks/kmmlu 2024-12-17T11:00:00,450 copying lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:00,452 copying lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:00,454 copying lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:00,456 copying lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml -> build/lib/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:00,458 copying lm_eval/tasks/race/README.md -> build/lib/lm_eval/tasks/race 2024-12-17T11:00:00,462 copying lm_eval/tasks/tmmluplus/README.md -> build/lib/lm_eval/tasks/tmmluplus 2024-12-17T11:00:00,464 copying lm_eval/tasks/tmmluplus/subject.tsv -> build/lib/lm_eval/tasks/tmmluplus 2024-12-17T11:00:00,467 copying lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml -> build/lib/lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:00,470 copying lm_eval/tasks/lingoly/README.md -> build/lib/lm_eval/tasks/lingoly 2024-12-17T11:00:00,474 copying lm_eval/tasks/xwinograd/README.md -> build/lib/lm_eval/tasks/xwinograd 2024-12-17T11:00:00,476 copying lm_eval/tasks/xwinograd/xwinograd_common_yaml -> build/lib/lm_eval/tasks/xwinograd 2024-12-17T11:00:00,480 copying lm_eval/tasks/csatqa/_default_csatqa_yaml -> build/lib/lm_eval/tasks/csatqa 2024-12-17T11:00:00,483 copying lm_eval/tasks/leaderboard/README.md -> build/lib/lm_eval/tasks/leaderboard 2024-12-17T11:00:00,487 copying lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml -> build/lib/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:00,489 copying lm_eval/tasks/leaderboard/math/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/math 2024-12-17T11:00:00,493 copying lm_eval/tasks/leaderboard/musr/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/musr 2024-12-17T11:00:00,501 copying lm_eval/tasks/leaderboard/gpqa/_template_yaml -> build/lib/lm_eval/tasks/leaderboard/gpqa 2024-12-17T11:00:00,505 copying lm_eval/tasks/qa4mre/README.md -> build/lib/lm_eval/tasks/qa4mre 2024-12-17T11:00:00,511 copying lm_eval/tasks/metabench/README.md -> build/lib/lm_eval/tasks/metabench 2024-12-17T11:00:00,540 copying lm_eval/tasks/bbh/README.md -> build/lib/lm_eval/tasks/bbh 2024-12-17T11:00:00,557 copying lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml -> build/lib/lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:00,567 copying lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml -> build/lib/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:00,572 copying lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml -> build/lib/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:00,574 copying lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml -> build/lib/lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:00,577 copying lm_eval/tasks/benchmarks/multimedqa/README.md -> build/lib/lm_eval/tasks/benchmarks/multimedqa 2024-12-17T11:00:00,579 copying lm_eval/tasks/benchmarks/flan/_held_in_template_yaml -> build/lib/lm_eval/tasks/benchmarks/flan 2024-12-17T11:00:00,581 copying lm_eval/tasks/spanish_bench/README.md -> build/lib/lm_eval/tasks/spanish_bench 2024-12-17T11:00:00,585 copying lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml -> build/lib/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:00,588 copying lm_eval/tasks/mela/README.md -> build/lib/lm_eval/tasks/mela 2024-12-17T11:00:00,590 copying lm_eval/tasks/lambada_multilingual/README.md -> build/lib/lm_eval/tasks/lambada_multilingual 2024-12-17T11:00:00,593 copying lm_eval/tasks/lambada_cloze/README.md -> build/lib/lm_eval/tasks/lambada_cloze 2024-12-17T11:00:00,595 copying lm_eval/tasks/eus_proficiency/README.md -> build/lib/lm_eval/tasks/eus_proficiency 2024-12-17T11:00:00,597 copying lm_eval/tasks/unitxt/README.md -> build/lib/lm_eval/tasks/unitxt 2024-12-17T11:00:00,600 copying lm_eval/tasks/unitxt/unitxt_multimodal -> build/lib/lm_eval/tasks/unitxt 2024-12-17T11:00:00,602 copying lm_eval/tasks/unitxt/unitxt -> build/lib/lm_eval/tasks/unitxt 2024-12-17T11:00:00,605 copying lm_eval/tasks/glue/README.md -> build/lib/lm_eval/tasks/glue 2024-12-17T11:00:00,608 copying lm_eval/tasks/okapi/hellaswag_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:00,611 copying lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml -> build/lib/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:00,614 copying lm_eval/tasks/okapi/arc_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:00,616 copying lm_eval/tasks/okapi/arc_multilingual/_arc_yaml -> build/lib/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:00,620 copying lm_eval/tasks/okapi/truthfulqa_multilingual/README.md -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:00,622 copying lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:00,625 copying lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml -> build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:00,628 copying lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml -> build/lib/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:00,632 copying lm_eval/tasks/prost/README.md -> build/lib/lm_eval/tasks/prost 2024-12-17T11:00:00,634 copying lm_eval/tasks/qasper/README.md -> build/lib/lm_eval/tasks/qasper 2024-12-17T11:00:00,639 copying lm_eval/tasks/arabic_leaderboard_complete/README.md -> build/lib/lm_eval/tasks/arabic_leaderboard_complete 2024-12-17T11:00:00,656 copying lm_eval/tasks/eq_bench/README.md -> build/lib/lm_eval/tasks/eq_bench 2024-12-17T11:00:00,661 copying lm_eval/tasks/noticia/README.md -> build/lib/lm_eval/tasks/noticia 2024-12-17T11:00:00,665 copying lm_eval/tasks/wikitext/README.md -> build/lib/lm_eval/tasks/wikitext 2024-12-17T11:00:00,668 copying lm_eval/tasks/wmdp/README.md -> build/lib/lm_eval/tasks/wmdp 2024-12-17T11:00:00,671 copying lm_eval/tasks/wmdp/_default_template_yaml -> build/lib/lm_eval/tasks/wmdp 2024-12-17T11:00:00,673 copying lm_eval/tasks/triviaqa/README.md -> build/lib/lm_eval/tasks/triviaqa 2024-12-17T11:00:00,676 copying lm_eval/tasks/tmlu/README.md -> build/lib/lm_eval/tasks/tmlu 2024-12-17T11:00:00,679 copying lm_eval/tasks/tmlu/subject.tsv -> build/lib/lm_eval/tasks/tmlu 2024-12-17T11:00:00,683 copying lm_eval/tasks/tmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/tmlu/default 2024-12-17T11:00:00,686 copying lm_eval/tasks/pile_10k/README.md -> build/lib/lm_eval/tasks/pile_10k 2024-12-17T11:00:00,688 copying lm_eval/tasks/copal_id/README.md -> build/lib/lm_eval/tasks/copal_id 2024-12-17T11:00:00,691 copying lm_eval/tasks/blimp/README.md -> build/lib/lm_eval/tasks/blimp 2024-12-17T11:00:00,693 copying lm_eval/tasks/blimp/_template_yaml -> build/lib/lm_eval/tasks/blimp 2024-12-17T11:00:00,696 copying lm_eval/tasks/arabicmmlu/README.md -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T11:00:00,699 copying lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml -> build/lib/lm_eval/tasks/arabicmmlu 2024-12-17T11:00:00,703 copying lm_eval/tasks/portuguese_bench/README.md -> build/lib/lm_eval/tasks/portuguese_bench 2024-12-17T11:00:00,706 copying lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml -> build/lib/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:00,708 copying lm_eval/tasks/arc/README.md -> build/lib/lm_eval/tasks/arc 2024-12-17T11:00:00,711 copying lm_eval/tasks/fda/README.md -> build/lib/lm_eval/tasks/fda 2024-12-17T11:00:00,714 copying lm_eval/tasks/afrimmlu/README.md -> build/lib/lm_eval/tasks/afrimmlu 2024-12-17T11:00:00,716 copying lm_eval/tasks/afrimmlu/fewshot.sh -> build/lib/lm_eval/tasks/afrimmlu 2024-12-17T11:00:00,720 copying lm_eval/tasks/afrimmlu/translate/afrimmlu_common_translate_yaml -> build/lib/lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:00,724 copying lm_eval/tasks/afrimmlu/direct/afrimmlu_common_yaml -> build/lib/lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:00,728 copying lm_eval/tasks/arithmetic/README.md -> build/lib/lm_eval/tasks/arithmetic 2024-12-17T11:00:00,730 copying lm_eval/tasks/scrolls/README.md -> build/lib/lm_eval/tasks/scrolls 2024-12-17T11:00:00,734 copying lm_eval/tasks/super_glue/README.md -> build/lib/lm_eval/tasks/super_glue 2024-12-17T11:00:00,743 copying lm_eval/tasks/fld/README.md -> build/lib/lm_eval/tasks/fld 2024-12-17T11:00:00,746 copying lm_eval/tasks/xnli/README.md -> build/lib/lm_eval/tasks/xnli 2024-12-17T11:00:00,749 copying lm_eval/tasks/xnli/xnli_common_yaml -> build/lib/lm_eval/tasks/xnli 2024-12-17T11:00:00,753 copying lm_eval/tasks/mmlu_pro/README.md -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T11:00:00,756 copying lm_eval/tasks/mmlu_pro/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu_pro 2024-12-17T11:00:00,759 copying lm_eval/tasks/mmmu/README.md -> build/lib/lm_eval/tasks/mmmu 2024-12-17T11:00:00,763 copying lm_eval/tasks/mmmu/_template_yaml -> build/lib/lm_eval/tasks/mmmu 2024-12-17T11:00:00,766 copying lm_eval/tasks/eus_trivia/README.md -> build/lib/lm_eval/tasks/eus_trivia 2024-12-17T11:00:00,769 copying lm_eval/tasks/sciq/README.md -> build/lib/lm_eval/tasks/sciq 2024-12-17T11:00:00,773 copying lm_eval/tasks/winogrande/README.md -> build/lib/lm_eval/tasks/winogrande 2024-12-17T11:00:00,776 copying lm_eval/tasks/afrixnli/README.md -> build/lib/lm_eval/tasks/afrixnli 2024-12-17T11:00:00,780 copying lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:00,784 copying lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:00,787 copying lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:00,792 copying lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:00,794 copying lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml -> build/lib/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:00,798 copying lm_eval/tasks/belebele/README.md -> build/lib/lm_eval/tasks/belebele 2024-12-17T11:00:00,801 copying lm_eval/tasks/belebele/_default_template_yaml -> build/lib/lm_eval/tasks/belebele 2024-12-17T11:00:00,804 copying lm_eval/tasks/minerva_math/README.md -> build/lib/lm_eval/tasks/minerva_math 2024-12-17T11:00:00,807 copying lm_eval/tasks/mc_taco/README.md -> build/lib/lm_eval/tasks/mc_taco 2024-12-17T11:00:00,810 copying lm_eval/tasks/wsc273/README.md -> build/lib/lm_eval/tasks/wsc273 2024-12-17T11:00:00,814 copying lm_eval/tasks/cmmlu/README.md -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T11:00:00,818 copying lm_eval/tasks/cmmlu/_default_template_yaml -> build/lib/lm_eval/tasks/cmmlu 2024-12-17T11:00:00,820 copying lm_eval/tasks/med_concepts_qa/README.md -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:00,824 copying lm_eval/tasks/med_concepts_qa/_default_template_yaml -> build/lib/lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:00,827 copying lm_eval/tasks/xcopa/README.md -> build/lib/lm_eval/tasks/xcopa 2024-12-17T11:00:00,836 copying lm_eval/tasks/crows_pairs/README.md -> build/lib/lm_eval/tasks/crows_pairs 2024-12-17T11:00:00,840 copying lm_eval/tasks/unscramble/README.md -> build/lib/lm_eval/tasks/unscramble 2024-12-17T11:00:00,843 copying lm_eval/tasks/anli/README.md -> build/lib/lm_eval/tasks/anli 2024-12-17T11:00:00,846 copying lm_eval/tasks/arabic_leaderboard_light/README.md -> build/lib/lm_eval/tasks/arabic_leaderboard_light 2024-12-17T11:00:00,859 copying lm_eval/tasks/drop/README.md -> build/lib/lm_eval/tasks/drop 2024-12-17T11:00:00,863 copying lm_eval/tasks/ifeval/README.md -> build/lib/lm_eval/tasks/ifeval 2024-12-17T11:00:00,868 copying lm_eval/tasks/ceval/README.md -> build/lib/lm_eval/tasks/ceval 2024-12-17T11:00:00,871 copying lm_eval/tasks/ceval/_default_ceval_yaml -> build/lib/lm_eval/tasks/ceval 2024-12-17T11:00:00,876 copying lm_eval/tasks/eus_exams/README.md -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T11:00:00,878 copying lm_eval/tasks/eus_exams/eus_exams_eu -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T11:00:00,880 copying lm_eval/tasks/eus_exams/eus_exams -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T11:00:00,883 copying lm_eval/tasks/eus_exams/eus_exams_es -> build/lib/lm_eval/tasks/eus_exams 2024-12-17T11:00:00,886 copying lm_eval/tasks/gsm8k/README.md -> build/lib/lm_eval/tasks/gsm8k 2024-12-17T11:00:00,889 copying lm_eval/tasks/headqa/README.md -> build/lib/lm_eval/tasks/headqa 2024-12-17T11:00:00,891 copying lm_eval/tasks/hendrycks_ethics/README.md -> build/lib/lm_eval/tasks/hendrycks_ethics 2024-12-17T11:00:00,894 copying lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml -> build/lib/lm_eval/tasks/hendrycks_ethics 2024-12-17T11:00:00,897 copying lm_eval/tasks/bertaqa/README.md -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T11:00:00,900 copying lm_eval/tasks/bertaqa/_bertaqa_template -> build/lib/lm_eval/tasks/bertaqa 2024-12-17T11:00:00,903 copying lm_eval/tasks/mutual/README.md -> build/lib/lm_eval/tasks/mutual 2024-12-17T11:00:00,906 copying lm_eval/tasks/webqs/README.md -> build/lib/lm_eval/tasks/webqs 2024-12-17T11:00:00,909 copying lm_eval/tasks/alghafa/copa_ar/README.md -> build/lib/lm_eval/tasks/alghafa/copa_ar 2024-12-17T11:00:00,911 copying lm_eval/tasks/alghafa/piqa_ar/README.md -> build/lib/lm_eval/tasks/alghafa/piqa_ar 2024-12-17T11:00:00,914 copying lm_eval/tasks/glianorex/README.md -> build/lib/lm_eval/tasks/glianorex 2024-12-17T11:00:00,918 copying lm_eval/tasks/paws-x/README.md -> build/lib/lm_eval/tasks/paws-x 2024-12-17T11:00:00,921 copying lm_eval/tasks/paws-x/pawsx_template_yaml -> build/lib/lm_eval/tasks/paws-x 2024-12-17T11:00:00,924 copying lm_eval/tasks/gpqa/README.md -> build/lib/lm_eval/tasks/gpqa 2024-12-17T11:00:00,926 copying lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/n_shot 2024-12-17T11:00:00,930 copying lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T11:00:00,933 copying lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml -> build/lib/lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T11:00:00,938 copying lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml -> build/lib/lm_eval/tasks/gpqa/zeroshot 2024-12-17T11:00:00,942 copying lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml -> build/lib/lm_eval/tasks/gpqa/generative 2024-12-17T11:00:00,944 copying lm_eval/tasks/piqa/README.md -> build/lib/lm_eval/tasks/piqa 2024-12-17T11:00:00,947 copying lm_eval/tasks/basqueglue/README.md -> build/lib/lm_eval/tasks/basqueglue 2024-12-17T11:00:00,950 copying lm_eval/tasks/wmt2016/README.md -> build/lib/lm_eval/tasks/wmt2016 2024-12-17T11:00:00,953 copying lm_eval/tasks/french_bench/README.md -> build/lib/lm_eval/tasks/french_bench 2024-12-17T11:00:00,958 copying lm_eval/tasks/french_bench/_default_template_yaml -> build/lib/lm_eval/tasks/french_bench 2024-12-17T11:00:00,962 copying lm_eval/tasks/turkishmmlu/README.md -> build/lib/lm_eval/tasks/turkishmmlu 2024-12-17T11:00:00,965 copying lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml -> build/lib/lm_eval/tasks/turkishmmlu/config 2024-12-17T11:00:00,970 copying lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml -> build/lib/lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T11:00:00,975 copying lm_eval/tasks/eus_reading/README.md -> build/lib/lm_eval/tasks/eus_reading 2024-12-17T11:00:00,978 copying lm_eval/tasks/inverse_scaling/README.md -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T11:00:00,981 copying lm_eval/tasks/inverse_scaling/_some_results -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T11:00:00,983 copying lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml -> build/lib/lm_eval/tasks/inverse_scaling 2024-12-17T11:00:00,986 copying lm_eval/tasks/kobest/README.md -> build/lib/lm_eval/tasks/kobest 2024-12-17T11:00:00,989 copying lm_eval/tasks/hendrycks_math/README.md -> build/lib/lm_eval/tasks/hendrycks_math 2024-12-17T11:00:00,999 copying lm_eval/tasks/truthfulqa/README.md -> build/lib/lm_eval/tasks/truthfulqa 2024-12-17T11:00:01,002 copying lm_eval/tasks/swag/README.md -> build/lib/lm_eval/tasks/swag 2024-12-17T11:00:01,005 copying lm_eval/tasks/toxigen/README.md -> build/lib/lm_eval/tasks/toxigen 2024-12-17T11:00:01,008 copying lm_eval/tasks/aclue/README.md -> build/lib/lm_eval/tasks/aclue 2024-12-17T11:00:01,012 copying lm_eval/tasks/aclue/_default_template_yaml -> build/lib/lm_eval/tasks/aclue 2024-12-17T11:00:01,014 copying lm_eval/tasks/xquad/README.md -> build/lib/lm_eval/tasks/xquad 2024-12-17T11:00:01,017 copying lm_eval/tasks/xquad/xquad_common_yaml -> build/lib/lm_eval/tasks/xquad 2024-12-17T11:00:01,020 copying lm_eval/tasks/basque_bench/README.md -> build/lib/lm_eval/tasks/basque_bench 2024-12-17T11:00:01,023 copying lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml -> build/lib/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:01,026 copying lm_eval/tasks/agieval/README.md -> build/lib/lm_eval/tasks/agieval 2024-12-17T11:00:01,030 copying lm_eval/tasks/mmlusr/README.md -> build/lib/lm_eval/tasks/mmlusr 2024-12-17T11:00:01,033 copying lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml -> build/lib/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:01,036 copying lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml -> build/lib/lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:01,040 copying lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml -> build/lib/lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:01,044 copying lm_eval/tasks/swde/README.md -> build/lib/lm_eval/tasks/swde 2024-12-17T11:00:01,047 copying lm_eval/tasks/pubmedqa/README.md -> build/lib/lm_eval/tasks/pubmedqa 2024-12-17T11:00:01,051 copying lm_eval/tasks/tinyBenchmarks/README.md -> build/lib/lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:01,056 copying lm_eval/tasks/kbl/README.md -> build/lib/lm_eval/tasks/kbl 2024-12-17T11:00:01,059 copying lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml -> build/lib/lm_eval/tasks/kbl/reasoning 2024-12-17T11:00:01,062 copying lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:01,064 copying lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:01,067 copying lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:01,069 copying lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml -> build/lib/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:01,071 copying lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml -> build/lib/lm_eval/tasks/kbl/knowledge 2024-12-17T11:00:01,074 copying lm_eval/tasks/pile/README.md -> build/lib/lm_eval/tasks/pile 2024-12-17T11:00:01,076 copying lm_eval/tasks/afrimgsm/README.md -> build/lib/lm_eval/tasks/afrimgsm 2024-12-17T11:00:01,079 copying lm_eval/tasks/afrimgsm/run.sh -> build/lib/lm_eval/tasks/afrimgsm 2024-12-17T11:00:01,082 copying lm_eval/tasks/afrimgsm/gen_yaml.sh -> build/lib/lm_eval/tasks/afrimgsm 2024-12-17T11:00:01,085 copying lm_eval/tasks/afrimgsm/en_cot/cot_yaml -> build/lib/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:01,087 copying lm_eval/tasks/afrimgsm/translate/translate_direct_yaml -> build/lib/lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:01,090 copying lm_eval/tasks/afrimgsm/direct/direct_yaml -> build/lib/lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:01,092 copying lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml -> build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:01,095 copying lm_eval/tasks/model_written_evals/persona/_template_yaml -> build/lib/lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:01,099 copying lm_eval/tasks/arc_mt/README.md -> build/lib/lm_eval/tasks/arc_mt 2024-12-17T11:00:01,101 copying lm_eval/tasks/storycloze/README.md -> build/lib/lm_eval/tasks/storycloze 2024-12-17T11:00:01,104 copying lm_eval/tasks/commonsense_qa/README.md -> build/lib/lm_eval/tasks/commonsense_qa 2024-12-17T11:00:01,107 copying lm_eval/tasks/galician_bench/README.md -> build/lib/lm_eval/tasks/galician_bench 2024-12-17T11:00:01,112 copying lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml -> build/lib/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:01,114 copying lm_eval/tasks/mmlu/README.md -> build/lib/lm_eval/tasks/mmlu 2024-12-17T11:00:01,118 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:01,120 copying lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json -> build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:01,126 copying lm_eval/tasks/mmlu/continuation/_continuation_template_yaml -> build/lib/lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:01,129 copying lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:01,132 copying lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:01,134 copying lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml -> build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:01,139 copying lm_eval/tasks/mmlu/default/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu/default 2024-12-17T11:00:01,141 copying lm_eval/tasks/mmlu/generative/_default_template_yaml -> build/lib/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:01,143 copying lm_eval/tasks/lambada_multilingual_stablelm/README.md -> build/lib/lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:01,146 copying lm_eval/tasks/hellaswag/README.md -> build/lib/lm_eval/tasks/hellaswag 2024-12-17T11:00:04,102 installing to build/bdist.linux-armv7l/wheel 2024-12-17T11:00:04,102 running install 2024-12-17T11:00:04,127 running install_lib 2024-12-17T11:00:04,133 creating build/bdist.linux-armv7l/wheel 2024-12-17T11:00:04,135 creating build/bdist.linux-armv7l/wheel/lm_eval 2024-12-17T11:00:04,136 copying build/lib/lm_eval/evaluator_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2024-12-17T11:00:04,140 creating build/bdist.linux-armv7l/wheel/lm_eval/api 2024-12-17T11:00:04,141 copying build/lib/lm_eval/api/model.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2024-12-17T11:00:04,144 copying build/lib/lm_eval/api/group.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2024-12-17T11:00:04,146 copying build/lib/lm_eval/api/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2024-12-17T11:00:04,148 copying build/lib/lm_eval/api/instance.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2024-12-17T11:00:04,150 copying build/lib/lm_eval/api/filter.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2024-12-17T11:00:04,152 copying build/lib/lm_eval/api/samplers.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2024-12-17T11:00:04,155 copying build/lib/lm_eval/api/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2024-12-17T11:00:04,158 copying build/lib/lm_eval/api/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2024-12-17T11:00:04,160 copying build/lib/lm_eval/api/registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/api 2024-12-17T11:00:04,162 creating build/bdist.linux-armv7l/wheel/lm_eval/loggers 2024-12-17T11:00:04,164 copying build/lib/lm_eval/loggers/wandb_logger.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2024-12-17T11:00:04,166 copying build/lib/lm_eval/loggers/evaluation_tracker.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2024-12-17T11:00:04,169 copying build/lib/lm_eval/loggers/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2024-12-17T11:00:04,171 copying build/lib/lm_eval/loggers/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/loggers 2024-12-17T11:00:04,175 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks 2024-12-17T11:00:04,177 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medmcqa 2024-12-17T11:00:04,178 copying build/lib/lm_eval/tasks/medmcqa/medmcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medmcqa 2024-12-17T11:00:04,180 copying build/lib/lm_eval/tasks/medmcqa/utils_medmcqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medmcqa 2024-12-17T11:00:04,183 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/coqa 2024-12-17T11:00:04,184 copying build/lib/lm_eval/tasks/coqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2024-12-17T11:00:04,186 copying build/lib/lm_eval/tasks/coqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2024-12-17T11:00:04,188 copying build/lib/lm_eval/tasks/coqa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/coqa 2024-12-17T11:00:04,190 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kormedmcqa 2024-12-17T11:00:04,191 copying build/lib/lm_eval/tasks/kormedmcqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2024-12-17T11:00:04,194 copying build/lib/lm_eval/tasks/kormedmcqa/kormedmcqa_doctor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2024-12-17T11:00:04,196 copying build/lib/lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2024-12-17T11:00:04,198 copying build/lib/lm_eval/tasks/kormedmcqa/kormedmcqa_nurse.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2024-12-17T11:00:04,200 copying build/lib/lm_eval/tasks/kormedmcqa/kormedmcqa_pharm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kormedmcqa 2024-12-17T11:00:04,203 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm_plus 2024-12-17T11:00:04,204 copying build/lib/lm_eval/tasks/gsm_plus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2024-12-17T11:00:04,206 copying build/lib/lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2024-12-17T11:00:04,208 copying build/lib/lm_eval/tasks/gsm_plus/gsm_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm_plus 2024-12-17T11:00:04,210 copying build/lib/lm_eval/tasks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2024-12-17T11:00:04,213 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada 2024-12-17T11:00:04,214 copying build/lib/lm_eval/tasks/lambada/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2024-12-17T11:00:04,216 copying build/lib/lm_eval/tasks/lambada/lambada_openai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2024-12-17T11:00:04,218 copying build/lib/lm_eval/tasks/lambada/lambada_standard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada 2024-12-17T11:00:04,220 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/openbookqa 2024-12-17T11:00:04,221 copying build/lib/lm_eval/tasks/openbookqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openbookqa 2024-12-17T11:00:04,224 copying build/lib/lm_eval/tasks/openbookqa/openbookqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/openbookqa 2024-12-17T11:00:04,226 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench 2024-12-17T11:00:04,227 copying build/lib/lm_eval/tasks/bigbench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2024-12-17T11:00:04,234 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,235 copying build/lib/lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,238 copying build/lib/lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,239 copying build/lib/lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,241 copying build/lib/lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,243 copying build/lib/lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,245 copying build/lib/lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,247 copying build/lib/lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,249 copying build/lib/lm_eval/tasks/bigbench/generate_until/question_selection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,250 copying build/lib/lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,252 copying build/lib/lm_eval/tasks/bigbench/generate_until/crass_ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,254 copying build/lib/lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,256 copying build/lib/lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,258 copying build/lib/lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,260 copying build/lib/lm_eval/tasks/bigbench/generate_until/timedial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,262 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,264 copying build/lib/lm_eval/tasks/bigbench/generate_until/codenames.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,266 copying build/lib/lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,268 copying build/lib/lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,270 copying build/lib/lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,272 copying build/lib/lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,274 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,276 copying build/lib/lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,278 copying build/lib/lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,280 copying build/lib/lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,282 copying build/lib/lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,283 copying build/lib/lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,285 copying build/lib/lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,287 copying build/lib/lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,289 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,291 copying build/lib/lm_eval/tasks/bigbench/generate_until/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,293 copying build/lib/lm_eval/tasks/bigbench/generate_until/code_line_description.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,295 copying build/lib/lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,297 copying build/lib/lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,299 copying build/lib/lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,301 copying build/lib/lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,303 copying build/lib/lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,305 copying build/lib/lm_eval/tasks/bigbench/generate_until/social_support.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,307 copying build/lib/lm_eval/tasks/bigbench/generate_until/implicatures.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,309 copying build/lib/lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,311 copying build/lib/lm_eval/tasks/bigbench/generate_until/color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,312 copying build/lib/lm_eval/tasks/bigbench/generate_until/multiemo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,314 copying build/lib/lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,316 copying build/lib/lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,319 copying build/lib/lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,321 copying build/lib/lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,323 copying build/lib/lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,325 copying build/lib/lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,327 copying build/lib/lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,329 copying build/lib/lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,331 copying build/lib/lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,333 copying build/lib/lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,335 copying build/lib/lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,337 copying build/lib/lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,339 copying build/lib/lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,341 copying build/lib/lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,344 copying build/lib/lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,346 copying build/lib/lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,349 copying build/lib/lm_eval/tasks/bigbench/generate_until/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,352 copying build/lib/lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,354 copying build/lib/lm_eval/tasks/bigbench/generate_until/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,356 copying build/lib/lm_eval/tasks/bigbench/generate_until/social_iqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,358 copying build/lib/lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,360 copying build/lib/lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,362 copying build/lib/lm_eval/tasks/bigbench/generate_until/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,363 copying build/lib/lm_eval/tasks/bigbench/generate_until/arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,366 copying build/lib/lm_eval/tasks/bigbench/generate_until/topical_chat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,367 copying build/lib/lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,369 copying build/lib/lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,371 copying build/lib/lm_eval/tasks/bigbench/generate_until/misconceptions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,373 copying build/lib/lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,375 copying build/lib/lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,377 copying build/lib/lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,379 copying build/lib/lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,381 copying build/lib/lm_eval/tasks/bigbench/generate_until/fact_checker.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,383 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,386 copying build/lib/lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,388 copying build/lib/lm_eval/tasks/bigbench/generate_until/physics_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,390 copying build/lib/lm_eval/tasks/bigbench/generate_until/operators.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,392 copying build/lib/lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,394 copying build/lib/lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,396 copying build/lib/lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,398 copying build/lib/lm_eval/tasks/bigbench/generate_until/language_games.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,400 copying build/lib/lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,402 copying build/lib/lm_eval/tasks/bigbench/generate_until/kannada.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,403 copying build/lib/lm_eval/tasks/bigbench/generate_until/anachronisms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,405 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,407 copying build/lib/lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,410 copying build/lib/lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,412 copying build/lib/lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,414 copying build/lib/lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,416 copying build/lib/lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,418 copying build/lib/lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,420 copying build/lib/lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,422 copying build/lib/lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,424 copying build/lib/lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,426 copying build/lib/lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,432 copying build/lib/lm_eval/tasks/bigbench/generate_until/tense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,441 copying build/lib/lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,444 copying build/lib/lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,447 copying build/lib/lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,449 copying build/lib/lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,451 copying build/lib/lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,453 copying build/lib/lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,455 copying build/lib/lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,457 copying build/lib/lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,459 copying build/lib/lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,462 copying build/lib/lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,464 copying build/lib/lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,466 copying build/lib/lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,468 copying build/lib/lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,476 copying build/lib/lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,478 copying build/lib/lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,480 copying build/lib/lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,483 copying build/lib/lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,485 copying build/lib/lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,487 copying build/lib/lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,489 copying build/lib/lm_eval/tasks/bigbench/generate_until/gem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,491 copying build/lib/lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,493 copying build/lib/lm_eval/tasks/bigbench/generate_until/list_functions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,496 copying build/lib/lm_eval/tasks/bigbench/generate_until/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,498 copying build/lib/lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,500 copying build/lib/lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,502 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_args.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,504 copying build/lib/lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,507 copying build/lib/lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,510 copying build/lib/lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,512 copying build/lib/lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,514 copying build/lib/lm_eval/tasks/bigbench/generate_until/winowhy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,516 copying build/lib/lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,518 copying build/lib/lm_eval/tasks/bigbench/generate_until/cryptonite.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,521 copying build/lib/lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,523 copying build/lib/lm_eval/tasks/bigbench/generate_until/irony_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,525 copying build/lib/lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,528 copying build/lib/lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,530 copying build/lib/lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,532 copying build/lib/lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,535 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,537 copying build/lib/lm_eval/tasks/bigbench/generate_until/language_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,540 copying build/lib/lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,542 copying build/lib/lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,544 copying build/lib/lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,547 copying build/lib/lm_eval/tasks/bigbench/generate_until/physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,549 copying build/lib/lm_eval/tasks/bigbench/generate_until/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,552 copying build/lib/lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,554 copying build/lib/lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,557 copying build/lib/lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,559 copying build/lib/lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,563 copying build/lib/lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,565 copying build/lib/lm_eval/tasks/bigbench/generate_until/strange_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,567 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,570 copying build/lib/lm_eval/tasks/bigbench/generate_until/strategyqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,572 copying build/lib/lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,574 copying build/lib/lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,577 copying build/lib/lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,579 copying build/lib/lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,582 copying build/lib/lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,584 copying build/lib/lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,587 copying build/lib/lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,589 copying build/lib/lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,591 copying build/lib/lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,594 copying build/lib/lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,596 copying build/lib/lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,598 copying build/lib/lm_eval/tasks/bigbench/generate_until/rephrase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,600 copying build/lib/lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,603 copying build/lib/lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,605 copying build/lib/lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,607 copying build/lib/lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/generate_until 2024-12-17T11:00:04,610 copying build/lib/lm_eval/tasks/bigbench/multiple_choice_template_a_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2024-12-17T11:00:04,615 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,616 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,619 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,621 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,623 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,626 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,628 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,630 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,632 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,634 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/timedial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,636 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,639 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,641 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,643 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,646 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,648 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,650 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,652 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,654 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,656 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,659 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,661 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,663 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,666 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,668 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/social_support.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,670 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,673 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,675 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,677 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,679 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,682 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,684 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,686 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,688 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,690 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,693 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,695 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,697 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,699 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,702 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,704 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,706 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,708 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,711 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,713 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,715 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,717 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,720 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,722 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,724 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,727 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,729 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,731 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,733 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,735 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,738 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,740 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,742 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,744 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/kannada.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,746 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,749 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,751 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,754 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,757 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,759 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,761 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,764 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,766 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,768 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,771 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,773 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,776 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,778 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,780 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,783 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,785 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,788 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,790 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,792 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,795 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,798 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,800 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,803 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,806 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,808 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,810 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,812 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,815 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,817 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,819 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,822 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,824 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,827 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,835 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,838 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,840 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,842 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,845 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,847 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,849 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,852 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,854 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,856 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,859 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,861 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,864 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,866 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,868 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,871 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,873 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,875 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,877 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,879 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,881 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,883 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,885 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,888 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,890 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,892 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,895 copying build/lib/lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench/multiple_choice 2024-12-17T11:00:04,897 copying build/lib/lm_eval/tasks/bigbench/generate_until_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2024-12-17T11:00:04,899 copying build/lib/lm_eval/tasks/bigbench/push_bigbench_dataset.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2024-12-17T11:00:04,902 copying build/lib/lm_eval/tasks/bigbench/generate_tasks.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2024-12-17T11:00:04,905 copying build/lib/lm_eval/tasks/bigbench/multiple_choice_template_b_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bigbench 2024-12-17T11:00:04,908 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/translation 2024-12-17T11:00:04,909 copying build/lib/lm_eval/tasks/translation/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2024-12-17T11:00:04,911 copying build/lib/lm_eval/tasks/translation/wmt_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2024-12-17T11:00:04,914 copying build/lib/lm_eval/tasks/translation/wmt14_en-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2024-12-17T11:00:04,916 copying build/lib/lm_eval/tasks/translation/iwslt2017_en-ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2024-12-17T11:00:04,918 copying build/lib/lm_eval/tasks/translation/wmt16_ro-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2024-12-17T11:00:04,921 copying build/lib/lm_eval/tasks/translation/wmt16_en-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2024-12-17T11:00:04,923 copying build/lib/lm_eval/tasks/translation/iwslt2017_ar-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2024-12-17T11:00:04,925 copying build/lib/lm_eval/tasks/translation/wmt14_fr-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2024-12-17T11:00:04,928 copying build/lib/lm_eval/tasks/translation/wmt16_en-ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2024-12-17T11:00:04,930 copying build/lib/lm_eval/tasks/translation/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2024-12-17T11:00:04,933 copying build/lib/lm_eval/tasks/translation/wmt16_de-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/translation 2024-12-17T11:00:04,936 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm 2024-12-17T11:00:04,937 copying build/lib/lm_eval/tasks/mgsm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2024-12-17T11:00:04,940 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,942 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,944 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,946 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,948 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,951 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,953 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,955 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,958 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,960 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,964 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,966 copying build/lib/lm_eval/tasks/mgsm/en_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,968 copying build/lib/lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/en_cot 2024-12-17T11:00:04,971 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:04,972 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:04,974 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:04,976 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:04,979 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:04,981 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:04,983 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:04,985 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:04,987 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:04,989 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:04,991 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:04,994 copying build/lib/lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:04,996 copying build/lib/lm_eval/tasks/mgsm/native_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/native_cot 2024-12-17T11:00:05,000 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,002 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,005 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,007 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,010 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,012 copying build/lib/lm_eval/tasks/mgsm/direct/direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,015 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,018 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,020 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,023 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,026 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,028 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,031 copying build/lib/lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm/direct 2024-12-17T11:00:05,034 copying build/lib/lm_eval/tasks/mgsm/gen_yaml.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2024-12-17T11:00:05,036 copying build/lib/lm_eval/tasks/mgsm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mgsm 2024-12-17T11:00:05,040 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,042 copying build/lib/lm_eval/tasks/japanese_leaderboard/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,045 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,048 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,050 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,053 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,056 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,058 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,061 copying build/lib/lm_eval/tasks/japanese_leaderboard/requirements.txt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,064 copying build/lib/lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,067 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,069 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,072 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,075 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,077 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,080 copying build/lib/lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/japanese_leaderboard 2024-12-17T11:00:05,084 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,085 copying build/lib/lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,088 copying build/lib/lm_eval/tasks/catalan_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,092 copying build/lib/lm_eval/tasks/catalan_bench/parafraseja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,095 copying build/lib/lm_eval/tasks/catalan_bench/siqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,098 copying build/lib/lm_eval/tasks/catalan_bench/arc_ca_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,099 copying build/lib/lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,102 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,104 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,106 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,108 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,110 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,112 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,114 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,116 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,118 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,120 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,123 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,126 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,128 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,130 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,132 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,134 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,137 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,139 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,141 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,143 copying build/lib/lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/flores_ca 2024-12-17T11:00:05,145 copying build/lib/lm_eval/tasks/catalan_bench/_arc_ca_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,147 copying build/lib/lm_eval/tasks/catalan_bench/wnli_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,149 copying build/lib/lm_eval/tasks/catalan_bench/openbookqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,151 copying build/lib/lm_eval/tasks/catalan_bench/catalanqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,154 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/catalan_bench/phrases_va 2024-12-17T11:00:05,155 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2024-12-17T11:00:05,157 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2024-12-17T11:00:05,159 copying build/lib/lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench/phrases_va 2024-12-17T11:00:05,162 copying build/lib/lm_eval/tasks/catalan_bench/catalan_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,164 copying build/lib/lm_eval/tasks/catalan_bench/xnli_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,166 copying build/lib/lm_eval/tasks/catalan_bench/coqcat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,168 copying build/lib/lm_eval/tasks/catalan_bench/_cabreu_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,170 copying build/lib/lm_eval/tasks/catalan_bench/paws_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,172 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,174 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_extractive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,176 copying build/lib/lm_eval/tasks/catalan_bench/xquad_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,178 copying build/lib/lm_eval/tasks/catalan_bench/catcola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,181 copying build/lib/lm_eval/tasks/catalan_bench/cabreu_extreme.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,183 copying build/lib/lm_eval/tasks/catalan_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,185 copying build/lib/lm_eval/tasks/catalan_bench/piqa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,188 copying build/lib/lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,190 copying build/lib/lm_eval/tasks/catalan_bench/copa_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,192 copying build/lib/lm_eval/tasks/catalan_bench/teca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/catalan_bench 2024-12-17T11:00:05,194 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/medqa 2024-12-17T11:00:05,196 copying build/lib/lm_eval/tasks/medqa/medqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medqa 2024-12-17T11:00:05,198 copying build/lib/lm_eval/tasks/medqa/preprocess_medqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/medqa 2024-12-17T11:00:05,202 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,203 copying build/lib/lm_eval/tasks/xstorycloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,206 copying build/lib/lm_eval/tasks/xstorycloze/default_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,208 copying build/lib/lm_eval/tasks/xstorycloze/default_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,210 copying build/lib/lm_eval/tasks/xstorycloze/default_my.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,212 copying build/lib/lm_eval/tasks/xstorycloze/default_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,214 copying build/lib/lm_eval/tasks/xstorycloze/default_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,216 copying build/lib/lm_eval/tasks/xstorycloze/default_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,218 copying build/lib/lm_eval/tasks/xstorycloze/default_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,220 copying build/lib/lm_eval/tasks/xstorycloze/_xstorycloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,222 copying build/lib/lm_eval/tasks/xstorycloze/default_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,224 copying build/lib/lm_eval/tasks/xstorycloze/default_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,226 copying build/lib/lm_eval/tasks/xstorycloze/default_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,228 copying build/lib/lm_eval/tasks/xstorycloze/default_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xstorycloze 2024-12-17T11:00:05,230 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/nq_open 2024-12-17T11:00:05,231 copying build/lib/lm_eval/tasks/nq_open/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nq_open 2024-12-17T11:00:05,233 copying build/lib/lm_eval/tasks/nq_open/nq_open.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/nq_open 2024-12-17T11:00:05,235 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/haerae 2024-12-17T11:00:05,236 copying build/lib/lm_eval/tasks/haerae/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2024-12-17T11:00:05,238 copying build/lib/lm_eval/tasks/haerae/_haerae.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2024-12-17T11:00:05,240 copying build/lib/lm_eval/tasks/haerae/haerae_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2024-12-17T11:00:05,242 copying build/lib/lm_eval/tasks/haerae/haerae_gk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2024-12-17T11:00:05,244 copying build/lib/lm_eval/tasks/haerae/haerae_rw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2024-12-17T11:00:05,246 copying build/lib/lm_eval/tasks/haerae/haerae_sn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2024-12-17T11:00:05,247 copying build/lib/lm_eval/tasks/haerae/haerae_lw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2024-12-17T11:00:05,249 copying build/lib/lm_eval/tasks/haerae/_default_haerae_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/haerae 2024-12-17T11:00:05,251 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/squadv2 2024-12-17T11:00:05,252 copying build/lib/lm_eval/tasks/squadv2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2024-12-17T11:00:05,255 copying build/lib/lm_eval/tasks/squadv2/squadv2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2024-12-17T11:00:05,256 copying build/lib/lm_eval/tasks/squadv2/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squadv2 2024-12-17T11:00:05,259 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/logiqa2 2024-12-17T11:00:05,260 copying build/lib/lm_eval/tasks/logiqa2/logieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2024-12-17T11:00:05,262 copying build/lib/lm_eval/tasks/logiqa2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2024-12-17T11:00:05,264 copying build/lib/lm_eval/tasks/logiqa2/utils_logiqa2.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2024-12-17T11:00:05,266 copying build/lib/lm_eval/tasks/logiqa2/logiqa2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa2 2024-12-17T11:00:05,268 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aexams 2024-12-17T11:00:05,269 copying build/lib/lm_eval/tasks/aexams/aexams_IslamicStudies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2024-12-17T11:00:05,271 copying build/lib/lm_eval/tasks/aexams/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2024-12-17T11:00:05,273 copying build/lib/lm_eval/tasks/aexams/aexams_Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2024-12-17T11:00:05,274 copying build/lib/lm_eval/tasks/aexams/aexams_Science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2024-12-17T11:00:05,276 copying build/lib/lm_eval/tasks/aexams/aexams_Social.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2024-12-17T11:00:05,278 copying build/lib/lm_eval/tasks/aexams/aexams_Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2024-12-17T11:00:05,279 copying build/lib/lm_eval/tasks/aexams/_aexams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2024-12-17T11:00:05,282 copying build/lib/lm_eval/tasks/aexams/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aexams 2024-12-17T11:00:05,284 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/squad_completion 2024-12-17T11:00:05,285 copying build/lib/lm_eval/tasks/squad_completion/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2024-12-17T11:00:05,287 copying build/lib/lm_eval/tasks/squad_completion/squad_completion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2024-12-17T11:00:05,289 copying build/lib/lm_eval/tasks/squad_completion/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/squad_completion 2024-12-17T11:00:05,291 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xnli_eu 2024-12-17T11:00:05,293 copying build/lib/lm_eval/tasks/xnli_eu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2024-12-17T11:00:05,295 copying build/lib/lm_eval/tasks/xnli_eu/xnli_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2024-12-17T11:00:05,296 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu_native.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2024-12-17T11:00:05,298 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2024-12-17T11:00:05,300 copying build/lib/lm_eval/tasks/xnli_eu/xnli_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli_eu 2024-12-17T11:00:05,302 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score 2024-12-17T11:00:05,303 copying build/lib/lm_eval/tasks/score/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2024-12-17T11:00:05,306 copying build/lib/lm_eval/tasks/score/NON_GREEDY.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2024-12-17T11:00:05,308 copying build/lib/lm_eval/tasks/score/non_greedy.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2024-12-17T11:00:05,310 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,311 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,314 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,316 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,318 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,319 copying build/lib/lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,321 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,323 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,325 copying build/lib/lm_eval/tasks/score/agi_eval/utils_agieval.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,327 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,328 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,330 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,332 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,334 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,336 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,338 copying build/lib/lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,339 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,341 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,343 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,345 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,347 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,349 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,351 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,353 copying build/lib/lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,355 copying build/lib/lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,357 copying build/lib/lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,359 copying build/lib/lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,360 copying build/lib/lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/agi_eval 2024-12-17T11:00:05,362 copying build/lib/lm_eval/tasks/score/score_robustness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2024-12-17T11:00:05,365 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/math 2024-12-17T11:00:05,366 copying build/lib/lm_eval/tasks/score/math/score_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,367 copying build/lib/lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,369 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,371 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,373 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,374 copying build/lib/lm_eval/tasks/score/math/to_be_fixed_questions.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,376 copying build/lib/lm_eval/tasks/score/math/score_prompt_robustness_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,378 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,380 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,382 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,384 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,385 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,387 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,389 copying build/lib/lm_eval/tasks/score/math/utils_math.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,391 copying build/lib/lm_eval/tasks/score/math/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,393 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,395 copying build/lib/lm_eval/tasks/score/math/math_grader.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,398 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,400 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,402 copying build/lib/lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,404 copying build/lib/lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/math 2024-12-17T11:00:05,406 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/score/mmlu_pro 2024-12-17T11:00:05,407 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2024-12-17T11:00:05,409 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2024-12-17T11:00:05,411 copying build/lib/lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2024-12-17T11:00:05,413 copying build/lib/lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2024-12-17T11:00:05,415 copying build/lib/lm_eval/tasks/score/mmlu_pro/prompt_templates.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score/mmlu_pro 2024-12-17T11:00:05,418 copying build/lib/lm_eval/tasks/score/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2024-12-17T11:00:05,420 copying build/lib/lm_eval/tasks/score/non_greedy_summarizer.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/score 2024-12-17T11:00:05,422 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/siqa 2024-12-17T11:00:05,424 copying build/lib/lm_eval/tasks/siqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/siqa 2024-12-17T11:00:05,426 copying build/lib/lm_eval/tasks/siqa/siqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/siqa 2024-12-17T11:00:05,428 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mathqa 2024-12-17T11:00:05,429 copying build/lib/lm_eval/tasks/mathqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2024-12-17T11:00:05,432 copying build/lib/lm_eval/tasks/mathqa/mathqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2024-12-17T11:00:05,434 copying build/lib/lm_eval/tasks/mathqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mathqa 2024-12-17T11:00:05,436 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/logiqa 2024-12-17T11:00:05,437 copying build/lib/lm_eval/tasks/logiqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2024-12-17T11:00:05,440 copying build/lib/lm_eval/tasks/logiqa/logiqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2024-12-17T11:00:05,442 copying build/lib/lm_eval/tasks/logiqa/utils_logiqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/logiqa 2024-12-17T11:00:05,444 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/paloma 2024-12-17T11:00:05,445 copying build/lib/lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,447 copying build/lib/lm_eval/tasks/paloma/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,449 copying build/lib/lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,451 copying build/lib/lm_eval/tasks/paloma/paloma_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,453 copying build/lib/lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,454 copying build/lib/lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,456 copying build/lib/lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,458 copying build/lib/lm_eval/tasks/paloma/paloma_redpajama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,460 copying build/lib/lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,461 copying build/lib/lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,463 copying build/lib/lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,465 copying build/lib/lm_eval/tasks/paloma/paloma_c4_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,467 copying build/lib/lm_eval/tasks/paloma/paloma_c4_100_domains.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,469 copying build/lib/lm_eval/tasks/paloma/paloma_gab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,471 copying build/lib/lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,473 copying build/lib/lm_eval/tasks/paloma/paloma_wikitext_103.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,475 copying build/lib/lm_eval/tasks/paloma/_paloma_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,476 copying build/lib/lm_eval/tasks/paloma/paloma_ptb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,479 copying build/lib/lm_eval/tasks/paloma/paloma_mc4.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paloma 2024-12-17T11:00:05,481 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/polemo2 2024-12-17T11:00:05,482 copying build/lib/lm_eval/tasks/polemo2/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2024-12-17T11:00:05,484 copying build/lib/lm_eval/tasks/polemo2/polemo2_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2024-12-17T11:00:05,486 copying build/lib/lm_eval/tasks/polemo2/polemo2_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/polemo2 2024-12-17T11:00:05,488 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/babi 2024-12-17T11:00:05,490 copying build/lib/lm_eval/tasks/babi/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babi 2024-12-17T11:00:05,491 copying build/lib/lm_eval/tasks/babi/babi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/babi 2024-12-17T11:00:05,494 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/asdiv 2024-12-17T11:00:05,495 copying build/lib/lm_eval/tasks/asdiv/asdiv-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2024-12-17T11:00:05,497 copying build/lib/lm_eval/tasks/asdiv/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2024-12-17T11:00:05,499 copying build/lib/lm_eval/tasks/asdiv/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/asdiv 2024-12-17T11:00:05,501 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu 2024-12-17T11:00:05,502 copying build/lib/lm_eval/tasks/kmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu 2024-12-17T11:00:05,505 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,507 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,509 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,511 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,512 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,514 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,516 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,518 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,520 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,522 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,524 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,526 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,527 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,529 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,530 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,532 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,534 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,536 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,537 copying build/lib/lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,539 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,541 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,543 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,545 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,546 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,548 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,550 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,552 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,554 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,555 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,557 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,559 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,561 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,563 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,565 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,567 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,568 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,570 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,572 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,574 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,575 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,577 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,579 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,580 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,582 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,584 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,586 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,587 copying build/lib/lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/hard 2024-12-17T11:00:05,590 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,591 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,593 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,595 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,597 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,599 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,600 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,602 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,604 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,606 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,607 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,609 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,611 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,613 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,614 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,616 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,618 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,619 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,621 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,623 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,624 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,626 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,628 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,629 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,631 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,633 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,635 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,636 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,638 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,640 copying build/lib/lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,642 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,644 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,646 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,647 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,649 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,651 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,653 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,655 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,656 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,658 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,660 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,662 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,663 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,665 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,667 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,668 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,670 copying build/lib/lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct 2024-12-17T11:00:05,673 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,674 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,677 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,679 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,682 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,684 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,687 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,689 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,692 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,694 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,697 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,700 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,703 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,706 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,708 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,710 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,712 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,715 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,717 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,719 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,721 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,724 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,726 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,729 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,731 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,734 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,736 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,738 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,740 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,743 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,746 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,748 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,751 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,753 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,756 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,758 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,760 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,762 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,764 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,767 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,769 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,771 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,774 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,776 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,778 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,780 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,783 copying build/lib/lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/cot_hard 2024-12-17T11:00:05,786 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,787 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,790 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,791 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,793 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,795 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,797 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,799 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,801 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,803 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,806 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,808 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,810 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,812 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,815 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,817 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,819 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,821 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,825 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,827 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,829 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,831 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,834 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,836 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,838 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,840 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,842 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,845 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,847 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,849 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,851 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,854 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,856 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,858 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,860 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,863 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,865 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,867 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,869 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,871 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,874 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,876 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,878 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,880 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,882 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,884 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,887 copying build/lib/lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kmmlu/direct_hard 2024-12-17T11:00:05,890 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/race 2024-12-17T11:00:05,891 copying build/lib/lm_eval/tasks/race/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2024-12-17T11:00:05,894 copying build/lib/lm_eval/tasks/race/preprocess_race.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2024-12-17T11:00:05,896 copying build/lib/lm_eval/tasks/race/race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/race 2024-12-17T11:00:05,899 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmmluplus 2024-12-17T11:00:05,900 copying build/lib/lm_eval/tasks/tmmluplus/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus 2024-12-17T11:00:05,902 copying build/lib/lm_eval/tasks/tmmluplus/subject.tsv -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus 2024-12-17T11:00:05,906 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,907 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,909 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,911 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,913 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,915 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,917 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,919 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,920 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,922 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,924 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,926 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,927 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,929 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,931 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,933 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,935 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,936 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,938 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,940 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,942 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,944 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,946 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,948 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,950 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,952 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,954 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,956 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,957 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,959 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,961 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,963 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,964 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,966 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,968 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,970 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,971 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,973 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,975 copying build/lib/lm_eval/tasks/tmmluplus/default/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,977 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,979 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,981 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,983 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,985 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,987 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,989 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,991 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,993 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,995 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,997 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:05,999 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,001 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,003 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,005 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,007 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,008 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,011 copying build/lib/lm_eval/tasks/tmmluplus/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,012 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,014 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,016 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,018 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,019 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,021 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,023 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,025 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,027 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,029 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,031 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,033 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,035 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,037 copying build/lib/lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,039 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,040 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,042 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,044 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,047 copying build/lib/lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmmluplus/default 2024-12-17T11:00:06,049 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lingoly 2024-12-17T11:00:06,050 copying build/lib/lm_eval/tasks/lingoly/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2024-12-17T11:00:06,052 copying build/lib/lm_eval/tasks/lingoly/lingoly_nocontext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2024-12-17T11:00:06,054 copying build/lib/lm_eval/tasks/lingoly/script.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2024-12-17T11:00:06,056 copying build/lib/lm_eval/tasks/lingoly/lingoly_group.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2024-12-17T11:00:06,058 copying build/lib/lm_eval/tasks/lingoly/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2024-12-17T11:00:06,060 copying build/lib/lm_eval/tasks/lingoly/lingoly_context.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lingoly 2024-12-17T11:00:06,063 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xwinograd 2024-12-17T11:00:06,064 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2024-12-17T11:00:06,066 copying build/lib/lm_eval/tasks/xwinograd/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2024-12-17T11:00:06,068 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2024-12-17T11:00:06,070 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2024-12-17T11:00:06,071 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_jp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2024-12-17T11:00:06,073 copying build/lib/lm_eval/tasks/xwinograd/_xwinograd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2024-12-17T11:00:06,075 copying build/lib/lm_eval/tasks/xwinograd/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2024-12-17T11:00:06,077 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2024-12-17T11:00:06,079 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2024-12-17T11:00:06,081 copying build/lib/lm_eval/tasks/xwinograd/xwinograd_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xwinograd 2024-12-17T11:00:06,083 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/csatqa 2024-12-17T11:00:06,084 copying build/lib/lm_eval/tasks/csatqa/_csatqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2024-12-17T11:00:06,086 copying build/lib/lm_eval/tasks/csatqa/csatqa_li.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2024-12-17T11:00:06,088 copying build/lib/lm_eval/tasks/csatqa/csatqa_rcss.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2024-12-17T11:00:06,090 copying build/lib/lm_eval/tasks/csatqa/csatqa_gr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2024-12-17T11:00:06,091 copying build/lib/lm_eval/tasks/csatqa/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2024-12-17T11:00:06,093 copying build/lib/lm_eval/tasks/csatqa/_default_csatqa_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2024-12-17T11:00:06,095 copying build/lib/lm_eval/tasks/csatqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2024-12-17T11:00:06,097 copying build/lib/lm_eval/tasks/csatqa/csatqa_wr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2024-12-17T11:00:06,099 copying build/lib/lm_eval/tasks/csatqa/csatqa_rch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2024-12-17T11:00:06,101 copying build/lib/lm_eval/tasks/csatqa/csatqa_rcs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/csatqa 2024-12-17T11:00:06,104 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard 2024-12-17T11:00:06,105 copying build/lib/lm_eval/tasks/leaderboard/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard 2024-12-17T11:00:06,109 copying build/lib/lm_eval/tasks/leaderboard/leaderboard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard 2024-12-17T11:00:06,112 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,113 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,116 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,118 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,120 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,122 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,124 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,127 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,129 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,131 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,133 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,135 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,138 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,140 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,145 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,147 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,150 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,152 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,154 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,156 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,158 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,160 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,163 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,165 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,167 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,169 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,171 copying build/lib/lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/bbh_mc 2024-12-17T11:00:06,174 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/math 2024-12-17T11:00:06,175 copying build/lib/lm_eval/tasks/leaderboard/math/math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2024-12-17T11:00:06,178 copying build/lib/lm_eval/tasks/leaderboard/math/math_precalculus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2024-12-17T11:00:06,180 copying build/lib/lm_eval/tasks/leaderboard/math/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2024-12-17T11:00:06,182 copying build/lib/lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2024-12-17T11:00:06,184 copying build/lib/lm_eval/tasks/leaderboard/math/math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2024-12-17T11:00:06,186 copying build/lib/lm_eval/tasks/leaderboard/math/math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2024-12-17T11:00:06,188 copying build/lib/lm_eval/tasks/leaderboard/math/math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2024-12-17T11:00:06,190 copying build/lib/lm_eval/tasks/leaderboard/math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2024-12-17T11:00:06,193 copying build/lib/lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2024-12-17T11:00:06,195 copying build/lib/lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/math 2024-12-17T11:00:06,198 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/musr 2024-12-17T11:00:06,200 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2024-12-17T11:00:06,202 copying build/lib/lm_eval/tasks/leaderboard/musr/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2024-12-17T11:00:06,204 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2024-12-17T11:00:06,206 copying build/lib/lm_eval/tasks/leaderboard/musr/_musr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2024-12-17T11:00:06,208 copying build/lib/lm_eval/tasks/leaderboard/musr/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2024-12-17T11:00:06,211 copying build/lib/lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/musr 2024-12-17T11:00:06,213 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/mmlu_pro 2024-12-17T11:00:06,215 copying build/lib/lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/mmlu_pro 2024-12-17T11:00:06,217 copying build/lib/lm_eval/tasks/leaderboard/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/mmlu_pro 2024-12-17T11:00:06,221 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/ifeval 2024-12-17T11:00:06,222 copying build/lib/lm_eval/tasks/leaderboard/ifeval/ifeval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2024-12-17T11:00:06,224 copying build/lib/lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2024-12-17T11:00:06,226 copying build/lib/lm_eval/tasks/leaderboard/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2024-12-17T11:00:06,228 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2024-12-17T11:00:06,231 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2024-12-17T11:00:06,234 copying build/lib/lm_eval/tasks/leaderboard/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/ifeval 2024-12-17T11:00:06,237 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/leaderboard/gpqa 2024-12-17T11:00:06,238 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2024-12-17T11:00:06,240 copying build/lib/lm_eval/tasks/leaderboard/gpqa/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2024-12-17T11:00:06,241 copying build/lib/lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2024-12-17T11:00:06,243 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2024-12-17T11:00:06,245 copying build/lib/lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2024-12-17T11:00:06,247 copying build/lib/lm_eval/tasks/leaderboard/gpqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/leaderboard/gpqa 2024-12-17T11:00:06,250 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/qa4mre 2024-12-17T11:00:06,251 copying build/lib/lm_eval/tasks/qa4mre/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2024-12-17T11:00:06,253 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2024-12-17T11:00:06,255 copying build/lib/lm_eval/tasks/qa4mre/preprocess_qa4mre.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2024-12-17T11:00:06,256 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2011.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2024-12-17T11:00:06,258 copying build/lib/lm_eval/tasks/qa4mre/qa4mre_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qa4mre 2024-12-17T11:00:06,261 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/metabench 2024-12-17T11:00:06,262 copying build/lib/lm_eval/tasks/metabench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,265 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,267 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,269 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,270 copying build/lib/lm_eval/tasks/metabench/metabench_arc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,272 copying build/lib/lm_eval/tasks/metabench/process_docs_permute.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,275 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,277 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,278 copying build/lib/lm_eval/tasks/metabench/process_docs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,280 copying build/lib/lm_eval/tasks/metabench/metabench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,282 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,284 copying build/lib/lm_eval/tasks/metabench/metabench_arc_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,285 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,287 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,289 copying build/lib/lm_eval/tasks/metabench/metabench_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,290 copying build/lib/lm_eval/tasks/metabench/metabench_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,292 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,294 copying build/lib/lm_eval/tasks/metabench/metabench_gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,296 copying build/lib/lm_eval/tasks/metabench/metabench_arc_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,298 copying build/lib/lm_eval/tasks/metabench/metabench_winogrande_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,308 copying build/lib/lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,314 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,318 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,323 copying build/lib/lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,327 copying build/lib/lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,331 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,336 copying build/lib/lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,340 copying build/lib/lm_eval/tasks/metabench/metabench_secondary_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,344 copying build/lib/lm_eval/tasks/metabench/metabench_mmlu_permute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/metabench 2024-12-17T11:00:06,353 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh 2024-12-17T11:00:06,354 copying build/lib/lm_eval/tasks/bbh/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh 2024-12-17T11:00:06,359 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,360 copying build/lib/lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,368 copying build/lib/lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,373 copying build/lib/lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,376 copying build/lib/lm_eval/tasks/bbh/fewshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,379 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,383 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,386 copying build/lib/lm_eval/tasks/bbh/fewshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,389 copying build/lib/lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,392 copying build/lib/lm_eval/tasks/bbh/fewshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,395 copying build/lib/lm_eval/tasks/bbh/fewshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,398 copying build/lib/lm_eval/tasks/bbh/fewshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,401 copying build/lib/lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,408 copying build/lib/lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,419 copying build/lib/lm_eval/tasks/bbh/fewshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,421 copying build/lib/lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,423 copying build/lib/lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,424 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,426 copying build/lib/lm_eval/tasks/bbh/fewshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,428 copying build/lib/lm_eval/tasks/bbh/fewshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,430 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,432 copying build/lib/lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,434 copying build/lib/lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,436 copying build/lib/lm_eval/tasks/bbh/fewshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,438 copying build/lib/lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,440 copying build/lib/lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,441 copying build/lib/lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,443 copying build/lib/lm_eval/tasks/bbh/fewshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,445 copying build/lib/lm_eval/tasks/bbh/fewshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,447 copying build/lib/lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/fewshot 2024-12-17T11:00:06,450 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,451 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,454 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,456 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,458 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,460 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,462 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,464 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,466 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,468 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,471 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,472 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,474 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,476 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,478 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,481 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,483 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,485 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,487 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,489 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,490 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,493 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,495 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,496 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,499 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,500 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,502 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,504 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,507 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,508 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,510 copying build/lib/lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_fewshot 2024-12-17T11:00:06,512 copying build/lib/lm_eval/tasks/bbh/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh 2024-12-17T11:00:06,515 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,516 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,518 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,520 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,522 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,524 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,526 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,528 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,529 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,532 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,534 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,536 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,538 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,540 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,542 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,544 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,546 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,548 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,550 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,551 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,553 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,555 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,557 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,559 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,561 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,563 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,565 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,567 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,569 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,571 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,572 copying build/lib/lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/cot_zeroshot 2024-12-17T11:00:06,577 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,578 copying build/lib/lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,580 copying build/lib/lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,582 copying build/lib/lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,584 copying build/lib/lm_eval/tasks/bbh/zeroshot/snarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,586 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,587 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,590 copying build/lib/lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,591 copying build/lib/lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,594 copying build/lib/lm_eval/tasks/bbh/zeroshot/object_counting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,596 copying build/lib/lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,598 copying build/lib/lm_eval/tasks/bbh/zeroshot/date_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,599 copying build/lib/lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,601 copying build/lib/lm_eval/tasks/bbh/zeroshot/word_sorting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,603 copying build/lib/lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,605 copying build/lib/lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,607 copying build/lib/lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,610 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,612 copying build/lib/lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,614 copying build/lib/lm_eval/tasks/bbh/zeroshot/navigate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,616 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,618 copying build/lib/lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,621 copying build/lib/lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,624 copying build/lib/lm_eval/tasks/bbh/zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,626 copying build/lib/lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,628 copying build/lib/lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,631 copying build/lib/lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,634 copying build/lib/lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,636 copying build/lib/lm_eval/tasks/bbh/zeroshot/ruin_names.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,639 copying build/lib/lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,641 copying build/lib/lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bbh/zeroshot 2024-12-17T11:00:06,644 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks 2024-12-17T11:00:06,646 copying build/lib/lm_eval/tasks/benchmarks/t0_eval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2024-12-17T11:00:06,649 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks/multimedqa 2024-12-17T11:00:06,650 copying build/lib/lm_eval/tasks/benchmarks/multimedqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/multimedqa 2024-12-17T11:00:06,654 copying build/lib/lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/multimedqa 2024-12-17T11:00:06,657 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/benchmarks/flan 2024-12-17T11:00:06,658 copying build/lib/lm_eval/tasks/benchmarks/flan/flan_held_in.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2024-12-17T11:00:06,662 copying build/lib/lm_eval/tasks/benchmarks/flan/_held_in_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2024-12-17T11:00:06,665 copying build/lib/lm_eval/tasks/benchmarks/flan/flan_held_out.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks/flan 2024-12-17T11:00:06,667 copying build/lib/lm_eval/tasks/benchmarks/minerva_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2024-12-17T11:00:06,670 copying build/lib/lm_eval/tasks/benchmarks/openllm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2024-12-17T11:00:06,672 copying build/lib/lm_eval/tasks/benchmarks/pythia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/benchmarks 2024-12-17T11:00:06,675 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench 2024-12-17T11:00:06,676 copying build/lib/lm_eval/tasks/spanish_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2024-12-17T11:00:06,680 copying build/lib/lm_eval/tasks/spanish_bench/escola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2024-12-17T11:00:06,682 copying build/lib/lm_eval/tasks/spanish_bench/copa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2024-12-17T11:00:06,684 copying build/lib/lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2024-12-17T11:00:06,687 copying build/lib/lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2024-12-17T11:00:06,689 copying build/lib/lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2024-12-17T11:00:06,692 copying build/lib/lm_eval/tasks/spanish_bench/openbookqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2024-12-17T11:00:06,695 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,696 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,699 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,702 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,705 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,707 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,709 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,711 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,713 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,715 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,718 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,720 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,722 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,724 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,726 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,728 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,730 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,732 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,734 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,736 copying build/lib/lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/flores_es 2024-12-17T11:00:06,737 copying build/lib/lm_eval/tasks/spanish_bench/xlsum_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2024-12-17T11:00:06,739 copying build/lib/lm_eval/tasks/spanish_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2024-12-17T11:00:06,742 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/spanish_bench/phrases_es 2024-12-17T11:00:06,743 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2024-12-17T11:00:06,745 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2024-12-17T11:00:06,747 copying build/lib/lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench/phrases_es 2024-12-17T11:00:06,749 copying build/lib/lm_eval/tasks/spanish_bench/wnli_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2024-12-17T11:00:06,751 copying build/lib/lm_eval/tasks/spanish_bench/spanish_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/spanish_bench 2024-12-17T11:00:06,754 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mela 2024-12-17T11:00:06,755 copying build/lib/lm_eval/tasks/mela/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2024-12-17T11:00:06,757 copying build/lib/lm_eval/tasks/mela/mela_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2024-12-17T11:00:06,759 copying build/lib/lm_eval/tasks/mela/mela_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2024-12-17T11:00:06,760 copying build/lib/lm_eval/tasks/mela/mela_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2024-12-17T11:00:06,762 copying build/lib/lm_eval/tasks/mela/mela_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2024-12-17T11:00:06,764 copying build/lib/lm_eval/tasks/mela/_mela.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2024-12-17T11:00:06,766 copying build/lib/lm_eval/tasks/mela/mela_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2024-12-17T11:00:06,768 copying build/lib/lm_eval/tasks/mela/mela_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2024-12-17T11:00:06,770 copying build/lib/lm_eval/tasks/mela/mela_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2024-12-17T11:00:06,772 copying build/lib/lm_eval/tasks/mela/mela_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2024-12-17T11:00:06,774 copying build/lib/lm_eval/tasks/mela/mela_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2024-12-17T11:00:06,776 copying build/lib/lm_eval/tasks/mela/mela_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mela 2024-12-17T11:00:06,778 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_multilingual 2024-12-17T11:00:06,779 copying build/lib/lm_eval/tasks/lambada_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2024-12-17T11:00:06,781 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2024-12-17T11:00:06,783 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2024-12-17T11:00:06,785 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2024-12-17T11:00:06,787 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2024-12-17T11:00:06,789 copying build/lib/lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual 2024-12-17T11:00:06,791 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_cloze 2024-12-17T11:00:06,792 copying build/lib/lm_eval/tasks/lambada_cloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2024-12-17T11:00:06,794 copying build/lib/lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2024-12-17T11:00:06,796 copying build/lib/lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_cloze 2024-12-17T11:00:06,798 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_proficiency 2024-12-17T11:00:06,799 copying build/lib/lm_eval/tasks/eus_proficiency/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_proficiency 2024-12-17T11:00:06,802 copying build/lib/lm_eval/tasks/eus_proficiency/eus_proficiency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_proficiency 2024-12-17T11:00:06,805 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/unitxt 2024-12-17T11:00:06,806 copying build/lib/lm_eval/tasks/unitxt/ledgar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,807 copying build/lib/lm_eval/tasks/unitxt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,810 copying build/lib/lm_eval/tasks/unitxt/stsb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,811 copying build/lib/lm_eval/tasks/unitxt/coedit_gec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,813 copying build/lib/lm_eval/tasks/unitxt/doc_vqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,815 copying build/lib/lm_eval/tasks/unitxt/20_newsgroups.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,817 copying build/lib/lm_eval/tasks/unitxt/dbpedia_14.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,819 copying build/lib/lm_eval/tasks/unitxt/argument_topic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,820 copying build/lib/lm_eval/tasks/unitxt/cnn_dailymail.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,822 copying build/lib/lm_eval/tasks/unitxt/unitxt_multimodal -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,824 copying build/lib/lm_eval/tasks/unitxt/ethos_binary.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,826 copying build/lib/lm_eval/tasks/unitxt/yahoo_answers_topics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,828 copying build/lib/lm_eval/tasks/unitxt/unitxt -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,830 copying build/lib/lm_eval/tasks/unitxt/financial_tweets.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,832 copying build/lib/lm_eval/tasks/unitxt/ag_news.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,834 copying build/lib/lm_eval/tasks/unitxt/unfair_tos.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,835 copying build/lib/lm_eval/tasks/unitxt/banking77.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,837 copying build/lib/lm_eval/tasks/unitxt/atis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,839 copying build/lib/lm_eval/tasks/unitxt/medical_abstracts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,841 copying build/lib/lm_eval/tasks/unitxt/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,843 copying build/lib/lm_eval/tasks/unitxt/law_stack_exchange.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,846 copying build/lib/lm_eval/tasks/unitxt/xsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,848 copying build/lib/lm_eval/tasks/unitxt/claim_stance_topic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unitxt 2024-12-17T11:00:06,851 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue 2024-12-17T11:00:06,852 copying build/lib/lm_eval/tasks/glue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue 2024-12-17T11:00:06,854 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/sst2 2024-12-17T11:00:06,855 copying build/lib/lm_eval/tasks/glue/sst2/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/sst2 2024-12-17T11:00:06,858 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/mrpc 2024-12-17T11:00:06,859 copying build/lib/lm_eval/tasks/glue/mrpc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mrpc 2024-12-17T11:00:06,862 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/qnli 2024-12-17T11:00:06,863 copying build/lib/lm_eval/tasks/glue/qnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/qnli 2024-12-17T11:00:06,866 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/wnli 2024-12-17T11:00:06,867 copying build/lib/lm_eval/tasks/glue/wnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/wnli 2024-12-17T11:00:06,869 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/qqp 2024-12-17T11:00:06,870 copying build/lib/lm_eval/tasks/glue/qqp/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/qqp 2024-12-17T11:00:06,873 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/rte 2024-12-17T11:00:06,874 copying build/lib/lm_eval/tasks/glue/rte/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/rte 2024-12-17T11:00:06,878 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/mnli 2024-12-17T11:00:06,879 copying build/lib/lm_eval/tasks/glue/mnli/mismatch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2024-12-17T11:00:06,882 copying build/lib/lm_eval/tasks/glue/mnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2024-12-17T11:00:06,884 copying build/lib/lm_eval/tasks/glue/mnli/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/mnli 2024-12-17T11:00:06,886 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glue/cola 2024-12-17T11:00:06,887 copying build/lib/lm_eval/tasks/glue/cola/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glue/cola 2024-12-17T11:00:06,890 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi 2024-12-17T11:00:06,892 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,894 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,896 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,898 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,900 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,902 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,904 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,905 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,907 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,909 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,911 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,912 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,915 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,916 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,919 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,920 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,922 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,924 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,926 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,928 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,930 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,932 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,934 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,937 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,939 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,941 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,944 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,946 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,948 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,950 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,953 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,954 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,956 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,958 copying build/lib/lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/hellaswag_multilingual 2024-12-17T11:00:06,961 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,962 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,965 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,967 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,970 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,971 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,973 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,975 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,977 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,979 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,981 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,982 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,984 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,986 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,988 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,990 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,992 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,994 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,995 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,997 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/_arc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:06,999 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,001 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,004 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,006 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,008 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,010 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,012 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,014 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,016 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,017 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,020 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,022 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,024 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,026 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,028 copying build/lib/lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/arc_multilingual 2024-12-17T11:00:07,031 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,032 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,034 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,036 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,038 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,040 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,043 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,045 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,047 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,049 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,052 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,055 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,057 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,059 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,062 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,065 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,067 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,070 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,073 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,076 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,079 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,081 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,084 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,088 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,090 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,298 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,300 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,301 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,303 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,305 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,308 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,310 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,311 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,314 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,315 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,317 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,319 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,321 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,323 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,325 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,327 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,329 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,331 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,333 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,335 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,337 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,339 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,341 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,344 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,345 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,347 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,349 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,350 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,352 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,354 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,356 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,358 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,360 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,362 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,364 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,367 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,368 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,370 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,372 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,374 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,376 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,378 copying build/lib/lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/truthfulqa_multilingual 2024-12-17T11:00:07,381 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,382 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,386 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,388 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,390 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,392 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,394 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,396 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,399 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,401 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,404 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,406 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,409 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,411 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,415 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,418 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,421 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,424 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,426 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,429 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,432 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,435 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,439 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,442 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,445 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,448 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,451 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,454 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,457 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,460 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,463 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,465 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,468 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,471 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,474 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,476 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,479 copying build/lib/lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/okapi/mmlu_multilingual 2024-12-17T11:00:07,482 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/prost 2024-12-17T11:00:07,484 copying build/lib/lm_eval/tasks/prost/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/prost 2024-12-17T11:00:07,487 copying build/lib/lm_eval/tasks/prost/corypaik_prost.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/prost 2024-12-17T11:00:07,491 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/qasper 2024-12-17T11:00:07,493 copying build/lib/lm_eval/tasks/qasper/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2024-12-17T11:00:07,495 copying build/lib/lm_eval/tasks/qasper/bool.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2024-12-17T11:00:07,498 copying build/lib/lm_eval/tasks/qasper/freeform.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2024-12-17T11:00:07,501 copying build/lib/lm_eval/tasks/qasper/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2024-12-17T11:00:07,504 copying build/lib/lm_eval/tasks/qasper/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/qasper 2024-12-17T11:00:07,509 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete 2024-12-17T11:00:07,511 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2024-12-17T11:00:07,512 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2024-12-17T11:00:07,515 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2024-12-17T11:00:07,517 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy 2024-12-17T11:00:07,521 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,522 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,525 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,526 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,529 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,531 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,534 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,536 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,538 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,540 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,543 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,545 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,547 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,549 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,552 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,554 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,556 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,559 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,561 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,564 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,567 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,570 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,572 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,575 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,578 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,580 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,582 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,584 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,586 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,589 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,591 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,595 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,597 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,599 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,602 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,604 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,607 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,611 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,615 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,618 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,622 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,625 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,627 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,630 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,633 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,635 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,638 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,640 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,643 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,645 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,648 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,651 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,653 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,656 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,658 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,661 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,663 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,666 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,668 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,670 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu 2024-12-17T11:00:07,673 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete 2024-12-17T11:00:07,676 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2024-12-17T11:00:07,678 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2024-12-17T11:00:07,680 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2024-12-17T11:00:07,684 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq 2024-12-17T11:00:07,687 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2024-12-17T11:00:07,688 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2024-12-17T11:00:07,691 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2024-12-17T11:00:07,694 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu 2024-12-17T11:00:07,697 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2024-12-17T11:00:07,699 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2024-12-17T11:00:07,702 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2024-12-17T11:00:07,705 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa 2024-12-17T11:00:07,708 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2024-12-17T11:00:07,710 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2024-12-17T11:00:07,713 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2024-12-17T11:00:07,715 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa 2024-12-17T11:00:07,717 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2024-12-17T11:00:07,718 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2024-12-17T11:00:07,720 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2024-12-17T11:00:07,722 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq 2024-12-17T11:00:07,724 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete 2024-12-17T11:00:07,727 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,728 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,731 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,733 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,734 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,737 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,738 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,740 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,743 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,744 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,746 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,748 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,750 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,752 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,754 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,756 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,758 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,760 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,762 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,764 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,766 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,767 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,769 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,771 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,773 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,775 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,777 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,779 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,781 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,782 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,784 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,786 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,788 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,790 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,792 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,794 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,795 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,797 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,799 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,801 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,803 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,805 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,807 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,808 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,811 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,813 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,815 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,817 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,819 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,820 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,823 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,824 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,826 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,828 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,830 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,832 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,834 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,836 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,838 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,840 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,842 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca 2024-12-17T11:00:07,845 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2024-12-17T11:00:07,846 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2024-12-17T11:00:07,848 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2024-12-17T11:00:07,850 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag 2024-12-17T11:00:07,852 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2024-12-17T11:00:07,853 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2024-12-17T11:00:07,855 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2024-12-17T11:00:07,857 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa 2024-12-17T11:00:07,859 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2024-12-17T11:00:07,860 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2024-12-17T11:00:07,863 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2024-12-17T11:00:07,865 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race 2024-12-17T11:00:07,867 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2024-12-17T11:00:07,868 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2024-12-17T11:00:07,872 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2024-12-17T11:00:07,874 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge 2024-12-17T11:00:07,876 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T11:00:07,878 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T11:00:07,880 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T11:00:07,882 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T11:00:07,883 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T11:00:07,885 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T11:00:07,887 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T11:00:07,889 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T11:00:07,891 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T11:00:07,892 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T11:00:07,894 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T11:00:07,896 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa 2024-12-17T11:00:07,899 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2024-12-17T11:00:07,900 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2024-12-17T11:00:07,902 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2024-12-17T11:00:07,905 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams 2024-12-17T11:00:07,908 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2024-12-17T11:00:07,909 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2024-12-17T11:00:07,911 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2024-12-17T11:00:07,914 copying build/lib/lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen 2024-12-17T11:00:07,916 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eq_bench 2024-12-17T11:00:07,917 copying build/lib/lm_eval/tasks/eq_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2024-12-17T11:00:07,920 copying build/lib/lm_eval/tasks/eq_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2024-12-17T11:00:07,922 copying build/lib/lm_eval/tasks/eq_bench/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eq_bench 2024-12-17T11:00:07,925 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/noticia 2024-12-17T11:00:07,926 copying build/lib/lm_eval/tasks/noticia/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2024-12-17T11:00:07,928 copying build/lib/lm_eval/tasks/noticia/noticia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2024-12-17T11:00:07,930 copying build/lib/lm_eval/tasks/noticia/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/noticia 2024-12-17T11:00:07,932 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wikitext 2024-12-17T11:00:07,933 copying build/lib/lm_eval/tasks/wikitext/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2024-12-17T11:00:07,936 copying build/lib/lm_eval/tasks/wikitext/preprocess_wikitext.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2024-12-17T11:00:07,938 copying build/lib/lm_eval/tasks/wikitext/wikitext.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wikitext 2024-12-17T11:00:07,940 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wmdp 2024-12-17T11:00:07,942 copying build/lib/lm_eval/tasks/wmdp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2024-12-17T11:00:07,943 copying build/lib/lm_eval/tasks/wmdp/wmdp_bio.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2024-12-17T11:00:07,945 copying build/lib/lm_eval/tasks/wmdp/wmdp_chem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2024-12-17T11:00:07,947 copying build/lib/lm_eval/tasks/wmdp/wmdp_cyber.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2024-12-17T11:00:07,949 copying build/lib/lm_eval/tasks/wmdp/_wmdp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2024-12-17T11:00:07,951 copying build/lib/lm_eval/tasks/wmdp/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmdp 2024-12-17T11:00:07,953 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/triviaqa 2024-12-17T11:00:07,954 copying build/lib/lm_eval/tasks/triviaqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/triviaqa 2024-12-17T11:00:07,956 copying build/lib/lm_eval/tasks/triviaqa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/triviaqa 2024-12-17T11:00:07,959 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmlu 2024-12-17T11:00:07,960 copying build/lib/lm_eval/tasks/tmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu 2024-12-17T11:00:07,963 copying build/lib/lm_eval/tasks/tmlu/subject.tsv -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu 2024-12-17T11:00:07,965 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,967 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,969 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,971 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,973 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,975 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,977 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,978 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,980 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,982 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,984 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,986 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,988 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,990 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,992 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,993 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,995 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,997 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:07,999 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,001 copying build/lib/lm_eval/tasks/tmlu/default/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,004 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,005 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,007 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,009 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,011 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,013 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,015 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,017 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,019 copying build/lib/lm_eval/tasks/tmlu/default/_tmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,021 copying build/lib/lm_eval/tasks/tmlu/default/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,023 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,024 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,026 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,028 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,030 copying build/lib/lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,032 copying build/lib/lm_eval/tasks/tmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tmlu/default 2024-12-17T11:00:08,034 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pile_10k 2024-12-17T11:00:08,035 copying build/lib/lm_eval/tasks/pile_10k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile_10k 2024-12-17T11:00:08,037 copying build/lib/lm_eval/tasks/pile_10k/pile_10k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile_10k 2024-12-17T11:00:08,040 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/copal_id 2024-12-17T11:00:08,040 copying build/lib/lm_eval/tasks/copal_id/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2024-12-17T11:00:08,043 copying build/lib/lm_eval/tasks/copal_id/colloquial.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2024-12-17T11:00:08,044 copying build/lib/lm_eval/tasks/copal_id/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2024-12-17T11:00:08,046 copying build/lib/lm_eval/tasks/copal_id/standard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/copal_id 2024-12-17T11:00:08,050 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/blimp 2024-12-17T11:00:08,051 copying build/lib/lm_eval/tasks/blimp/causative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,053 copying build/lib/lm_eval/tasks/blimp/adjunct_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,055 copying build/lib/lm_eval/tasks/blimp/left_branch_island_simple_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,057 copying build/lib/lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,059 copying build/lib/lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,061 copying build/lib/lm_eval/tasks/blimp/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,063 copying build/lib/lm_eval/tasks/blimp/principle_A_reconstruction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,065 copying build/lib/lm_eval/tasks/blimp/existential_there_object_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,067 copying build/lib/lm_eval/tasks/blimp/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,069 copying build/lib/lm_eval/tasks/blimp/wh_questions_object_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,073 copying build/lib/lm_eval/tasks/blimp/passive_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,075 copying build/lib/lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,077 copying build/lib/lm_eval/tasks/blimp/existential_there_subject_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,079 copying build/lib/lm_eval/tasks/blimp/only_npi_scope.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,080 copying build/lib/lm_eval/tasks/blimp/principle_A_case_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,082 copying build/lib/lm_eval/tasks/blimp/only_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,084 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,086 copying build/lib/lm_eval/tasks/blimp/left_branch_island_echo_question.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,087 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,089 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,091 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,092 copying build/lib/lm_eval/tasks/blimp/tough_vs_raising_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,094 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,096 copying build/lib/lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,098 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,100 copying build/lib/lm_eval/tasks/blimp/npi_present_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,102 copying build/lib/lm_eval/tasks/blimp/complex_NP_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,103 copying build/lib/lm_eval/tasks/blimp/principle_A_domain_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,105 copying build/lib/lm_eval/tasks/blimp/animate_subject_trans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,106 copying build/lib/lm_eval/tasks/blimp/sentential_subject_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,108 copying build/lib/lm_eval/tasks/blimp/superlative_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,110 copying build/lib/lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,112 copying build/lib/lm_eval/tasks/blimp/drop_argument.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,114 copying build/lib/lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,116 copying build/lib/lm_eval/tasks/blimp/anaphor_number_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,117 copying build/lib/lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,119 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,121 copying build/lib/lm_eval/tasks/blimp/principle_A_c_command.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,123 copying build/lib/lm_eval/tasks/blimp/transitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,128 copying build/lib/lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,130 copying build/lib/lm_eval/tasks/blimp/superlative_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,132 copying build/lib/lm_eval/tasks/blimp/wh_questions_subject_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,135 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,136 copying build/lib/lm_eval/tasks/blimp/tough_vs_raising_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,138 copying build/lib/lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,140 copying build/lib/lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,142 copying build/lib/lm_eval/tasks/blimp/inchoative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,143 copying build/lib/lm_eval/tasks/blimp/wh_island.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,145 copying build/lib/lm_eval/tasks/blimp/passive_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,147 copying build/lib/lm_eval/tasks/blimp/intransitive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,149 copying build/lib/lm_eval/tasks/blimp/expletive_it_object_raising.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,151 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,152 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,154 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,156 copying build/lib/lm_eval/tasks/blimp/generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,158 copying build/lib/lm_eval/tasks/blimp/animate_subject_passive.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,160 copying build/lib/lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,162 copying build/lib/lm_eval/tasks/blimp/principle_A_case_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,164 copying build/lib/lm_eval/tasks/blimp/anaphor_gender_agreement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,166 copying build/lib/lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,168 copying build/lib/lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,170 copying build/lib/lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,172 copying build/lib/lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,174 copying build/lib/lm_eval/tasks/blimp/npi_present_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,176 copying build/lib/lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,178 copying build/lib/lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,180 copying build/lib/lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,182 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,184 copying build/lib/lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,186 copying build/lib/lm_eval/tasks/blimp/_blimp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,188 copying build/lib/lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/blimp 2024-12-17T11:00:08,191 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,192 copying build/lib/lm_eval/tasks/arabicmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,195 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_high_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,197 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,198 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_high_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,200 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_primary_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,202 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_middle_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,204 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_primary_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,205 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_middle_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,207 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_univ_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,209 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_univ_political_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,211 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_high_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,212 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_univ_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,214 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_high_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,218 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_middle_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,221 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,223 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,226 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_primary_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,229 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,232 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_high_civics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,235 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_middle_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,238 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,240 copying build/lib/lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,244 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_middle_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,246 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_primary_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,249 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_primary_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,252 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_high_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,255 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_middle_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,257 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_primary_natural_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,260 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_middle_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,263 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_univ_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,266 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_primary_islamic_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,269 copying build/lib/lm_eval/tasks/arabicmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,272 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_prof_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,275 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,278 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_middle_natural_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,280 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_primary_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,283 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,286 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,289 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_middle_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,292 copying build/lib/lm_eval/tasks/arabicmmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,295 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_high_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,298 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,301 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_high_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,304 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_univ_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,306 copying build/lib/lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,309 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_high_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,312 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_middle_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,315 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_primary_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,318 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,320 copying build/lib/lm_eval/tasks/arabicmmlu/arabicmmlu_high_arabic_language.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabicmmlu 2024-12-17T11:00:08,322 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/portuguese_bench 2024-12-17T11:00:08,323 copying build/lib/lm_eval/tasks/portuguese_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2024-12-17T11:00:08,327 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,328 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,331 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,333 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,335 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,338 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,340 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,342 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,344 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,347 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,349 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,351 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,353 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,356 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,358 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,360 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,362 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,364 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,366 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,369 copying build/lib/lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench/flores_pt 2024-12-17T11:00:08,371 copying build/lib/lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2024-12-17T11:00:08,373 copying build/lib/lm_eval/tasks/portuguese_bench/assin_entailment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2024-12-17T11:00:08,375 copying build/lib/lm_eval/tasks/portuguese_bench/portuguese_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/portuguese_bench 2024-12-17T11:00:08,378 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arc 2024-12-17T11:00:08,379 copying build/lib/lm_eval/tasks/arc/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2024-12-17T11:00:08,382 copying build/lib/lm_eval/tasks/arc/arc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2024-12-17T11:00:08,384 copying build/lib/lm_eval/tasks/arc/arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc 2024-12-17T11:00:08,386 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/fda 2024-12-17T11:00:08,388 copying build/lib/lm_eval/tasks/fda/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2024-12-17T11:00:08,391 copying build/lib/lm_eval/tasks/fda/fda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2024-12-17T11:00:08,393 copying build/lib/lm_eval/tasks/fda/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fda 2024-12-17T11:00:08,395 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu 2024-12-17T11:00:08,397 copying build/lib/lm_eval/tasks/afrimmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2024-12-17T11:00:08,399 copying build/lib/lm_eval/tasks/afrimmlu/fewshot.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2024-12-17T11:00:08,402 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,403 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,406 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,409 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,411 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,413 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,415 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,417 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,419 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,421 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,424 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_common_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,426 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,428 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,430 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,432 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,435 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,436 copying build/lib/lm_eval/tasks/afrimmlu/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,438 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,441 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,443 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,445 copying build/lib/lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/translate 2024-12-17T11:00:08,448 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,449 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,452 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,454 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,456 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,458 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,460 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,462 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,465 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,467 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,469 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,471 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,473 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,475 copying build/lib/lm_eval/tasks/afrimmlu/direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,478 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,480 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,482 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,484 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,486 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,489 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,491 copying build/lib/lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu/direct 2024-12-17T11:00:08,493 copying build/lib/lm_eval/tasks/afrimmlu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimmlu 2024-12-17T11:00:08,495 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arithmetic 2024-12-17T11:00:08,497 copying build/lib/lm_eval/tasks/arithmetic/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2024-12-17T11:00:08,499 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_5ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2024-12-17T11:00:08,501 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_3da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2024-12-17T11:00:08,504 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2024-12-17T11:00:08,506 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_4ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2024-12-17T11:00:08,508 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_1dc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2024-12-17T11:00:08,510 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_4da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2024-12-17T11:00:08,512 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_5da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2024-12-17T11:00:08,514 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2dm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2024-12-17T11:00:08,516 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_2da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2024-12-17T11:00:08,518 copying build/lib/lm_eval/tasks/arithmetic/arithmetic_3ds.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arithmetic 2024-12-17T11:00:08,521 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/scrolls 2024-12-17T11:00:08,522 copying build/lib/lm_eval/tasks/scrolls/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2024-12-17T11:00:08,524 copying build/lib/lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2024-12-17T11:00:08,526 copying build/lib/lm_eval/tasks/scrolls/scrolls_qasper.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2024-12-17T11:00:08,528 copying build/lib/lm_eval/tasks/scrolls/scrolls_contractnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2024-12-17T11:00:08,530 copying build/lib/lm_eval/tasks/scrolls/scrolls_govreport.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2024-12-17T11:00:08,532 copying build/lib/lm_eval/tasks/scrolls/scrolls_quality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2024-12-17T11:00:08,534 copying build/lib/lm_eval/tasks/scrolls/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2024-12-17T11:00:08,537 copying build/lib/lm_eval/tasks/scrolls/scrolls_qmsum.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2024-12-17T11:00:08,539 copying build/lib/lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/scrolls 2024-12-17T11:00:08,542 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue 2024-12-17T11:00:08,544 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/wsc 2024-12-17T11:00:08,546 copying build/lib/lm_eval/tasks/super_glue/wsc/preprocess_wsc.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2024-12-17T11:00:08,548 copying build/lib/lm_eval/tasks/super_glue/wsc/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2024-12-17T11:00:08,550 copying build/lib/lm_eval/tasks/super_glue/wsc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2024-12-17T11:00:08,552 copying build/lib/lm_eval/tasks/super_glue/wsc/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wsc 2024-12-17T11:00:08,554 copying build/lib/lm_eval/tasks/super_glue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue 2024-12-17T11:00:08,558 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/copa 2024-12-17T11:00:08,559 copying build/lib/lm_eval/tasks/super_glue/copa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2024-12-17T11:00:08,561 copying build/lib/lm_eval/tasks/super_glue/copa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2024-12-17T11:00:08,563 copying build/lib/lm_eval/tasks/super_glue/copa/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/copa 2024-12-17T11:00:08,566 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/cb 2024-12-17T11:00:08,567 copying build/lib/lm_eval/tasks/super_glue/cb/aggregate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2024-12-17T11:00:08,570 copying build/lib/lm_eval/tasks/super_glue/cb/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2024-12-17T11:00:08,572 copying build/lib/lm_eval/tasks/super_glue/cb/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2024-12-17T11:00:08,574 copying build/lib/lm_eval/tasks/super_glue/cb/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/cb 2024-12-17T11:00:08,577 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/wic 2024-12-17T11:00:08,578 copying build/lib/lm_eval/tasks/super_glue/wic/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wic 2024-12-17T11:00:08,581 copying build/lib/lm_eval/tasks/super_glue/wic/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/wic 2024-12-17T11:00:08,584 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/rte 2024-12-17T11:00:08,586 copying build/lib/lm_eval/tasks/super_glue/rte/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/rte 2024-12-17T11:00:08,588 copying build/lib/lm_eval/tasks/super_glue/rte/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/rte 2024-12-17T11:00:08,591 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/boolq 2024-12-17T11:00:08,592 copying build/lib/lm_eval/tasks/super_glue/boolq/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2024-12-17T11:00:08,594 copying build/lib/lm_eval/tasks/super_glue/boolq/seq2seq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2024-12-17T11:00:08,596 copying build/lib/lm_eval/tasks/super_glue/boolq/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/boolq 2024-12-17T11:00:08,599 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/record 2024-12-17T11:00:08,600 copying build/lib/lm_eval/tasks/super_glue/record/util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2024-12-17T11:00:08,602 copying build/lib/lm_eval/tasks/super_glue/record/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2024-12-17T11:00:08,604 copying build/lib/lm_eval/tasks/super_glue/record/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2024-12-17T11:00:08,607 copying build/lib/lm_eval/tasks/super_glue/record/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/record 2024-12-17T11:00:08,609 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/super_glue/multirc 2024-12-17T11:00:08,610 copying build/lib/lm_eval/tasks/super_glue/multirc/t5_utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2024-12-17T11:00:08,612 copying build/lib/lm_eval/tasks/super_glue/multirc/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2024-12-17T11:00:08,614 copying build/lib/lm_eval/tasks/super_glue/multirc/t5-prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/super_glue/multirc 2024-12-17T11:00:08,616 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/fld 2024-12-17T11:00:08,617 copying build/lib/lm_eval/tasks/fld/fld_logical_formula_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2024-12-17T11:00:08,619 copying build/lib/lm_eval/tasks/fld/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2024-12-17T11:00:08,622 copying build/lib/lm_eval/tasks/fld/fld_logical_formula_star.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2024-12-17T11:00:08,624 copying build/lib/lm_eval/tasks/fld/fld_default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2024-12-17T11:00:08,625 copying build/lib/lm_eval/tasks/fld/fld_star.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/fld 2024-12-17T11:00:08,628 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xnli 2024-12-17T11:00:08,629 copying build/lib/lm_eval/tasks/xnli/xnli_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,631 copying build/lib/lm_eval/tasks/xnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,633 copying build/lib/lm_eval/tasks/xnli/xnli_ur.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,635 copying build/lib/lm_eval/tasks/xnli/xnli_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,636 copying build/lib/lm_eval/tasks/xnli/xnli_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,640 copying build/lib/lm_eval/tasks/xnli/xnli_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,642 copying build/lib/lm_eval/tasks/xnli/xnli_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,644 copying build/lib/lm_eval/tasks/xnli/xnli_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,646 copying build/lib/lm_eval/tasks/xnli/xnli_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,647 copying build/lib/lm_eval/tasks/xnli/xnli_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,649 copying build/lib/lm_eval/tasks/xnli/xnli_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,651 copying build/lib/lm_eval/tasks/xnli/xnli_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,653 copying build/lib/lm_eval/tasks/xnli/xnli_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,655 copying build/lib/lm_eval/tasks/xnli/xnli_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,656 copying build/lib/lm_eval/tasks/xnli/_xnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,658 copying build/lib/lm_eval/tasks/xnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,661 copying build/lib/lm_eval/tasks/xnli/xnli_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,662 copying build/lib/lm_eval/tasks/xnli/xnli_bg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,664 copying build/lib/lm_eval/tasks/xnli/xnli_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xnli 2024-12-17T11:00:08,667 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,668 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,670 copying build/lib/lm_eval/tasks/mmlu_pro/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,672 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,673 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,675 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,677 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,678 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,680 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,682 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,684 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,686 copying build/lib/lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,687 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,689 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,691 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,693 copying build/lib/lm_eval/tasks/mmlu_pro/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,694 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,696 copying build/lib/lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,698 copying build/lib/lm_eval/tasks/mmlu_pro/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu_pro 2024-12-17T11:00:08,701 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmmu 2024-12-17T11:00:08,702 copying build/lib/lm_eval/tasks/mmmu/_business.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,704 copying build/lib/lm_eval/tasks/mmmu/mmmu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,706 copying build/lib/lm_eval/tasks/mmmu/_art_and_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,708 copying build/lib/lm_eval/tasks/mmmu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,710 copying build/lib/lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,712 copying build/lib/lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,714 copying build/lib/lm_eval/tasks/mmmu/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,715 copying build/lib/lm_eval/tasks/mmmu/mmmu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,717 copying build/lib/lm_eval/tasks/mmmu/_tech_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,719 copying build/lib/lm_eval/tasks/mmmu/mmmu_materials.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,721 copying build/lib/lm_eval/tasks/mmmu/mmmu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,723 copying build/lib/lm_eval/tasks/mmmu/mmmu_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,725 copying build/lib/lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,727 copying build/lib/lm_eval/tasks/mmmu/mmmu_manage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,728 copying build/lib/lm_eval/tasks/mmmu/mmmu_design.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,730 copying build/lib/lm_eval/tasks/mmmu/mmmu_art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,731 copying build/lib/lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,733 copying build/lib/lm_eval/tasks/mmmu/mmmu_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,735 copying build/lib/lm_eval/tasks/mmmu/mmmu_music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,736 copying build/lib/lm_eval/tasks/mmmu/_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,738 copying build/lib/lm_eval/tasks/mmmu/mmmu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,740 copying build/lib/lm_eval/tasks/mmmu/mmmu_agriculture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,742 copying build/lib/lm_eval/tasks/mmmu/mmmu_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,744 copying build/lib/lm_eval/tasks/mmmu/mmmu_public_health.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,746 copying build/lib/lm_eval/tasks/mmmu/mmmu_electronics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,747 copying build/lib/lm_eval/tasks/mmmu/mmmu_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,749 copying build/lib/lm_eval/tasks/mmmu/_mmmu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,751 copying build/lib/lm_eval/tasks/mmmu/mmmu_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,753 copying build/lib/lm_eval/tasks/mmmu/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,756 copying build/lib/lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,758 copying build/lib/lm_eval/tasks/mmmu/mmmu_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,759 copying build/lib/lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,761 copying build/lib/lm_eval/tasks/mmmu/mmmu_art_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,763 copying build/lib/lm_eval/tasks/mmmu/mmmu_finance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,765 copying build/lib/lm_eval/tasks/mmmu/mmmu_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,767 copying build/lib/lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,768 copying build/lib/lm_eval/tasks/mmmu/mmmu_pharmacy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,770 copying build/lib/lm_eval/tasks/mmmu/_health_and_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,772 copying build/lib/lm_eval/tasks/mmmu/mmmu_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,774 copying build/lib/lm_eval/tasks/mmmu/mmmu_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmmu 2024-12-17T11:00:08,776 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_trivia 2024-12-17T11:00:08,777 copying build/lib/lm_eval/tasks/eus_trivia/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2024-12-17T11:00:08,779 copying build/lib/lm_eval/tasks/eus_trivia/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2024-12-17T11:00:08,781 copying build/lib/lm_eval/tasks/eus_trivia/eus_trivia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_trivia 2024-12-17T11:00:08,783 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/sciq 2024-12-17T11:00:08,784 copying build/lib/lm_eval/tasks/sciq/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/sciq 2024-12-17T11:00:08,786 copying build/lib/lm_eval/tasks/sciq/sciq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/sciq 2024-12-17T11:00:08,788 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/winogrande 2024-12-17T11:00:08,789 copying build/lib/lm_eval/tasks/winogrande/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2024-12-17T11:00:08,791 copying build/lib/lm_eval/tasks/winogrande/preprocess_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2024-12-17T11:00:08,793 copying build/lib/lm_eval/tasks/winogrande/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/winogrande 2024-12-17T11:00:08,795 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli 2024-12-17T11:00:08,796 copying build/lib/lm_eval/tasks/afrixnli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2024-12-17T11:00:08,799 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt 2024-12-17T11:00:08,801 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,802 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,804 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,806 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,808 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,810 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,812 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,814 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,815 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,818 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,819 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,821 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,823 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,825 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,827 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,828 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,836 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,837 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,839 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,841 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,843 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/native-direct 2024-12-17T11:00:08,845 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,847 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,849 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,851 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,853 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,855 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,857 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,858 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,860 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,862 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,864 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,866 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,868 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,870 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,871 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,873 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,875 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,877 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,879 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,880 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/translate 2024-12-17T11:00:08,883 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,885 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,886 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,888 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,890 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,892 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,894 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,896 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,898 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,900 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,901 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,903 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,905 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,907 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,909 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,911 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,912 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,914 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,916 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,918 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,919 copying build/lib/lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/anli prompt/en-direct 2024-12-17T11:00:08,921 copying build/lib/lm_eval/tasks/afrixnli/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli 2024-12-17T11:00:08,924 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt 2024-12-17T11:00:08,926 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,927 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,929 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,931 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,933 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,935 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,937 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,939 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,941 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,942 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,944 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,946 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,948 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,949 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,951 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,953 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,954 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,956 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,958 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,960 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/translate 2024-12-17T11:00:08,962 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,963 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,965 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,967 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,969 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,971 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,973 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,975 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,976 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,979 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,981 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,982 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,984 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,986 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,987 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,989 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,990 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,992 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,994 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,996 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:08,998 copying build/lib/lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrixnli/lai prompt/direct 2024-12-17T11:00:09,002 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/belebele 2024-12-17T11:00:09,003 copying build/lib/lm_eval/tasks/belebele/belebele_xho_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,005 copying build/lib/lm_eval/tasks/belebele/belebele_kor_Hang.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,006 copying build/lib/lm_eval/tasks/belebele/belebele_spa_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,008 copying build/lib/lm_eval/tasks/belebele/belebele_ita_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,010 copying build/lib/lm_eval/tasks/belebele/belebele_luo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,012 copying build/lib/lm_eval/tasks/belebele/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,014 copying build/lib/lm_eval/tasks/belebele/belebele_ssw_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,016 copying build/lib/lm_eval/tasks/belebele/belebele_grn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,018 copying build/lib/lm_eval/tasks/belebele/belebele_kin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,020 copying build/lib/lm_eval/tasks/belebele/belebele_urd_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,022 copying build/lib/lm_eval/tasks/belebele/belebele_swe_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,024 copying build/lib/lm_eval/tasks/belebele/belebele_amh_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,026 copying build/lib/lm_eval/tasks/belebele/belebele_lao_Laoo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,028 copying build/lib/lm_eval/tasks/belebele/belebele_lug_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,031 copying build/lib/lm_eval/tasks/belebele/belebele_nya_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,033 copying build/lib/lm_eval/tasks/belebele/belebele_npi_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,035 copying build/lib/lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,038 copying build/lib/lm_eval/tasks/belebele/belebele_war_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,039 copying build/lib/lm_eval/tasks/belebele/belebele_shn_Mymr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,042 copying build/lib/lm_eval/tasks/belebele/belebele_gaz_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,044 copying build/lib/lm_eval/tasks/belebele/belebele_ell_Grek.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,046 copying build/lib/lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,048 copying build/lib/lm_eval/tasks/belebele/belebele_hrv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,051 copying build/lib/lm_eval/tasks/belebele/belebele_isl_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,053 copying build/lib/lm_eval/tasks/belebele/belebele_ilo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,055 copying build/lib/lm_eval/tasks/belebele/belebele_kea_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,058 copying build/lib/lm_eval/tasks/belebele/belebele_bod_Tibt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,060 copying build/lib/lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,062 copying build/lib/lm_eval/tasks/belebele/belebele_deu_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,064 copying build/lib/lm_eval/tasks/belebele/belebele_cat_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,067 copying build/lib/lm_eval/tasks/belebele/belebele_lin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,069 copying build/lib/lm_eval/tasks/belebele/belebele_jav_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,071 copying build/lib/lm_eval/tasks/belebele/belebele_heb_Hebr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,074 copying build/lib/lm_eval/tasks/belebele/belebele_slk_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,076 copying build/lib/lm_eval/tasks/belebele/belebele_hye_Armn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,078 copying build/lib/lm_eval/tasks/belebele/belebele_guj_Gujr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,081 copying build/lib/lm_eval/tasks/belebele/belebele_arz_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,083 copying build/lib/lm_eval/tasks/belebele/belebele_zsm_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,085 copying build/lib/lm_eval/tasks/belebele/belebele_pbt_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,087 copying build/lib/lm_eval/tasks/belebele/belebele_hin_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,090 copying build/lib/lm_eval/tasks/belebele/belebele_ary_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,092 copying build/lib/lm_eval/tasks/belebele/belebele_kan_Knda.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,094 copying build/lib/lm_eval/tasks/belebele/belebele_azj_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,096 copying build/lib/lm_eval/tasks/belebele/belebele_sun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,098 copying build/lib/lm_eval/tasks/belebele/belebele_tgl_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,100 copying build/lib/lm_eval/tasks/belebele/belebele_sot_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,103 copying build/lib/lm_eval/tasks/belebele/belebele_hat_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,105 copying build/lib/lm_eval/tasks/belebele/belebele_ben_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,107 copying build/lib/lm_eval/tasks/belebele/belebele_bam_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,109 copying build/lib/lm_eval/tasks/belebele/belebele_pol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,112 copying build/lib/lm_eval/tasks/belebele/belebele_eng_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,114 copying build/lib/lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,116 copying build/lib/lm_eval/tasks/belebele/belebele_fra_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,118 copying build/lib/lm_eval/tasks/belebele/belebele_hau_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,120 copying build/lib/lm_eval/tasks/belebele/belebele_apc_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,122 copying build/lib/lm_eval/tasks/belebele/belebele_por_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,124 copying build/lib/lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,126 copying build/lib/lm_eval/tasks/belebele/belebele_ibo_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,128 copying build/lib/lm_eval/tasks/belebele/belebele_acm_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,129 copying build/lib/lm_eval/tasks/belebele/belebele_wol_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,131 copying build/lib/lm_eval/tasks/belebele/belebele_ckb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,133 copying build/lib/lm_eval/tasks/belebele/belebele_mal_Mlym.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,135 copying build/lib/lm_eval/tasks/belebele/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,137 copying build/lib/lm_eval/tasks/belebele/belebele_kac_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,138 copying build/lib/lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,140 copying build/lib/lm_eval/tasks/belebele/belebele_sna_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,142 copying build/lib/lm_eval/tasks/belebele/belebele_ind_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,144 copying build/lib/lm_eval/tasks/belebele/belebele_yor_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,145 copying build/lib/lm_eval/tasks/belebele/belebele_ben_Beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,147 copying build/lib/lm_eval/tasks/belebele/belebele_ory_Orya.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,149 copying build/lib/lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,151 copying build/lib/lm_eval/tasks/belebele/belebele_tam_Taml.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,154 copying build/lib/lm_eval/tasks/belebele/belebele_tel_Telu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,155 copying build/lib/lm_eval/tasks/belebele/belebele_afr_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,157 copying build/lib/lm_eval/tasks/belebele/_belebele.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,159 copying build/lib/lm_eval/tasks/belebele/belebele_mri_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,161 copying build/lib/lm_eval/tasks/belebele/belebele_dan_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,162 copying build/lib/lm_eval/tasks/belebele/belebele_lvs_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,164 copying build/lib/lm_eval/tasks/belebele/belebele_tur_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,166 copying build/lib/lm_eval/tasks/belebele/belebele_arb_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,167 copying build/lib/lm_eval/tasks/belebele/belebele_urd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,169 copying build/lib/lm_eval/tasks/belebele/belebele_snd_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,171 copying build/lib/lm_eval/tasks/belebele/belebele_swh_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,172 copying build/lib/lm_eval/tasks/belebele/belebele_arb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,174 copying build/lib/lm_eval/tasks/belebele/belebele_hun_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,176 copying build/lib/lm_eval/tasks/belebele/belebele_tir_Ethi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,178 copying build/lib/lm_eval/tasks/belebele/belebele_ars_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,179 copying build/lib/lm_eval/tasks/belebele/belebele_mya_Mymr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,181 copying build/lib/lm_eval/tasks/belebele/belebele_kat_Geor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,183 copying build/lib/lm_eval/tasks/belebele/belebele_slv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,185 copying build/lib/lm_eval/tasks/belebele/belebele_ceb_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,187 copying build/lib/lm_eval/tasks/belebele/belebele_plt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,189 copying build/lib/lm_eval/tasks/belebele/belebele_khm_Khmr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,190 copying build/lib/lm_eval/tasks/belebele/belebele_zul_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,192 copying build/lib/lm_eval/tasks/belebele/belebele_uzn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,194 copying build/lib/lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,196 copying build/lib/lm_eval/tasks/belebele/belebele_som_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,198 copying build/lib/lm_eval/tasks/belebele/belebele_mar_Deva.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,200 copying build/lib/lm_eval/tasks/belebele/belebele_tsn_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,202 copying build/lib/lm_eval/tasks/belebele/belebele_zho_Hant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,203 copying build/lib/lm_eval/tasks/belebele/belebele_sin_Sinh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,205 copying build/lib/lm_eval/tasks/belebele/belebele_fuv_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,207 copying build/lib/lm_eval/tasks/belebele/belebele_asm_Beng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,208 copying build/lib/lm_eval/tasks/belebele/belebele_ces_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,210 copying build/lib/lm_eval/tasks/belebele/belebele_eus_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,212 copying build/lib/lm_eval/tasks/belebele/belebele_zho_Hans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,214 copying build/lib/lm_eval/tasks/belebele/belebele_sin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,216 copying build/lib/lm_eval/tasks/belebele/belebele_mlt_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,218 copying build/lib/lm_eval/tasks/belebele/belebele_nld_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,220 copying build/lib/lm_eval/tasks/belebele/belebele_tha_Thai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,221 copying build/lib/lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,223 copying build/lib/lm_eval/tasks/belebele/belebele_pan_Guru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,225 copying build/lib/lm_eval/tasks/belebele/belebele_nob_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,227 copying build/lib/lm_eval/tasks/belebele/belebele_npi_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,228 copying build/lib/lm_eval/tasks/belebele/belebele_est_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,230 copying build/lib/lm_eval/tasks/belebele/belebele_lit_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,233 copying build/lib/lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,236 copying build/lib/lm_eval/tasks/belebele/belebele_pes_Arab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,239 copying build/lib/lm_eval/tasks/belebele/belebele_tso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,241 copying build/lib/lm_eval/tasks/belebele/belebele_als_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,243 copying build/lib/lm_eval/tasks/belebele/belebele_ron_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,245 copying build/lib/lm_eval/tasks/belebele/belebele_vie_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,247 copying build/lib/lm_eval/tasks/belebele/belebele_nso_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,249 copying build/lib/lm_eval/tasks/belebele/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,251 copying build/lib/lm_eval/tasks/belebele/belebele_fin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,254 copying build/lib/lm_eval/tasks/belebele/belebele_hin_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/belebele 2024-12-17T11:00:09,258 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/minerva_math 2024-12-17T11:00:09,259 copying build/lib/lm_eval/tasks/minerva_math/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2024-12-17T11:00:09,261 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2024-12-17T11:00:09,263 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2024-12-17T11:00:09,265 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2024-12-17T11:00:09,267 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2024-12-17T11:00:09,269 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2024-12-17T11:00:09,270 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2024-12-17T11:00:09,272 copying build/lib/lm_eval/tasks/minerva_math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2024-12-17T11:00:09,275 copying build/lib/lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/minerva_math 2024-12-17T11:00:09,277 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mc_taco 2024-12-17T11:00:09,278 copying build/lib/lm_eval/tasks/mc_taco/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mc_taco 2024-12-17T11:00:09,280 copying build/lib/lm_eval/tasks/mc_taco/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mc_taco 2024-12-17T11:00:09,283 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wsc273 2024-12-17T11:00:09,284 copying build/lib/lm_eval/tasks/wsc273/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2024-12-17T11:00:09,285 copying build/lib/lm_eval/tasks/wsc273/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2024-12-17T11:00:09,287 copying build/lib/lm_eval/tasks/wsc273/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wsc273 2024-12-17T11:00:09,292 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/cmmlu 2024-12-17T11:00:09,293 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,295 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,297 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,299 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_arts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,301 copying build/lib/lm_eval/tasks/cmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,302 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,304 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,306 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_civil_service_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,308 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,310 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,312 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_security_study.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,314 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,316 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,317 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,319 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,321 copying build/lib/lm_eval/tasks/cmmlu/_cmmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,323 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,325 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,326 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,328 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,330 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,332 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,334 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,336 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,337 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_medical_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,339 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,341 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,343 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,345 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,346 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,348 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,349 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_traditional_chinese_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,351 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,353 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,355 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_food_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,357 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,358 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,361 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_security_study.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,362 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,364 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,365 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,367 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,369 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,370 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,372 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,374 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,375 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_arts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,377 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,379 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,381 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,382 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,384 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,386 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,388 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_food_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,390 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,392 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,393 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,395 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,397 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_elementary_information_and_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,398 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,400 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_actuarial_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,402 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,404 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,406 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,408 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,409 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,411 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,412 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,414 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,416 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,418 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_food_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,419 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,421 copying build/lib/lm_eval/tasks/cmmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,423 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,425 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,427 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_marxist_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,429 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,430 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_journalism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,432 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,434 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,435 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_construction_project_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,437 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_modern_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,439 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,441 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,442 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_engineering_hydrology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,444 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,446 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,448 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,450 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,451 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,453 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,455 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,457 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,459 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,460 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,462 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,464 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,466 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,467 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,469 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,471 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,472 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_college_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,474 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,476 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,478 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,479 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,481 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,483 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_elementary_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,485 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_agronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,487 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,488 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,490 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,492 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_college_education.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,494 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_elementary_commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,496 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,497 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,499 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,501 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,502 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,504 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,506 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,507 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_legal_and_moral_basis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,509 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_logical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,511 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,512 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,514 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,516 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_logical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,518 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_journalism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,519 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,521 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,523 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,526 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,528 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,743 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,745 copying build/lib/lm_eval/tasks/cmmlu/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,747 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,748 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_ethnology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,750 copying build/lib/lm_eval/tasks/cmmlu/cmmlu_default_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/cmmlu 2024-12-17T11:00:09,753 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,754 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,756 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,758 copying build/lib/lm_eval/tasks/med_concepts_qa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,760 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,762 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,764 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,766 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,767 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,769 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,771 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,772 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,774 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,776 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,777 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,779 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,780 copying build/lib/lm_eval/tasks/med_concepts_qa/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,782 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,784 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,786 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,788 copying build/lib/lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,789 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,799 copying build/lib/lm_eval/tasks/med_concepts_qa/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,800 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,802 copying build/lib/lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/med_concepts_qa 2024-12-17T11:00:09,805 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xcopa 2024-12-17T11:00:09,806 copying build/lib/lm_eval/tasks/xcopa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,808 copying build/lib/lm_eval/tasks/xcopa/default_qu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,810 copying build/lib/lm_eval/tasks/xcopa/default_sw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,811 copying build/lib/lm_eval/tasks/xcopa/default_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,813 copying build/lib/lm_eval/tasks/xcopa/default_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,815 copying build/lib/lm_eval/tasks/xcopa/default_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,817 copying build/lib/lm_eval/tasks/xcopa/_xcopa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,819 copying build/lib/lm_eval/tasks/xcopa/default_ht.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,821 copying build/lib/lm_eval/tasks/xcopa/default_et.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,823 copying build/lib/lm_eval/tasks/xcopa/default_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,824 copying build/lib/lm_eval/tasks/xcopa/default_ta.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,826 copying build/lib/lm_eval/tasks/xcopa/default_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,828 copying build/lib/lm_eval/tasks/xcopa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,831 copying build/lib/lm_eval/tasks/xcopa/default_id.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xcopa 2024-12-17T11:00:09,834 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,836 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,838 copying build/lib/lm_eval/tasks/crows_pairs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,841 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,843 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,845 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,848 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,850 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,853 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,855 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,858 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,860 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,862 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,865 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,867 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,869 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,871 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,874 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,876 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,879 copying build/lib/lm_eval/tasks/crows_pairs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,881 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,883 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,886 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,888 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,890 copying build/lib/lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/crows_pairs 2024-12-17T11:00:09,893 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/unscramble 2024-12-17T11:00:09,894 copying build/lib/lm_eval/tasks/unscramble/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2024-12-17T11:00:09,897 copying build/lib/lm_eval/tasks/unscramble/anagrams2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2024-12-17T11:00:09,899 copying build/lib/lm_eval/tasks/unscramble/random_insertion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2024-12-17T11:00:09,902 copying build/lib/lm_eval/tasks/unscramble/cycle_letters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2024-12-17T11:00:09,904 copying build/lib/lm_eval/tasks/unscramble/reversed_words.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2024-12-17T11:00:09,908 copying build/lib/lm_eval/tasks/unscramble/anagrams1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/unscramble 2024-12-17T11:00:09,911 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/anli 2024-12-17T11:00:09,912 copying build/lib/lm_eval/tasks/anli/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2024-12-17T11:00:09,915 copying build/lib/lm_eval/tasks/anli/anli_r2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2024-12-17T11:00:09,917 copying build/lib/lm_eval/tasks/anli/anli_r1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2024-12-17T11:00:09,920 copying build/lib/lm_eval/tasks/anli/anli_r3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/anli 2024-12-17T11:00:09,923 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light 2024-12-17T11:00:09,925 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light 2024-12-17T11:00:09,927 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2024-12-17T11:00:09,928 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2024-12-17T11:00:09,931 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2024-12-17T11:00:09,933 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light 2024-12-17T11:00:09,935 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2024-12-17T11:00:09,936 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2024-12-17T11:00:09,938 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2024-12-17T11:00:09,940 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light 2024-12-17T11:00:09,942 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2024-12-17T11:00:09,943 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2024-12-17T11:00:09,945 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2024-12-17T11:00:09,947 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light 2024-12-17T11:00:09,949 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2024-12-17T11:00:09,950 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2024-12-17T11:00:09,952 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2024-12-17T11:00:09,954 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light 2024-12-17T11:00:09,956 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2024-12-17T11:00:09,958 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2024-12-17T11:00:09,959 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2024-12-17T11:00:09,962 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light 2024-12-17T11:00:09,964 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T11:00:09,965 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T11:00:09,967 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T11:00:09,969 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T11:00:09,971 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T11:00:09,972 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T11:00:09,974 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T11:00:09,976 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T11:00:09,978 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T11:00:09,979 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T11:00:09,981 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T11:00:09,983 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light 2024-12-17T11:00:09,988 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2024-12-17T11:00:09,989 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2024-12-17T11:00:09,991 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2024-12-17T11:00:09,993 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light 2024-12-17T11:00:09,996 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2024-12-17T11:00:09,997 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2024-12-17T11:00:09,998 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2024-12-17T11:00:10,000 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light 2024-12-17T11:00:10,002 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2024-12-17T11:00:10,003 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2024-12-17T11:00:10,005 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2024-12-17T11:00:10,007 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light 2024-12-17T11:00:10,009 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2024-12-17T11:00:10,010 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2024-12-17T11:00:10,012 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2024-12-17T11:00:10,014 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light 2024-12-17T11:00:10,017 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,018 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,020 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,022 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,024 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,026 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,027 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,029 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,031 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,033 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,034 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,036 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,038 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,040 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,042 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,044 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,046 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,047 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,049 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,051 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,053 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,055 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,057 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,059 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,060 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,062 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,064 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,066 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,068 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,070 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,071 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,073 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,075 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,077 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,079 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,080 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,082 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,084 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,086 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,087 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,089 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,091 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,093 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,095 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,097 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,099 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,100 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,102 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,104 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,106 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,108 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,109 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,111 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,113 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,115 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,117 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,119 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,120 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,122 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,124 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,126 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light 2024-12-17T11:00:10,128 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2024-12-17T11:00:10,129 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2024-12-17T11:00:10,131 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2024-12-17T11:00:10,133 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light 2024-12-17T11:00:10,136 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,138 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,140 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,141 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,143 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,145 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,147 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,149 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,151 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,153 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,155 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,157 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,159 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,161 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,162 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,164 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,166 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,168 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,170 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,171 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,174 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,175 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,177 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,179 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,181 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,183 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,185 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,186 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,188 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,190 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,192 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,194 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,196 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,197 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,199 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,201 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,203 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,205 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,206 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,208 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,210 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,212 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,214 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,216 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,217 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,219 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,221 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,223 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,225 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,227 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,229 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,231 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,233 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,234 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,236 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,238 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,240 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,241 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,243 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,245 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light 2024-12-17T11:00:10,248 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2024-12-17T11:00:10,249 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2024-12-17T11:00:10,251 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2024-12-17T11:00:10,252 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light 2024-12-17T11:00:10,255 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2024-12-17T11:00:10,256 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2024-12-17T11:00:10,258 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2024-12-17T11:00:10,260 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light 2024-12-17T11:00:10,262 copying build/lib/lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arabic_leaderboard_light 2024-12-17T11:00:10,264 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/drop 2024-12-17T11:00:10,265 copying build/lib/lm_eval/tasks/drop/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2024-12-17T11:00:10,267 copying build/lib/lm_eval/tasks/drop/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2024-12-17T11:00:10,270 copying build/lib/lm_eval/tasks/drop/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/drop 2024-12-17T11:00:10,272 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ifeval 2024-12-17T11:00:10,273 copying build/lib/lm_eval/tasks/ifeval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2024-12-17T11:00:10,275 copying build/lib/lm_eval/tasks/ifeval/ifeval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2024-12-17T11:00:10,277 copying build/lib/lm_eval/tasks/ifeval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2024-12-17T11:00:10,279 copying build/lib/lm_eval/tasks/ifeval/instructions_util.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2024-12-17T11:00:10,282 copying build/lib/lm_eval/tasks/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2024-12-17T11:00:10,285 copying build/lib/lm_eval/tasks/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ifeval 2024-12-17T11:00:10,289 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/ceval 2024-12-17T11:00:10,290 copying build/lib/lm_eval/tasks/ceval/ceval-valid_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,292 copying build/lib/lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,293 copying build/lib/lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,296 copying build/lib/lm_eval/tasks/ceval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,298 copying build/lib/lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,299 copying build/lib/lm_eval/tasks/ceval/ceval-valid_education_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,301 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,303 copying build/lib/lm_eval/tasks/ceval/ceval-valid_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,305 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,306 copying build/lib/lm_eval/tasks/ceval/ceval-valid_sports_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,308 copying build/lib/lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,309 copying build/lib/lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,311 copying build/lib/lm_eval/tasks/ceval/ceval-valid_physician.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,313 copying build/lib/lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,315 copying build/lib/lm_eval/tasks/ceval/_default_ceval_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,317 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,318 copying build/lib/lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,320 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,322 copying build/lib/lm_eval/tasks/ceval/ceval-valid_operating_system.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,324 copying build/lib/lm_eval/tasks/ceval/ceval-valid_business_administration.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,326 copying build/lib/lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,328 copying build/lib/lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,329 copying build/lib/lm_eval/tasks/ceval/ceval-valid_art_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,331 copying build/lib/lm_eval/tasks/ceval/ceval-valid_computer_network.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,333 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,335 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,337 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,339 copying build/lib/lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,340 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,342 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,344 copying build/lib/lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,346 copying build/lib/lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,347 copying build/lib/lm_eval/tasks/ceval/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,349 copying build/lib/lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,351 copying build/lib/lm_eval/tasks/ceval/ceval-valid_marxism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,353 copying build/lib/lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,354 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,356 copying build/lib/lm_eval/tasks/ceval/_ceval-valid.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,358 copying build/lib/lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,360 copying build/lib/lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,362 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,364 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,366 copying build/lib/lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,367 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,369 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,371 copying build/lib/lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,372 copying build/lib/lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,374 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_economics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,376 copying build/lib/lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,378 copying build/lib/lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,380 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,382 copying build/lib/lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,384 copying build/lib/lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,386 copying build/lib/lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,388 copying build/lib/lm_eval/tasks/ceval/ceval-valid_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,390 copying build/lib/lm_eval/tasks/ceval/ceval-valid_college_programming.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/ceval 2024-12-17T11:00:10,393 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/code_x_glue 2024-12-17T11:00:10,394 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/code_x_glue/code-text 2024-12-17T11:00:10,395 copying build/lib/lm_eval/tasks/code_x_glue/code-text/java.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2024-12-17T11:00:10,398 copying build/lib/lm_eval/tasks/code_x_glue/code-text/go.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2024-12-17T11:00:10,403 copying build/lib/lm_eval/tasks/code_x_glue/code-text/python.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2024-12-17T11:00:10,405 copying build/lib/lm_eval/tasks/code_x_glue/code-text/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2024-12-17T11:00:10,407 copying build/lib/lm_eval/tasks/code_x_glue/code-text/ruby.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2024-12-17T11:00:10,409 copying build/lib/lm_eval/tasks/code_x_glue/code-text/javascript.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2024-12-17T11:00:10,411 copying build/lib/lm_eval/tasks/code_x_glue/code-text/php.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2024-12-17T11:00:10,412 copying build/lib/lm_eval/tasks/code_x_glue/code-text/bleu.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/code_x_glue/code-text 2024-12-17T11:00:10,416 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/realtoxicityprompts 2024-12-17T11:00:10,417 copying build/lib/lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/realtoxicityprompts 2024-12-17T11:00:10,418 copying build/lib/lm_eval/tasks/realtoxicityprompts/metric.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/realtoxicityprompts 2024-12-17T11:00:10,422 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_exams 2024-12-17T11:00:10,423 copying build/lib/lm_eval/tasks/eus_exams/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,425 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,427 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,429 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,431 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,434 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,437 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,439 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,440 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,442 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,445 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,447 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,449 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,451 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,453 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,455 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,457 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,458 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,460 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,462 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,463 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,465 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,467 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,469 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,470 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,472 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,474 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,476 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,478 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,479 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,481 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,483 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,485 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,487 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,488 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,490 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,492 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,494 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,496 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,497 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,499 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,501 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,502 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,504 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,506 copying build/lib/lm_eval/tasks/eus_exams/eus_exams -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,507 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,509 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,511 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,513 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,514 copying build/lib/lm_eval/tasks/eus_exams/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,516 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,519 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,521 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,524 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,527 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,530 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,533 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,535 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,537 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,539 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,542 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,544 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,548 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,553 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,558 copying build/lib/lm_eval/tasks/eus_exams/configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,563 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,826 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,829 copying build/lib/lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_exams 2024-12-17T11:00:10,833 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gsm8k 2024-12-17T11:00:10,835 copying build/lib/lm_eval/tasks/gsm8k/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2024-12-17T11:00:10,839 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2024-12-17T11:00:10,842 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2024-12-17T11:00:10,846 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2024-12-17T11:00:10,849 copying build/lib/lm_eval/tasks/gsm8k/gsm8k-cot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2024-12-17T11:00:10,853 copying build/lib/lm_eval/tasks/gsm8k/gsm8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gsm8k 2024-12-17T11:00:10,858 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/headqa 2024-12-17T11:00:10,860 copying build/lib/lm_eval/tasks/headqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2024-12-17T11:00:10,863 copying build/lib/lm_eval/tasks/headqa/headqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2024-12-17T11:00:10,865 copying build/lib/lm_eval/tasks/headqa/headqa_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/headqa 2024-12-17T11:00:10,869 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hendrycks_ethics 2024-12-17T11:00:10,870 copying build/lib/lm_eval/tasks/hendrycks_ethics/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2024-12-17T11:00:10,874 copying build/lib/lm_eval/tasks/hendrycks_ethics/justice.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2024-12-17T11:00:10,876 copying build/lib/lm_eval/tasks/hendrycks_ethics/commonsense.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2024-12-17T11:00:10,879 copying build/lib/lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2024-12-17T11:00:10,883 copying build/lib/lm_eval/tasks/hendrycks_ethics/virtue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2024-12-17T11:00:10,886 copying build/lib/lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2024-12-17T11:00:10,889 copying build/lib/lm_eval/tasks/hendrycks_ethics/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2024-12-17T11:00:10,892 copying build/lib/lm_eval/tasks/hendrycks_ethics/deontology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_ethics 2024-12-17T11:00:10,897 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/bertaqa 2024-12-17T11:00:10,899 copying build/lib/lm_eval/tasks/bertaqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,902 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,905 copying build/lib/lm_eval/tasks/bertaqa/_bertaqa_template -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,907 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,910 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,913 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,915 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,918 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,920 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,923 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,926 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,928 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,931 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,934 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,937 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,939 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,943 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,947 copying build/lib/lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/bertaqa 2024-12-17T11:00:10,950 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mutual 2024-12-17T11:00:10,969 copying build/lib/lm_eval/tasks/mutual/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2024-12-17T11:00:10,972 copying build/lib/lm_eval/tasks/mutual/mutual.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2024-12-17T11:00:10,974 copying build/lib/lm_eval/tasks/mutual/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2024-12-17T11:00:10,976 copying build/lib/lm_eval/tasks/mutual/multual_plus.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mutual 2024-12-17T11:00:10,979 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/webqs 2024-12-17T11:00:10,980 copying build/lib/lm_eval/tasks/webqs/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2024-12-17T11:00:10,983 copying build/lib/lm_eval/tasks/webqs/webqs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2024-12-17T11:00:10,985 copying build/lib/lm_eval/tasks/webqs/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/webqs 2024-12-17T11:00:10,988 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa 2024-12-17T11:00:10,991 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa/copa_ar 2024-12-17T11:00:10,992 copying build/lib/lm_eval/tasks/alghafa/copa_ar/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/copa_ar 2024-12-17T11:00:10,995 copying build/lib/lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/copa_ar 2024-12-17T11:00:10,998 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/alghafa/piqa_ar 2024-12-17T11:00:11,000 copying build/lib/lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/piqa_ar 2024-12-17T11:00:11,003 copying build/lib/lm_eval/tasks/alghafa/piqa_ar/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/alghafa/piqa_ar 2024-12-17T11:00:11,006 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/glianorex 2024-12-17T11:00:11,007 copying build/lib/lm_eval/tasks/glianorex/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2024-12-17T11:00:11,010 copying build/lib/lm_eval/tasks/glianorex/glianorex_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2024-12-17T11:00:11,014 copying build/lib/lm_eval/tasks/glianorex/preprocess_glianorex.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2024-12-17T11:00:11,018 copying build/lib/lm_eval/tasks/glianorex/glianorex_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2024-12-17T11:00:11,022 copying build/lib/lm_eval/tasks/glianorex/glianorex.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/glianorex 2024-12-17T11:00:11,027 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/paws-x 2024-12-17T11:00:11,029 copying build/lib/lm_eval/tasks/paws-x/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2024-12-17T11:00:11,034 copying build/lib/lm_eval/tasks/paws-x/paws_ko.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2024-12-17T11:00:11,038 copying build/lib/lm_eval/tasks/paws-x/_generate_config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2024-12-17T11:00:11,042 copying build/lib/lm_eval/tasks/paws-x/paws_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2024-12-17T11:00:11,047 copying build/lib/lm_eval/tasks/paws-x/paws_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2024-12-17T11:00:11,052 copying build/lib/lm_eval/tasks/paws-x/_pawsx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2024-12-17T11:00:11,057 copying build/lib/lm_eval/tasks/paws-x/paws_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2024-12-17T11:00:11,062 copying build/lib/lm_eval/tasks/paws-x/paws_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2024-12-17T11:00:11,068 copying build/lib/lm_eval/tasks/paws-x/paws_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2024-12-17T11:00:11,074 copying build/lib/lm_eval/tasks/paws-x/paws_ja.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2024-12-17T11:00:11,080 copying build/lib/lm_eval/tasks/paws-x/pawsx_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/paws-x 2024-12-17T11:00:11,083 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa 2024-12-17T11:00:11,084 copying build/lib/lm_eval/tasks/gpqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa 2024-12-17T11:00:11,087 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/n_shot 2024-12-17T11:00:11,089 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2024-12-17T11:00:11,091 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2024-12-17T11:00:11,094 copying build/lib/lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2024-12-17T11:00:11,096 copying build/lib/lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2024-12-17T11:00:11,098 copying build/lib/lm_eval/tasks/gpqa/n_shot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2024-12-17T11:00:11,100 copying build/lib/lm_eval/tasks/gpqa/n_shot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/n_shot 2024-12-17T11:00:11,104 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T11:00:11,105 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T11:00:11,108 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T11:00:11,110 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T11:00:11,113 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T11:00:11,116 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T11:00:11,118 copying build/lib/lm_eval/tasks/gpqa/cot_n_shot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_n_shot 2024-12-17T11:00:11,122 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T11:00:11,124 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T11:00:11,127 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T11:00:11,130 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T11:00:11,133 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T11:00:11,135 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T11:00:11,138 copying build/lib/lm_eval/tasks/gpqa/cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/cot_zeroshot 2024-12-17T11:00:11,141 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/zeroshot 2024-12-17T11:00:11,142 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2024-12-17T11:00:11,145 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2024-12-17T11:00:11,148 copying build/lib/lm_eval/tasks/gpqa/zeroshot/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2024-12-17T11:00:11,151 copying build/lib/lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2024-12-17T11:00:11,155 copying build/lib/lm_eval/tasks/gpqa/zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2024-12-17T11:00:11,163 copying build/lib/lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/zeroshot 2024-12-17T11:00:11,178 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/gpqa/generative 2024-12-17T11:00:11,183 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2024-12-17T11:00:11,186 copying build/lib/lm_eval/tasks/gpqa/generative/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2024-12-17T11:00:11,189 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2024-12-17T11:00:11,191 copying build/lib/lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2024-12-17T11:00:11,194 copying build/lib/lm_eval/tasks/gpqa/generative/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2024-12-17T11:00:11,196 copying build/lib/lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/gpqa/generative 2024-12-17T11:00:11,205 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/piqa 2024-12-17T11:00:11,212 copying build/lib/lm_eval/tasks/piqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/piqa 2024-12-17T11:00:11,227 copying build/lib/lm_eval/tasks/piqa/piqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/piqa 2024-12-17T11:00:11,236 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basqueglue 2024-12-17T11:00:11,237 copying build/lib/lm_eval/tasks/basqueglue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2024-12-17T11:00:11,241 copying build/lib/lm_eval/tasks/basqueglue/coref.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2024-12-17T11:00:11,244 copying build/lib/lm_eval/tasks/basqueglue/qnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2024-12-17T11:00:11,248 copying build/lib/lm_eval/tasks/basqueglue/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2024-12-17T11:00:11,253 copying build/lib/lm_eval/tasks/basqueglue/bhtc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2024-12-17T11:00:11,256 copying build/lib/lm_eval/tasks/basqueglue/vaxx.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2024-12-17T11:00:11,261 copying build/lib/lm_eval/tasks/basqueglue/wic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2024-12-17T11:00:11,266 copying build/lib/lm_eval/tasks/basqueglue/bec.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basqueglue 2024-12-17T11:00:11,271 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/wmt2016 2024-12-17T11:00:11,274 copying build/lib/lm_eval/tasks/wmt2016/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2024-12-17T11:00:11,279 copying build/lib/lm_eval/tasks/wmt2016/metrics.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2024-12-17T11:00:11,282 copying build/lib/lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/wmt2016 2024-12-17T11:00:11,290 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/french_bench 2024-12-17T11:00:11,297 copying build/lib/lm_eval/tasks/french_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,310 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,314 copying build/lib/lm_eval/tasks/french_bench/french_bench_trivia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,318 copying build/lib/lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,320 copying build/lib/lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,324 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,327 copying build/lib/lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,330 copying build/lib/lm_eval/tasks/french_bench/french_bench_grammar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,333 copying build/lib/lm_eval/tasks/french_bench/french_bench_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,336 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,340 copying build/lib/lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,344 copying build/lib/lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,348 copying build/lib/lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,351 copying build/lib/lm_eval/tasks/french_bench/french_bench_reading_comp.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,354 copying build/lib/lm_eval/tasks/french_bench/french_bench_boolqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,356 copying build/lib/lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,359 copying build/lib/lm_eval/tasks/french_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,361 copying build/lib/lm_eval/tasks/french_bench/french_bench_xnli.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,364 copying build/lib/lm_eval/tasks/french_bench/preprocess_wikitext.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,366 copying build/lib/lm_eval/tasks/french_bench/french_bench_multifquad.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,369 copying build/lib/lm_eval/tasks/french_bench/french_bench_vocab.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,371 copying build/lib/lm_eval/tasks/french_bench/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/french_bench 2024-12-17T11:00:11,375 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu 2024-12-17T11:00:11,376 copying build/lib/lm_eval/tasks/turkishmmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu 2024-12-17T11:00:11,380 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu/config 2024-12-17T11:00:11,382 copying build/lib/lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2024-12-17T11:00:11,385 copying build/lib/lm_eval/tasks/turkishmmlu/config/Mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2024-12-17T11:00:11,388 copying build/lib/lm_eval/tasks/turkishmmlu/config/History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2024-12-17T11:00:11,391 copying build/lib/lm_eval/tasks/turkishmmlu/config/Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2024-12-17T11:00:11,395 copying build/lib/lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2024-12-17T11:00:11,399 copying build/lib/lm_eval/tasks/turkishmmlu/config/Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2024-12-17T11:00:11,402 copying build/lib/lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2024-12-17T11:00:11,404 copying build/lib/lm_eval/tasks/turkishmmlu/config/Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2024-12-17T11:00:11,406 copying build/lib/lm_eval/tasks/turkishmmlu/config/Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2024-12-17T11:00:11,409 copying build/lib/lm_eval/tasks/turkishmmlu/config/Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config 2024-12-17T11:00:11,413 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T11:00:11,417 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T11:00:11,432 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T11:00:11,438 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/History.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T11:00:11,456 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T11:00:11,472 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T11:00:11,486 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T11:00:11,496 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T11:00:11,510 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T11:00:11,519 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T11:00:11,521 copying build/lib/lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/turkishmmlu/config_cot 2024-12-17T11:00:11,525 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/eus_reading 2024-12-17T11:00:11,526 copying build/lib/lm_eval/tasks/eus_reading/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2024-12-17T11:00:11,529 copying build/lib/lm_eval/tasks/eus_reading/eus_reading.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2024-12-17T11:00:11,531 copying build/lib/lm_eval/tasks/eus_reading/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/eus_reading 2024-12-17T11:00:11,537 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,539 copying build/lib/lm_eval/tasks/inverse_scaling/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,544 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,547 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,551 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,556 copying build/lib/lm_eval/tasks/inverse_scaling/_some_results -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,560 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,567 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,570 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,575 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,579 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,583 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,587 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,590 copying build/lib/lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,594 copying build/lib/lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/inverse_scaling 2024-12-17T11:00:11,601 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kobest 2024-12-17T11:00:11,604 copying build/lib/lm_eval/tasks/kobest/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2024-12-17T11:00:11,611 copying build/lib/lm_eval/tasks/kobest/kobest_hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2024-12-17T11:00:11,621 copying build/lib/lm_eval/tasks/kobest/kobest_wic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2024-12-17T11:00:11,632 copying build/lib/lm_eval/tasks/kobest/kobest_boolq.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2024-12-17T11:00:11,641 copying build/lib/lm_eval/tasks/kobest/kobest_copa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2024-12-17T11:00:11,648 copying build/lib/lm_eval/tasks/kobest/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2024-12-17T11:00:11,651 copying build/lib/lm_eval/tasks/kobest/kobest_sentineg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kobest 2024-12-17T11:00:11,654 copying build/lib/lm_eval/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks 2024-12-17T11:00:11,660 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hendrycks_math 2024-12-17T11:00:11,663 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2024-12-17T11:00:11,670 copying build/lib/lm_eval/tasks/hendrycks_math/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2024-12-17T11:00:11,677 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2024-12-17T11:00:11,687 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2024-12-17T11:00:11,694 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2024-12-17T11:00:11,696 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2024-12-17T11:00:11,700 copying build/lib/lm_eval/tasks/hendrycks_math/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2024-12-17T11:00:11,707 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2024-12-17T11:00:11,714 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2024-12-17T11:00:11,722 copying build/lib/lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hendrycks_math 2024-12-17T11:00:11,726 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/truthfulqa 2024-12-17T11:00:11,727 copying build/lib/lm_eval/tasks/truthfulqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2024-12-17T11:00:11,731 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2024-12-17T11:00:11,735 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2024-12-17T11:00:11,737 copying build/lib/lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2024-12-17T11:00:11,740 copying build/lib/lm_eval/tasks/truthfulqa/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/truthfulqa 2024-12-17T11:00:11,744 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/swag 2024-12-17T11:00:11,745 copying build/lib/lm_eval/tasks/swag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swag 2024-12-17T11:00:11,748 copying build/lib/lm_eval/tasks/swag/swag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swag 2024-12-17T11:00:11,751 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/toxigen 2024-12-17T11:00:11,753 copying build/lib/lm_eval/tasks/toxigen/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2024-12-17T11:00:11,755 copying build/lib/lm_eval/tasks/toxigen/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2024-12-17T11:00:11,758 copying build/lib/lm_eval/tasks/toxigen/toxigen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/toxigen 2024-12-17T11:00:11,761 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/aclue 2024-12-17T11:00:11,762 copying build/lib/lm_eval/tasks/aclue/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,765 copying build/lib/lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,767 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,770 copying build/lib/lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,772 copying build/lib/lm_eval/tasks/aclue/aclue_couplet_prediction.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,774 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,776 copying build/lib/lm_eval/tasks/aclue/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,779 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,782 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_medical.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,784 copying build/lib/lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,787 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,789 copying build/lib/lm_eval/tasks/aclue/_aclue.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,792 copying build/lib/lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,794 copying build/lib/lm_eval/tasks/aclue/aclue_reading_comprehension.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,797 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,799 copying build/lib/lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,801 copying build/lib/lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,804 copying build/lib/lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,806 copying build/lib/lm_eval/tasks/aclue/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/aclue 2024-12-17T11:00:11,809 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/xquad 2024-12-17T11:00:11,810 copying build/lib/lm_eval/tasks/xquad/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,816 copying build/lib/lm_eval/tasks/xquad/xquad_zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,818 copying build/lib/lm_eval/tasks/xquad/xquad_th.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,820 copying build/lib/lm_eval/tasks/xquad/xquad_ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,822 copying build/lib/lm_eval/tasks/xquad/xquad_tr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,825 copying build/lib/lm_eval/tasks/xquad/xquad_ru.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,827 copying build/lib/lm_eval/tasks/xquad/xquad_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,829 copying build/lib/lm_eval/tasks/xquad/xquad_vi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,832 copying build/lib/lm_eval/tasks/xquad/xquad_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,834 copying build/lib/lm_eval/tasks/xquad/xquad_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,836 copying build/lib/lm_eval/tasks/xquad/xquad_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,838 copying build/lib/lm_eval/tasks/xquad/xquad_ro.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,840 copying build/lib/lm_eval/tasks/xquad/xquad_hi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,843 copying build/lib/lm_eval/tasks/xquad/xquad_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,845 copying build/lib/lm_eval/tasks/xquad/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/xquad 2024-12-17T11:00:11,848 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basque_bench 2024-12-17T11:00:11,849 copying build/lib/lm_eval/tasks/basque_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2024-12-17T11:00:11,852 copying build/lib/lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2024-12-17T11:00:11,855 copying build/lib/lm_eval/tasks/basque_bench/basque_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2024-12-17T11:00:11,857 copying build/lib/lm_eval/tasks/basque_bench/wnli_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2024-12-17T11:00:11,859 copying build/lib/lm_eval/tasks/basque_bench/xcopa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2024-12-17T11:00:11,861 copying build/lib/lm_eval/tasks/basque_bench/mgsm_cot_native_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2024-12-17T11:00:11,863 copying build/lib/lm_eval/tasks/basque_bench/piqa_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2024-12-17T11:00:11,865 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,867 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,868 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,870 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,872 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,874 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,876 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,877 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,879 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,881 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,883 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,885 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,887 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,889 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,891 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,892 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,894 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,896 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,898 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,899 copying build/lib/lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench/flores_eu 2024-12-17T11:00:11,902 copying build/lib/lm_eval/tasks/basque_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/basque_bench 2024-12-17T11:00:11,904 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/agieval 2024-12-17T11:00:11,906 copying build/lib/lm_eval/tasks/agieval/gaokao-physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,907 copying build/lib/lm_eval/tasks/agieval/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,910 copying build/lib/lm_eval/tasks/agieval/gaokao-biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,912 copying build/lib/lm_eval/tasks/agieval/gaokao-english.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,914 copying build/lib/lm_eval/tasks/agieval/agieval.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,915 copying build/lib/lm_eval/tasks/agieval/logiqa-zh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,917 copying build/lib/lm_eval/tasks/agieval/sat-math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,919 copying build/lib/lm_eval/tasks/agieval/agieval_nous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,921 copying build/lib/lm_eval/tasks/agieval/lsat-ar.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,923 copying build/lib/lm_eval/tasks/agieval/gaokao-history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,925 copying build/lib/lm_eval/tasks/agieval/sat-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,927 copying build/lib/lm_eval/tasks/agieval/math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,928 copying build/lib/lm_eval/tasks/agieval/gaokao-geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,930 copying build/lib/lm_eval/tasks/agieval/gaokao-chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,932 copying build/lib/lm_eval/tasks/agieval/gaokao-chinese.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,934 copying build/lib/lm_eval/tasks/agieval/sat-en-without-passage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,936 copying build/lib/lm_eval/tasks/agieval/gaokao-mathqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,938 copying build/lib/lm_eval/tasks/agieval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,940 copying build/lib/lm_eval/tasks/agieval/agieval_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,941 copying build/lib/lm_eval/tasks/agieval/aqua-rat.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,943 copying build/lib/lm_eval/tasks/agieval/jec-qa-kd.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,945 copying build/lib/lm_eval/tasks/agieval/logiqa-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,946 copying build/lib/lm_eval/tasks/agieval/lsat-lr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,948 copying build/lib/lm_eval/tasks/agieval/lsat-rc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,950 copying build/lib/lm_eval/tasks/agieval/gaokao-mathcloze.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,952 copying build/lib/lm_eval/tasks/agieval/jec-qa-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,954 copying build/lib/lm_eval/tasks/agieval/agieval_cn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/agieval 2024-12-17T11:00:11,956 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr 2024-12-17T11:00:11,957 copying build/lib/lm_eval/tasks/mmlusr/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr 2024-12-17T11:00:11,961 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,962 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,964 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,966 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,968 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,970 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,972 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,974 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,976 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,978 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,980 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,983 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,984 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,986 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,988 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,990 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,991 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,993 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,995 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,998 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:11,999 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,001 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,004 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,006 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,008 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,010 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,011 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,014 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,015 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,017 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,019 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,021 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,023 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,024 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,026 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,028 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,030 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,032 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,033 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,035 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,037 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,039 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,041 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,043 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,044 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,046 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,048 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,050 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,052 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,053 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,055 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,057 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,059 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,061 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,063 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,064 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,066 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,068 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,070 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,071 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,073 copying build/lib/lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_and_answer 2024-12-17T11:00:12,076 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,077 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,079 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,081 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,083 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,085 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,087 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,088 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,090 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,092 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,094 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,096 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,097 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,099 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,101 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,103 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,104 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,106 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,108 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,109 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,111 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,113 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,115 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,116 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,118 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,120 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,122 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,124 copying build/lib/lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,126 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,127 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,129 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,131 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,133 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,135 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,136 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,138 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,140 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,142 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,143 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,145 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,147 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,148 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,152 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,154 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,156 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,158 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,160 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,162 copying build/lib/lm_eval/tasks/mmlusr/answer_only/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,164 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,166 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,168 copying build/lib/lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,170 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,171 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,174 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,175 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,177 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,179 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,181 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,183 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,185 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,187 copying build/lib/lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/answer_only 2024-12-17T11:00:12,188 copying build/lib/lm_eval/tasks/mmlusr/config.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr 2024-12-17T11:00:12,192 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,193 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,195 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,197 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,199 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,200 copying build/lib/lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,202 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,204 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,207 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,208 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,210 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,212 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,214 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,217 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,219 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,221 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,224 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,226 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,228 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,231 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,233 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,235 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,237 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,239 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,241 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,243 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,245 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,247 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,249 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,251 copying build/lib/lm_eval/tasks/mmlusr/question_only/_question_only.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,254 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,256 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,258 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,260 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,263 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,264 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,266 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,268 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,270 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,272 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,274 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,276 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,278 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,279 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,281 copying build/lib/lm_eval/tasks/mmlusr/question_only/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,283 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,284 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,286 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,288 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,290 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,292 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,294 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,295 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,297 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,299 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,301 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,303 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,305 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,307 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,310 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,313 copying build/lib/lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlusr/question_only 2024-12-17T11:00:12,318 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/swde 2024-12-17T11:00:12,319 copying build/lib/lm_eval/tasks/swde/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2024-12-17T11:00:12,322 copying build/lib/lm_eval/tasks/swde/swde.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2024-12-17T11:00:12,323 copying build/lib/lm_eval/tasks/swde/task.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/swde 2024-12-17T11:00:12,326 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pubmedqa 2024-12-17T11:00:12,327 copying build/lib/lm_eval/tasks/pubmedqa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2024-12-17T11:00:12,329 copying build/lib/lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2024-12-17T11:00:12,331 copying build/lib/lm_eval/tasks/pubmedqa/pubmedqa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pubmedqa 2024-12-17T11:00:12,333 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,334 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,336 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,337 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_winogrande.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,339 copying build/lib/lm_eval/tasks/tinyBenchmarks/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,341 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,344 copying build/lib/lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,346 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyArc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,347 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,349 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,351 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,353 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,355 copying build/lib/lm_eval/tasks/tinyBenchmarks/agg_functions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,357 copying build/lib/lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/tinyBenchmarks 2024-12-17T11:00:12,359 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl 2024-12-17T11:00:12,360 copying build/lib/lm_eval/tasks/kbl/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl 2024-12-17T11:00:12,364 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/reasoning 2024-12-17T11:00:12,365 copying build/lib/lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2024-12-17T11:00:12,368 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2024-12-17T11:00:12,370 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2024-12-17T11:00:12,373 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2024-12-17T11:00:12,375 copying build/lib/lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/reasoning 2024-12-17T11:00:12,378 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam 2024-12-17T11:00:12,380 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,382 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,384 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,386 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,388 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,390 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,393 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,395 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,398 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,399 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,401 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,403 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,405 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,407 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,409 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,411 copying build/lib/lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/responsibility 2024-12-17T11:00:12,414 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,415 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,418 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,421 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,426 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,432 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,434 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,436 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,439 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,442 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,444 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,446 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,448 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,450 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,452 copying build/lib/lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/civil 2024-12-17T11:00:12,454 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,455 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,457 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,459 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,461 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,463 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,464 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,466 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,468 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,470 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,472 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,474 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,475 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,478 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,480 copying build/lib/lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/public 2024-12-17T11:00:12,482 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,483 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,485 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,487 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,489 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,490 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,492 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,494 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,496 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,498 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,500 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,503 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,505 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,507 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,509 copying build/lib/lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/bar_exam/criminal 2024-12-17T11:00:12,512 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/kbl/knowledge 2024-12-17T11:00:12,513 copying build/lib/lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2024-12-17T11:00:12,515 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2024-12-17T11:00:12,518 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2024-12-17T11:00:12,520 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2024-12-17T11:00:12,523 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2024-12-17T11:00:12,526 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2024-12-17T11:00:12,528 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2024-12-17T11:00:12,530 copying build/lib/lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/kbl/knowledge 2024-12-17T11:00:12,534 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/pile 2024-12-17T11:00:12,535 copying build/lib/lm_eval/tasks/pile/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,537 copying build/lib/lm_eval/tasks/pile/pile_pubmed-central.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,538 copying build/lib/lm_eval/tasks/pile/pile_opensubtitles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,540 copying build/lib/lm_eval/tasks/pile/pile_github.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,541 copying build/lib/lm_eval/tasks/pile/pile_freelaw.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,543 copying build/lib/lm_eval/tasks/pile/pile_youtubesubtitles.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,545 copying build/lib/lm_eval/tasks/pile/pile_arxiv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,547 copying build/lib/lm_eval/tasks/pile/pile_hackernews.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,551 copying build/lib/lm_eval/tasks/pile/pile_europarl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,556 copying build/lib/lm_eval/tasks/pile/pile_gutenberg.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,564 copying build/lib/lm_eval/tasks/pile/pile_enron.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,573 copying build/lib/lm_eval/tasks/pile/pile_philpapers.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,584 copying build/lib/lm_eval/tasks/pile/pile_ubuntu-irc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,597 copying build/lib/lm_eval/tasks/pile/pile_dm-mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,610 copying build/lib/lm_eval/tasks/pile/pile_nih-exporter.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,624 copying build/lib/lm_eval/tasks/pile/pile_stackexchange.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,639 copying build/lib/lm_eval/tasks/pile/pile_pubmed-abstracts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,652 copying build/lib/lm_eval/tasks/pile/pile_bookcorpus2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,655 copying build/lib/lm_eval/tasks/pile/pile_wikipedia.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,657 copying build/lib/lm_eval/tasks/pile/pile_pile-cc.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,659 copying build/lib/lm_eval/tasks/pile/pile_books3.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,662 copying build/lib/lm_eval/tasks/pile/pile_uspto.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,664 copying build/lib/lm_eval/tasks/pile/pile_openwebtext2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/pile 2024-12-17T11:00:12,668 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm 2024-12-17T11:00:12,669 copying build/lib/lm_eval/tasks/afrimgsm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2024-12-17T11:00:12,673 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,675 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,678 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,680 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,683 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,685 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,688 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,690 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,692 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,695 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,697 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,699 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,702 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,704 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,707 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,710 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,713 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,716 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,719 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/cot_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,722 copying build/lib/lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/en_cot 2024-12-17T11:00:12,724 copying build/lib/lm_eval/tasks/afrimgsm/run.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2024-12-17T11:00:12,728 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,729 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,732 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,735 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,737 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,740 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,742 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,745 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,748 copying build/lib/lm_eval/tasks/afrimgsm/translate/translate_direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,750 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,753 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,756 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,758 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,761 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,763 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,765 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,767 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,768 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,770 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,772 copying build/lib/lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/translate 2024-12-17T11:00:12,775 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,776 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_twi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,777 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_swa.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,779 copying build/lib/lm_eval/tasks/afrimgsm/direct/direct_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,781 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_zul.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,783 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_orm.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,784 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_ewe.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,786 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_fra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,788 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_ibo.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,790 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_eng.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,791 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_yor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,793 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_xho.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,795 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_kin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,801 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_lin.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,803 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_sna.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,805 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_wol.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,807 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_amh.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,808 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_sot.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,810 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_hau.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,812 copying build/lib/lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_lug.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm/direct 2024-12-17T11:00:12,814 copying build/lib/lm_eval/tasks/afrimgsm/gen_yaml.sh -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2024-12-17T11:00:12,815 copying build/lib/lm_eval/tasks/afrimgsm/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/afrimgsm 2024-12-17T11:00:12,818 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals 2024-12-17T11:00:12,819 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/winogenerated 2024-12-17T11:00:12,820 copying build/lib/lm_eval/tasks/model_written_evals/winogenerated/winogenerated.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/winogenerated 2024-12-17T11:00:12,823 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/sycophancy 2024-12-17T11:00:12,824 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2024-12-17T11:00:12,826 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2024-12-17T11:00:12,827 copying build/lib/lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/sycophancy 2024-12-17T11:00:12,830 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,831 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,833 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,835 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,837 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,839 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,840 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,842 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,844 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,846 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,848 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,849 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,851 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,852 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,854 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,856 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,858 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,860 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,861 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,863 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,865 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,867 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,869 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,871 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,872 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,874 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,876 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,878 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,880 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,882 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,883 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,885 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,886 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,888 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,890 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,891 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,893 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,895 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,897 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,899 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,900 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,902 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,904 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,906 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,908 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,910 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,911 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,913 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,915 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,916 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,918 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,920 copying build/lib/lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/advanced_ai_risk 2024-12-17T11:00:12,925 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,925 copying build/lib/lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,927 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,929 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,931 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,933 copying build/lib/lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,934 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,936 copying build/lib/lm_eval/tasks/model_written_evals/persona/_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,938 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,940 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,942 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,944 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,946 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,948 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,950 copying build/lib/lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,951 copying build/lib/lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,953 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,955 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,956 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,958 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,960 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,961 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,963 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,965 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,967 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,968 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,970 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,972 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,974 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,976 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,977 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-averse.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,979 copying build/lib/lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,981 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,983 copying build/lib/lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,985 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,987 copying build/lib/lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,988 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,990 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,991 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,994 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,995 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,997 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:12,999 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,000 copying build/lib/lm_eval/tasks/model_written_evals/persona/extraversion.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,002 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,004 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,006 copying build/lib/lm_eval/tasks/model_written_evals/persona/self-replication.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,007 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,009 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,011 copying build/lib/lm_eval/tasks/model_written_evals/persona/openness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,013 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,015 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,016 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,018 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,020 copying build/lib/lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,022 copying build/lib/lm_eval/tasks/model_written_evals/persona/neuroticism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,023 copying build/lib/lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,025 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,027 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,028 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,030 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,032 copying build/lib/lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,034 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,035 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-disability.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,037 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,039 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,040 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,042 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,044 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,046 copying build/lib/lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,047 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,049 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,051 copying build/lib/lm_eval/tasks/model_written_evals/persona/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,053 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,054 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,056 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,058 copying build/lib/lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,060 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,061 copying build/lib/lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,063 copying build/lib/lm_eval/tasks/model_written_evals/persona/psychopathy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,065 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,066 copying build/lib/lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,068 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,069 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,071 copying build/lib/lm_eval/tasks/model_written_evals/persona/agreeableness.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,073 copying build/lib/lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,075 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,077 copying build/lib/lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,079 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,080 copying build/lib/lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,082 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,084 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,085 copying build/lib/lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,087 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,089 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,091 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,092 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,094 copying build/lib/lm_eval/tasks/model_written_evals/persona/narcissism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,096 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,098 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,099 copying build/lib/lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,101 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,103 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,105 copying build/lib/lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,107 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,108 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,110 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,111 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,113 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,115 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,117 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,118 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,120 copying build/lib/lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,122 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,124 copying build/lib/lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,125 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,127 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,128 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,131 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,132 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,135 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,137 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,139 copying build/lib/lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,141 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,142 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,145 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,147 copying build/lib/lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,149 copying build/lib/lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,151 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,154 copying build/lib/lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,156 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,158 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,160 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,162 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,165 copying build/lib/lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,167 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,169 copying build/lib/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,171 copying build/lib/lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/model_written_evals/persona 2024-12-17T11:00:13,174 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/arc_mt 2024-12-17T11:00:13,175 copying build/lib/lm_eval/tasks/arc_mt/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,178 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,180 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,182 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,184 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,186 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,188 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,190 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,191 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,194 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,196 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,198 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,199 copying build/lib/lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/arc_mt 2024-12-17T11:00:13,202 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/storycloze 2024-12-17T11:00:13,203 copying build/lib/lm_eval/tasks/storycloze/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2024-12-17T11:00:13,206 copying build/lib/lm_eval/tasks/storycloze/storycloze_2016.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2024-12-17T11:00:13,207 copying build/lib/lm_eval/tasks/storycloze/storycloze_2018.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/storycloze 2024-12-17T11:00:13,210 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/commonsense_qa 2024-12-17T11:00:13,211 copying build/lib/lm_eval/tasks/commonsense_qa/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/commonsense_qa 2024-12-17T11:00:13,214 copying build/lib/lm_eval/tasks/commonsense_qa/default.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/commonsense_qa 2024-12-17T11:00:13,216 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/galician_bench 2024-12-17T11:00:13,217 copying build/lib/lm_eval/tasks/galician_bench/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,220 copying build/lib/lm_eval/tasks/galician_bench/paws_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,222 copying build/lib/lm_eval/tasks/galician_bench/xnli_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,224 copying build/lib/lm_eval/tasks/galician_bench/galician_bench.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,226 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,228 copying build/lib/lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,230 copying build/lib/lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,231 copying build/lib/lm_eval/tasks/galician_bench/openbookqa_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,234 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,236 copying build/lib/lm_eval/tasks/galician_bench/galcola.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,239 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,240 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,242 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,245 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,247 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,249 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,251 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,253 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,255 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,257 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,259 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,262 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,264 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,266 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,268 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,270 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,272 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,274 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,276 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,279 copying build/lib/lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench/flores_gl 2024-12-17T11:00:13,281 copying build/lib/lm_eval/tasks/galician_bench/summarization_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,283 copying build/lib/lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,285 copying build/lib/lm_eval/tasks/galician_bench/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,287 copying build/lib/lm_eval/tasks/galician_bench/xstorycloze_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,290 copying build/lib/lm_eval/tasks/galician_bench/parafrases_gl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/galician_bench 2024-12-17T11:00:13,292 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu 2024-12-17T11:00:13,293 copying build/lib/lm_eval/tasks/mmlu/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu 2024-12-17T11:00:13,298 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,299 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,303 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,305 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,307 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,309 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,311 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,314 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,317 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,320 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,323 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,325 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,328 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,331 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,334 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,337 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,340 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,342 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,346 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,348 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,351 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,354 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,356 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,360 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,363 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,365 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,368 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,370 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,373 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,375 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,379 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,381 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,384 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,387 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,390 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,392 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,396 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,398 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,402 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,406 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,409 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,413 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,417 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,419 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,422 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,425 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,428 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,431 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,434 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,437 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,441 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,443 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,446 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,449 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,452 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,456 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,458 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,466 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,469 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,471 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,474 copying build/lib/lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_fewshot 2024-12-17T11:00:13,479 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,480 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,483 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,486 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,488 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,491 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,493 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,495 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,498 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,500 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,503 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,505 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,508 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,510 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,513 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,516 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,519 copying build/lib/lm_eval/tasks/mmlu/continuation/_continuation_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,522 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,525 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,528 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,531 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,534 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,536 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,539 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,542 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,544 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,546 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,548 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,551 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,553 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,555 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,558 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,560 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,563 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,566 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,568 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,571 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,574 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,576 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,578 copying build/lib/lm_eval/tasks/mmlu/continuation/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,581 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,584 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,587 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,590 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,592 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,595 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,597 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,600 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,602 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,605 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,608 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,610 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,613 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,616 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,619 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,622 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,625 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,627 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,630 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,632 copying build/lib/lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/continuation 2024-12-17T11:00:13,636 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,638 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,641 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,643 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,645 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,647 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,649 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,652 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,654 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,656 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,658 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,661 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,663 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,665 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,668 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,670 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,673 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,675 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,678 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,680 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,682 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,685 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,687 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,690 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,692 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,694 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,696 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,699 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,701 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,703 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,705 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,707 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,710 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,712 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,714 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,716 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,718 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,720 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,722 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,724 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,726 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,728 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,730 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,732 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,734 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,736 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,738 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,740 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,743 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,744 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,746 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,748 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,749 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,751 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,753 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,755 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,757 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,758 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,760 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,761 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,763 copying build/lib/lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_cot_zeroshot 2024-12-17T11:00:13,765 copying build/lib/lm_eval/tasks/mmlu/_generate_configs.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu 2024-12-17T11:00:13,767 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot 2024-12-17T11:00:13,769 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,771 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,772 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,774 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,776 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,778 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,780 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,781 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,783 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,785 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,786 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,788 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,790 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,791 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,793 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,795 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,797 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,798 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,800 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,802 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,804 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,805 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,807 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,809 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,810 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,812 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,814 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,816 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,817 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,819 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,821 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,823 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,825 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,826 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,828 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,830 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,832 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,834 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,835 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,837 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,839 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,841 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,843 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,844 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,846 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,848 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,849 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,851 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,854 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,855 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,857 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,859 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,861 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,863 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,865 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,868 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,870 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,872 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,874 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,876 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/loglikelihood 2024-12-17T11:00:13,879 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,880 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,883 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,885 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,887 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,889 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,891 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,893 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,895 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,897 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,898 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,900 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,902 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,904 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,907 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,909 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,910 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,912 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,914 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,916 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,918 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,920 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,922 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,924 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,925 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,927 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,929 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,930 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,932 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,934 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,935 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,937 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,939 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,941 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,943 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,944 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,946 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,948 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,950 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,952 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,954 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,955 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,957 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,959 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,961 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,962 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,964 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,965 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,967 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,969 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,971 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,973 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,974 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,976 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,978 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,980 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,981 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,983 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,985 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,987 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,989 copying build/lib/lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/flan_n_shot/generative 2024-12-17T11:00:13,992 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/default 2024-12-17T11:00:13,993 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:13,994 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:13,996 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:13,998 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:13,999 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,001 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,003 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,005 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,006 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,008 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,010 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_stem.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,011 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,014 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,016 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,018 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,020 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,022 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,023 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,025 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu_other.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,027 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,029 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,031 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,032 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,034 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,036 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,038 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,040 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,041 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,043 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,045 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,046 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,048 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,050 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,051 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,053 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,055 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,056 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,058 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,060 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,062 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,064 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,066 copying build/lib/lm_eval/tasks/mmlu/default/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,067 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,069 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,071 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,073 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,075 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,076 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,078 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,080 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,082 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,084 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,085 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,087 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,089 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,090 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,092 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,094 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,095 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,097 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,099 copying build/lib/lm_eval/tasks/mmlu/default/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,101 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,102 copying build/lib/lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/default 2024-12-17T11:00:14,105 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,106 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,108 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_virology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,110 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,111 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,113 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,115 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,117 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,119 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,120 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,122 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,124 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,126 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,128 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,130 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,131 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,133 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,134 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,136 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,138 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,139 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,141 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,143 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,145 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,146 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,148 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,150 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,152 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,154 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,155 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,157 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,159 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,160 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,162 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,164 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,166 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,167 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,169 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_management.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,171 copying build/lib/lm_eval/tasks/mmlu/generative/_mmlu.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,172 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,174 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,176 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,177 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,179 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,181 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,182 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,184 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,186 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,188 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,190 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,191 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,193 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,195 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,197 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,199 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,201 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,203 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,204 copying build/lib/lm_eval/tasks/mmlu/generative/_default_template_yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,206 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,208 copying build/lib/lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/mmlu/generative 2024-12-17T11:00:14,210 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:14,211 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:14,213 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:14,215 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:14,216 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:14,218 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:14,220 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:14,221 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:14,223 copying build/lib/lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/lambada_multilingual_stablelm 2024-12-17T11:00:14,225 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks/hellaswag 2024-12-17T11:00:14,226 copying build/lib/lm_eval/tasks/hellaswag/README.md -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2024-12-17T11:00:14,228 copying build/lib/lm_eval/tasks/hellaswag/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2024-12-17T11:00:14,230 copying build/lib/lm_eval/tasks/hellaswag/hellaswag.yaml -> build/bdist.linux-armv7l/wheel/./lm_eval/tasks/hellaswag 2024-12-17T11:00:14,233 copying build/lib/lm_eval/__main__.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2024-12-17T11:00:14,236 creating build/bdist.linux-armv7l/wheel/lm_eval/prompts 2024-12-17T11:00:14,237 copying build/lib/lm_eval/prompts/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/prompts 2024-12-17T11:00:14,240 creating build/bdist.linux-armv7l/wheel/lm_eval/decontamination 2024-12-17T11:00:14,241 copying build/lib/lm_eval/decontamination/decontaminate.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2024-12-17T11:00:14,243 copying build/lib/lm_eval/decontamination/archiver.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2024-12-17T11:00:14,246 copying build/lib/lm_eval/decontamination/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2024-12-17T11:00:14,247 copying build/lib/lm_eval/decontamination/janitor.py -> build/bdist.linux-armv7l/wheel/./lm_eval/decontamination 2024-12-17T11:00:14,250 creating build/bdist.linux-armv7l/wheel/lm_eval/caching 2024-12-17T11:00:14,251 copying build/lib/lm_eval/caching/cache.py -> build/bdist.linux-armv7l/wheel/./lm_eval/caching 2024-12-17T11:00:14,253 copying build/lib/lm_eval/caching/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/caching 2024-12-17T11:00:14,255 copying build/lib/lm_eval/evaluator.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2024-12-17T11:00:14,259 creating build/bdist.linux-armv7l/wheel/lm_eval/models 2024-12-17T11:00:14,259 copying build/lib/lm_eval/models/neuron_optimum.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,262 copying build/lib/lm_eval/models/textsynth.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,265 copying build/lib/lm_eval/models/optimum_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,267 copying build/lib/lm_eval/models/api_models.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,270 copying build/lib/lm_eval/models/ibm_watsonx_ai.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,273 copying build/lib/lm_eval/models/vllm_vlms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,276 copying build/lib/lm_eval/models/dummy.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,278 copying build/lib/lm_eval/models/hf_vlms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,281 copying build/lib/lm_eval/models/anthropic_llms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,284 copying build/lib/lm_eval/models/openai_completions.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,287 copying build/lib/lm_eval/models/nemo_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,290 copying build/lib/lm_eval/models/optimum_ipex.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,292 copying build/lib/lm_eval/models/gguf.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,295 copying build/lib/lm_eval/models/mamba_lm.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,297 copying build/lib/lm_eval/models/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,300 copying build/lib/lm_eval/models/vllm_causallms.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,304 copying build/lib/lm_eval/models/huggingface.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,309 copying build/lib/lm_eval/models/neuralmagic.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,311 copying build/lib/lm_eval/models/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/models 2024-12-17T11:00:14,314 creating build/bdist.linux-armv7l/wheel/lm_eval/filters 2024-12-17T11:00:14,316 copying build/lib/lm_eval/filters/selection.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2024-12-17T11:00:14,318 copying build/lib/lm_eval/filters/extraction.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2024-12-17T11:00:14,321 copying build/lib/lm_eval/filters/transformation.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2024-12-17T11:00:14,323 copying build/lib/lm_eval/filters/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2024-12-17T11:00:14,325 copying build/lib/lm_eval/filters/decontamination.py -> build/bdist.linux-armv7l/wheel/./lm_eval/filters 2024-12-17T11:00:14,328 copying build/lib/lm_eval/utils.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2024-12-17T11:00:14,330 copying build/lib/lm_eval/__init__.py -> build/bdist.linux-armv7l/wheel/./lm_eval 2024-12-17T11:00:14,333 running install_egg_info 2024-12-17T11:00:14,342 Copying lm_eval.egg-info to build/bdist.linux-armv7l/wheel/./lm_eval-0.4.7-py3.11.egg-info 2024-12-17T11:00:14,365 running install_scripts 2024-12-17T11:00:14,378 creating build/bdist.linux-armv7l/wheel/lm_eval-0.4.7.dist-info/WHEEL 2024-12-17T11:00:14,380 creating '/tmp/pip-wheel-gii7g1u5/.tmp-bcgkt828/lm_eval-0.4.7-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-12-17T11:00:14,383 adding 'lm_eval/__init__.py' 2024-12-17T11:00:14,386 adding 'lm_eval/__main__.py' 2024-12-17T11:00:14,389 adding 'lm_eval/evaluator.py' 2024-12-17T11:00:14,392 adding 'lm_eval/evaluator_utils.py' 2024-12-17T11:00:14,395 adding 'lm_eval/utils.py' 2024-12-17T11:00:14,397 adding 'lm_eval/api/__init__.py' 2024-12-17T11:00:14,398 adding 'lm_eval/api/filter.py' 2024-12-17T11:00:14,400 adding 'lm_eval/api/group.py' 2024-12-17T11:00:14,401 adding 'lm_eval/api/instance.py' 2024-12-17T11:00:14,403 adding 'lm_eval/api/metrics.py' 2024-12-17T11:00:14,406 adding 'lm_eval/api/model.py' 2024-12-17T11:00:14,408 adding 'lm_eval/api/registry.py' 2024-12-17T11:00:14,410 adding 'lm_eval/api/samplers.py' 2024-12-17T11:00:14,417 adding 'lm_eval/api/task.py' 2024-12-17T11:00:14,419 adding 'lm_eval/caching/__init__.py' 2024-12-17T11:00:14,420 adding 'lm_eval/caching/cache.py' 2024-12-17T11:00:14,422 adding 'lm_eval/decontamination/__init__.py' 2024-12-17T11:00:14,423 adding 'lm_eval/decontamination/archiver.py' 2024-12-17T11:00:14,425 adding 'lm_eval/decontamination/decontaminate.py' 2024-12-17T11:00:14,427 adding 'lm_eval/decontamination/janitor.py' 2024-12-17T11:00:14,428 adding 'lm_eval/filters/__init__.py' 2024-12-17T11:00:14,430 adding 'lm_eval/filters/decontamination.py' 2024-12-17T11:00:14,431 adding 'lm_eval/filters/extraction.py' 2024-12-17T11:00:14,432 adding 'lm_eval/filters/selection.py' 2024-12-17T11:00:14,433 adding 'lm_eval/filters/transformation.py' 2024-12-17T11:00:14,435 adding 'lm_eval/loggers/__init__.py' 2024-12-17T11:00:14,438 adding 'lm_eval/loggers/evaluation_tracker.py' 2024-12-17T11:00:14,439 adding 'lm_eval/loggers/utils.py' 2024-12-17T11:00:14,441 adding 'lm_eval/loggers/wandb_logger.py' 2024-12-17T11:00:14,443 adding 'lm_eval/models/__init__.py' 2024-12-17T11:00:14,445 adding 'lm_eval/models/anthropic_llms.py' 2024-12-17T11:00:14,448 adding 'lm_eval/models/api_models.py' 2024-12-17T11:00:14,449 adding 'lm_eval/models/dummy.py' 2024-12-17T11:00:14,451 adding 'lm_eval/models/gguf.py' 2024-12-17T11:00:14,455 adding 'lm_eval/models/hf_vlms.py' 2024-12-17T11:00:14,462 adding 'lm_eval/models/huggingface.py' 2024-12-17T11:00:14,464 adding 'lm_eval/models/ibm_watsonx_ai.py' 2024-12-17T11:00:14,466 adding 'lm_eval/models/mamba_lm.py' 2024-12-17T11:00:14,468 adding 'lm_eval/models/nemo_lm.py' 2024-12-17T11:00:14,471 adding 'lm_eval/models/neuralmagic.py' 2024-12-17T11:00:14,474 adding 'lm_eval/models/neuron_optimum.py' 2024-12-17T11:00:14,476 adding 'lm_eval/models/openai_completions.py' 2024-12-17T11:00:14,477 adding 'lm_eval/models/optimum_ipex.py' 2024-12-17T11:00:14,479 adding 'lm_eval/models/optimum_lm.py' 2024-12-17T11:00:14,480 adding 'lm_eval/models/textsynth.py' 2024-12-17T11:00:14,484 adding 'lm_eval/models/utils.py' 2024-12-17T11:00:14,487 adding 'lm_eval/models/vllm_causallms.py' 2024-12-17T11:00:14,489 adding 'lm_eval/models/vllm_vlms.py' 2024-12-17T11:00:14,491 adding 'lm_eval/prompts/__init__.py' 2024-12-17T11:00:14,496 adding 'lm_eval/tasks/README.md' 2024-12-17T11:00:14,500 adding 'lm_eval/tasks/__init__.py' 2024-12-17T11:00:14,502 adding 'lm_eval/tasks/aclue/README.md' 2024-12-17T11:00:14,503 adding 'lm_eval/tasks/aclue/_aclue.yaml' 2024-12-17T11:00:14,504 adding 'lm_eval/tasks/aclue/_default_template_yaml' 2024-12-17T11:00:14,505 adding 'lm_eval/tasks/aclue/_generate_configs.py' 2024-12-17T11:00:14,507 adding 'lm_eval/tasks/aclue/aclue_ancient_chinese_culture.yaml' 2024-12-17T11:00:14,508 adding 'lm_eval/tasks/aclue/aclue_ancient_literature.yaml' 2024-12-17T11:00:14,509 adding 'lm_eval/tasks/aclue/aclue_ancient_medical.yaml' 2024-12-17T11:00:14,510 adding 'lm_eval/tasks/aclue/aclue_ancient_phonetics.yaml' 2024-12-17T11:00:14,511 adding 'lm_eval/tasks/aclue/aclue_basic_ancient_chinese.yaml' 2024-12-17T11:00:14,512 adding 'lm_eval/tasks/aclue/aclue_couplet_prediction.yaml' 2024-12-17T11:00:14,514 adding 'lm_eval/tasks/aclue/aclue_homographic_character_resolution.yaml' 2024-12-17T11:00:14,515 adding 'lm_eval/tasks/aclue/aclue_named_entity_recognition.yaml' 2024-12-17T11:00:14,516 adding 'lm_eval/tasks/aclue/aclue_poetry_appreciate.yaml' 2024-12-17T11:00:14,517 adding 'lm_eval/tasks/aclue/aclue_poetry_context_prediction.yaml' 2024-12-17T11:00:14,518 adding 'lm_eval/tasks/aclue/aclue_poetry_quality_assessment.yaml' 2024-12-17T11:00:14,520 adding 'lm_eval/tasks/aclue/aclue_poetry_sentiment_analysis.yaml' 2024-12-17T11:00:14,521 adding 'lm_eval/tasks/aclue/aclue_polysemy_resolution.yaml' 2024-12-17T11:00:14,522 adding 'lm_eval/tasks/aclue/aclue_reading_comprehension.yaml' 2024-12-17T11:00:14,523 adding 'lm_eval/tasks/aclue/aclue_sentence_segmentation.yaml' 2024-12-17T11:00:14,525 adding 'lm_eval/tasks/aexams/README.md' 2024-12-17T11:00:14,526 adding 'lm_eval/tasks/aexams/_aexams.yaml' 2024-12-17T11:00:14,527 adding 'lm_eval/tasks/aexams/_default_template_yaml' 2024-12-17T11:00:14,528 adding 'lm_eval/tasks/aexams/aexams_Biology.yaml' 2024-12-17T11:00:14,530 adding 'lm_eval/tasks/aexams/aexams_IslamicStudies.yaml' 2024-12-17T11:00:14,531 adding 'lm_eval/tasks/aexams/aexams_Physics.yaml' 2024-12-17T11:00:14,532 adding 'lm_eval/tasks/aexams/aexams_Science.yaml' 2024-12-17T11:00:14,533 adding 'lm_eval/tasks/aexams/aexams_Social.yaml' 2024-12-17T11:00:14,535 adding 'lm_eval/tasks/afrimgsm/README.md' 2024-12-17T11:00:14,536 adding 'lm_eval/tasks/afrimgsm/gen_yaml.sh' 2024-12-17T11:00:14,537 adding 'lm_eval/tasks/afrimgsm/run.sh' 2024-12-17T11:00:14,538 adding 'lm_eval/tasks/afrimgsm/utils.py' 2024-12-17T11:00:14,540 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_amh.yaml' 2024-12-17T11:00:14,541 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_eng.yaml' 2024-12-17T11:00:14,542 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_ewe.yaml' 2024-12-17T11:00:14,543 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_fra.yaml' 2024-12-17T11:00:14,544 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_hau.yaml' 2024-12-17T11:00:14,546 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_ibo.yaml' 2024-12-17T11:00:14,547 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_kin.yaml' 2024-12-17T11:00:14,548 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_lin.yaml' 2024-12-17T11:00:14,549 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_lug.yaml' 2024-12-17T11:00:14,550 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_orm.yaml' 2024-12-17T11:00:14,551 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_sna.yaml' 2024-12-17T11:00:14,552 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_sot.yaml' 2024-12-17T11:00:14,553 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_swa.yaml' 2024-12-17T11:00:14,554 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_twi.yaml' 2024-12-17T11:00:14,556 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_wol.yaml' 2024-12-17T11:00:14,557 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_xho.yaml' 2024-12-17T11:00:14,558 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_yor.yaml' 2024-12-17T11:00:14,559 adding 'lm_eval/tasks/afrimgsm/direct/afrimgsm_direct_zul.yaml' 2024-12-17T11:00:14,560 adding 'lm_eval/tasks/afrimgsm/direct/direct_yaml' 2024-12-17T11:00:14,562 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_amh.yaml' 2024-12-17T11:00:14,563 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_eng.yaml' 2024-12-17T11:00:14,565 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_ewe.yaml' 2024-12-17T11:00:14,566 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_fra.yaml' 2024-12-17T11:00:14,567 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_hau.yaml' 2024-12-17T11:00:14,568 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_ibo.yaml' 2024-12-17T11:00:14,569 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_kin.yaml' 2024-12-17T11:00:14,571 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_lin.yaml' 2024-12-17T11:00:14,572 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_lug.yaml' 2024-12-17T11:00:14,573 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_orm.yaml' 2024-12-17T11:00:14,574 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_sna.yaml' 2024-12-17T11:00:14,576 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_sot.yaml' 2024-12-17T11:00:14,577 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_swa.yaml' 2024-12-17T11:00:14,578 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_twi.yaml' 2024-12-17T11:00:14,579 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_wol.yaml' 2024-12-17T11:00:14,580 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_xho.yaml' 2024-12-17T11:00:14,582 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_yor.yaml' 2024-12-17T11:00:14,583 adding 'lm_eval/tasks/afrimgsm/en_cot/afrimgsm_en_cot_zul.yaml' 2024-12-17T11:00:14,584 adding 'lm_eval/tasks/afrimgsm/en_cot/cot_yaml' 2024-12-17T11:00:14,586 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_amh.yaml' 2024-12-17T11:00:14,588 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_eng.yaml' 2024-12-17T11:00:14,589 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_ewe.yaml' 2024-12-17T11:00:14,590 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_fra.yaml' 2024-12-17T11:00:14,591 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_hau.yaml' 2024-12-17T11:00:14,592 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_ibo.yaml' 2024-12-17T11:00:14,593 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_kin.yaml' 2024-12-17T11:00:14,594 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_lin.yaml' 2024-12-17T11:00:14,595 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_lug.yaml' 2024-12-17T11:00:14,597 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_orm.yaml' 2024-12-17T11:00:14,598 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_sna.yaml' 2024-12-17T11:00:14,599 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_sot.yaml' 2024-12-17T11:00:14,600 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_swa.yaml' 2024-12-17T11:00:14,601 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_twi.yaml' 2024-12-17T11:00:14,602 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_wol.yaml' 2024-12-17T11:00:14,603 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_xho.yaml' 2024-12-17T11:00:14,604 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_yor.yaml' 2024-12-17T11:00:14,605 adding 'lm_eval/tasks/afrimgsm/translate/afrimgsm_translate_zul.yaml' 2024-12-17T11:00:14,606 adding 'lm_eval/tasks/afrimgsm/translate/translate_direct_yaml' 2024-12-17T11:00:14,608 adding 'lm_eval/tasks/afrimmlu/README.md' 2024-12-17T11:00:14,609 adding 'lm_eval/tasks/afrimmlu/fewshot.sh' 2024-12-17T11:00:14,611 adding 'lm_eval/tasks/afrimmlu/utils.py' 2024-12-17T11:00:14,612 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_common_yaml' 2024-12-17T11:00:14,613 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_amh.yaml' 2024-12-17T11:00:14,615 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_eng.yaml' 2024-12-17T11:00:14,616 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_ewe.yaml' 2024-12-17T11:00:14,617 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_fra.yaml' 2024-12-17T11:00:14,618 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_hau.yaml' 2024-12-17T11:00:14,619 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_ibo.yaml' 2024-12-17T11:00:14,620 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_kin.yaml' 2024-12-17T11:00:14,621 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_lin.yaml' 2024-12-17T11:00:14,622 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_lug.yaml' 2024-12-17T11:00:14,624 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_orm.yaml' 2024-12-17T11:00:14,625 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_sna.yaml' 2024-12-17T11:00:14,626 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_sot.yaml' 2024-12-17T11:00:14,627 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_swa.yaml' 2024-12-17T11:00:14,628 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_twi.yaml' 2024-12-17T11:00:14,629 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_wol.yaml' 2024-12-17T11:00:14,630 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_xho.yaml' 2024-12-17T11:00:14,631 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_yor.yaml' 2024-12-17T11:00:14,633 adding 'lm_eval/tasks/afrimmlu/direct/afrimmlu_direct_zul.yaml' 2024-12-17T11:00:14,634 adding 'lm_eval/tasks/afrimmlu/direct/utils.py' 2024-12-17T11:00:14,636 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_common_translate_yaml' 2024-12-17T11:00:14,637 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_amh.yaml' 2024-12-17T11:00:14,638 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_eng.yaml' 2024-12-17T11:00:14,639 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_ewe.yaml' 2024-12-17T11:00:14,640 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_fra.yaml' 2024-12-17T11:00:14,642 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_hau.yaml' 2024-12-17T11:00:14,643 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_ibo.yaml' 2024-12-17T11:00:14,644 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_kin.yaml' 2024-12-17T11:00:14,645 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_lin.yaml' 2024-12-17T11:00:14,646 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_lug.yaml' 2024-12-17T11:00:14,647 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_orm.yaml' 2024-12-17T11:00:14,648 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_sna.yaml' 2024-12-17T11:00:14,649 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_sot.yaml' 2024-12-17T11:00:14,650 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_swa.yaml' 2024-12-17T11:00:14,651 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_twi.yaml' 2024-12-17T11:00:14,651 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_wol.yaml' 2024-12-17T11:00:14,653 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_xho.yaml' 2024-12-17T11:00:14,654 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_yor.yaml' 2024-12-17T11:00:14,655 adding 'lm_eval/tasks/afrimmlu/translate/afrimmlu_translate_zul.yaml' 2024-12-17T11:00:14,656 adding 'lm_eval/tasks/afrimmlu/translate/utils.py' 2024-12-17T11:00:14,658 adding 'lm_eval/tasks/afrixnli/README.md' 2024-12-17T11:00:14,659 adding 'lm_eval/tasks/afrixnli/utils.py' 2024-12-17T11:00:14,661 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_amh.yaml' 2024-12-17T11:00:14,663 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_eng.yaml' 2024-12-17T11:00:14,664 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ewe.yaml' 2024-12-17T11:00:14,665 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_fra.yaml' 2024-12-17T11:00:14,666 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_hau.yaml' 2024-12-17T11:00:14,667 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_ibo.yaml' 2024-12-17T11:00:14,668 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_kin.yaml' 2024-12-17T11:00:14,669 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lin.yaml' 2024-12-17T11:00:14,670 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_lug.yaml' 2024-12-17T11:00:14,672 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_orm.yaml' 2024-12-17T11:00:14,673 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sna.yaml' 2024-12-17T11:00:14,674 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_sot.yaml' 2024-12-17T11:00:14,675 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_swa.yaml' 2024-12-17T11:00:14,676 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_twi.yaml' 2024-12-17T11:00:14,677 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_wol.yaml' 2024-12-17T11:00:14,679 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_xho.yaml' 2024-12-17T11:00:14,680 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yaml' 2024-12-17T11:00:14,681 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_yor.yaml' 2024-12-17T11:00:14,682 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/afrixnli_en_direct_zul.yaml' 2024-12-17T11:00:14,683 adding 'lm_eval/tasks/afrixnli/anli prompt/en-direct/utils.py' 2024-12-17T11:00:14,685 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_amh.yaml' 2024-12-17T11:00:14,687 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_eng.yaml' 2024-12-17T11:00:14,688 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ewe.yaml' 2024-12-17T11:00:14,689 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_fra.yaml' 2024-12-17T11:00:14,690 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_hau.yaml' 2024-12-17T11:00:14,691 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_ibo.yaml' 2024-12-17T11:00:14,692 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_kin.yaml' 2024-12-17T11:00:14,694 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lin.yaml' 2024-12-17T11:00:14,695 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_lug.yaml' 2024-12-17T11:00:14,696 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_orm.yaml' 2024-12-17T11:00:14,697 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sna.yaml' 2024-12-17T11:00:14,698 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_sot.yaml' 2024-12-17T11:00:14,699 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_swa.yaml' 2024-12-17T11:00:14,700 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_twi.yaml' 2024-12-17T11:00:14,701 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_wol.yaml' 2024-12-17T11:00:14,702 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_xho.yaml' 2024-12-17T11:00:14,703 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yaml' 2024-12-17T11:00:14,704 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_yor.yaml' 2024-12-17T11:00:14,705 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/afrixnli_native_direct_zul.yaml' 2024-12-17T11:00:14,706 adding 'lm_eval/tasks/afrixnli/anli prompt/native-direct/utils.py' 2024-12-17T11:00:14,708 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_amh.yaml' 2024-12-17T11:00:14,709 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ewe.yaml' 2024-12-17T11:00:14,710 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_fra.yaml' 2024-12-17T11:00:14,712 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_hau.yaml' 2024-12-17T11:00:14,713 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_ibo.yaml' 2024-12-17T11:00:14,714 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_kin.yaml' 2024-12-17T11:00:14,715 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lin.yaml' 2024-12-17T11:00:14,716 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_lug.yaml' 2024-12-17T11:00:14,718 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_orm.yaml' 2024-12-17T11:00:14,719 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sna.yaml' 2024-12-17T11:00:14,720 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_sot.yaml' 2024-12-17T11:00:14,722 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_swa.yaml' 2024-12-17T11:00:14,723 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_twi.yaml' 2024-12-17T11:00:14,724 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_wol.yaml' 2024-12-17T11:00:14,725 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_xho.yaml' 2024-12-17T11:00:14,726 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yaml' 2024-12-17T11:00:14,728 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_yor.yaml' 2024-12-17T11:00:14,729 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/afrixnli_translate_zul.yaml' 2024-12-17T11:00:14,730 adding 'lm_eval/tasks/afrixnli/anli prompt/translate/utils.py' 2024-12-17T11:00:14,732 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_amh.yaml' 2024-12-17T11:00:14,733 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_eng.yaml' 2024-12-17T11:00:14,734 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ewe.yaml' 2024-12-17T11:00:14,735 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_fra.yaml' 2024-12-17T11:00:14,736 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_hau.yaml' 2024-12-17T11:00:14,737 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_ibo.yaml' 2024-12-17T11:00:14,738 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_kin.yaml' 2024-12-17T11:00:14,739 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lin.yaml' 2024-12-17T11:00:14,740 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_lug.yaml' 2024-12-17T11:00:14,742 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_orm.yaml' 2024-12-17T11:00:14,743 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sna.yaml' 2024-12-17T11:00:14,744 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_sot.yaml' 2024-12-17T11:00:14,745 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_swa.yaml' 2024-12-17T11:00:14,746 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_twi.yaml' 2024-12-17T11:00:14,747 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_wol.yaml' 2024-12-17T11:00:14,748 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_xho.yaml' 2024-12-17T11:00:14,749 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yaml' 2024-12-17T11:00:14,750 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_yor.yaml' 2024-12-17T11:00:14,751 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/afrixnli_manual_direct_zul.yaml' 2024-12-17T11:00:14,753 adding 'lm_eval/tasks/afrixnli/lai prompt/direct/utils.py' 2024-12-17T11:00:14,755 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_amh.yaml' 2024-12-17T11:00:14,756 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ewe.yaml' 2024-12-17T11:00:14,757 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_fra.yaml' 2024-12-17T11:00:14,758 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_hau.yaml' 2024-12-17T11:00:14,759 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_ibo.yaml' 2024-12-17T11:00:14,760 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_kin.yaml' 2024-12-17T11:00:14,761 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lin.yaml' 2024-12-17T11:00:14,763 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_lug.yaml' 2024-12-17T11:00:14,764 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_orm.yaml' 2024-12-17T11:00:14,765 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sna.yaml' 2024-12-17T11:00:14,766 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_sot.yaml' 2024-12-17T11:00:14,768 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_swa.yaml' 2024-12-17T11:00:14,769 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_twi.yaml' 2024-12-17T11:00:14,770 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_wol.yaml' 2024-12-17T11:00:14,771 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_xho.yaml' 2024-12-17T11:00:14,772 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yaml' 2024-12-17T11:00:14,774 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_yor.yaml' 2024-12-17T11:00:14,775 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/afrixnli_manual_translate_zul.yaml' 2024-12-17T11:00:14,776 adding 'lm_eval/tasks/afrixnli/lai prompt/translate/utils.py' 2024-12-17T11:00:14,778 adding 'lm_eval/tasks/agieval/README.md' 2024-12-17T11:00:14,779 adding 'lm_eval/tasks/agieval/agieval.yaml' 2024-12-17T11:00:14,780 adding 'lm_eval/tasks/agieval/agieval_cn.yaml' 2024-12-17T11:00:14,785 adding 'lm_eval/tasks/agieval/agieval_en.yaml' 2024-12-17T11:00:14,787 adding 'lm_eval/tasks/agieval/agieval_nous.yaml' 2024-12-17T11:00:14,788 adding 'lm_eval/tasks/agieval/aqua-rat.yaml' 2024-12-17T11:00:14,789 adding 'lm_eval/tasks/agieval/gaokao-biology.yaml' 2024-12-17T11:00:14,790 adding 'lm_eval/tasks/agieval/gaokao-chemistry.yaml' 2024-12-17T11:00:14,791 adding 'lm_eval/tasks/agieval/gaokao-chinese.yaml' 2024-12-17T11:00:14,792 adding 'lm_eval/tasks/agieval/gaokao-english.yaml' 2024-12-17T11:00:14,793 adding 'lm_eval/tasks/agieval/gaokao-geography.yaml' 2024-12-17T11:00:14,794 adding 'lm_eval/tasks/agieval/gaokao-history.yaml' 2024-12-17T11:00:14,795 adding 'lm_eval/tasks/agieval/gaokao-mathcloze.yaml' 2024-12-17T11:00:14,796 adding 'lm_eval/tasks/agieval/gaokao-mathqa.yaml' 2024-12-17T11:00:14,797 adding 'lm_eval/tasks/agieval/gaokao-physics.yaml' 2024-12-17T11:00:14,798 adding 'lm_eval/tasks/agieval/jec-qa-ca.yaml' 2024-12-17T11:00:14,799 adding 'lm_eval/tasks/agieval/jec-qa-kd.yaml' 2024-12-17T11:00:14,800 adding 'lm_eval/tasks/agieval/logiqa-en.yaml' 2024-12-17T11:00:14,801 adding 'lm_eval/tasks/agieval/logiqa-zh.yaml' 2024-12-17T11:00:14,802 adding 'lm_eval/tasks/agieval/lsat-ar.yaml' 2024-12-17T11:00:14,803 adding 'lm_eval/tasks/agieval/lsat-lr.yaml' 2024-12-17T11:00:14,804 adding 'lm_eval/tasks/agieval/lsat-rc.yaml' 2024-12-17T11:00:14,805 adding 'lm_eval/tasks/agieval/math.yaml' 2024-12-17T11:00:14,807 adding 'lm_eval/tasks/agieval/sat-en-without-passage.yaml' 2024-12-17T11:00:14,808 adding 'lm_eval/tasks/agieval/sat-en.yaml' 2024-12-17T11:00:14,809 adding 'lm_eval/tasks/agieval/sat-math.yaml' 2024-12-17T11:00:14,810 adding 'lm_eval/tasks/agieval/utils.py' 2024-12-17T11:00:14,812 adding 'lm_eval/tasks/alghafa/copa_ar/README.md' 2024-12-17T11:00:14,814 adding 'lm_eval/tasks/alghafa/copa_ar/copa_ar.yaml' 2024-12-17T11:00:14,815 adding 'lm_eval/tasks/alghafa/piqa_ar/README.md' 2024-12-17T11:00:14,817 adding 'lm_eval/tasks/alghafa/piqa_ar/piqa_ar.yaml' 2024-12-17T11:00:14,818 adding 'lm_eval/tasks/anli/README.md' 2024-12-17T11:00:14,820 adding 'lm_eval/tasks/anli/anli_r1.yaml' 2024-12-17T11:00:14,821 adding 'lm_eval/tasks/anli/anli_r2.yaml' 2024-12-17T11:00:14,822 adding 'lm_eval/tasks/anli/anli_r3.yaml' 2024-12-17T11:00:14,825 adding 'lm_eval/tasks/arabic_leaderboard_complete/README.md' 2024-12-17T11:00:14,826 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_complete.yaml' 2024-12-17T11:00:14,828 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa.yaml' 2024-12-17T11:00:14,829 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_mcq_exams_test_ar.yaml' 2024-12-17T11:00:14,830 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_dialects.yaml' 2024-12-17T11:00:14,831 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_meta_ar_msa.yaml' 2024-12-17T11:00:14,833 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task.yaml' 2024-12-17T11:00:14,834 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task.yaml' 2024-12-17T11:00:14,835 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task.yaml' 2024-12-17T11:00:14,836 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task.yaml' 2024-12-17T11:00:14,837 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task.yaml' 2024-12-17T11:00:14,838 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/arabic_leaderboard_alghafa_multiple_choice_sentiment_task.yaml' 2024-12-17T11:00:14,839 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_alghafa/utils.py' 2024-12-17T11:00:14,841 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_exams.yaml' 2024-12-17T11:00:14,844 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/arabic_leaderboard_arabic_exams.yaml' 2024-12-17T11:00:14,845 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_exams/utils.py' 2024-12-17T11:00:14,848 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu.yaml' 2024-12-17T11:00:14,849 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_abstract_algebra.yaml' 2024-12-17T11:00:14,851 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_anatomy.yaml' 2024-12-17T11:00:14,852 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_astronomy.yaml' 2024-12-17T11:00:14,853 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_business_ethics.yaml' 2024-12-17T11:00:14,854 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_clinical_knowledge.yaml' 2024-12-17T11:00:14,856 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_biology.yaml' 2024-12-17T11:00:14,857 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_chemistry.yaml' 2024-12-17T11:00:14,858 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_computer_science.yaml' 2024-12-17T11:00:14,859 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_mathematics.yaml' 2024-12-17T11:00:14,861 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_medicine.yaml' 2024-12-17T11:00:14,862 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_college_physics.yaml' 2024-12-17T11:00:14,863 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_computer_security.yaml' 2024-12-17T11:00:14,864 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_conceptual_physics.yaml' 2024-12-17T11:00:14,865 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_econometrics.yaml' 2024-12-17T11:00:14,867 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_electrical_engineering.yaml' 2024-12-17T11:00:14,868 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_elementary_mathematics.yaml' 2024-12-17T11:00:14,869 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_formal_logic.yaml' 2024-12-17T11:00:14,870 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_global_facts.yaml' 2024-12-17T11:00:14,872 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_biology.yaml' 2024-12-17T11:00:14,873 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_chemistry.yaml' 2024-12-17T11:00:14,874 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_computer_science.yaml' 2024-12-17T11:00:14,875 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_european_history.yaml' 2024-12-17T11:00:14,877 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_geography.yaml' 2024-12-17T11:00:14,878 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics.yaml' 2024-12-17T11:00:14,879 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics.yaml' 2024-12-17T11:00:14,880 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_mathematics.yaml' 2024-12-17T11:00:14,881 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_microeconomics.yaml' 2024-12-17T11:00:14,882 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_physics.yaml' 2024-12-17T11:00:14,883 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_psychology.yaml' 2024-12-17T11:00:14,884 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_statistics.yaml' 2024-12-17T11:00:14,886 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_us_history.yaml' 2024-12-17T11:00:14,887 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_high_school_world_history.yaml' 2024-12-17T11:00:14,888 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_aging.yaml' 2024-12-17T11:00:14,889 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_human_sexuality.yaml' 2024-12-17T11:00:14,890 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_international_law.yaml' 2024-12-17T11:00:14,892 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_jurisprudence.yaml' 2024-12-17T11:00:14,893 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_logical_fallacies.yaml' 2024-12-17T11:00:14,894 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_machine_learning.yaml' 2024-12-17T11:00:14,895 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_management.yaml' 2024-12-17T11:00:14,896 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_marketing.yaml' 2024-12-17T11:00:14,898 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_medical_genetics.yaml' 2024-12-17T11:00:14,899 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_miscellaneous.yaml' 2024-12-17T11:00:14,900 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_disputes.yaml' 2024-12-17T11:00:14,901 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_moral_scenarios.yaml' 2024-12-17T11:00:14,903 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_nutrition.yaml' 2024-12-17T11:00:14,904 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_philosophy.yaml' 2024-12-17T11:00:14,905 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_prehistory.yaml' 2024-12-17T11:00:14,906 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_accounting.yaml' 2024-12-17T11:00:14,907 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_law.yaml' 2024-12-17T11:00:14,908 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_medicine.yaml' 2024-12-17T11:00:14,909 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_professional_psychology.yaml' 2024-12-17T11:00:14,910 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_public_relations.yaml' 2024-12-17T11:00:14,911 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_security_studies.yaml' 2024-12-17T11:00:14,912 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_sociology.yaml' 2024-12-17T11:00:14,914 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_us_foreign_policy.yaml' 2024-12-17T11:00:14,915 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_virology.yaml' 2024-12-17T11:00:14,916 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/arabic_leaderboard_arabic_mmlu_world_religions.yaml' 2024-12-17T11:00:14,917 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mmlu/utils.py' 2024-12-17T11:00:14,919 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_leaderboard_arabic_mt_arc_challenge.yaml' 2024-12-17T11:00:14,921 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/arabic_mt_arc_challenge.yaml' 2024-12-17T11:00:14,922 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_challenge/utils.py' 2024-12-17T11:00:14,924 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_leaderboard_arabic_mt_arc_easy.yaml' 2024-12-17T11:00:14,925 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/arabic_mt_arc_easy.yaml' 2024-12-17T11:00:14,926 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_arc_easy/utils.py' 2024-12-17T11:00:14,928 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_leaderboard_arabic_mt_boolq.yaml' 2024-12-17T11:00:14,929 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/arabic_mt_boolq.yaml' 2024-12-17T11:00:14,930 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_boolq/utils.py' 2024-12-17T11:00:14,932 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_leaderboard_arabic_mt_copa.yaml' 2024-12-17T11:00:14,933 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/arabic_mt_copa.yaml' 2024-12-17T11:00:14,934 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_copa/utils.py' 2024-12-17T11:00:14,936 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_leaderboard_arabic_mt_hellaswag.yaml' 2024-12-17T11:00:14,937 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/arabic_mt_hellaswag.yaml' 2024-12-17T11:00:14,938 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_hellaswag/utils.py' 2024-12-17T11:00:14,940 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_leaderboard_arabic_mt_mmlu.yaml' 2024-12-17T11:00:14,941 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/arabic_mt_mmlu.yaml' 2024-12-17T11:00:14,942 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_mmlu/utils.py' 2024-12-17T11:00:14,944 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_leaderboard_arabic_mt_openbook_qa.yaml' 2024-12-17T11:00:14,945 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/arabic_mt_openbook_qa.yaml' 2024-12-17T11:00:14,946 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_openbook_qa/utils.py' 2024-12-17T11:00:14,948 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_leaderboard_arabic_mt_piqa.yaml' 2024-12-17T11:00:14,949 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/arabic_mt_piqa.yaml' 2024-12-17T11:00:14,950 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_piqa/utils.py' 2024-12-17T11:00:14,951 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_leaderboard_arabic_mt_race.yaml' 2024-12-17T11:00:14,953 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/arabic_mt_race.yaml' 2024-12-17T11:00:14,954 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_race/utils.py' 2024-12-17T11:00:14,956 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_leaderboard_arabic_mt_sciq.yaml' 2024-12-17T11:00:14,957 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/arabic_mt_sciq.yaml' 2024-12-17T11:00:14,958 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_sciq/utils.py' 2024-12-17T11:00:14,960 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_leaderboard_arabic_mt_toxigen.yaml' 2024-12-17T11:00:14,961 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/arabic_mt_toxigen.yaml' 2024-12-17T11:00:14,962 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_arabic_mt_toxigen/utils.py' 2024-12-17T11:00:14,965 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva.yaml' 2024-12-17T11:00:14,966 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Algeria.yaml' 2024-12-17T11:00:14,968 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Ancient_Egypt.yaml' 2024-12-17T11:00:14,969 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arab_Empire.yaml' 2024-12-17T11:00:14,970 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Architecture.yaml' 2024-12-17T11:00:14,971 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Art.yaml' 2024-12-17T11:00:14,972 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Astronomy.yaml' 2024-12-17T11:00:14,974 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Calligraphy.yaml' 2024-12-17T11:00:14,975 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ceremony.yaml' 2024-12-17T11:00:14,976 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Clothing.yaml' 2024-12-17T11:00:14,977 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Culture.yaml' 2024-12-17T11:00:14,978 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Food.yaml' 2024-12-17T11:00:14,979 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Funeral.yaml' 2024-12-17T11:00:14,981 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Geography.yaml' 2024-12-17T11:00:14,982 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_History.yaml' 2024-12-17T11:00:14,983 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Language_Origin.yaml' 2024-12-17T11:00:14,984 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Literature.yaml' 2024-12-17T11:00:14,985 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Math.yaml' 2024-12-17T11:00:14,986 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Medicine.yaml' 2024-12-17T11:00:14,987 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Music.yaml' 2024-12-17T11:00:14,988 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Ornament.yaml' 2024-12-17T11:00:14,990 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Philosophy.yaml' 2024-12-17T11:00:14,991 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry.yaml' 2024-12-17T11:00:14,992 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Arabic_Wedding.yaml' 2024-12-17T11:00:14,993 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Bahrain.yaml' 2024-12-17T11:00:14,994 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Comoros.yaml' 2024-12-17T11:00:14,996 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Egypt_modern.yaml' 2024-12-17T11:00:14,997 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromAncientEgypt.yaml' 2024-12-17T11:00:14,998 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromByzantium.yaml' 2024-12-17T11:00:14,999 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromChina.yaml' 2024-12-17T11:00:15,001 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromGreece.yaml' 2024-12-17T11:00:15,002 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromIslam.yaml' 2024-12-17T11:00:15,003 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromPersia.yaml' 2024-12-17T11:00:15,004 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_InfluenceFromRome.yaml' 2024-12-17T11:00:15,006 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Iraq.yaml' 2024-12-17T11:00:15,007 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_Education.yaml' 2024-12-17T11:00:15,008 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islam_branches_and_schools.yaml' 2024-12-17T11:00:15,009 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Islamic_law_system.yaml' 2024-12-17T11:00:15,010 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Jordan.yaml' 2024-12-17T11:00:15,011 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Kuwait.yaml' 2024-12-17T11:00:15,012 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Lebanon.yaml' 2024-12-17T11:00:15,014 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Libya.yaml' 2024-12-17T11:00:15,015 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mauritania.yaml' 2024-12-17T11:00:15,016 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Mesopotamia_civilization.yaml' 2024-12-17T11:00:15,017 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Morocco.yaml' 2024-12-17T11:00:15,018 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Oman.yaml' 2024-12-17T11:00:15,019 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Palestine.yaml' 2024-12-17T11:00:15,020 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Qatar.yaml' 2024-12-17T11:00:15,021 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Saudi_Arabia.yaml' 2024-12-17T11:00:15,022 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Somalia.yaml' 2024-12-17T11:00:15,023 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Sudan.yaml' 2024-12-17T11:00:15,025 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Syria.yaml' 2024-12-17T11:00:15,026 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Tunisia.yaml' 2024-12-17T11:00:15,027 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_United_Arab_Emirates.yaml' 2024-12-17T11:00:15,028 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_Yemen.yaml' 2024-12-17T11:00:15,030 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_communication.yaml' 2024-12-17T11:00:15,031 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_computer_and_phone.yaml' 2024-12-17T11:00:15,032 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_daily_life.yaml' 2024-12-17T11:00:15,034 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/arabic_leaderboard_acva_entertainment.yaml' 2024-12-17T11:00:15,035 adding 'lm_eval/tasks/arabic_leaderboard_complete/arabic_leaderboard_avca/utils.py' 2024-12-17T11:00:15,037 adding 'lm_eval/tasks/arabic_leaderboard_light/README.md' 2024-12-17T11:00:15,038 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_light.yaml' 2024-12-17T11:00:15,040 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_light.yaml' 2024-12-17T11:00:15,041 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_mcq_exams_test_ar_light.yaml' 2024-12-17T11:00:15,042 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_dialects_light.yaml' 2024-12-17T11:00:15,043 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_meta_ar_msa_light.yaml' 2024-12-17T11:00:15,045 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_facts_truefalse_balanced_task_light.yaml' 2024-12-17T11:00:15,046 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_soqal_task_light.yaml' 2024-12-17T11:00:15,047 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_light.yaml' 2024-12-17T11:00:15,048 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_no_neutral_task_light.yaml' 2024-12-17T11:00:15,049 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_rating_sentiment_task_light.yaml' 2024-12-17T11:00:15,050 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/arabic_leaderboard_alghafa_multiple_choice_sentiment_task_light.yaml' 2024-12-17T11:00:15,051 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_alghafa_light/utils.py' 2024-12-17T11:00:15,053 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_exams_light.yaml' 2024-12-17T11:00:15,054 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/arabic_leaderboard_arabic_exams_light.yaml' 2024-12-17T11:00:15,055 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_exams_light/utils.py' 2024-12-17T11:00:15,058 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_abstract_algebra_light.yaml' 2024-12-17T11:00:15,059 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_anatomy_light.yaml' 2024-12-17T11:00:15,060 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_astronomy_light.yaml' 2024-12-17T11:00:15,061 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_business_ethics_light.yaml' 2024-12-17T11:00:15,063 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_clinical_knowledge_light.yaml' 2024-12-17T11:00:15,064 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_biology_light.yaml' 2024-12-17T11:00:15,065 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_chemistry_light.yaml' 2024-12-17T11:00:15,067 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_computer_science_light.yaml' 2024-12-17T11:00:15,068 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_mathematics_light.yaml' 2024-12-17T11:00:15,069 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_medicine_light.yaml' 2024-12-17T11:00:15,071 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_college_physics_light.yaml' 2024-12-17T11:00:15,072 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_computer_security_light.yaml' 2024-12-17T11:00:15,073 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_conceptual_physics_light.yaml' 2024-12-17T11:00:15,074 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_econometrics_light.yaml' 2024-12-17T11:00:15,076 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_electrical_engineering_light.yaml' 2024-12-17T11:00:15,077 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_elementary_mathematics_light.yaml' 2024-12-17T11:00:15,078 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_formal_logic_light.yaml' 2024-12-17T11:00:15,079 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_global_facts_light.yaml' 2024-12-17T11:00:15,080 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_biology_light.yaml' 2024-12-17T11:00:15,081 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_chemistry_light.yaml' 2024-12-17T11:00:15,083 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_computer_science_light.yaml' 2024-12-17T11:00:15,084 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_european_history_light.yaml' 2024-12-17T11:00:15,085 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_geography_light.yaml' 2024-12-17T11:00:15,086 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_government_and_politics_light.yaml' 2024-12-17T11:00:15,087 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_macroeconomics_light.yaml' 2024-12-17T11:00:15,088 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_mathematics_light.yaml' 2024-12-17T11:00:15,090 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_microeconomics_light.yaml' 2024-12-17T11:00:15,091 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_physics_light.yaml' 2024-12-17T11:00:15,092 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_psychology_light.yaml' 2024-12-17T11:00:15,094 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_statistics_light.yaml' 2024-12-17T11:00:15,095 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_us_history_light.yaml' 2024-12-17T11:00:15,096 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_high_school_world_history_light.yaml' 2024-12-17T11:00:15,097 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_aging_light.yaml' 2024-12-17T11:00:15,098 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_human_sexuality_light.yaml' 2024-12-17T11:00:15,100 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_international_law_light.yaml' 2024-12-17T11:00:15,101 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_jurisprudence_light.yaml' 2024-12-17T11:00:15,102 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_light.yaml' 2024-12-17T11:00:15,103 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_logical_fallacies_light.yaml' 2024-12-17T11:00:15,104 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_machine_learning_light.yaml' 2024-12-17T11:00:15,106 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_management_light.yaml' 2024-12-17T11:00:15,107 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_marketing_light.yaml' 2024-12-17T11:00:15,108 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_medical_genetics_light.yaml' 2024-12-17T11:00:15,109 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_miscellaneous_light.yaml' 2024-12-17T11:00:15,110 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_disputes_light.yaml' 2024-12-17T11:00:15,111 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_moral_scenarios_light.yaml' 2024-12-17T11:00:15,112 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_nutrition_light.yaml' 2024-12-17T11:00:15,114 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_philosophy_light.yaml' 2024-12-17T11:00:15,115 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_prehistory_light.yaml' 2024-12-17T11:00:15,116 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_accounting_light.yaml' 2024-12-17T11:00:15,117 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_law_light.yaml' 2024-12-17T11:00:15,118 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_medicine_light.yaml' 2024-12-17T11:00:15,120 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_professional_psychology_light.yaml' 2024-12-17T11:00:15,121 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_public_relations_light.yaml' 2024-12-17T11:00:15,123 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_security_studies_light.yaml' 2024-12-17T11:00:15,124 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_sociology_light.yaml' 2024-12-17T11:00:15,125 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_us_foreign_policy_light.yaml' 2024-12-17T11:00:15,126 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_virology_light.yaml' 2024-12-17T11:00:15,128 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/arabic_leaderboard_arabic_mmlu_world_religions_light.yaml' 2024-12-17T11:00:15,129 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mmlu_light/utils.py' 2024-12-17T11:00:15,131 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_leaderboard_arabic_mt_arc_challenge_light.yaml' 2024-12-17T11:00:15,132 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/arabic_mt_arc_challenge_light.yaml' 2024-12-17T11:00:15,133 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_challenge_light/utils.py' 2024-12-17T11:00:15,135 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_leaderboard_arabic_mt_arc_easy_light.yaml' 2024-12-17T11:00:15,136 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/arabic_mt_arc_easy_light.yaml' 2024-12-17T11:00:15,138 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_arc_easy_light/utils.py' 2024-12-17T11:00:15,139 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_leaderboard_arabic_mt_boolq_light.yaml' 2024-12-17T11:00:15,140 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/arabic_mt_boolq_light.yaml' 2024-12-17T11:00:15,142 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_boolq_light/utils.py' 2024-12-17T11:00:15,143 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arabic_mt_copa_light.yaml' 2024-12-17T11:00:15,144 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/arbic_leaderboard_arabic_mt_copa_light.yaml' 2024-12-17T11:00:15,145 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_copa_light/utils.py' 2024-12-17T11:00:15,147 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_leaderboard_arabic_mt_hellaswag_light.yaml' 2024-12-17T11:00:15,148 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/arabic_mt_hellaswag_light.yaml' 2024-12-17T11:00:15,149 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_hellaswag_light/utils.py' 2024-12-17T11:00:15,151 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_leaderboard_arabic_mt_mmlu_light.yaml' 2024-12-17T11:00:15,152 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/arabic_mt_mmlu_light.yaml' 2024-12-17T11:00:15,154 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_mmlu_light/utils.py' 2024-12-17T11:00:15,155 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_leaderboard_arabic_mt_openbook_qa_light.yaml' 2024-12-17T11:00:15,157 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/arabic_mt_openbook_qa_light.yaml' 2024-12-17T11:00:15,158 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_openbook_qa_light/utils.py' 2024-12-17T11:00:15,160 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_leaderboard_arabic_mt_piqa_light.yaml' 2024-12-17T11:00:15,162 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/arabic_mt_piqa_light.yaml' 2024-12-17T11:00:15,163 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_piqa_light/utils.py' 2024-12-17T11:00:15,165 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_leaderboard_arabic_mt_race_light.yaml' 2024-12-17T11:00:15,166 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/arabic_mt_race_light.yaml' 2024-12-17T11:00:15,167 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_race_light/utils.py' 2024-12-17T11:00:15,169 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_leaderboard_arabic_mt_sciq_light.yaml' 2024-12-17T11:00:15,170 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/arabic_mt_sciq_light.yaml' 2024-12-17T11:00:15,171 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_sciq_light/utils.py' 2024-12-17T11:00:15,173 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_leaderboard_arabic_mt_toxigen_light.yaml' 2024-12-17T11:00:15,174 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/arabic_mt_toxigen_light.yaml' 2024-12-17T11:00:15,175 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_arabic_mt_toxigen_light/utils.py' 2024-12-17T11:00:15,178 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Algeria_light.yaml' 2024-12-17T11:00:15,179 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Ancient_Egypt_light.yaml' 2024-12-17T11:00:15,180 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arab_Empire_light.yaml' 2024-12-17T11:00:15,181 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Architecture_light.yaml' 2024-12-17T11:00:15,182 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Art_light.yaml' 2024-12-17T11:00:15,184 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Astronomy_light.yaml' 2024-12-17T11:00:15,185 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Calligraphy_light.yaml' 2024-12-17T11:00:15,186 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ceremony_light.yaml' 2024-12-17T11:00:15,187 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Clothing_light.yaml' 2024-12-17T11:00:15,188 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Culture_light.yaml' 2024-12-17T11:00:15,189 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Food_light.yaml' 2024-12-17T11:00:15,190 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Funeral_light.yaml' 2024-12-17T11:00:15,191 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Geography_light.yaml' 2024-12-17T11:00:15,193 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_History_light.yaml' 2024-12-17T11:00:15,194 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Language_Origin_light.yaml' 2024-12-17T11:00:15,195 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Literature_light.yaml' 2024-12-17T11:00:15,196 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Math_light.yaml' 2024-12-17T11:00:15,198 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Medicine_light.yaml' 2024-12-17T11:00:15,199 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Music_light.yaml' 2024-12-17T11:00:15,200 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Ornament_light.yaml' 2024-12-17T11:00:15,201 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Philosophy_light.yaml' 2024-12-17T11:00:15,203 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Physics_and_Chemistry_light.yaml' 2024-12-17T11:00:15,204 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Arabic_Wedding_light.yaml' 2024-12-17T11:00:15,205 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Bahrain_light.yaml' 2024-12-17T11:00:15,206 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Comoros_light.yaml' 2024-12-17T11:00:15,208 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Egypt_modern_light.yaml' 2024-12-17T11:00:15,209 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromAncientEgypt_light.yaml' 2024-12-17T11:00:15,210 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromByzantium_light.yaml' 2024-12-17T11:00:15,211 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromChina_light.yaml' 2024-12-17T11:00:15,212 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromGreece_light.yaml' 2024-12-17T11:00:15,213 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromIslam_light.yaml' 2024-12-17T11:00:15,214 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromPersia_light.yaml' 2024-12-17T11:00:15,215 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_InfluenceFromRome_light.yaml' 2024-12-17T11:00:15,216 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Iraq_light.yaml' 2024-12-17T11:00:15,218 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_Education_light.yaml' 2024-12-17T11:00:15,219 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islam_branches_and_schools_light.yaml' 2024-12-17T11:00:15,220 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Islamic_law_system_light.yaml' 2024-12-17T11:00:15,221 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Jordan_light.yaml' 2024-12-17T11:00:15,222 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Kuwait_light.yaml' 2024-12-17T11:00:15,223 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Lebanon_light.yaml' 2024-12-17T11:00:15,225 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Libya_light.yaml' 2024-12-17T11:00:15,226 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mauritania_light.yaml' 2024-12-17T11:00:15,227 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Mesopotamia_civilization_light.yaml' 2024-12-17T11:00:15,228 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Morocco_light.yaml' 2024-12-17T11:00:15,229 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Oman_light.yaml' 2024-12-17T11:00:15,231 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Palestine_light.yaml' 2024-12-17T11:00:15,232 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Qatar_light.yaml' 2024-12-17T11:00:15,233 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Saudi_Arabia_light.yaml' 2024-12-17T11:00:15,235 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Somalia_light.yaml' 2024-12-17T11:00:15,236 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Sudan_light.yaml' 2024-12-17T11:00:15,237 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Syria_light.yaml' 2024-12-17T11:00:15,239 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Tunisia_light.yaml' 2024-12-17T11:00:15,240 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_United_Arab_Emirates_light.yaml' 2024-12-17T11:00:15,241 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_Yemen_light.yaml' 2024-12-17T11:00:15,242 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_communication_light.yaml' 2024-12-17T11:00:15,243 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_computer_and_phone_light.yaml' 2024-12-17T11:00:15,244 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_daily_life_light.yaml' 2024-12-17T11:00:15,246 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_entertainment_light.yaml' 2024-12-17T11:00:15,247 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/arabic_leaderboard_acva_light.yaml' 2024-12-17T11:00:15,248 adding 'lm_eval/tasks/arabic_leaderboard_light/arabic_leaderboard_avca_light/utils.py' 2024-12-17T11:00:15,251 adding 'lm_eval/tasks/arabicmmlu/README.md' 2024-12-17T11:00:15,252 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu.yaml' 2024-12-17T11:00:15,253 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_humanities.yaml' 2024-12-17T11:00:15,254 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_language.yaml' 2024-12-17T11:00:15,255 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_other.yaml' 2024-12-17T11:00:15,256 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_social_science.yaml' 2024-12-17T11:00:15,257 adding 'lm_eval/tasks/arabicmmlu/_arabicmmlu_stem.yaml' 2024-12-17T11:00:15,258 adding 'lm_eval/tasks/arabicmmlu/_default_arabicmmlu_template_yaml' 2024-12-17T11:00:15,260 adding 'lm_eval/tasks/arabicmmlu/_generate_configs.py' 2024-12-17T11:00:15,261 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_general.yaml' 2024-12-17T11:00:15,262 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_arabic_language_grammar.yaml' 2024-12-17T11:00:15,264 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_driving_test.yaml' 2024-12-17T11:00:15,265 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_general_knowledge.yaml' 2024-12-17T11:00:15,266 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_high_arabic_language.yaml' 2024-12-17T11:00:15,267 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_high_biology.yaml' 2024-12-17T11:00:15,268 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_high_civics.yaml' 2024-12-17T11:00:15,270 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_high_computer_science.yaml' 2024-12-17T11:00:15,271 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_high_economics.yaml' 2024-12-17T11:00:15,272 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_high_geography.yaml' 2024-12-17T11:00:15,274 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_high_history.yaml' 2024-12-17T11:00:15,275 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_high_islamic_studies.yaml' 2024-12-17T11:00:15,277 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_high_philosophy.yaml' 2024-12-17T11:00:15,278 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_high_physics.yaml' 2024-12-17T11:00:15,279 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_islamic_studies.yaml' 2024-12-17T11:00:15,281 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_middle_arabic_language.yaml' 2024-12-17T11:00:15,282 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_middle_civics.yaml' 2024-12-17T11:00:15,284 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_middle_computer_science.yaml' 2024-12-17T11:00:15,285 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_middle_economics.yaml' 2024-12-17T11:00:15,286 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_middle_general_knowledge.yaml' 2024-12-17T11:00:15,287 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_middle_geography.yaml' 2024-12-17T11:00:15,289 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_middle_history.yaml' 2024-12-17T11:00:15,290 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_middle_islamic_studies.yaml' 2024-12-17T11:00:15,292 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_middle_natural_science.yaml' 2024-12-17T11:00:15,294 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_middle_social_science.yaml' 2024-12-17T11:00:15,295 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_primary_arabic_language.yaml' 2024-12-17T11:00:15,297 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_primary_computer_science.yaml' 2024-12-17T11:00:15,298 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_primary_general_knowledge.yaml' 2024-12-17T11:00:15,300 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_primary_geography.yaml' 2024-12-17T11:00:15,301 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_primary_history.yaml' 2024-12-17T11:00:15,303 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_primary_islamic_studies.yaml' 2024-12-17T11:00:15,304 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_primary_math.yaml' 2024-12-17T11:00:15,306 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_primary_natural_science.yaml' 2024-12-17T11:00:15,307 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_primary_social_science.yaml' 2024-12-17T11:00:15,308 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_prof_law.yaml' 2024-12-17T11:00:15,310 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_univ_accounting.yaml' 2024-12-17T11:00:15,311 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_univ_computer_science.yaml' 2024-12-17T11:00:15,312 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_univ_economics.yaml' 2024-12-17T11:00:15,314 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_univ_management.yaml' 2024-12-17T11:00:15,315 adding 'lm_eval/tasks/arabicmmlu/arabicmmlu_univ_political_science.yaml' 2024-12-17T11:00:15,317 adding 'lm_eval/tasks/arabicmmlu/utils.py' 2024-12-17T11:00:15,319 adding 'lm_eval/tasks/arc/README.md' 2024-12-17T11:00:15,320 adding 'lm_eval/tasks/arc/arc_challenge.yaml' 2024-12-17T11:00:15,322 adding 'lm_eval/tasks/arc/arc_easy.yaml' 2024-12-17T11:00:15,324 adding 'lm_eval/tasks/arc_mt/README.md' 2024-12-17T11:00:15,325 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_da.yaml' 2024-12-17T11:00:15,326 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_de.yaml' 2024-12-17T11:00:15,328 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_el.yaml' 2024-12-17T11:00:15,329 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_es.yaml' 2024-12-17T11:00:15,330 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_fi.yaml' 2024-12-17T11:00:15,332 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_hu.yaml' 2024-12-17T11:00:15,334 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_is.yaml' 2024-12-17T11:00:15,335 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_it.yaml' 2024-12-17T11:00:15,336 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_nb.yaml' 2024-12-17T11:00:15,337 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_pl.yaml' 2024-12-17T11:00:15,339 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_pt.yaml' 2024-12-17T11:00:15,340 adding 'lm_eval/tasks/arc_mt/arc_challenge_mt_sv.yaml' 2024-12-17T11:00:15,342 adding 'lm_eval/tasks/arithmetic/README.md' 2024-12-17T11:00:15,343 adding 'lm_eval/tasks/arithmetic/arithmetic_1dc.yaml' 2024-12-17T11:00:15,345 adding 'lm_eval/tasks/arithmetic/arithmetic_2da.yaml' 2024-12-17T11:00:15,346 adding 'lm_eval/tasks/arithmetic/arithmetic_2dm.yaml' 2024-12-17T11:00:15,347 adding 'lm_eval/tasks/arithmetic/arithmetic_2ds.yaml' 2024-12-17T11:00:15,349 adding 'lm_eval/tasks/arithmetic/arithmetic_3da.yaml' 2024-12-17T11:00:15,350 adding 'lm_eval/tasks/arithmetic/arithmetic_3ds.yaml' 2024-12-17T11:00:15,351 adding 'lm_eval/tasks/arithmetic/arithmetic_4da.yaml' 2024-12-17T11:00:15,353 adding 'lm_eval/tasks/arithmetic/arithmetic_4ds.yaml' 2024-12-17T11:00:15,354 adding 'lm_eval/tasks/arithmetic/arithmetic_5da.yaml' 2024-12-17T11:00:15,355 adding 'lm_eval/tasks/arithmetic/arithmetic_5ds.yaml' 2024-12-17T11:00:15,358 adding 'lm_eval/tasks/asdiv/README.md' 2024-12-17T11:00:15,359 adding 'lm_eval/tasks/asdiv/asdiv-cot-llama.yaml' 2024-12-17T11:00:15,362 adding 'lm_eval/tasks/asdiv/default.yaml' 2024-12-17T11:00:15,366 adding 'lm_eval/tasks/babi/README.md' 2024-12-17T11:00:15,367 adding 'lm_eval/tasks/babi/babi.yaml' 2024-12-17T11:00:15,370 adding 'lm_eval/tasks/basque_bench/README.md' 2024-12-17T11:00:15,371 adding 'lm_eval/tasks/basque_bench/basque_bench.yaml' 2024-12-17T11:00:15,373 adding 'lm_eval/tasks/basque_bench/mgsm_cot_native_eu.yaml' 2024-12-17T11:00:15,374 adding 'lm_eval/tasks/basque_bench/mgsm_direct_eu.yaml' 2024-12-17T11:00:15,376 adding 'lm_eval/tasks/basque_bench/piqa_eu.yaml' 2024-12-17T11:00:15,377 adding 'lm_eval/tasks/basque_bench/utils.py' 2024-12-17T11:00:15,379 adding 'lm_eval/tasks/basque_bench/wnli_eu.yaml' 2024-12-17T11:00:15,380 adding 'lm_eval/tasks/basque_bench/xcopa_eu.yaml' 2024-12-17T11:00:15,382 adding 'lm_eval/tasks/basque_bench/flores_eu/_flores_common_yaml' 2024-12-17T11:00:15,384 adding 'lm_eval/tasks/basque_bench/flores_eu/create_yamls_flores_eu.py' 2024-12-17T11:00:15,385 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_ca-eu.yaml' 2024-12-17T11:00:15,387 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_de-eu.yaml' 2024-12-17T11:00:15,388 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_en-eu.yaml' 2024-12-17T11:00:15,390 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_es-eu.yaml' 2024-12-17T11:00:15,391 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-ca.yaml' 2024-12-17T11:00:15,392 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-de.yaml' 2024-12-17T11:00:15,394 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-en.yaml' 2024-12-17T11:00:15,395 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-es.yaml' 2024-12-17T11:00:15,397 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-fr.yaml' 2024-12-17T11:00:15,398 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-gl.yaml' 2024-12-17T11:00:15,399 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-it.yaml' 2024-12-17T11:00:15,401 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu-pt.yaml' 2024-12-17T11:00:15,402 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_eu.yaml' 2024-12-17T11:00:15,403 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_fr-eu.yaml' 2024-12-17T11:00:15,405 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_gl-eu.yaml' 2024-12-17T11:00:15,406 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_it-eu.yaml' 2024-12-17T11:00:15,407 adding 'lm_eval/tasks/basque_bench/flores_eu/flores_pt-eu.yaml' 2024-12-17T11:00:15,410 adding 'lm_eval/tasks/basqueglue/README.md' 2024-12-17T11:00:15,412 adding 'lm_eval/tasks/basqueglue/bec.yaml' 2024-12-17T11:00:15,413 adding 'lm_eval/tasks/basqueglue/bhtc.yaml' 2024-12-17T11:00:15,415 adding 'lm_eval/tasks/basqueglue/coref.yaml' 2024-12-17T11:00:15,416 adding 'lm_eval/tasks/basqueglue/qnli.yaml' 2024-12-17T11:00:15,418 adding 'lm_eval/tasks/basqueglue/utils.py' 2024-12-17T11:00:15,419 adding 'lm_eval/tasks/basqueglue/vaxx.yaml' 2024-12-17T11:00:15,421 adding 'lm_eval/tasks/basqueglue/wic.yaml' 2024-12-17T11:00:15,423 adding 'lm_eval/tasks/bbh/README.md' 2024-12-17T11:00:15,424 adding 'lm_eval/tasks/bbh/_generate_configs.py' 2024-12-17T11:00:15,427 adding 'lm_eval/tasks/bbh/cot_fewshot/_bbh.yaml' 2024-12-17T11:00:15,428 adding 'lm_eval/tasks/bbh/cot_fewshot/_bbh_cot_fewshot.yaml' 2024-12-17T11:00:15,430 adding 'lm_eval/tasks/bbh/cot_fewshot/_cot_fewshot_template_yaml' 2024-12-17T11:00:15,431 adding 'lm_eval/tasks/bbh/cot_fewshot/boolean_expressions.yaml' 2024-12-17T11:00:15,433 adding 'lm_eval/tasks/bbh/cot_fewshot/causal_judgement.yaml' 2024-12-17T11:00:15,434 adding 'lm_eval/tasks/bbh/cot_fewshot/date_understanding.yaml' 2024-12-17T11:00:15,436 adding 'lm_eval/tasks/bbh/cot_fewshot/disambiguation_qa.yaml' 2024-12-17T11:00:15,438 adding 'lm_eval/tasks/bbh/cot_fewshot/dyck_languages.yaml' 2024-12-17T11:00:15,440 adding 'lm_eval/tasks/bbh/cot_fewshot/formal_fallacies.yaml' 2024-12-17T11:00:15,442 adding 'lm_eval/tasks/bbh/cot_fewshot/geometric_shapes.yaml' 2024-12-17T11:00:15,444 adding 'lm_eval/tasks/bbh/cot_fewshot/hyperbaton.yaml' 2024-12-17T11:00:15,445 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_five_objects.yaml' 2024-12-17T11:00:15,448 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_seven_objects.yaml' 2024-12-17T11:00:15,449 adding 'lm_eval/tasks/bbh/cot_fewshot/logical_deduction_three_objects.yaml' 2024-12-17T11:00:15,451 adding 'lm_eval/tasks/bbh/cot_fewshot/movie_recommendation.yaml' 2024-12-17T11:00:15,453 adding 'lm_eval/tasks/bbh/cot_fewshot/multistep_arithmetic_two.yaml' 2024-12-17T11:00:15,455 adding 'lm_eval/tasks/bbh/cot_fewshot/navigate.yaml' 2024-12-17T11:00:15,456 adding 'lm_eval/tasks/bbh/cot_fewshot/object_counting.yaml' 2024-12-17T11:00:15,458 adding 'lm_eval/tasks/bbh/cot_fewshot/penguins_in_a_table.yaml' 2024-12-17T11:00:15,459 adding 'lm_eval/tasks/bbh/cot_fewshot/reasoning_about_colored_objects.yaml' 2024-12-17T11:00:15,461 adding 'lm_eval/tasks/bbh/cot_fewshot/ruin_names.yaml' 2024-12-17T11:00:15,463 adding 'lm_eval/tasks/bbh/cot_fewshot/salient_translation_error_detection.yaml' 2024-12-17T11:00:15,465 adding 'lm_eval/tasks/bbh/cot_fewshot/snarks.yaml' 2024-12-17T11:00:15,467 adding 'lm_eval/tasks/bbh/cot_fewshot/sports_understanding.yaml' 2024-12-17T11:00:15,469 adding 'lm_eval/tasks/bbh/cot_fewshot/temporal_sequences.yaml' 2024-12-17T11:00:15,470 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_five_objects.yaml' 2024-12-17T11:00:15,472 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_seven_objects.yaml' 2024-12-17T11:00:15,474 adding 'lm_eval/tasks/bbh/cot_fewshot/tracking_shuffled_objects_three_objects.yaml' 2024-12-17T11:00:15,475 adding 'lm_eval/tasks/bbh/cot_fewshot/web_of_lies.yaml' 2024-12-17T11:00:15,477 adding 'lm_eval/tasks/bbh/cot_fewshot/word_sorting.yaml' 2024-12-17T11:00:15,479 adding 'lm_eval/tasks/bbh/cot_zeroshot/_bbh_cot_zeroshot.yaml' 2024-12-17T11:00:15,480 adding 'lm_eval/tasks/bbh/cot_zeroshot/_cot_zeroshot_template_yaml' 2024-12-17T11:00:15,482 adding 'lm_eval/tasks/bbh/cot_zeroshot/boolean_expressions.yaml' 2024-12-17T11:00:15,483 adding 'lm_eval/tasks/bbh/cot_zeroshot/causal_judgement.yaml' 2024-12-17T11:00:15,485 adding 'lm_eval/tasks/bbh/cot_zeroshot/date_understanding.yaml' 2024-12-17T11:00:15,487 adding 'lm_eval/tasks/bbh/cot_zeroshot/disambiguation_qa.yaml' 2024-12-17T11:00:15,488 adding 'lm_eval/tasks/bbh/cot_zeroshot/dyck_languages.yaml' 2024-12-17T11:00:15,492 adding 'lm_eval/tasks/bbh/cot_zeroshot/formal_fallacies.yaml' 2024-12-17T11:00:15,494 adding 'lm_eval/tasks/bbh/cot_zeroshot/geometric_shapes.yaml' 2024-12-17T11:00:15,495 adding 'lm_eval/tasks/bbh/cot_zeroshot/hyperbaton.yaml' 2024-12-17T11:00:15,496 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_five_objects.yaml' 2024-12-17T11:00:15,498 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_seven_objects.yaml' 2024-12-17T11:00:15,499 adding 'lm_eval/tasks/bbh/cot_zeroshot/logical_deduction_three_objects.yaml' 2024-12-17T11:00:15,501 adding 'lm_eval/tasks/bbh/cot_zeroshot/movie_recommendation.yaml' 2024-12-17T11:00:15,502 adding 'lm_eval/tasks/bbh/cot_zeroshot/multistep_arithmetic_two.yaml' 2024-12-17T11:00:15,504 adding 'lm_eval/tasks/bbh/cot_zeroshot/navigate.yaml' 2024-12-17T11:00:15,505 adding 'lm_eval/tasks/bbh/cot_zeroshot/object_counting.yaml' 2024-12-17T11:00:15,507 adding 'lm_eval/tasks/bbh/cot_zeroshot/penguins_in_a_table.yaml' 2024-12-17T11:00:15,508 adding 'lm_eval/tasks/bbh/cot_zeroshot/reasoning_about_colored_objects.yaml' 2024-12-17T11:00:15,509 adding 'lm_eval/tasks/bbh/cot_zeroshot/ruin_names.yaml' 2024-12-17T11:00:15,511 adding 'lm_eval/tasks/bbh/cot_zeroshot/salient_translation_error_detection.yaml' 2024-12-17T11:00:15,512 adding 'lm_eval/tasks/bbh/cot_zeroshot/snarks.yaml' 2024-12-17T11:00:15,514 adding 'lm_eval/tasks/bbh/cot_zeroshot/sports_understanding.yaml' 2024-12-17T11:00:15,515 adding 'lm_eval/tasks/bbh/cot_zeroshot/temporal_sequences.yaml' 2024-12-17T11:00:15,517 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_five_objects.yaml' 2024-12-17T11:00:15,518 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_seven_objects.yaml' 2024-12-17T11:00:15,519 adding 'lm_eval/tasks/bbh/cot_zeroshot/tracking_shuffled_objects_three_objects.yaml' 2024-12-17T11:00:15,521 adding 'lm_eval/tasks/bbh/cot_zeroshot/utils.py' 2024-12-17T11:00:15,523 adding 'lm_eval/tasks/bbh/cot_zeroshot/web_of_lies.yaml' 2024-12-17T11:00:15,525 adding 'lm_eval/tasks/bbh/cot_zeroshot/word_sorting.yaml' 2024-12-17T11:00:15,527 adding 'lm_eval/tasks/bbh/fewshot/_bbh_fewshot.yaml' 2024-12-17T11:00:15,528 adding 'lm_eval/tasks/bbh/fewshot/_fewshot_template_yaml' 2024-12-17T11:00:15,530 adding 'lm_eval/tasks/bbh/fewshot/boolean_expressions.yaml' 2024-12-17T11:00:15,531 adding 'lm_eval/tasks/bbh/fewshot/causal_judgement.yaml' 2024-12-17T11:00:15,533 adding 'lm_eval/tasks/bbh/fewshot/date_understanding.yaml' 2024-12-17T11:00:15,534 adding 'lm_eval/tasks/bbh/fewshot/disambiguation_qa.yaml' 2024-12-17T11:00:15,536 adding 'lm_eval/tasks/bbh/fewshot/dyck_languages.yaml' 2024-12-17T11:00:15,537 adding 'lm_eval/tasks/bbh/fewshot/formal_fallacies.yaml' 2024-12-17T11:00:15,539 adding 'lm_eval/tasks/bbh/fewshot/geometric_shapes.yaml' 2024-12-17T11:00:15,540 adding 'lm_eval/tasks/bbh/fewshot/hyperbaton.yaml' 2024-12-17T11:00:15,542 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_five_objects.yaml' 2024-12-17T11:00:15,543 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_seven_objects.yaml' 2024-12-17T11:00:15,545 adding 'lm_eval/tasks/bbh/fewshot/logical_deduction_three_objects.yaml' 2024-12-17T11:00:15,546 adding 'lm_eval/tasks/bbh/fewshot/movie_recommendation.yaml' 2024-12-17T11:00:15,548 adding 'lm_eval/tasks/bbh/fewshot/multistep_arithmetic_two.yaml' 2024-12-17T11:00:15,549 adding 'lm_eval/tasks/bbh/fewshot/navigate.yaml' 2024-12-17T11:00:15,551 adding 'lm_eval/tasks/bbh/fewshot/object_counting.yaml' 2024-12-17T11:00:15,552 adding 'lm_eval/tasks/bbh/fewshot/penguins_in_a_table.yaml' 2024-12-17T11:00:15,554 adding 'lm_eval/tasks/bbh/fewshot/reasoning_about_colored_objects.yaml' 2024-12-17T11:00:15,555 adding 'lm_eval/tasks/bbh/fewshot/ruin_names.yaml' 2024-12-17T11:00:15,557 adding 'lm_eval/tasks/bbh/fewshot/salient_translation_error_detection.yaml' 2024-12-17T11:00:15,559 adding 'lm_eval/tasks/bbh/fewshot/snarks.yaml' 2024-12-17T11:00:15,560 adding 'lm_eval/tasks/bbh/fewshot/sports_understanding.yaml' 2024-12-17T11:00:15,562 adding 'lm_eval/tasks/bbh/fewshot/temporal_sequences.yaml' 2024-12-17T11:00:15,564 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_five_objects.yaml' 2024-12-17T11:00:15,565 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_seven_objects.yaml' 2024-12-17T11:00:15,567 adding 'lm_eval/tasks/bbh/fewshot/tracking_shuffled_objects_three_objects.yaml' 2024-12-17T11:00:15,568 adding 'lm_eval/tasks/bbh/fewshot/web_of_lies.yaml' 2024-12-17T11:00:15,570 adding 'lm_eval/tasks/bbh/fewshot/word_sorting.yaml' 2024-12-17T11:00:15,572 adding 'lm_eval/tasks/bbh/zeroshot/_bbh_zeroshot.yaml' 2024-12-17T11:00:15,573 adding 'lm_eval/tasks/bbh/zeroshot/_zeroshot_template_yaml' 2024-12-17T11:00:15,575 adding 'lm_eval/tasks/bbh/zeroshot/boolean_expressions.yaml' 2024-12-17T11:00:15,576 adding 'lm_eval/tasks/bbh/zeroshot/causal_judgement.yaml' 2024-12-17T11:00:15,578 adding 'lm_eval/tasks/bbh/zeroshot/date_understanding.yaml' 2024-12-17T11:00:15,579 adding 'lm_eval/tasks/bbh/zeroshot/disambiguation_qa.yaml' 2024-12-17T11:00:15,580 adding 'lm_eval/tasks/bbh/zeroshot/dyck_languages.yaml' 2024-12-17T11:00:15,582 adding 'lm_eval/tasks/bbh/zeroshot/formal_fallacies.yaml' 2024-12-17T11:00:15,583 adding 'lm_eval/tasks/bbh/zeroshot/geometric_shapes.yaml' 2024-12-17T11:00:15,584 adding 'lm_eval/tasks/bbh/zeroshot/hyperbaton.yaml' 2024-12-17T11:00:15,586 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_five_objects.yaml' 2024-12-17T11:00:15,587 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_seven_objects.yaml' 2024-12-17T11:00:15,588 adding 'lm_eval/tasks/bbh/zeroshot/logical_deduction_three_objects.yaml' 2024-12-17T11:00:15,590 adding 'lm_eval/tasks/bbh/zeroshot/movie_recommendation.yaml' 2024-12-17T11:00:15,591 adding 'lm_eval/tasks/bbh/zeroshot/multistep_arithmetic_two.yaml' 2024-12-17T11:00:15,593 adding 'lm_eval/tasks/bbh/zeroshot/navigate.yaml' 2024-12-17T11:00:15,594 adding 'lm_eval/tasks/bbh/zeroshot/object_counting.yaml' 2024-12-17T11:00:15,595 adding 'lm_eval/tasks/bbh/zeroshot/penguins_in_a_table.yaml' 2024-12-17T11:00:15,596 adding 'lm_eval/tasks/bbh/zeroshot/reasoning_about_colored_objects.yaml' 2024-12-17T11:00:15,597 adding 'lm_eval/tasks/bbh/zeroshot/ruin_names.yaml' 2024-12-17T11:00:15,598 adding 'lm_eval/tasks/bbh/zeroshot/salient_translation_error_detection.yaml' 2024-12-17T11:00:15,599 adding 'lm_eval/tasks/bbh/zeroshot/snarks.yaml' 2024-12-17T11:00:15,600 adding 'lm_eval/tasks/bbh/zeroshot/sports_understanding.yaml' 2024-12-17T11:00:15,602 adding 'lm_eval/tasks/bbh/zeroshot/temporal_sequences.yaml' 2024-12-17T11:00:15,603 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_five_objects.yaml' 2024-12-17T11:00:15,604 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_seven_objects.yaml' 2024-12-17T11:00:15,606 adding 'lm_eval/tasks/bbh/zeroshot/tracking_shuffled_objects_three_objects.yaml' 2024-12-17T11:00:15,607 adding 'lm_eval/tasks/bbh/zeroshot/utils.py' 2024-12-17T11:00:15,609 adding 'lm_eval/tasks/bbh/zeroshot/web_of_lies.yaml' 2024-12-17T11:00:15,610 adding 'lm_eval/tasks/bbh/zeroshot/word_sorting.yaml' 2024-12-17T11:00:15,614 adding 'lm_eval/tasks/belebele/README.md' 2024-12-17T11:00:15,615 adding 'lm_eval/tasks/belebele/_belebele.yaml' 2024-12-17T11:00:15,616 adding 'lm_eval/tasks/belebele/_default_template_yaml' 2024-12-17T11:00:15,618 adding 'lm_eval/tasks/belebele/_generate_configs.py' 2024-12-17T11:00:15,619 adding 'lm_eval/tasks/belebele/belebele_acm_Arab.yaml' 2024-12-17T11:00:15,620 adding 'lm_eval/tasks/belebele/belebele_afr_Latn.yaml' 2024-12-17T11:00:15,621 adding 'lm_eval/tasks/belebele/belebele_als_Latn.yaml' 2024-12-17T11:00:15,622 adding 'lm_eval/tasks/belebele/belebele_amh_Ethi.yaml' 2024-12-17T11:00:15,623 adding 'lm_eval/tasks/belebele/belebele_apc_Arab.yaml' 2024-12-17T11:00:15,624 adding 'lm_eval/tasks/belebele/belebele_arb_Arab.yaml' 2024-12-17T11:00:15,625 adding 'lm_eval/tasks/belebele/belebele_arb_Latn.yaml' 2024-12-17T11:00:15,627 adding 'lm_eval/tasks/belebele/belebele_ars_Arab.yaml' 2024-12-17T11:00:15,628 adding 'lm_eval/tasks/belebele/belebele_ary_Arab.yaml' 2024-12-17T11:00:15,629 adding 'lm_eval/tasks/belebele/belebele_arz_Arab.yaml' 2024-12-17T11:00:15,630 adding 'lm_eval/tasks/belebele/belebele_asm_Beng.yaml' 2024-12-17T11:00:15,631 adding 'lm_eval/tasks/belebele/belebele_azj_Latn.yaml' 2024-12-17T11:00:15,632 adding 'lm_eval/tasks/belebele/belebele_bam_Latn.yaml' 2024-12-17T11:00:15,634 adding 'lm_eval/tasks/belebele/belebele_ben_Beng.yaml' 2024-12-17T11:00:15,635 adding 'lm_eval/tasks/belebele/belebele_ben_Latn.yaml' 2024-12-17T11:00:15,636 adding 'lm_eval/tasks/belebele/belebele_bod_Tibt.yaml' 2024-12-17T11:00:15,638 adding 'lm_eval/tasks/belebele/belebele_bul_Cyrl.yaml' 2024-12-17T11:00:15,639 adding 'lm_eval/tasks/belebele/belebele_cat_Latn.yaml' 2024-12-17T11:00:15,640 adding 'lm_eval/tasks/belebele/belebele_ceb_Latn.yaml' 2024-12-17T11:00:15,641 adding 'lm_eval/tasks/belebele/belebele_ces_Latn.yaml' 2024-12-17T11:00:15,642 adding 'lm_eval/tasks/belebele/belebele_ckb_Arab.yaml' 2024-12-17T11:00:15,643 adding 'lm_eval/tasks/belebele/belebele_dan_Latn.yaml' 2024-12-17T11:00:15,645 adding 'lm_eval/tasks/belebele/belebele_deu_Latn.yaml' 2024-12-17T11:00:15,646 adding 'lm_eval/tasks/belebele/belebele_ell_Grek.yaml' 2024-12-17T11:00:15,647 adding 'lm_eval/tasks/belebele/belebele_eng_Latn.yaml' 2024-12-17T11:00:15,648 adding 'lm_eval/tasks/belebele/belebele_est_Latn.yaml' 2024-12-17T11:00:15,649 adding 'lm_eval/tasks/belebele/belebele_eus_Latn.yaml' 2024-12-17T11:00:15,650 adding 'lm_eval/tasks/belebele/belebele_fin_Latn.yaml' 2024-12-17T11:00:15,651 adding 'lm_eval/tasks/belebele/belebele_fra_Latn.yaml' 2024-12-17T11:00:15,653 adding 'lm_eval/tasks/belebele/belebele_fuv_Latn.yaml' 2024-12-17T11:00:15,654 adding 'lm_eval/tasks/belebele/belebele_gaz_Latn.yaml' 2024-12-17T11:00:15,655 adding 'lm_eval/tasks/belebele/belebele_grn_Latn.yaml' 2024-12-17T11:00:15,656 adding 'lm_eval/tasks/belebele/belebele_guj_Gujr.yaml' 2024-12-17T11:00:15,657 adding 'lm_eval/tasks/belebele/belebele_hat_Latn.yaml' 2024-12-17T11:00:15,658 adding 'lm_eval/tasks/belebele/belebele_hau_Latn.yaml' 2024-12-17T11:00:15,659 adding 'lm_eval/tasks/belebele/belebele_heb_Hebr.yaml' 2024-12-17T11:00:15,660 adding 'lm_eval/tasks/belebele/belebele_hin_Deva.yaml' 2024-12-17T11:00:15,662 adding 'lm_eval/tasks/belebele/belebele_hin_Latn.yaml' 2024-12-17T11:00:15,663 adding 'lm_eval/tasks/belebele/belebele_hrv_Latn.yaml' 2024-12-17T11:00:15,664 adding 'lm_eval/tasks/belebele/belebele_hun_Latn.yaml' 2024-12-17T11:00:15,666 adding 'lm_eval/tasks/belebele/belebele_hye_Armn.yaml' 2024-12-17T11:00:15,667 adding 'lm_eval/tasks/belebele/belebele_ibo_Latn.yaml' 2024-12-17T11:00:15,668 adding 'lm_eval/tasks/belebele/belebele_ilo_Latn.yaml' 2024-12-17T11:00:15,669 adding 'lm_eval/tasks/belebele/belebele_ind_Latn.yaml' 2024-12-17T11:00:15,670 adding 'lm_eval/tasks/belebele/belebele_isl_Latn.yaml' 2024-12-17T11:00:15,671 adding 'lm_eval/tasks/belebele/belebele_ita_Latn.yaml' 2024-12-17T11:00:15,672 adding 'lm_eval/tasks/belebele/belebele_jav_Latn.yaml' 2024-12-17T11:00:15,673 adding 'lm_eval/tasks/belebele/belebele_jpn_Jpan.yaml' 2024-12-17T11:00:15,674 adding 'lm_eval/tasks/belebele/belebele_kac_Latn.yaml' 2024-12-17T11:00:15,675 adding 'lm_eval/tasks/belebele/belebele_kan_Knda.yaml' 2024-12-17T11:00:15,676 adding 'lm_eval/tasks/belebele/belebele_kat_Geor.yaml' 2024-12-17T11:00:15,677 adding 'lm_eval/tasks/belebele/belebele_kaz_Cyrl.yaml' 2024-12-17T11:00:15,678 adding 'lm_eval/tasks/belebele/belebele_kea_Latn.yaml' 2024-12-17T11:00:15,680 adding 'lm_eval/tasks/belebele/belebele_khk_Cyrl.yaml' 2024-12-17T11:00:15,681 adding 'lm_eval/tasks/belebele/belebele_khm_Khmr.yaml' 2024-12-17T11:00:15,682 adding 'lm_eval/tasks/belebele/belebele_kin_Latn.yaml' 2024-12-17T11:00:15,683 adding 'lm_eval/tasks/belebele/belebele_kir_Cyrl.yaml' 2024-12-17T11:00:15,684 adding 'lm_eval/tasks/belebele/belebele_kor_Hang.yaml' 2024-12-17T11:00:15,685 adding 'lm_eval/tasks/belebele/belebele_lao_Laoo.yaml' 2024-12-17T11:00:15,686 adding 'lm_eval/tasks/belebele/belebele_lin_Latn.yaml' 2024-12-17T11:00:15,688 adding 'lm_eval/tasks/belebele/belebele_lit_Latn.yaml' 2024-12-17T11:00:15,689 adding 'lm_eval/tasks/belebele/belebele_lug_Latn.yaml' 2024-12-17T11:00:15,690 adding 'lm_eval/tasks/belebele/belebele_luo_Latn.yaml' 2024-12-17T11:00:15,691 adding 'lm_eval/tasks/belebele/belebele_lvs_Latn.yaml' 2024-12-17T11:00:15,692 adding 'lm_eval/tasks/belebele/belebele_mal_Mlym.yaml' 2024-12-17T11:00:15,693 adding 'lm_eval/tasks/belebele/belebele_mar_Deva.yaml' 2024-12-17T11:00:15,695 adding 'lm_eval/tasks/belebele/belebele_mkd_Cyrl.yaml' 2024-12-17T11:00:15,696 adding 'lm_eval/tasks/belebele/belebele_mlt_Latn.yaml' 2024-12-17T11:00:15,697 adding 'lm_eval/tasks/belebele/belebele_mri_Latn.yaml' 2024-12-17T11:00:15,698 adding 'lm_eval/tasks/belebele/belebele_mya_Mymr.yaml' 2024-12-17T11:00:15,699 adding 'lm_eval/tasks/belebele/belebele_nld_Latn.yaml' 2024-12-17T11:00:15,700 adding 'lm_eval/tasks/belebele/belebele_nob_Latn.yaml' 2024-12-17T11:00:15,702 adding 'lm_eval/tasks/belebele/belebele_npi_Deva.yaml' 2024-12-17T11:00:15,703 adding 'lm_eval/tasks/belebele/belebele_npi_Latn.yaml' 2024-12-17T11:00:15,704 adding 'lm_eval/tasks/belebele/belebele_nso_Latn.yaml' 2024-12-17T11:00:15,706 adding 'lm_eval/tasks/belebele/belebele_nya_Latn.yaml' 2024-12-17T11:00:15,707 adding 'lm_eval/tasks/belebele/belebele_ory_Orya.yaml' 2024-12-17T11:00:15,709 adding 'lm_eval/tasks/belebele/belebele_pan_Guru.yaml' 2024-12-17T11:00:15,710 adding 'lm_eval/tasks/belebele/belebele_pbt_Arab.yaml' 2024-12-17T11:00:15,711 adding 'lm_eval/tasks/belebele/belebele_pes_Arab.yaml' 2024-12-17T11:00:15,712 adding 'lm_eval/tasks/belebele/belebele_plt_Latn.yaml' 2024-12-17T11:00:15,713 adding 'lm_eval/tasks/belebele/belebele_pol_Latn.yaml' 2024-12-17T11:00:15,715 adding 'lm_eval/tasks/belebele/belebele_por_Latn.yaml' 2024-12-17T11:00:15,716 adding 'lm_eval/tasks/belebele/belebele_ron_Latn.yaml' 2024-12-17T11:00:15,717 adding 'lm_eval/tasks/belebele/belebele_rus_Cyrl.yaml' 2024-12-17T11:00:15,718 adding 'lm_eval/tasks/belebele/belebele_shn_Mymr.yaml' 2024-12-17T11:00:15,719 adding 'lm_eval/tasks/belebele/belebele_sin_Latn.yaml' 2024-12-17T11:00:15,720 adding 'lm_eval/tasks/belebele/belebele_sin_Sinh.yaml' 2024-12-17T11:00:15,721 adding 'lm_eval/tasks/belebele/belebele_slk_Latn.yaml' 2024-12-17T11:00:15,722 adding 'lm_eval/tasks/belebele/belebele_slv_Latn.yaml' 2024-12-17T11:00:15,723 adding 'lm_eval/tasks/belebele/belebele_sna_Latn.yaml' 2024-12-17T11:00:15,724 adding 'lm_eval/tasks/belebele/belebele_snd_Arab.yaml' 2024-12-17T11:00:15,725 adding 'lm_eval/tasks/belebele/belebele_som_Latn.yaml' 2024-12-17T11:00:15,726 adding 'lm_eval/tasks/belebele/belebele_sot_Latn.yaml' 2024-12-17T11:00:15,728 adding 'lm_eval/tasks/belebele/belebele_spa_Latn.yaml' 2024-12-17T11:00:15,729 adding 'lm_eval/tasks/belebele/belebele_srp_Cyrl.yaml' 2024-12-17T11:00:15,730 adding 'lm_eval/tasks/belebele/belebele_ssw_Latn.yaml' 2024-12-17T11:00:15,731 adding 'lm_eval/tasks/belebele/belebele_sun_Latn.yaml' 2024-12-17T11:00:15,732 adding 'lm_eval/tasks/belebele/belebele_swe_Latn.yaml' 2024-12-17T11:00:15,733 adding 'lm_eval/tasks/belebele/belebele_swh_Latn.yaml' 2024-12-17T11:00:15,734 adding 'lm_eval/tasks/belebele/belebele_tam_Taml.yaml' 2024-12-17T11:00:15,736 adding 'lm_eval/tasks/belebele/belebele_tel_Telu.yaml' 2024-12-17T11:00:15,737 adding 'lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml' 2024-12-17T11:00:15,738 adding 'lm_eval/tasks/belebele/belebele_tgl_Latn.yaml' 2024-12-17T11:00:15,739 adding 'lm_eval/tasks/belebele/belebele_tha_Thai.yaml' 2024-12-17T11:00:15,741 adding 'lm_eval/tasks/belebele/belebele_tir_Ethi.yaml' 2024-12-17T11:00:15,742 adding 'lm_eval/tasks/belebele/belebele_tsn_Latn.yaml' 2024-12-17T11:00:15,743 adding 'lm_eval/tasks/belebele/belebele_tso_Latn.yaml' 2024-12-17T11:00:15,744 adding 'lm_eval/tasks/belebele/belebele_tur_Latn.yaml' 2024-12-17T11:00:15,745 adding 'lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml' 2024-12-17T11:00:15,746 adding 'lm_eval/tasks/belebele/belebele_urd_Arab.yaml' 2024-12-17T11:00:15,747 adding 'lm_eval/tasks/belebele/belebele_urd_Latn.yaml' 2024-12-17T11:00:15,749 adding 'lm_eval/tasks/belebele/belebele_uzn_Latn.yaml' 2024-12-17T11:00:15,750 adding 'lm_eval/tasks/belebele/belebele_vie_Latn.yaml' 2024-12-17T11:00:15,751 adding 'lm_eval/tasks/belebele/belebele_war_Latn.yaml' 2024-12-17T11:00:15,752 adding 'lm_eval/tasks/belebele/belebele_wol_Latn.yaml' 2024-12-17T11:00:15,753 adding 'lm_eval/tasks/belebele/belebele_xho_Latn.yaml' 2024-12-17T11:00:15,755 adding 'lm_eval/tasks/belebele/belebele_yor_Latn.yaml' 2024-12-17T11:00:15,756 adding 'lm_eval/tasks/belebele/belebele_zho_Hans.yaml' 2024-12-17T11:00:15,757 adding 'lm_eval/tasks/belebele/belebele_zho_Hant.yaml' 2024-12-17T11:00:15,758 adding 'lm_eval/tasks/belebele/belebele_zsm_Latn.yaml' 2024-12-17T11:00:15,759 adding 'lm_eval/tasks/belebele/belebele_zul_Latn.yaml' 2024-12-17T11:00:15,761 adding 'lm_eval/tasks/benchmarks/minerva_math.yaml' 2024-12-17T11:00:15,762 adding 'lm_eval/tasks/benchmarks/openllm.yaml' 2024-12-17T11:00:15,763 adding 'lm_eval/tasks/benchmarks/pythia.yaml' 2024-12-17T11:00:15,765 adding 'lm_eval/tasks/benchmarks/t0_eval.yaml' 2024-12-17T11:00:15,767 adding 'lm_eval/tasks/benchmarks/flan/_held_in_template_yaml' 2024-12-17T11:00:15,769 adding 'lm_eval/tasks/benchmarks/flan/flan_held_in.yaml' 2024-12-17T11:00:15,771 adding 'lm_eval/tasks/benchmarks/flan/flan_held_out.yaml' 2024-12-17T11:00:15,773 adding 'lm_eval/tasks/benchmarks/multimedqa/README.md' 2024-12-17T11:00:15,774 adding 'lm_eval/tasks/benchmarks/multimedqa/multimedqa.yaml' 2024-12-17T11:00:15,776 adding 'lm_eval/tasks/bertaqa/README.md' 2024-12-17T11:00:15,777 adding 'lm_eval/tasks/bertaqa/_bertaqa_template' 2024-12-17T11:00:15,778 adding 'lm_eval/tasks/bertaqa/bertaqa_en.yaml' 2024-12-17T11:00:15,779 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_gemma-7b.yaml' 2024-12-17T11:00:15,780 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_hitz.yaml' 2024-12-17T11:00:15,781 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_itzuli.yaml' 2024-12-17T11:00:15,783 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.1.yaml' 2024-12-17T11:00:15,784 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-13b-v1.yaml' 2024-12-17T11:00:15,785 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.1.yaml' 2024-12-17T11:00:15,786 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-70b-v1.yaml' 2024-12-17T11:00:15,787 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.1.yaml' 2024-12-17T11:00:15,788 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_latxa-7b-v1.yaml' 2024-12-17T11:00:15,789 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-13b.yaml' 2024-12-17T11:00:15,791 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-70b.yaml' 2024-12-17T11:00:15,792 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_llama-2-7b.yaml' 2024-12-17T11:00:15,793 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_madlad.yaml' 2024-12-17T11:00:15,794 adding 'lm_eval/tasks/bertaqa/bertaqa_en_mt_nllb.yaml' 2024-12-17T11:00:15,795 adding 'lm_eval/tasks/bertaqa/bertaqa_eu.yaml' 2024-12-17T11:00:15,798 adding 'lm_eval/tasks/bigbench/README.md' 2024-12-17T11:00:15,799 adding 'lm_eval/tasks/bigbench/generate_tasks.py' 2024-12-17T11:00:15,801 adding 'lm_eval/tasks/bigbench/generate_until_template_yaml' 2024-12-17T11:00:15,802 adding 'lm_eval/tasks/bigbench/multiple_choice_template_a_yaml' 2024-12-17T11:00:15,804 adding 'lm_eval/tasks/bigbench/multiple_choice_template_b_yaml' 2024-12-17T11:00:15,805 adding 'lm_eval/tasks/bigbench/push_bigbench_dataset.py' 2024-12-17T11:00:15,811 adding 'lm_eval/tasks/bigbench/generate_until/abstract_narrative_understanding.yaml' 2024-12-17T11:00:15,813 adding 'lm_eval/tasks/bigbench/generate_until/anachronisms.yaml' 2024-12-17T11:00:15,814 adding 'lm_eval/tasks/bigbench/generate_until/analogical_similarity.yaml' 2024-12-17T11:00:15,815 adding 'lm_eval/tasks/bigbench/generate_until/analytic_entailment.yaml' 2024-12-17T11:00:15,816 adding 'lm_eval/tasks/bigbench/generate_until/arithmetic.yaml' 2024-12-17T11:00:15,817 adding 'lm_eval/tasks/bigbench/generate_until/ascii_word_recognition.yaml' 2024-12-17T11:00:15,818 adding 'lm_eval/tasks/bigbench/generate_until/authorship_verification.yaml' 2024-12-17T11:00:15,820 adding 'lm_eval/tasks/bigbench/generate_until/auto_categorization.yaml' 2024-12-17T11:00:15,821 adding 'lm_eval/tasks/bigbench/generate_until/auto_debugging.yaml' 2024-12-17T11:00:15,822 adding 'lm_eval/tasks/bigbench/generate_until/bbq_lite_json.yaml' 2024-12-17T11:00:15,823 adding 'lm_eval/tasks/bigbench/generate_until/bridging_anaphora_resolution_barqa.yaml' 2024-12-17T11:00:15,824 adding 'lm_eval/tasks/bigbench/generate_until/causal_judgment.yaml' 2024-12-17T11:00:15,825 adding 'lm_eval/tasks/bigbench/generate_until/cause_and_effect.yaml' 2024-12-17T11:00:15,826 adding 'lm_eval/tasks/bigbench/generate_until/checkmate_in_one.yaml' 2024-12-17T11:00:15,828 adding 'lm_eval/tasks/bigbench/generate_until/chess_state_tracking.yaml' 2024-12-17T11:00:15,829 adding 'lm_eval/tasks/bigbench/generate_until/chinese_remainder_theorem.yaml' 2024-12-17T11:00:15,831 adding 'lm_eval/tasks/bigbench/generate_until/cifar10_classification.yaml' 2024-12-17T11:00:15,832 adding 'lm_eval/tasks/bigbench/generate_until/code_line_description.yaml' 2024-12-17T11:00:15,833 adding 'lm_eval/tasks/bigbench/generate_until/codenames.yaml' 2024-12-17T11:00:15,834 adding 'lm_eval/tasks/bigbench/generate_until/color.yaml' 2024-12-17T11:00:15,836 adding 'lm_eval/tasks/bigbench/generate_until/common_morpheme.yaml' 2024-12-17T11:00:15,837 adding 'lm_eval/tasks/bigbench/generate_until/conceptual_combinations.yaml' 2024-12-17T11:00:15,838 adding 'lm_eval/tasks/bigbench/generate_until/conlang_translation.yaml' 2024-12-17T11:00:15,839 adding 'lm_eval/tasks/bigbench/generate_until/contextual_parametric_knowledge_conflicts.yaml' 2024-12-17T11:00:15,840 adding 'lm_eval/tasks/bigbench/generate_until/crash_blossom.yaml' 2024-12-17T11:00:15,841 adding 'lm_eval/tasks/bigbench/generate_until/crass_ai.yaml' 2024-12-17T11:00:15,842 adding 'lm_eval/tasks/bigbench/generate_until/cryobiology_spanish.yaml' 2024-12-17T11:00:15,843 adding 'lm_eval/tasks/bigbench/generate_until/cryptonite.yaml' 2024-12-17T11:00:15,844 adding 'lm_eval/tasks/bigbench/generate_until/cs_algorithms.yaml' 2024-12-17T11:00:15,845 adding 'lm_eval/tasks/bigbench/generate_until/dark_humor_detection.yaml' 2024-12-17T11:00:15,846 adding 'lm_eval/tasks/bigbench/generate_until/date_understanding.yaml' 2024-12-17T11:00:15,847 adding 'lm_eval/tasks/bigbench/generate_until/disambiguation_qa.yaml' 2024-12-17T11:00:15,848 adding 'lm_eval/tasks/bigbench/generate_until/discourse_marker_prediction.yaml' 2024-12-17T11:00:15,849 adding 'lm_eval/tasks/bigbench/generate_until/disfl_qa.yaml' 2024-12-17T11:00:15,850 adding 'lm_eval/tasks/bigbench/generate_until/dyck_languages.yaml' 2024-12-17T11:00:15,852 adding 'lm_eval/tasks/bigbench/generate_until/elementary_math_qa.yaml' 2024-12-17T11:00:15,853 adding 'lm_eval/tasks/bigbench/generate_until/emoji_movie.yaml' 2024-12-17T11:00:15,854 adding 'lm_eval/tasks/bigbench/generate_until/emojis_emotion_prediction.yaml' 2024-12-17T11:00:15,855 adding 'lm_eval/tasks/bigbench/generate_until/empirical_judgments.yaml' 2024-12-17T11:00:15,856 adding 'lm_eval/tasks/bigbench/generate_until/english_proverbs.yaml' 2024-12-17T11:00:15,857 adding 'lm_eval/tasks/bigbench/generate_until/english_russian_proverbs.yaml' 2024-12-17T11:00:15,859 adding 'lm_eval/tasks/bigbench/generate_until/entailed_polarity.yaml' 2024-12-17T11:00:15,860 adding 'lm_eval/tasks/bigbench/generate_until/entailed_polarity_hindi.yaml' 2024-12-17T11:00:15,862 adding 'lm_eval/tasks/bigbench/generate_until/epistemic_reasoning.yaml' 2024-12-17T11:00:15,863 adding 'lm_eval/tasks/bigbench/generate_until/evaluating_information_essentiality.yaml' 2024-12-17T11:00:15,864 adding 'lm_eval/tasks/bigbench/generate_until/fact_checker.yaml' 2024-12-17T11:00:15,865 adding 'lm_eval/tasks/bigbench/generate_until/fantasy_reasoning.yaml' 2024-12-17T11:00:15,866 adding 'lm_eval/tasks/bigbench/generate_until/few_shot_nlg.yaml' 2024-12-17T11:00:15,867 adding 'lm_eval/tasks/bigbench/generate_until/figure_of_speech_detection.yaml' 2024-12-17T11:00:15,868 adding 'lm_eval/tasks/bigbench/generate_until/formal_fallacies_syllogisms_negation.yaml' 2024-12-17T11:00:15,869 adding 'lm_eval/tasks/bigbench/generate_until/gem.yaml' 2024-12-17T11:00:15,871 adding 'lm_eval/tasks/bigbench/generate_until/gender_inclusive_sentences_german.yaml' 2024-12-17T11:00:15,872 adding 'lm_eval/tasks/bigbench/generate_until/general_knowledge.yaml' 2024-12-17T11:00:15,873 adding 'lm_eval/tasks/bigbench/generate_until/geometric_shapes.yaml' 2024-12-17T11:00:15,874 adding 'lm_eval/tasks/bigbench/generate_until/goal_step_wikihow.yaml' 2024-12-17T11:00:15,876 adding 'lm_eval/tasks/bigbench/generate_until/gre_reading_comprehension.yaml' 2024-12-17T11:00:15,877 adding 'lm_eval/tasks/bigbench/generate_until/hhh_alignment.yaml' 2024-12-17T11:00:15,878 adding 'lm_eval/tasks/bigbench/generate_until/hindi_question_answering.yaml' 2024-12-17T11:00:15,879 adding 'lm_eval/tasks/bigbench/generate_until/hindu_knowledge.yaml' 2024-12-17T11:00:15,880 adding 'lm_eval/tasks/bigbench/generate_until/hinglish_toxicity.yaml' 2024-12-17T11:00:15,881 adding 'lm_eval/tasks/bigbench/generate_until/human_organs_senses.yaml' 2024-12-17T11:00:15,883 adding 'lm_eval/tasks/bigbench/generate_until/hyperbaton.yaml' 2024-12-17T11:00:15,884 adding 'lm_eval/tasks/bigbench/generate_until/identify_math_theorems.yaml' 2024-12-17T11:00:15,885 adding 'lm_eval/tasks/bigbench/generate_until/identify_odd_metaphor.yaml' 2024-12-17T11:00:15,886 adding 'lm_eval/tasks/bigbench/generate_until/implicatures.yaml' 2024-12-17T11:00:15,888 adding 'lm_eval/tasks/bigbench/generate_until/implicit_relations.yaml' 2024-12-17T11:00:15,890 adding 'lm_eval/tasks/bigbench/generate_until/intent_recognition.yaml' 2024-12-17T11:00:15,891 adding 'lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_nli.yaml' 2024-12-17T11:00:15,892 adding 'lm_eval/tasks/bigbench/generate_until/international_phonetic_alphabet_transliterate.yaml' 2024-12-17T11:00:15,893 adding 'lm_eval/tasks/bigbench/generate_until/intersect_geometry.yaml' 2024-12-17T11:00:15,894 adding 'lm_eval/tasks/bigbench/generate_until/irony_identification.yaml' 2024-12-17T11:00:15,895 adding 'lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml' 2024-12-17T11:00:15,896 adding 'lm_eval/tasks/bigbench/generate_until/kannada.yaml' 2024-12-17T11:00:15,898 adding 'lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml' 2024-12-17T11:00:15,899 adding 'lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml' 2024-12-17T11:00:15,900 adding 'lm_eval/tasks/bigbench/generate_until/language_games.yaml' 2024-12-17T11:00:15,901 adding 'lm_eval/tasks/bigbench/generate_until/language_identification.yaml' 2024-12-17T11:00:15,902 adding 'lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml' 2024-12-17T11:00:15,903 adding 'lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml' 2024-12-17T11:00:15,904 adding 'lm_eval/tasks/bigbench/generate_until/list_functions.yaml' 2024-12-17T11:00:15,905 adding 'lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml' 2024-12-17T11:00:15,906 adding 'lm_eval/tasks/bigbench/generate_until/logical_args.yaml' 2024-12-17T11:00:15,907 adding 'lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml' 2024-12-17T11:00:15,908 adding 'lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml' 2024-12-17T11:00:15,909 adding 'lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml' 2024-12-17T11:00:15,910 adding 'lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml' 2024-12-17T11:00:15,911 adding 'lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml' 2024-12-17T11:00:15,912 adding 'lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml' 2024-12-17T11:00:15,914 adding 'lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml' 2024-12-17T11:00:15,915 adding 'lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml' 2024-12-17T11:00:15,916 adding 'lm_eval/tasks/bigbench/generate_until/misconceptions.yaml' 2024-12-17T11:00:15,918 adding 'lm_eval/tasks/bigbench/generate_until/misconceptions_russian.yaml' 2024-12-17T11:00:15,919 adding 'lm_eval/tasks/bigbench/generate_until/mnist_ascii.yaml' 2024-12-17T11:00:15,920 adding 'lm_eval/tasks/bigbench/generate_until/modified_arithmetic.yaml' 2024-12-17T11:00:15,922 adding 'lm_eval/tasks/bigbench/generate_until/moral_permissibility.yaml' 2024-12-17T11:00:15,923 adding 'lm_eval/tasks/bigbench/generate_until/movie_dialog_same_or_different.yaml' 2024-12-17T11:00:15,924 adding 'lm_eval/tasks/bigbench/generate_until/movie_recommendation.yaml' 2024-12-17T11:00:15,925 adding 'lm_eval/tasks/bigbench/generate_until/mult_data_wrangling.yaml' 2024-12-17T11:00:15,926 adding 'lm_eval/tasks/bigbench/generate_until/multiemo.yaml' 2024-12-17T11:00:15,927 adding 'lm_eval/tasks/bigbench/generate_until/natural_instructions.yaml' 2024-12-17T11:00:15,929 adding 'lm_eval/tasks/bigbench/generate_until/navigate.yaml' 2024-12-17T11:00:15,930 adding 'lm_eval/tasks/bigbench/generate_until/nonsense_words_grammar.yaml' 2024-12-17T11:00:15,931 adding 'lm_eval/tasks/bigbench/generate_until/novel_concepts.yaml' 2024-12-17T11:00:15,932 adding 'lm_eval/tasks/bigbench/generate_until/object_counting.yaml' 2024-12-17T11:00:15,934 adding 'lm_eval/tasks/bigbench/generate_until/odd_one_out.yaml' 2024-12-17T11:00:15,935 adding 'lm_eval/tasks/bigbench/generate_until/operators.yaml' 2024-12-17T11:00:15,936 adding 'lm_eval/tasks/bigbench/generate_until/paragraph_segmentation.yaml' 2024-12-17T11:00:15,937 adding 'lm_eval/tasks/bigbench/generate_until/parsinlu_qa.yaml' 2024-12-17T11:00:15,938 adding 'lm_eval/tasks/bigbench/generate_until/parsinlu_reading_comprehension.yaml' 2024-12-17T11:00:15,939 adding 'lm_eval/tasks/bigbench/generate_until/penguins_in_a_table.yaml' 2024-12-17T11:00:15,940 adding 'lm_eval/tasks/bigbench/generate_until/periodic_elements.yaml' 2024-12-17T11:00:15,941 adding 'lm_eval/tasks/bigbench/generate_until/persian_idioms.yaml' 2024-12-17T11:00:15,942 adding 'lm_eval/tasks/bigbench/generate_until/phrase_relatedness.yaml' 2024-12-17T11:00:15,943 adding 'lm_eval/tasks/bigbench/generate_until/physical_intuition.yaml' 2024-12-17T11:00:15,944 adding 'lm_eval/tasks/bigbench/generate_until/physics.yaml' 2024-12-17T11:00:15,945 adding 'lm_eval/tasks/bigbench/generate_until/physics_questions.yaml' 2024-12-17T11:00:15,947 adding 'lm_eval/tasks/bigbench/generate_until/play_dialog_same_or_different.yaml' 2024-12-17T11:00:15,948 adding 'lm_eval/tasks/bigbench/generate_until/polish_sequence_labeling.yaml' 2024-12-17T11:00:15,949 adding 'lm_eval/tasks/bigbench/generate_until/presuppositions_as_nli.yaml' 2024-12-17T11:00:15,950 adding 'lm_eval/tasks/bigbench/generate_until/qa_wikidata.yaml' 2024-12-17T11:00:15,951 adding 'lm_eval/tasks/bigbench/generate_until/question_selection.yaml' 2024-12-17T11:00:15,953 adding 'lm_eval/tasks/bigbench/generate_until/real_or_fake_text.yaml' 2024-12-17T11:00:15,954 adding 'lm_eval/tasks/bigbench/generate_until/reasoning_about_colored_objects.yaml' 2024-12-17T11:00:15,955 adding 'lm_eval/tasks/bigbench/generate_until/repeat_copy_logic.yaml' 2024-12-17T11:00:15,956 adding 'lm_eval/tasks/bigbench/generate_until/rephrase.yaml' 2024-12-17T11:00:15,957 adding 'lm_eval/tasks/bigbench/generate_until/riddle_sense.yaml' 2024-12-17T11:00:15,958 adding 'lm_eval/tasks/bigbench/generate_until/ruin_names.yaml' 2024-12-17T11:00:15,960 adding 'lm_eval/tasks/bigbench/generate_until/salient_translation_error_detection.yaml' 2024-12-17T11:00:15,961 adding 'lm_eval/tasks/bigbench/generate_until/scientific_press_release.yaml' 2024-12-17T11:00:15,962 adding 'lm_eval/tasks/bigbench/generate_until/semantic_parsing_in_context_sparc.yaml' 2024-12-17T11:00:15,963 adding 'lm_eval/tasks/bigbench/generate_until/semantic_parsing_spider.yaml' 2024-12-17T11:00:15,964 adding 'lm_eval/tasks/bigbench/generate_until/sentence_ambiguity.yaml' 2024-12-17T11:00:15,965 adding 'lm_eval/tasks/bigbench/generate_until/similarities_abstraction.yaml' 2024-12-17T11:00:15,966 adding 'lm_eval/tasks/bigbench/generate_until/simp_turing_concept.yaml' 2024-12-17T11:00:15,967 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json.yaml' 2024-12-17T11:00:15,969 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_multiple_choice.yaml' 2024-12-17T11:00:15,970 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_json_subtasks.yaml' 2024-12-17T11:00:15,971 adding 'lm_eval/tasks/bigbench/generate_until/simple_arithmetic_multiple_targets_json.yaml' 2024-12-17T11:00:15,972 adding 'lm_eval/tasks/bigbench/generate_until/simple_ethical_questions.yaml' 2024-12-17T11:00:15,973 adding 'lm_eval/tasks/bigbench/generate_until/simple_text_editing.yaml' 2024-12-17T11:00:15,974 adding 'lm_eval/tasks/bigbench/generate_until/snarks.yaml' 2024-12-17T11:00:15,975 adding 'lm_eval/tasks/bigbench/generate_until/social_iqa.yaml' 2024-12-17T11:00:15,977 adding 'lm_eval/tasks/bigbench/generate_until/social_support.yaml' 2024-12-17T11:00:15,978 adding 'lm_eval/tasks/bigbench/generate_until/sports_understanding.yaml' 2024-12-17T11:00:15,979 adding 'lm_eval/tasks/bigbench/generate_until/strange_stories.yaml' 2024-12-17T11:00:15,980 adding 'lm_eval/tasks/bigbench/generate_until/strategyqa.yaml' 2024-12-17T11:00:15,982 adding 'lm_eval/tasks/bigbench/generate_until/sufficient_information.yaml' 2024-12-17T11:00:15,983 adding 'lm_eval/tasks/bigbench/generate_until/suicide_risk.yaml' 2024-12-17T11:00:15,984 adding 'lm_eval/tasks/bigbench/generate_until/swahili_english_proverbs.yaml' 2024-12-17T11:00:15,986 adding 'lm_eval/tasks/bigbench/generate_until/swedish_to_german_proverbs.yaml' 2024-12-17T11:00:15,986 adding 'lm_eval/tasks/bigbench/generate_until/symbol_interpretation.yaml' 2024-12-17T11:00:15,988 adding 'lm_eval/tasks/bigbench/generate_until/temporal_sequences.yaml' 2024-12-17T11:00:15,989 adding 'lm_eval/tasks/bigbench/generate_until/tense.yaml' 2024-12-17T11:00:15,990 adding 'lm_eval/tasks/bigbench/generate_until/timedial.yaml' 2024-12-17T11:00:15,991 adding 'lm_eval/tasks/bigbench/generate_until/topical_chat.yaml' 2024-12-17T11:00:15,992 adding 'lm_eval/tasks/bigbench/generate_until/tracking_shuffled_objects.yaml' 2024-12-17T11:00:15,993 adding 'lm_eval/tasks/bigbench/generate_until/understanding_fables.yaml' 2024-12-17T11:00:15,994 adding 'lm_eval/tasks/bigbench/generate_until/undo_permutation.yaml' 2024-12-17T11:00:15,995 adding 'lm_eval/tasks/bigbench/generate_until/unit_conversion.yaml' 2024-12-17T11:00:15,996 adding 'lm_eval/tasks/bigbench/generate_until/unit_interpretation.yaml' 2024-12-17T11:00:15,998 adding 'lm_eval/tasks/bigbench/generate_until/unnatural_in_context_learning.yaml' 2024-12-17T11:00:15,999 adding 'lm_eval/tasks/bigbench/generate_until/vitaminc_fact_verification.yaml' 2024-12-17T11:00:16,000 adding 'lm_eval/tasks/bigbench/generate_until/what_is_the_tao.yaml' 2024-12-17T11:00:16,001 adding 'lm_eval/tasks/bigbench/generate_until/which_wiki_edit.yaml' 2024-12-17T11:00:16,002 adding 'lm_eval/tasks/bigbench/generate_until/winowhy.yaml' 2024-12-17T11:00:16,003 adding 'lm_eval/tasks/bigbench/generate_until/word_sorting.yaml' 2024-12-17T11:00:16,004 adding 'lm_eval/tasks/bigbench/generate_until/word_unscrambling.yaml' 2024-12-17T11:00:16,008 adding 'lm_eval/tasks/bigbench/multiple_choice/abstract_narrative_understanding.yaml' 2024-12-17T11:00:16,009 adding 'lm_eval/tasks/bigbench/multiple_choice/anachronisms.yaml' 2024-12-17T11:00:16,010 adding 'lm_eval/tasks/bigbench/multiple_choice/analogical_similarity.yaml' 2024-12-17T11:00:16,011 adding 'lm_eval/tasks/bigbench/multiple_choice/analytic_entailment.yaml' 2024-12-17T11:00:16,013 adding 'lm_eval/tasks/bigbench/multiple_choice/arithmetic.yaml' 2024-12-17T11:00:16,014 adding 'lm_eval/tasks/bigbench/multiple_choice/authorship_verification.yaml' 2024-12-17T11:00:16,015 adding 'lm_eval/tasks/bigbench/multiple_choice/bbq_lite_json.yaml' 2024-12-17T11:00:16,016 adding 'lm_eval/tasks/bigbench/multiple_choice/causal_judgment.yaml' 2024-12-17T11:00:16,017 adding 'lm_eval/tasks/bigbench/multiple_choice/cause_and_effect.yaml' 2024-12-17T11:00:16,018 adding 'lm_eval/tasks/bigbench/multiple_choice/checkmate_in_one.yaml' 2024-12-17T11:00:16,019 adding 'lm_eval/tasks/bigbench/multiple_choice/cifar10_classification.yaml' 2024-12-17T11:00:16,021 adding 'lm_eval/tasks/bigbench/multiple_choice/code_line_description.yaml' 2024-12-17T11:00:16,022 adding 'lm_eval/tasks/bigbench/multiple_choice/color.yaml' 2024-12-17T11:00:16,023 adding 'lm_eval/tasks/bigbench/multiple_choice/common_morpheme.yaml' 2024-12-17T11:00:16,024 adding 'lm_eval/tasks/bigbench/multiple_choice/conceptual_combinations.yaml' 2024-12-17T11:00:16,025 adding 'lm_eval/tasks/bigbench/multiple_choice/contextual_parametric_knowledge_conflicts.yaml' 2024-12-17T11:00:16,027 adding 'lm_eval/tasks/bigbench/multiple_choice/crash_blossom.yaml' 2024-12-17T11:00:16,028 adding 'lm_eval/tasks/bigbench/multiple_choice/crass_ai.yaml' 2024-12-17T11:00:16,029 adding 'lm_eval/tasks/bigbench/multiple_choice/cryobiology_spanish.yaml' 2024-12-17T11:00:16,030 adding 'lm_eval/tasks/bigbench/multiple_choice/cs_algorithms.yaml' 2024-12-17T11:00:16,031 adding 'lm_eval/tasks/bigbench/multiple_choice/dark_humor_detection.yaml' 2024-12-17T11:00:16,033 adding 'lm_eval/tasks/bigbench/multiple_choice/date_understanding.yaml' 2024-12-17T11:00:16,034 adding 'lm_eval/tasks/bigbench/multiple_choice/disambiguation_qa.yaml' 2024-12-17T11:00:16,035 adding 'lm_eval/tasks/bigbench/multiple_choice/discourse_marker_prediction.yaml' 2024-12-17T11:00:16,036 adding 'lm_eval/tasks/bigbench/multiple_choice/dyck_languages.yaml' 2024-12-17T11:00:16,037 adding 'lm_eval/tasks/bigbench/multiple_choice/elementary_math_qa.yaml' 2024-12-17T11:00:16,038 adding 'lm_eval/tasks/bigbench/multiple_choice/emoji_movie.yaml' 2024-12-17T11:00:16,039 adding 'lm_eval/tasks/bigbench/multiple_choice/emojis_emotion_prediction.yaml' 2024-12-17T11:00:16,041 adding 'lm_eval/tasks/bigbench/multiple_choice/empirical_judgments.yaml' 2024-12-17T11:00:16,042 adding 'lm_eval/tasks/bigbench/multiple_choice/english_proverbs.yaml' 2024-12-17T11:00:16,043 adding 'lm_eval/tasks/bigbench/multiple_choice/english_russian_proverbs.yaml' 2024-12-17T11:00:16,044 adding 'lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml' 2024-12-17T11:00:16,045 adding 'lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml' 2024-12-17T11:00:16,046 adding 'lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml' 2024-12-17T11:00:16,047 adding 'lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml' 2024-12-17T11:00:16,048 adding 'lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml' 2024-12-17T11:00:16,049 adding 'lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml' 2024-12-17T11:00:16,050 adding 'lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml' 2024-12-17T11:00:16,051 adding 'lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml' 2024-12-17T11:00:16,052 adding 'lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml' 2024-12-17T11:00:16,054 adding 'lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml' 2024-12-17T11:00:16,055 adding 'lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml' 2024-12-17T11:00:16,056 adding 'lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml' 2024-12-17T11:00:16,057 adding 'lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml' 2024-12-17T11:00:16,058 adding 'lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml' 2024-12-17T11:00:16,059 adding 'lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml' 2024-12-17T11:00:16,060 adding 'lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml' 2024-12-17T11:00:16,062 adding 'lm_eval/tasks/bigbench/multiple_choice/hyperbaton.yaml' 2024-12-17T11:00:16,063 adding 'lm_eval/tasks/bigbench/multiple_choice/identify_math_theorems.yaml' 2024-12-17T11:00:16,064 adding 'lm_eval/tasks/bigbench/multiple_choice/identify_odd_metaphor.yaml' 2024-12-17T11:00:16,065 adding 'lm_eval/tasks/bigbench/multiple_choice/implicatures.yaml' 2024-12-17T11:00:16,066 adding 'lm_eval/tasks/bigbench/multiple_choice/implicit_relations.yaml' 2024-12-17T11:00:16,067 adding 'lm_eval/tasks/bigbench/multiple_choice/intent_recognition.yaml' 2024-12-17T11:00:16,069 adding 'lm_eval/tasks/bigbench/multiple_choice/international_phonetic_alphabet_nli.yaml' 2024-12-17T11:00:16,070 adding 'lm_eval/tasks/bigbench/multiple_choice/intersect_geometry.yaml' 2024-12-17T11:00:16,071 adding 'lm_eval/tasks/bigbench/multiple_choice/irony_identification.yaml' 2024-12-17T11:00:16,072 adding 'lm_eval/tasks/bigbench/multiple_choice/kanji_ascii.yaml' 2024-12-17T11:00:16,073 adding 'lm_eval/tasks/bigbench/multiple_choice/kannada.yaml' 2024-12-17T11:00:16,074 adding 'lm_eval/tasks/bigbench/multiple_choice/key_value_maps.yaml' 2024-12-17T11:00:16,075 adding 'lm_eval/tasks/bigbench/multiple_choice/known_unknowns.yaml' 2024-12-17T11:00:16,077 adding 'lm_eval/tasks/bigbench/multiple_choice/language_identification.yaml' 2024-12-17T11:00:16,078 adding 'lm_eval/tasks/bigbench/multiple_choice/logic_grid_puzzle.yaml' 2024-12-17T11:00:16,079 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_args.yaml' 2024-12-17T11:00:16,080 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_deduction.yaml' 2024-12-17T11:00:16,081 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_fallacy_detection.yaml' 2024-12-17T11:00:16,082 adding 'lm_eval/tasks/bigbench/multiple_choice/logical_sequence.yaml' 2024-12-17T11:00:16,083 adding 'lm_eval/tasks/bigbench/multiple_choice/mathematical_induction.yaml' 2024-12-17T11:00:16,084 adding 'lm_eval/tasks/bigbench/multiple_choice/metaphor_boolean.yaml' 2024-12-17T11:00:16,085 adding 'lm_eval/tasks/bigbench/multiple_choice/metaphor_understanding.yaml' 2024-12-17T11:00:16,086 adding 'lm_eval/tasks/bigbench/multiple_choice/misconceptions.yaml' 2024-12-17T11:00:16,087 adding 'lm_eval/tasks/bigbench/multiple_choice/misconceptions_russian.yaml' 2024-12-17T11:00:16,088 adding 'lm_eval/tasks/bigbench/multiple_choice/mnist_ascii.yaml' 2024-12-17T11:00:16,089 adding 'lm_eval/tasks/bigbench/multiple_choice/moral_permissibility.yaml' 2024-12-17T11:00:16,091 adding 'lm_eval/tasks/bigbench/multiple_choice/movie_dialog_same_or_different.yaml' 2024-12-17T11:00:16,092 adding 'lm_eval/tasks/bigbench/multiple_choice/movie_recommendation.yaml' 2024-12-17T11:00:16,093 adding 'lm_eval/tasks/bigbench/multiple_choice/multiemo.yaml' 2024-12-17T11:00:16,094 adding 'lm_eval/tasks/bigbench/multiple_choice/navigate.yaml' 2024-12-17T11:00:16,095 adding 'lm_eval/tasks/bigbench/multiple_choice/nonsense_words_grammar.yaml' 2024-12-17T11:00:16,096 adding 'lm_eval/tasks/bigbench/multiple_choice/novel_concepts.yaml' 2024-12-17T11:00:16,097 adding 'lm_eval/tasks/bigbench/multiple_choice/odd_one_out.yaml' 2024-12-17T11:00:16,098 adding 'lm_eval/tasks/bigbench/multiple_choice/parsinlu_qa.yaml' 2024-12-17T11:00:16,099 adding 'lm_eval/tasks/bigbench/multiple_choice/penguins_in_a_table.yaml' 2024-12-17T11:00:16,101 adding 'lm_eval/tasks/bigbench/multiple_choice/periodic_elements.yaml' 2024-12-17T11:00:16,102 adding 'lm_eval/tasks/bigbench/multiple_choice/persian_idioms.yaml' 2024-12-17T11:00:16,103 adding 'lm_eval/tasks/bigbench/multiple_choice/phrase_relatedness.yaml' 2024-12-17T11:00:16,104 adding 'lm_eval/tasks/bigbench/multiple_choice/physical_intuition.yaml' 2024-12-17T11:00:16,105 adding 'lm_eval/tasks/bigbench/multiple_choice/physics.yaml' 2024-12-17T11:00:16,106 adding 'lm_eval/tasks/bigbench/multiple_choice/play_dialog_same_or_different.yaml' 2024-12-17T11:00:16,107 adding 'lm_eval/tasks/bigbench/multiple_choice/presuppositions_as_nli.yaml' 2024-12-17T11:00:16,108 adding 'lm_eval/tasks/bigbench/multiple_choice/question_selection.yaml' 2024-12-17T11:00:16,109 adding 'lm_eval/tasks/bigbench/multiple_choice/real_or_fake_text.yaml' 2024-12-17T11:00:16,110 adding 'lm_eval/tasks/bigbench/multiple_choice/reasoning_about_colored_objects.yaml' 2024-12-17T11:00:16,112 adding 'lm_eval/tasks/bigbench/multiple_choice/riddle_sense.yaml' 2024-12-17T11:00:16,113 adding 'lm_eval/tasks/bigbench/multiple_choice/ruin_names.yaml' 2024-12-17T11:00:16,114 adding 'lm_eval/tasks/bigbench/multiple_choice/salient_translation_error_detection.yaml' 2024-12-17T11:00:16,115 adding 'lm_eval/tasks/bigbench/multiple_choice/sentence_ambiguity.yaml' 2024-12-17T11:00:16,116 adding 'lm_eval/tasks/bigbench/multiple_choice/similarities_abstraction.yaml' 2024-12-17T11:00:16,117 adding 'lm_eval/tasks/bigbench/multiple_choice/simple_ethical_questions.yaml' 2024-12-17T11:00:16,118 adding 'lm_eval/tasks/bigbench/multiple_choice/snarks.yaml' 2024-12-17T11:00:16,120 adding 'lm_eval/tasks/bigbench/multiple_choice/social_iqa.yaml' 2024-12-17T11:00:16,121 adding 'lm_eval/tasks/bigbench/multiple_choice/social_support.yaml' 2024-12-17T11:00:16,122 adding 'lm_eval/tasks/bigbench/multiple_choice/sports_understanding.yaml' 2024-12-17T11:00:16,123 adding 'lm_eval/tasks/bigbench/multiple_choice/strange_stories.yaml' 2024-12-17T11:00:16,124 adding 'lm_eval/tasks/bigbench/multiple_choice/strategyqa.yaml' 2024-12-17T11:00:16,125 adding 'lm_eval/tasks/bigbench/multiple_choice/suicide_risk.yaml' 2024-12-17T11:00:16,127 adding 'lm_eval/tasks/bigbench/multiple_choice/swahili_english_proverbs.yaml' 2024-12-17T11:00:16,128 adding 'lm_eval/tasks/bigbench/multiple_choice/swedish_to_german_proverbs.yaml' 2024-12-17T11:00:16,129 adding 'lm_eval/tasks/bigbench/multiple_choice/symbol_interpretation.yaml' 2024-12-17T11:00:16,130 adding 'lm_eval/tasks/bigbench/multiple_choice/temporal_sequences.yaml' 2024-12-17T11:00:16,131 adding 'lm_eval/tasks/bigbench/multiple_choice/timedial.yaml' 2024-12-17T11:00:16,132 adding 'lm_eval/tasks/bigbench/multiple_choice/tracking_shuffled_objects.yaml' 2024-12-17T11:00:16,133 adding 'lm_eval/tasks/bigbench/multiple_choice/understanding_fables.yaml' 2024-12-17T11:00:16,134 adding 'lm_eval/tasks/bigbench/multiple_choice/undo_permutation.yaml' 2024-12-17T11:00:16,135 adding 'lm_eval/tasks/bigbench/multiple_choice/unit_conversion.yaml' 2024-12-17T11:00:16,136 adding 'lm_eval/tasks/bigbench/multiple_choice/unit_interpretation.yaml' 2024-12-17T11:00:16,137 adding 'lm_eval/tasks/bigbench/multiple_choice/vitaminc_fact_verification.yaml' 2024-12-17T11:00:16,138 adding 'lm_eval/tasks/bigbench/multiple_choice/what_is_the_tao.yaml' 2024-12-17T11:00:16,139 adding 'lm_eval/tasks/bigbench/multiple_choice/which_wiki_edit.yaml' 2024-12-17T11:00:16,140 adding 'lm_eval/tasks/bigbench/multiple_choice/winowhy.yaml' 2024-12-17T11:00:16,143 adding 'lm_eval/tasks/blimp/README.md' 2024-12-17T11:00:16,145 adding 'lm_eval/tasks/blimp/_blimp.yaml' 2024-12-17T11:00:16,146 adding 'lm_eval/tasks/blimp/_template_yaml' 2024-12-17T11:00:16,147 adding 'lm_eval/tasks/blimp/adjunct_island.yaml' 2024-12-17T11:00:16,148 adding 'lm_eval/tasks/blimp/anaphor_gender_agreement.yaml' 2024-12-17T11:00:16,149 adding 'lm_eval/tasks/blimp/anaphor_number_agreement.yaml' 2024-12-17T11:00:16,150 adding 'lm_eval/tasks/blimp/animate_subject_passive.yaml' 2024-12-17T11:00:16,151 adding 'lm_eval/tasks/blimp/animate_subject_trans.yaml' 2024-12-17T11:00:16,152 adding 'lm_eval/tasks/blimp/causative.yaml' 2024-12-17T11:00:16,153 adding 'lm_eval/tasks/blimp/complex_NP_island.yaml' 2024-12-17T11:00:16,154 adding 'lm_eval/tasks/blimp/coordinate_structure_constraint_complex_left_branch.yaml' 2024-12-17T11:00:16,155 adding 'lm_eval/tasks/blimp/coordinate_structure_constraint_object_extraction.yaml' 2024-12-17T11:00:16,157 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_1.yaml' 2024-12-17T11:00:16,158 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_2.yaml' 2024-12-17T11:00:16,159 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_irregular_1.yaml' 2024-12-17T11:00:16,160 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_irregular_2.yaml' 2024-12-17T11:00:16,162 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_2.yaml' 2024-12-17T11:00:16,163 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_1.yaml' 2024-12-17T11:00:16,164 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adj_irregular_2.yaml' 2024-12-17T11:00:16,165 adding 'lm_eval/tasks/blimp/determiner_noun_agreement_with_adjective_1.yaml' 2024-12-17T11:00:16,166 adding 'lm_eval/tasks/blimp/distractor_agreement_relational_noun.yaml' 2024-12-17T11:00:16,167 adding 'lm_eval/tasks/blimp/distractor_agreement_relative_clause.yaml' 2024-12-17T11:00:16,168 adding 'lm_eval/tasks/blimp/drop_argument.yaml' 2024-12-17T11:00:16,170 adding 'lm_eval/tasks/blimp/ellipsis_n_bar_1.yaml' 2024-12-17T11:00:16,171 adding 'lm_eval/tasks/blimp/ellipsis_n_bar_2.yaml' 2024-12-17T11:00:16,172 adding 'lm_eval/tasks/blimp/existential_there_object_raising.yaml' 2024-12-17T11:00:16,173 adding 'lm_eval/tasks/blimp/existential_there_quantifiers_1.yaml' 2024-12-17T11:00:16,174 adding 'lm_eval/tasks/blimp/existential_there_quantifiers_2.yaml' 2024-12-17T11:00:16,175 adding 'lm_eval/tasks/blimp/existential_there_subject_raising.yaml' 2024-12-17T11:00:16,177 adding 'lm_eval/tasks/blimp/expletive_it_object_raising.yaml' 2024-12-17T11:00:16,178 adding 'lm_eval/tasks/blimp/generate_configs.py' 2024-12-17T11:00:16,179 adding 'lm_eval/tasks/blimp/inchoative.yaml' 2024-12-17T11:00:16,181 adding 'lm_eval/tasks/blimp/intransitive.yaml' 2024-12-17T11:00:16,182 adding 'lm_eval/tasks/blimp/irregular_past_participle_adjectives.yaml' 2024-12-17T11:00:16,183 adding 'lm_eval/tasks/blimp/irregular_past_participle_verbs.yaml' 2024-12-17T11:00:16,184 adding 'lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_1.yaml' 2024-12-17T11:00:16,185 adding 'lm_eval/tasks/blimp/irregular_plural_subject_verb_agreement_2.yaml' 2024-12-17T11:00:16,186 adding 'lm_eval/tasks/blimp/left_branch_island_echo_question.yaml' 2024-12-17T11:00:16,187 adding 'lm_eval/tasks/blimp/left_branch_island_simple_question.yaml' 2024-12-17T11:00:16,188 adding 'lm_eval/tasks/blimp/matrix_question_npi_licensor_present.yaml' 2024-12-17T11:00:16,189 adding 'lm_eval/tasks/blimp/npi_present_1.yaml' 2024-12-17T11:00:16,190 adding 'lm_eval/tasks/blimp/npi_present_2.yaml' 2024-12-17T11:00:16,191 adding 'lm_eval/tasks/blimp/only_npi_licensor_present.yaml' 2024-12-17T11:00:16,192 adding 'lm_eval/tasks/blimp/only_npi_scope.yaml' 2024-12-17T11:00:16,193 adding 'lm_eval/tasks/blimp/passive_1.yaml' 2024-12-17T11:00:16,194 adding 'lm_eval/tasks/blimp/passive_2.yaml' 2024-12-17T11:00:16,195 adding 'lm_eval/tasks/blimp/principle_A_c_command.yaml' 2024-12-17T11:00:16,196 adding 'lm_eval/tasks/blimp/principle_A_case_1.yaml' 2024-12-17T11:00:16,197 adding 'lm_eval/tasks/blimp/principle_A_case_2.yaml' 2024-12-17T11:00:16,198 adding 'lm_eval/tasks/blimp/principle_A_domain_1.yaml' 2024-12-17T11:00:16,199 adding 'lm_eval/tasks/blimp/principle_A_domain_2.yaml' 2024-12-17T11:00:16,200 adding 'lm_eval/tasks/blimp/principle_A_domain_3.yaml' 2024-12-17T11:00:16,201 adding 'lm_eval/tasks/blimp/principle_A_reconstruction.yaml' 2024-12-17T11:00:16,202 adding 'lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml' 2024-12-17T11:00:16,204 adding 'lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml' 2024-12-17T11:00:16,205 adding 'lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml' 2024-12-17T11:00:16,206 adding 'lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml' 2024-12-17T11:00:16,207 adding 'lm_eval/tasks/blimp/sentential_subject_island.yaml' 2024-12-17T11:00:16,208 adding 'lm_eval/tasks/blimp/superlative_quantifiers_1.yaml' 2024-12-17T11:00:16,209 adding 'lm_eval/tasks/blimp/superlative_quantifiers_2.yaml' 2024-12-17T11:00:16,210 adding 'lm_eval/tasks/blimp/tough_vs_raising_1.yaml' 2024-12-17T11:00:16,211 adding 'lm_eval/tasks/blimp/tough_vs_raising_2.yaml' 2024-12-17T11:00:16,212 adding 'lm_eval/tasks/blimp/transitive.yaml' 2024-12-17T11:00:16,214 adding 'lm_eval/tasks/blimp/wh_island.yaml' 2024-12-17T11:00:16,215 adding 'lm_eval/tasks/blimp/wh_questions_object_gap.yaml' 2024-12-17T11:00:16,216 adding 'lm_eval/tasks/blimp/wh_questions_subject_gap.yaml' 2024-12-17T11:00:16,217 adding 'lm_eval/tasks/blimp/wh_questions_subject_gap_long_distance.yaml' 2024-12-17T11:00:16,218 adding 'lm_eval/tasks/blimp/wh_vs_that_no_gap.yaml' 2024-12-17T11:00:16,219 adding 'lm_eval/tasks/blimp/wh_vs_that_no_gap_long_distance.yaml' 2024-12-17T11:00:16,220 adding 'lm_eval/tasks/blimp/wh_vs_that_with_gap.yaml' 2024-12-17T11:00:16,221 adding 'lm_eval/tasks/blimp/wh_vs_that_with_gap_long_distance.yaml' 2024-12-17T11:00:16,224 adding 'lm_eval/tasks/catalan_bench/README.md' 2024-12-17T11:00:16,226 adding 'lm_eval/tasks/catalan_bench/_arc_ca_common_yaml' 2024-12-17T11:00:16,227 adding 'lm_eval/tasks/catalan_bench/_cabreu_common_yaml' 2024-12-17T11:00:16,228 adding 'lm_eval/tasks/catalan_bench/arc_ca_challenge.yaml' 2024-12-17T11:00:16,229 adding 'lm_eval/tasks/catalan_bench/arc_ca_easy.yaml' 2024-12-17T11:00:16,231 adding 'lm_eval/tasks/catalan_bench/cabreu_abstractive.yaml' 2024-12-17T11:00:16,232 adding 'lm_eval/tasks/catalan_bench/cabreu_extractive.yaml' 2024-12-17T11:00:16,233 adding 'lm_eval/tasks/catalan_bench/cabreu_extreme.yaml' 2024-12-17T11:00:16,234 adding 'lm_eval/tasks/catalan_bench/catalan_bench.yaml' 2024-12-17T11:00:16,236 adding 'lm_eval/tasks/catalan_bench/catalanqa.yaml' 2024-12-17T11:00:16,237 adding 'lm_eval/tasks/catalan_bench/catcola.yaml' 2024-12-17T11:00:16,238 adding 'lm_eval/tasks/catalan_bench/copa_ca.yaml' 2024-12-17T11:00:16,239 adding 'lm_eval/tasks/catalan_bench/coqcat.yaml' 2024-12-17T11:00:16,240 adding 'lm_eval/tasks/catalan_bench/mgsm_direct_ca.yaml' 2024-12-17T11:00:16,241 adding 'lm_eval/tasks/catalan_bench/openbookqa_ca.yaml' 2024-12-17T11:00:16,243 adding 'lm_eval/tasks/catalan_bench/parafraseja.yaml' 2024-12-17T11:00:16,244 adding 'lm_eval/tasks/catalan_bench/paws_ca.yaml' 2024-12-17T11:00:16,245 adding 'lm_eval/tasks/catalan_bench/piqa_ca.yaml' 2024-12-17T11:00:16,246 adding 'lm_eval/tasks/catalan_bench/siqa_ca.yaml' 2024-12-17T11:00:16,247 adding 'lm_eval/tasks/catalan_bench/teca.yaml' 2024-12-17T11:00:16,249 adding 'lm_eval/tasks/catalan_bench/utils.py' 2024-12-17T11:00:16,250 adding 'lm_eval/tasks/catalan_bench/wnli_ca.yaml' 2024-12-17T11:00:16,251 adding 'lm_eval/tasks/catalan_bench/xnli_ca.yaml' 2024-12-17T11:00:16,252 adding 'lm_eval/tasks/catalan_bench/xquad_ca.yaml' 2024-12-17T11:00:16,254 adding 'lm_eval/tasks/catalan_bench/xstorycloze_ca.yaml' 2024-12-17T11:00:16,255 adding 'lm_eval/tasks/catalan_bench/flores_ca/_flores_common_yaml' 2024-12-17T11:00:16,257 adding 'lm_eval/tasks/catalan_bench/flores_ca/create_yamls_flores_ca.py' 2024-12-17T11:00:16,258 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-de.yaml' 2024-12-17T11:00:16,260 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-en.yaml' 2024-12-17T11:00:16,261 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-es.yaml' 2024-12-17T11:00:16,262 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-eu.yaml' 2024-12-17T11:00:16,263 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-fr.yaml' 2024-12-17T11:00:16,264 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-gl.yaml' 2024-12-17T11:00:16,265 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-it.yaml' 2024-12-17T11:00:16,267 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca-pt.yaml' 2024-12-17T11:00:16,268 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_ca.yaml' 2024-12-17T11:00:16,269 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_de-ca.yaml' 2024-12-17T11:00:16,270 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_en-ca.yaml' 2024-12-17T11:00:16,271 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_es-ca.yaml' 2024-12-17T11:00:16,273 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_eu-ca.yaml' 2024-12-17T11:00:16,274 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_fr-ca.yaml' 2024-12-17T11:00:16,275 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_gl-ca.yaml' 2024-12-17T11:00:16,276 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_it-ca.yaml' 2024-12-17T11:00:16,277 adding 'lm_eval/tasks/catalan_bench/flores_ca/flores_pt-ca.yaml' 2024-12-17T11:00:16,279 adding 'lm_eval/tasks/catalan_bench/phrases_va/_phrases_va_common.yaml' 2024-12-17T11:00:16,280 adding 'lm_eval/tasks/catalan_bench/phrases_va/phrases_ca-va.yaml' 2024-12-17T11:00:16,281 adding 'lm_eval/tasks/catalan_bench/phrases_va/phrases_va-ca.yaml' 2024-12-17T11:00:16,284 adding 'lm_eval/tasks/ceval/README.md' 2024-12-17T11:00:16,286 adding 'lm_eval/tasks/ceval/_ceval-valid.yaml' 2024-12-17T11:00:16,287 adding 'lm_eval/tasks/ceval/_default_ceval_yaml' 2024-12-17T11:00:16,288 adding 'lm_eval/tasks/ceval/_generate_configs.py' 2024-12-17T11:00:16,290 adding 'lm_eval/tasks/ceval/ceval-valid_accountant.yaml' 2024-12-17T11:00:16,291 adding 'lm_eval/tasks/ceval/ceval-valid_advanced_mathematics.yaml' 2024-12-17T11:00:16,292 adding 'lm_eval/tasks/ceval/ceval-valid_art_studies.yaml' 2024-12-17T11:00:16,293 adding 'lm_eval/tasks/ceval/ceval-valid_basic_medicine.yaml' 2024-12-17T11:00:16,294 adding 'lm_eval/tasks/ceval/ceval-valid_business_administration.yaml' 2024-12-17T11:00:16,296 adding 'lm_eval/tasks/ceval/ceval-valid_chinese_language_and_literature.yaml' 2024-12-17T11:00:16,297 adding 'lm_eval/tasks/ceval/ceval-valid_civil_servant.yaml' 2024-12-17T11:00:16,298 adding 'lm_eval/tasks/ceval/ceval-valid_clinical_medicine.yaml' 2024-12-17T11:00:16,299 adding 'lm_eval/tasks/ceval/ceval-valid_college_chemistry.yaml' 2024-12-17T11:00:16,300 adding 'lm_eval/tasks/ceval/ceval-valid_college_economics.yaml' 2024-12-17T11:00:16,301 adding 'lm_eval/tasks/ceval/ceval-valid_college_physics.yaml' 2024-12-17T11:00:16,302 adding 'lm_eval/tasks/ceval/ceval-valid_college_programming.yaml' 2024-12-17T11:00:16,303 adding 'lm_eval/tasks/ceval/ceval-valid_computer_architecture.yaml' 2024-12-17T11:00:16,304 adding 'lm_eval/tasks/ceval/ceval-valid_computer_network.yaml' 2024-12-17T11:00:16,305 adding 'lm_eval/tasks/ceval/ceval-valid_discrete_mathematics.yaml' 2024-12-17T11:00:16,307 adding 'lm_eval/tasks/ceval/ceval-valid_education_science.yaml' 2024-12-17T11:00:16,308 adding 'lm_eval/tasks/ceval/ceval-valid_electrical_engineer.yaml' 2024-12-17T11:00:16,309 adding 'lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml' 2024-12-17T11:00:16,310 adding 'lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml' 2024-12-17T11:00:16,311 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml' 2024-12-17T11:00:16,312 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml' 2024-12-17T11:00:16,313 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml' 2024-12-17T11:00:16,315 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml' 2024-12-17T11:00:16,316 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml' 2024-12-17T11:00:16,317 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml' 2024-12-17T11:00:16,318 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml' 2024-12-17T11:00:16,319 adding 'lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml' 2024-12-17T11:00:16,320 adding 'lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml' 2024-12-17T11:00:16,322 adding 'lm_eval/tasks/ceval/ceval-valid_law.yaml' 2024-12-17T11:00:16,323 adding 'lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml' 2024-12-17T11:00:16,324 adding 'lm_eval/tasks/ceval/ceval-valid_logic.yaml' 2024-12-17T11:00:16,325 adding 'lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml' 2024-12-17T11:00:16,326 adding 'lm_eval/tasks/ceval/ceval-valid_marxism.yaml' 2024-12-17T11:00:16,327 adding 'lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml' 2024-12-17T11:00:16,328 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml' 2024-12-17T11:00:16,329 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml' 2024-12-17T11:00:16,331 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml' 2024-12-17T11:00:16,332 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml' 2024-12-17T11:00:16,333 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml' 2024-12-17T11:00:16,334 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml' 2024-12-17T11:00:16,335 adding 'lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml' 2024-12-17T11:00:16,336 adding 'lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml' 2024-12-17T11:00:16,338 adding 'lm_eval/tasks/ceval/ceval-valid_operating_system.yaml' 2024-12-17T11:00:16,339 adding 'lm_eval/tasks/ceval/ceval-valid_physician.yaml' 2024-12-17T11:00:16,340 adding 'lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml' 2024-12-17T11:00:16,341 adding 'lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml' 2024-12-17T11:00:16,342 adding 'lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml' 2024-12-17T11:00:16,344 adding 'lm_eval/tasks/ceval/ceval-valid_sports_science.yaml' 2024-12-17T11:00:16,345 adding 'lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml' 2024-12-17T11:00:16,346 adding 'lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml' 2024-12-17T11:00:16,347 adding 'lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml' 2024-12-17T11:00:16,348 adding 'lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml' 2024-12-17T11:00:16,352 adding 'lm_eval/tasks/cmmlu/README.md' 2024-12-17T11:00:16,354 adding 'lm_eval/tasks/cmmlu/_cmmlu.yaml' 2024-12-17T11:00:16,355 adding 'lm_eval/tasks/cmmlu/_default_template_yaml' 2024-12-17T11:00:16,356 adding 'lm_eval/tasks/cmmlu/_generate_configs.py' 2024-12-17T11:00:16,357 adding 'lm_eval/tasks/cmmlu/cmmlu_agronomy.yaml' 2024-12-17T11:00:16,358 adding 'lm_eval/tasks/cmmlu/cmmlu_anatomy.yaml' 2024-12-17T11:00:16,359 adding 'lm_eval/tasks/cmmlu/cmmlu_ancient_chinese.yaml' 2024-12-17T11:00:16,360 adding 'lm_eval/tasks/cmmlu/cmmlu_arts.yaml' 2024-12-17T11:00:16,361 adding 'lm_eval/tasks/cmmlu/cmmlu_astronomy.yaml' 2024-12-17T11:00:16,363 adding 'lm_eval/tasks/cmmlu/cmmlu_business_ethics.yaml' 2024-12-17T11:00:16,364 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_civil_service_exam.yaml' 2024-12-17T11:00:16,365 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_driving_rule.yaml' 2024-12-17T11:00:16,366 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_food_culture.yaml' 2024-12-17T11:00:16,367 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_foreign_policy.yaml' 2024-12-17T11:00:16,368 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_history.yaml' 2024-12-17T11:00:16,369 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_literature.yaml' 2024-12-17T11:00:16,370 adding 'lm_eval/tasks/cmmlu/cmmlu_chinese_teacher_qualification.yaml' 2024-12-17T11:00:16,371 adding 'lm_eval/tasks/cmmlu/cmmlu_clinical_knowledge.yaml' 2024-12-17T11:00:16,372 adding 'lm_eval/tasks/cmmlu/cmmlu_college_actuarial_science.yaml' 2024-12-17T11:00:16,373 adding 'lm_eval/tasks/cmmlu/cmmlu_college_education.yaml' 2024-12-17T11:00:16,374 adding 'lm_eval/tasks/cmmlu/cmmlu_college_engineering_hydrology.yaml' 2024-12-17T11:00:16,376 adding 'lm_eval/tasks/cmmlu/cmmlu_college_law.yaml' 2024-12-17T11:00:16,377 adding 'lm_eval/tasks/cmmlu/cmmlu_college_mathematics.yaml' 2024-12-17T11:00:16,378 adding 'lm_eval/tasks/cmmlu/cmmlu_college_medical_statistics.yaml' 2024-12-17T11:00:16,379 adding 'lm_eval/tasks/cmmlu/cmmlu_college_medicine.yaml' 2024-12-17T11:00:16,380 adding 'lm_eval/tasks/cmmlu/cmmlu_computer_science.yaml' 2024-12-17T11:00:16,382 adding 'lm_eval/tasks/cmmlu/cmmlu_computer_security.yaml' 2024-12-17T11:00:16,383 adding 'lm_eval/tasks/cmmlu/cmmlu_conceptual_physics.yaml' 2024-12-17T11:00:16,384 adding 'lm_eval/tasks/cmmlu/cmmlu_construction_project_management.yaml' 2024-12-17T11:00:16,385 adding 'lm_eval/tasks/cmmlu/cmmlu_default_agronomy.yaml' 2024-12-17T11:00:16,386 adding 'lm_eval/tasks/cmmlu/cmmlu_default_anatomy.yaml' 2024-12-17T11:00:16,387 adding 'lm_eval/tasks/cmmlu/cmmlu_default_ancient_chinese.yaml' 2024-12-17T11:00:16,389 adding 'lm_eval/tasks/cmmlu/cmmlu_default_arts.yaml' 2024-12-17T11:00:16,390 adding 'lm_eval/tasks/cmmlu/cmmlu_default_astronomy.yaml' 2024-12-17T11:00:16,391 adding 'lm_eval/tasks/cmmlu/cmmlu_default_business_ethics.yaml' 2024-12-17T11:00:16,392 adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_civil_service_exam.yaml' 2024-12-17T11:00:16,393 adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_driving_rule.yaml' 2024-12-17T11:00:16,394 adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_food_culture.yaml' 2024-12-17T11:00:16,396 adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_foreign_policy.yaml' 2024-12-17T11:00:16,397 adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_history.yaml' 2024-12-17T11:00:16,398 adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_literature.yaml' 2024-12-17T11:00:16,399 adding 'lm_eval/tasks/cmmlu/cmmlu_default_chinese_teacher_qualification.yaml' 2024-12-17T11:00:16,400 adding 'lm_eval/tasks/cmmlu/cmmlu_default_clinical_knowledge.yaml' 2024-12-17T11:00:16,402 adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_actuarial_science.yaml' 2024-12-17T11:00:16,403 adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_education.yaml' 2024-12-17T11:00:16,404 adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_engineering_hydrology.yaml' 2024-12-17T11:00:16,405 adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_law.yaml' 2024-12-17T11:00:16,406 adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_mathematics.yaml' 2024-12-17T11:00:16,408 adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_medical_statistics.yaml' 2024-12-17T11:00:16,409 adding 'lm_eval/tasks/cmmlu/cmmlu_default_college_medicine.yaml' 2024-12-17T11:00:16,410 adding 'lm_eval/tasks/cmmlu/cmmlu_default_computer_science.yaml' 2024-12-17T11:00:16,411 adding 'lm_eval/tasks/cmmlu/cmmlu_default_computer_security.yaml' 2024-12-17T11:00:16,412 adding 'lm_eval/tasks/cmmlu/cmmlu_default_conceptual_physics.yaml' 2024-12-17T11:00:16,413 adding 'lm_eval/tasks/cmmlu/cmmlu_default_construction_project_management.yaml' 2024-12-17T11:00:16,414 adding 'lm_eval/tasks/cmmlu/cmmlu_default_economics.yaml' 2024-12-17T11:00:16,415 adding 'lm_eval/tasks/cmmlu/cmmlu_default_education.yaml' 2024-12-17T11:00:16,416 adding 'lm_eval/tasks/cmmlu/cmmlu_default_electrical_engineering.yaml' 2024-12-17T11:00:16,417 adding 'lm_eval/tasks/cmmlu/cmmlu_default_elementary_chinese.yaml' 2024-12-17T11:00:16,418 adding 'lm_eval/tasks/cmmlu/cmmlu_default_elementary_commonsense.yaml' 2024-12-17T11:00:16,419 adding 'lm_eval/tasks/cmmlu/cmmlu_default_elementary_information_and_technology.yaml' 2024-12-17T11:00:16,420 adding 'lm_eval/tasks/cmmlu/cmmlu_default_elementary_mathematics.yaml' 2024-12-17T11:00:16,422 adding 'lm_eval/tasks/cmmlu/cmmlu_default_ethnology.yaml' 2024-12-17T11:00:16,423 adding 'lm_eval/tasks/cmmlu/cmmlu_default_food_science.yaml' 2024-12-17T11:00:16,424 adding 'lm_eval/tasks/cmmlu/cmmlu_default_genetics.yaml' 2024-12-17T11:00:16,425 adding 'lm_eval/tasks/cmmlu/cmmlu_default_global_facts.yaml' 2024-12-17T11:00:16,426 adding 'lm_eval/tasks/cmmlu/cmmlu_default_high_school_biology.yaml' 2024-12-17T11:00:16,427 adding 'lm_eval/tasks/cmmlu/cmmlu_default_high_school_chemistry.yaml' 2024-12-17T11:00:16,428 adding 'lm_eval/tasks/cmmlu/cmmlu_default_high_school_geography.yaml' 2024-12-17T11:00:16,429 adding 'lm_eval/tasks/cmmlu/cmmlu_default_high_school_mathematics.yaml' 2024-12-17T11:00:16,430 adding 'lm_eval/tasks/cmmlu/cmmlu_default_high_school_physics.yaml' 2024-12-17T11:00:16,431 adding 'lm_eval/tasks/cmmlu/cmmlu_default_high_school_politics.yaml' 2024-12-17T11:00:16,433 adding 'lm_eval/tasks/cmmlu/cmmlu_default_human_sexuality.yaml' 2024-12-17T11:00:16,434 adding 'lm_eval/tasks/cmmlu/cmmlu_default_international_law.yaml' 2024-12-17T11:00:16,435 adding 'lm_eval/tasks/cmmlu/cmmlu_default_journalism.yaml' 2024-12-17T11:00:16,436 adding 'lm_eval/tasks/cmmlu/cmmlu_default_jurisprudence.yaml' 2024-12-17T11:00:16,437 adding 'lm_eval/tasks/cmmlu/cmmlu_default_legal_and_moral_basis.yaml' 2024-12-17T11:00:16,438 adding 'lm_eval/tasks/cmmlu/cmmlu_default_logical.yaml' 2024-12-17T11:00:16,440 adding 'lm_eval/tasks/cmmlu/cmmlu_default_machine_learning.yaml' 2024-12-17T11:00:16,441 adding 'lm_eval/tasks/cmmlu/cmmlu_default_management.yaml' 2024-12-17T11:00:16,442 adding 'lm_eval/tasks/cmmlu/cmmlu_default_marketing.yaml' 2024-12-17T11:00:16,443 adding 'lm_eval/tasks/cmmlu/cmmlu_default_marxist_theory.yaml' 2024-12-17T11:00:16,444 adding 'lm_eval/tasks/cmmlu/cmmlu_default_modern_chinese.yaml' 2024-12-17T11:00:16,445 adding 'lm_eval/tasks/cmmlu/cmmlu_default_nutrition.yaml' 2024-12-17T11:00:16,447 adding 'lm_eval/tasks/cmmlu/cmmlu_default_philosophy.yaml' 2024-12-17T11:00:16,448 adding 'lm_eval/tasks/cmmlu/cmmlu_default_professional_accounting.yaml' 2024-12-17T11:00:16,449 adding 'lm_eval/tasks/cmmlu/cmmlu_default_professional_law.yaml' 2024-12-17T11:00:16,450 adding 'lm_eval/tasks/cmmlu/cmmlu_default_professional_medicine.yaml' 2024-12-17T11:00:16,451 adding 'lm_eval/tasks/cmmlu/cmmlu_default_professional_psychology.yaml' 2024-12-17T11:00:16,452 adding 'lm_eval/tasks/cmmlu/cmmlu_default_public_relations.yaml' 2024-12-17T11:00:16,454 adding 'lm_eval/tasks/cmmlu/cmmlu_default_security_study.yaml' 2024-12-17T11:00:16,455 adding 'lm_eval/tasks/cmmlu/cmmlu_default_sociology.yaml' 2024-12-17T11:00:16,456 adding 'lm_eval/tasks/cmmlu/cmmlu_default_sports_science.yaml' 2024-12-17T11:00:16,457 adding 'lm_eval/tasks/cmmlu/cmmlu_default_traditional_chinese_medicine.yaml' 2024-12-17T11:00:16,458 adding 'lm_eval/tasks/cmmlu/cmmlu_default_virology.yaml' 2024-12-17T11:00:16,459 adding 'lm_eval/tasks/cmmlu/cmmlu_default_world_history.yaml' 2024-12-17T11:00:16,460 adding 'lm_eval/tasks/cmmlu/cmmlu_default_world_religions.yaml' 2024-12-17T11:00:16,461 adding 'lm_eval/tasks/cmmlu/cmmlu_economics.yaml' 2024-12-17T11:00:16,462 adding 'lm_eval/tasks/cmmlu/cmmlu_education.yaml' 2024-12-17T11:00:16,463 adding 'lm_eval/tasks/cmmlu/cmmlu_electrical_engineering.yaml' 2024-12-17T11:00:16,465 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_chinese.yaml' 2024-12-17T11:00:16,466 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_commonsense.yaml' 2024-12-17T11:00:16,467 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_information_and_technology.yaml' 2024-12-17T11:00:16,468 adding 'lm_eval/tasks/cmmlu/cmmlu_elementary_mathematics.yaml' 2024-12-17T11:00:16,469 adding 'lm_eval/tasks/cmmlu/cmmlu_ethnology.yaml' 2024-12-17T11:00:16,470 adding 'lm_eval/tasks/cmmlu/cmmlu_food_science.yaml' 2024-12-17T11:00:16,471 adding 'lm_eval/tasks/cmmlu/cmmlu_genetics.yaml' 2024-12-17T11:00:16,472 adding 'lm_eval/tasks/cmmlu/cmmlu_global_facts.yaml' 2024-12-17T11:00:16,473 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_biology.yaml' 2024-12-17T11:00:16,474 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_chemistry.yaml' 2024-12-17T11:00:16,476 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_geography.yaml' 2024-12-17T11:00:16,477 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_mathematics.yaml' 2024-12-17T11:00:16,478 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_physics.yaml' 2024-12-17T11:00:16,479 adding 'lm_eval/tasks/cmmlu/cmmlu_high_school_politics.yaml' 2024-12-17T11:00:16,480 adding 'lm_eval/tasks/cmmlu/cmmlu_human_sexuality.yaml' 2024-12-17T11:00:16,481 adding 'lm_eval/tasks/cmmlu/cmmlu_international_law.yaml' 2024-12-17T11:00:16,482 adding 'lm_eval/tasks/cmmlu/cmmlu_journalism.yaml' 2024-12-17T11:00:16,483 adding 'lm_eval/tasks/cmmlu/cmmlu_jurisprudence.yaml' 2024-12-17T11:00:16,484 adding 'lm_eval/tasks/cmmlu/cmmlu_legal_and_moral_basis.yaml' 2024-12-17T11:00:16,485 adding 'lm_eval/tasks/cmmlu/cmmlu_logical.yaml' 2024-12-17T11:00:16,487 adding 'lm_eval/tasks/cmmlu/cmmlu_machine_learning.yaml' 2024-12-17T11:00:16,488 adding 'lm_eval/tasks/cmmlu/cmmlu_management.yaml' 2024-12-17T11:00:16,489 adding 'lm_eval/tasks/cmmlu/cmmlu_marketing.yaml' 2024-12-17T11:00:16,490 adding 'lm_eval/tasks/cmmlu/cmmlu_marxist_theory.yaml' 2024-12-17T11:00:16,491 adding 'lm_eval/tasks/cmmlu/cmmlu_modern_chinese.yaml' 2024-12-17T11:00:16,492 adding 'lm_eval/tasks/cmmlu/cmmlu_nutrition.yaml' 2024-12-17T11:00:16,494 adding 'lm_eval/tasks/cmmlu/cmmlu_philosophy.yaml' 2024-12-17T11:00:16,495 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_accounting.yaml' 2024-12-17T11:00:16,496 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_law.yaml' 2024-12-17T11:00:16,497 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_medicine.yaml' 2024-12-17T11:00:16,498 adding 'lm_eval/tasks/cmmlu/cmmlu_professional_psychology.yaml' 2024-12-17T11:00:16,499 adding 'lm_eval/tasks/cmmlu/cmmlu_public_relations.yaml' 2024-12-17T11:00:16,501 adding 'lm_eval/tasks/cmmlu/cmmlu_security_study.yaml' 2024-12-17T11:00:16,502 adding 'lm_eval/tasks/cmmlu/cmmlu_sociology.yaml' 2024-12-17T11:00:16,503 adding 'lm_eval/tasks/cmmlu/cmmlu_sports_science.yaml' 2024-12-17T11:00:16,504 adding 'lm_eval/tasks/cmmlu/cmmlu_traditional_chinese_medicine.yaml' 2024-12-17T11:00:16,505 adding 'lm_eval/tasks/cmmlu/cmmlu_virology.yaml' 2024-12-17T11:00:16,507 adding 'lm_eval/tasks/cmmlu/cmmlu_world_history.yaml' 2024-12-17T11:00:16,508 adding 'lm_eval/tasks/cmmlu/cmmlu_world_religions.yaml' 2024-12-17T11:00:16,511 adding 'lm_eval/tasks/code_x_glue/code-text/bleu.py' 2024-12-17T11:00:16,512 adding 'lm_eval/tasks/code_x_glue/code-text/go.yaml' 2024-12-17T11:00:16,513 adding 'lm_eval/tasks/code_x_glue/code-text/java.yaml' 2024-12-17T11:00:16,514 adding 'lm_eval/tasks/code_x_glue/code-text/javascript.yaml' 2024-12-17T11:00:16,516 adding 'lm_eval/tasks/code_x_glue/code-text/php.yaml' 2024-12-17T11:00:16,517 adding 'lm_eval/tasks/code_x_glue/code-text/python.yaml' 2024-12-17T11:00:16,518 adding 'lm_eval/tasks/code_x_glue/code-text/ruby.yaml' 2024-12-17T11:00:16,519 adding 'lm_eval/tasks/code_x_glue/code-text/utils.py' 2024-12-17T11:00:16,520 adding 'lm_eval/tasks/commonsense_qa/README.md' 2024-12-17T11:00:16,521 adding 'lm_eval/tasks/commonsense_qa/default.yaml' 2024-12-17T11:00:16,523 adding 'lm_eval/tasks/copal_id/README.md' 2024-12-17T11:00:16,524 adding 'lm_eval/tasks/copal_id/colloquial.yaml' 2024-12-17T11:00:16,526 adding 'lm_eval/tasks/copal_id/standard.yaml' 2024-12-17T11:00:16,527 adding 'lm_eval/tasks/copal_id/utils.py' 2024-12-17T11:00:16,528 adding 'lm_eval/tasks/coqa/README.md' 2024-12-17T11:00:16,529 adding 'lm_eval/tasks/coqa/default.yaml' 2024-12-17T11:00:16,531 adding 'lm_eval/tasks/coqa/utils.py' 2024-12-17T11:00:16,533 adding 'lm_eval/tasks/crows_pairs/README.md' 2024-12-17T11:00:16,534 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english.yaml' 2024-12-17T11:00:16,535 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml' 2024-12-17T11:00:16,537 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml' 2024-12-17T11:00:16,538 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml' 2024-12-17T11:00:16,539 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml' 2024-12-17T11:00:16,540 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml' 2024-12-17T11:00:16,541 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml' 2024-12-17T11:00:16,542 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml' 2024-12-17T11:00:16,543 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml' 2024-12-17T11:00:16,544 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml' 2024-12-17T11:00:16,545 adding 'lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml' 2024-12-17T11:00:16,546 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french.yaml' 2024-12-17T11:00:16,547 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml' 2024-12-17T11:00:16,548 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml' 2024-12-17T11:00:16,550 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml' 2024-12-17T11:00:16,551 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml' 2024-12-17T11:00:16,552 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml' 2024-12-17T11:00:16,553 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml' 2024-12-17T11:00:16,554 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml' 2024-12-17T11:00:16,555 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml' 2024-12-17T11:00:16,556 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml' 2024-12-17T11:00:16,557 adding 'lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml' 2024-12-17T11:00:16,559 adding 'lm_eval/tasks/crows_pairs/utils.py' 2024-12-17T11:00:16,560 adding 'lm_eval/tasks/csatqa/_csatqa.yaml' 2024-12-17T11:00:16,562 adding 'lm_eval/tasks/csatqa/_default_csatqa_yaml' 2024-12-17T11:00:16,563 adding 'lm_eval/tasks/csatqa/_generate_configs.py' 2024-12-17T11:00:16,564 adding 'lm_eval/tasks/csatqa/csatqa_gr.yaml' 2024-12-17T11:00:16,565 adding 'lm_eval/tasks/csatqa/csatqa_li.yaml' 2024-12-17T11:00:16,566 adding 'lm_eval/tasks/csatqa/csatqa_rch.yaml' 2024-12-17T11:00:16,567 adding 'lm_eval/tasks/csatqa/csatqa_rcs.yaml' 2024-12-17T11:00:16,568 adding 'lm_eval/tasks/csatqa/csatqa_rcss.yaml' 2024-12-17T11:00:16,570 adding 'lm_eval/tasks/csatqa/csatqa_wr.yaml' 2024-12-17T11:00:16,571 adding 'lm_eval/tasks/csatqa/utils.py' 2024-12-17T11:00:16,573 adding 'lm_eval/tasks/drop/README.md' 2024-12-17T11:00:16,574 adding 'lm_eval/tasks/drop/default.yaml' 2024-12-17T11:00:16,575 adding 'lm_eval/tasks/drop/utils.py' 2024-12-17T11:00:16,577 adding 'lm_eval/tasks/eq_bench/README.md' 2024-12-17T11:00:16,579 adding 'lm_eval/tasks/eq_bench/default.yaml' 2024-12-17T11:00:16,580 adding 'lm_eval/tasks/eq_bench/utils.py' 2024-12-17T11:00:16,583 adding 'lm_eval/tasks/eus_exams/README.md' 2024-12-17T11:00:16,584 adding 'lm_eval/tasks/eus_exams/configs.py' 2024-12-17T11:00:16,585 adding 'lm_eval/tasks/eus_exams/eus_exams' 2024-12-17T11:00:16,586 adding 'lm_eval/tasks/eus_exams/eus_exams_es' 2024-12-17T11:00:16,587 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejadministrativo.yaml' 2024-12-17T11:00:16,588 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejauxiliar.yaml' 2024-12-17T11:00:16,589 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejsubalterno.yaml' 2024-12-17T11:00:16,590 adding 'lm_eval/tasks/eus_exams/eus_exams_es_ejtecnico.yaml' 2024-12-17T11:00:16,592 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeayuntamientovitoria.yaml' 2024-12-17T11:00:16,593 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opebilbao.yaml' 2024-12-17T11:00:16,594 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuadmin.yaml' 2024-12-17T11:00:16,596 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuaux.yaml' 2024-12-17T11:00:16,597 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehubiblio.yaml' 2024-12-17T11:00:16,598 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuderecho.yaml' 2024-12-17T11:00:16,599 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehueconomicas.yaml' 2024-12-17T11:00:16,600 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehuempresariales.yaml' 2024-12-17T11:00:16,601 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehusubalterno.yaml' 2024-12-17T11:00:16,602 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnico.yaml' 2024-12-17T11:00:16,603 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeehutecnicob.yaml' 2024-12-17T11:00:16,604 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiadmin.yaml' 2024-12-17T11:00:16,605 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiaux.yaml' 2024-12-17T11:00:16,607 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakiauxenf.yaml' 2024-12-17T11:00:16,608 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakicelador.yaml' 2024-12-17T11:00:16,609 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakienf.yaml' 2024-12-17T11:00:16,610 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakijuridico.yaml' 2024-12-17T11:00:16,611 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakioperario.yaml' 2024-12-17T11:00:16,612 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakitecnico.yaml' 2024-12-17T11:00:16,613 adding 'lm_eval/tasks/eus_exams/eus_exams_es_opeosakivarios.yaml' 2024-12-17T11:00:16,614 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza1c.yaml' 2024-12-17T11:00:16,615 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza2c.yaml' 2024-12-17T11:00:16,617 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza3c.yaml' 2024-12-17T11:00:16,618 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza4c.yaml' 2024-12-17T11:00:16,619 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza5c.yaml' 2024-12-17T11:00:16,620 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza6c.yaml' 2024-12-17T11:00:16,621 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza7c.yaml' 2024-12-17T11:00:16,622 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza8c.yaml' 2024-12-17T11:00:16,623 adding 'lm_eval/tasks/eus_exams/eus_exams_es_osakidetza9c.yaml' 2024-12-17T11:00:16,624 adding 'lm_eval/tasks/eus_exams/eus_exams_eu' 2024-12-17T11:00:16,626 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejadministrari.yaml' 2024-12-17T11:00:16,627 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntza.yaml' 2024-12-17T11:00:16,628 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejlaguntzaile.yaml' 2024-12-17T11:00:16,629 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_ejteknikari.yaml' 2024-12-17T11:00:16,630 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opebilbaoeu.yaml' 2024-12-17T11:00:16,631 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuadmineu.yaml' 2024-12-17T11:00:16,632 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuauxeu.yaml' 2024-12-17T11:00:16,633 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehubiblioeu.yaml' 2024-12-17T11:00:16,634 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuderechoeu.yaml' 2024-12-17T11:00:16,635 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehueconomicaseu.yaml' 2024-12-17T11:00:16,636 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuempresarialeseu.yaml' 2024-12-17T11:00:16,637 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehusubalternoeu.yaml' 2024-12-17T11:00:16,638 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehutecnicoeu.yaml' 2024-12-17T11:00:16,639 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeehuteknikarib.yaml' 2024-12-17T11:00:16,640 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opegasteizkoudala.yaml' 2024-12-17T11:00:16,641 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiadmineu.yaml' 2024-12-17T11:00:16,643 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxenfeu.yaml' 2024-12-17T11:00:16,644 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiauxeu.yaml' 2024-12-17T11:00:16,645 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakiceladoreu.yaml' 2024-12-17T11:00:16,646 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakienfeu.yaml' 2024-12-17T11:00:16,647 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakioperarioeu.yaml' 2024-12-17T11:00:16,648 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakitecnicoeu.yaml' 2024-12-17T11:00:16,649 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_opeosakivarioseu.yaml' 2024-12-17T11:00:16,650 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza1e.yaml' 2024-12-17T11:00:16,651 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza2e.yaml' 2024-12-17T11:00:16,652 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza3e.yaml' 2024-12-17T11:00:16,653 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza5e.yaml' 2024-12-17T11:00:16,654 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza6e.yaml' 2024-12-17T11:00:16,656 adding 'lm_eval/tasks/eus_exams/eus_exams_eu_osakidetza7e.yaml' 2024-12-17T11:00:16,657 adding 'lm_eval/tasks/eus_exams/utils.py' 2024-12-17T11:00:16,658 adding 'lm_eval/tasks/eus_proficiency/README.md' 2024-12-17T11:00:16,660 adding 'lm_eval/tasks/eus_proficiency/eus_proficiency.yaml' 2024-12-17T11:00:16,661 adding 'lm_eval/tasks/eus_reading/README.md' 2024-12-17T11:00:16,663 adding 'lm_eval/tasks/eus_reading/eus_reading.yaml' 2024-12-17T11:00:16,664 adding 'lm_eval/tasks/eus_reading/utils.py' 2024-12-17T11:00:16,666 adding 'lm_eval/tasks/eus_trivia/README.md' 2024-12-17T11:00:16,667 adding 'lm_eval/tasks/eus_trivia/eus_trivia.yaml' 2024-12-17T11:00:16,668 adding 'lm_eval/tasks/eus_trivia/utils.py' 2024-12-17T11:00:16,670 adding 'lm_eval/tasks/fda/README.md' 2024-12-17T11:00:16,672 adding 'lm_eval/tasks/fda/fda.yaml' 2024-12-17T11:00:16,673 adding 'lm_eval/tasks/fda/task.py' 2024-12-17T11:00:16,675 adding 'lm_eval/tasks/fld/README.md' 2024-12-17T11:00:16,677 adding 'lm_eval/tasks/fld/fld_default.yaml' 2024-12-17T11:00:16,679 adding 'lm_eval/tasks/fld/fld_logical_formula_default.yaml' 2024-12-17T11:00:16,680 adding 'lm_eval/tasks/fld/fld_logical_formula_star.yaml' 2024-12-17T11:00:16,681 adding 'lm_eval/tasks/fld/fld_star.yaml' 2024-12-17T11:00:16,683 adding 'lm_eval/tasks/french_bench/README.md' 2024-12-17T11:00:16,684 adding 'lm_eval/tasks/french_bench/_default_template_yaml' 2024-12-17T11:00:16,686 adding 'lm_eval/tasks/french_bench/french_bench_arc_challenge.yaml' 2024-12-17T11:00:16,687 adding 'lm_eval/tasks/french_bench/french_bench_boolqa.yaml' 2024-12-17T11:00:16,689 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2.yaml' 2024-12-17T11:00:16,690 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_bool.yaml' 2024-12-17T11:00:16,692 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_genq.yaml' 2024-12-17T11:00:16,693 adding 'lm_eval/tasks/french_bench/french_bench_fquadv2_hasAns.yaml' 2024-12-17T11:00:16,694 adding 'lm_eval/tasks/french_bench/french_bench_grammar.yaml' 2024-12-17T11:00:16,695 adding 'lm_eval/tasks/french_bench/french_bench_hellaswag.yaml' 2024-12-17T11:00:16,696 adding 'lm_eval/tasks/french_bench/french_bench_multifquad.yaml' 2024-12-17T11:00:16,697 adding 'lm_eval/tasks/french_bench/french_bench_opus_perplexity.yaml' 2024-12-17T11:00:16,699 adding 'lm_eval/tasks/french_bench/french_bench_orangesum_abstract.yaml' 2024-12-17T11:00:16,700 adding 'lm_eval/tasks/french_bench/french_bench_orangesum_title.yaml' 2024-12-17T11:00:16,701 adding 'lm_eval/tasks/french_bench/french_bench_reading_comp.yaml' 2024-12-17T11:00:16,702 adding 'lm_eval/tasks/french_bench/french_bench_topic_based_nli.yaml' 2024-12-17T11:00:16,703 adding 'lm_eval/tasks/french_bench/french_bench_trivia.yaml' 2024-12-17T11:00:16,704 adding 'lm_eval/tasks/french_bench/french_bench_vocab.yaml' 2024-12-17T11:00:16,705 adding 'lm_eval/tasks/french_bench/french_bench_wikitext_fr.yaml' 2024-12-17T11:00:16,707 adding 'lm_eval/tasks/french_bench/french_bench_xnli.yaml' 2024-12-17T11:00:16,708 adding 'lm_eval/tasks/french_bench/preprocess_wikitext.py' 2024-12-17T11:00:16,709 adding 'lm_eval/tasks/french_bench/utils.py' 2024-12-17T11:00:16,711 adding 'lm_eval/tasks/galician_bench/README.md' 2024-12-17T11:00:16,712 adding 'lm_eval/tasks/galician_bench/belebele_glg_Latn.yaml' 2024-12-17T11:00:16,714 adding 'lm_eval/tasks/galician_bench/galcola.yaml' 2024-12-17T11:00:16,715 adding 'lm_eval/tasks/galician_bench/galician_bench.yaml' 2024-12-17T11:00:16,716 adding 'lm_eval/tasks/galician_bench/mgsm_direct_gl.yaml' 2024-12-17T11:00:16,717 adding 'lm_eval/tasks/galician_bench/openbookqa_gl.yaml' 2024-12-17T11:00:16,718 adding 'lm_eval/tasks/galician_bench/parafrases_gl.yaml' 2024-12-17T11:00:16,719 adding 'lm_eval/tasks/galician_bench/paws_gl.yaml' 2024-12-17T11:00:16,720 adding 'lm_eval/tasks/galician_bench/summarization_gl.yaml' 2024-12-17T11:00:16,722 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_gen.yaml' 2024-12-17T11:00:16,723 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_mc1.yaml' 2024-12-17T11:00:16,724 adding 'lm_eval/tasks/galician_bench/truthfulqa_gl_mc2.yaml' 2024-12-17T11:00:16,726 adding 'lm_eval/tasks/galician_bench/utils.py' 2024-12-17T11:00:16,727 adding 'lm_eval/tasks/galician_bench/xnli_gl.yaml' 2024-12-17T11:00:16,729 adding 'lm_eval/tasks/galician_bench/xstorycloze_gl.yaml' 2024-12-17T11:00:16,731 adding 'lm_eval/tasks/galician_bench/flores_gl/_flores_common_yaml' 2024-12-17T11:00:16,732 adding 'lm_eval/tasks/galician_bench/flores_gl/create_yamls_flores_gl.py' 2024-12-17T11:00:16,734 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_ca-gl.yaml' 2024-12-17T11:00:16,735 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_de-gl.yaml' 2024-12-17T11:00:16,736 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_en-gl.yaml' 2024-12-17T11:00:16,737 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_es-gl.yaml' 2024-12-17T11:00:16,738 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_eu-gl.yaml' 2024-12-17T11:00:16,739 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_fr-gl.yaml' 2024-12-17T11:00:16,740 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-ca.yaml' 2024-12-17T11:00:16,741 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-de.yaml' 2024-12-17T11:00:16,743 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-en.yaml' 2024-12-17T11:00:16,744 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-es.yaml' 2024-12-17T11:00:16,745 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-eu.yaml' 2024-12-17T11:00:16,746 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-fr.yaml' 2024-12-17T11:00:16,747 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-it.yaml' 2024-12-17T11:00:16,748 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl-pt.yaml' 2024-12-17T11:00:16,749 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_gl.yaml' 2024-12-17T11:00:16,751 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_it-gl.yaml' 2024-12-17T11:00:16,752 adding 'lm_eval/tasks/galician_bench/flores_gl/flores_pt-gl.yaml' 2024-12-17T11:00:16,753 adding 'lm_eval/tasks/glianorex/README.md' 2024-12-17T11:00:16,754 adding 'lm_eval/tasks/glianorex/glianorex.yaml' 2024-12-17T11:00:16,755 adding 'lm_eval/tasks/glianorex/glianorex_en.yaml' 2024-12-17T11:00:16,756 adding 'lm_eval/tasks/glianorex/glianorex_fr.yaml' 2024-12-17T11:00:16,757 adding 'lm_eval/tasks/glianorex/preprocess_glianorex.py' 2024-12-17T11:00:16,759 adding 'lm_eval/tasks/glue/README.md' 2024-12-17T11:00:16,761 adding 'lm_eval/tasks/glue/cola/default.yaml' 2024-12-17T11:00:16,762 adding 'lm_eval/tasks/glue/mnli/default.yaml' 2024-12-17T11:00:16,764 adding 'lm_eval/tasks/glue/mnli/mismatch.yaml' 2024-12-17T11:00:16,765 adding 'lm_eval/tasks/glue/mnli/utils.py' 2024-12-17T11:00:16,766 adding 'lm_eval/tasks/glue/mrpc/default.yaml' 2024-12-17T11:00:16,770 adding 'lm_eval/tasks/glue/qnli/default.yaml' 2024-12-17T11:00:16,984 adding 'lm_eval/tasks/glue/qqp/default.yaml' 2024-12-17T11:00:16,986 adding 'lm_eval/tasks/glue/rte/default.yaml' 2024-12-17T11:00:16,989 adding 'lm_eval/tasks/glue/sst2/default.yaml' 2024-12-17T11:00:16,992 adding 'lm_eval/tasks/glue/wnli/default.yaml' 2024-12-17T11:00:16,995 adding 'lm_eval/tasks/gpqa/README.md' 2024-12-17T11:00:16,996 adding 'lm_eval/tasks/gpqa/cot_n_shot/_generate_configs.py' 2024-12-17T11:00:16,998 adding 'lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml' 2024-12-17T11:00:16,999 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_diamond_cot_n_shot.yaml' 2024-12-17T11:00:17,000 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_extended_cot_n_shot.yaml' 2024-12-17T11:00:17,001 adding 'lm_eval/tasks/gpqa/cot_n_shot/gpqa_main_cot_n_shot.yaml' 2024-12-17T11:00:17,002 adding 'lm_eval/tasks/gpqa/cot_n_shot/utils.py' 2024-12-17T11:00:17,004 adding 'lm_eval/tasks/gpqa/cot_zeroshot/_generate_configs.py' 2024-12-17T11:00:17,005 adding 'lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml' 2024-12-17T11:00:17,006 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_diamond_cot_zeroshot.yaml' 2024-12-17T11:00:17,007 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_extended_cot_zeroshot.yaml' 2024-12-17T11:00:17,008 adding 'lm_eval/tasks/gpqa/cot_zeroshot/gpqa_main_cot_zeroshot.yaml' 2024-12-17T11:00:17,010 adding 'lm_eval/tasks/gpqa/cot_zeroshot/utils.py' 2024-12-17T11:00:17,011 adding 'lm_eval/tasks/gpqa/generative/_generate_configs.py' 2024-12-17T11:00:17,013 adding 'lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml' 2024-12-17T11:00:17,014 adding 'lm_eval/tasks/gpqa/generative/gpqa_diamond_generative_n_shot.yaml' 2024-12-17T11:00:17,015 adding 'lm_eval/tasks/gpqa/generative/gpqa_extended_generative_n_shot.yaml' 2024-12-17T11:00:17,016 adding 'lm_eval/tasks/gpqa/generative/gpqa_main_generative_n_shot.yaml' 2024-12-17T11:00:17,017 adding 'lm_eval/tasks/gpqa/generative/utils.py' 2024-12-17T11:00:17,019 adding 'lm_eval/tasks/gpqa/n_shot/_generate_configs.py' 2024-12-17T11:00:17,021 adding 'lm_eval/tasks/gpqa/n_shot/_gpqa_n_shot_yaml' 2024-12-17T11:00:17,022 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_diamond_n_shot.yaml' 2024-12-17T11:00:17,023 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_extended_n_shot.yaml' 2024-12-17T11:00:17,024 adding 'lm_eval/tasks/gpqa/n_shot/gpqa_main_n_shot.yaml' 2024-12-17T11:00:17,025 adding 'lm_eval/tasks/gpqa/n_shot/utils.py' 2024-12-17T11:00:17,027 adding 'lm_eval/tasks/gpqa/zeroshot/_generate_configs.py' 2024-12-17T11:00:17,028 adding 'lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml' 2024-12-17T11:00:17,030 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_diamond_zeroshot.yaml' 2024-12-17T11:00:17,031 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_extended_zeroshot.yaml' 2024-12-17T11:00:17,032 adding 'lm_eval/tasks/gpqa/zeroshot/gpqa_main_zeroshot.yaml' 2024-12-17T11:00:17,033 adding 'lm_eval/tasks/gpqa/zeroshot/utils.py' 2024-12-17T11:00:17,035 adding 'lm_eval/tasks/gsm8k/README.md' 2024-12-17T11:00:17,037 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-llama.yaml' 2024-12-17T11:00:17,038 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-self-consistency.yaml' 2024-12-17T11:00:17,039 adding 'lm_eval/tasks/gsm8k/gsm8k-cot-zeroshot.yaml' 2024-12-17T11:00:17,040 adding 'lm_eval/tasks/gsm8k/gsm8k-cot.yaml' 2024-12-17T11:00:17,041 adding 'lm_eval/tasks/gsm8k/gsm8k.yaml' 2024-12-17T11:00:17,043 adding 'lm_eval/tasks/gsm_plus/README.md' 2024-12-17T11:00:17,044 adding 'lm_eval/tasks/gsm_plus/gsm_plus.yaml' 2024-12-17T11:00:17,045 adding 'lm_eval/tasks/gsm_plus/gsm_plus_mini.yaml' 2024-12-17T11:00:17,047 adding 'lm_eval/tasks/haerae/README.md' 2024-12-17T11:00:17,048 adding 'lm_eval/tasks/haerae/_default_haerae_yaml' 2024-12-17T11:00:17,049 adding 'lm_eval/tasks/haerae/_haerae.yaml' 2024-12-17T11:00:17,050 adding 'lm_eval/tasks/haerae/haerae_gk.yaml' 2024-12-17T11:00:17,051 adding 'lm_eval/tasks/haerae/haerae_hi.yaml' 2024-12-17T11:00:17,052 adding 'lm_eval/tasks/haerae/haerae_lw.yaml' 2024-12-17T11:00:17,053 adding 'lm_eval/tasks/haerae/haerae_rw.yaml' 2024-12-17T11:00:17,055 adding 'lm_eval/tasks/haerae/haerae_sn.yaml' 2024-12-17T11:00:17,056 adding 'lm_eval/tasks/headqa/README.md' 2024-12-17T11:00:17,058 adding 'lm_eval/tasks/headqa/headqa_en.yaml' 2024-12-17T11:00:17,059 adding 'lm_eval/tasks/headqa/headqa_es.yaml' 2024-12-17T11:00:17,061 adding 'lm_eval/tasks/hellaswag/README.md' 2024-12-17T11:00:17,062 adding 'lm_eval/tasks/hellaswag/hellaswag.yaml' 2024-12-17T11:00:17,063 adding 'lm_eval/tasks/hellaswag/utils.py' 2024-12-17T11:00:17,066 adding 'lm_eval/tasks/hendrycks_ethics/README.md' 2024-12-17T11:00:17,067 adding 'lm_eval/tasks/hendrycks_ethics/commonsense.yaml' 2024-12-17T11:00:17,068 adding 'lm_eval/tasks/hendrycks_ethics/deontology.yaml' 2024-12-17T11:00:17,069 adding 'lm_eval/tasks/hendrycks_ethics/justice.yaml' 2024-12-17T11:00:17,070 adding 'lm_eval/tasks/hendrycks_ethics/utilitarianism.yaml' 2024-12-17T11:00:17,072 adding 'lm_eval/tasks/hendrycks_ethics/utilitarianism_original_yaml' 2024-12-17T11:00:17,073 adding 'lm_eval/tasks/hendrycks_ethics/utils.py' 2024-12-17T11:00:17,074 adding 'lm_eval/tasks/hendrycks_ethics/virtue.yaml' 2024-12-17T11:00:17,076 adding 'lm_eval/tasks/hendrycks_math/README.md' 2024-12-17T11:00:17,077 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math.yaml' 2024-12-17T11:00:17,079 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_algebra.yaml' 2024-12-17T11:00:17,080 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_counting_and_prob.yaml' 2024-12-17T11:00:17,081 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_geometry.yaml' 2024-12-17T11:00:17,082 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_intermediate_algebra.yaml' 2024-12-17T11:00:17,083 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_num_theory.yaml' 2024-12-17T11:00:17,084 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_prealgebra.yaml' 2024-12-17T11:00:17,086 adding 'lm_eval/tasks/hendrycks_math/hendrycks_math_precalc.yaml' 2024-12-17T11:00:17,087 adding 'lm_eval/tasks/hendrycks_math/utils.py' 2024-12-17T11:00:17,090 adding 'lm_eval/tasks/ifeval/README.md' 2024-12-17T11:00:17,091 adding 'lm_eval/tasks/ifeval/ifeval.yaml' 2024-12-17T11:00:17,096 adding 'lm_eval/tasks/ifeval/instructions.py' 2024-12-17T11:00:17,098 adding 'lm_eval/tasks/ifeval/instructions_registry.py' 2024-12-17T11:00:17,102 adding 'lm_eval/tasks/ifeval/instructions_util.py' 2024-12-17T11:00:17,103 adding 'lm_eval/tasks/ifeval/utils.py' 2024-12-17T11:00:17,106 adding 'lm_eval/tasks/inverse_scaling/README.md' 2024-12-17T11:00:17,107 adding 'lm_eval/tasks/inverse_scaling/_inverse_scaling_mc_yaml' 2024-12-17T11:00:17,108 adding 'lm_eval/tasks/inverse_scaling/_some_results' 2024-12-17T11:00:17,110 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_hindsight_neglect.yaml' 2024-12-17T11:00:17,111 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_into_the_unknown.yaml' 2024-12-17T11:00:17,112 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_memo_trap.yaml' 2024-12-17T11:00:17,113 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_modus_tollens.yaml' 2024-12-17T11:00:17,114 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_neqa.yaml' 2024-12-17T11:00:17,115 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_pattern_matching_suppression.yaml' 2024-12-17T11:00:17,116 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_quote_repetition.yaml' 2024-12-17T11:00:17,117 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_redefine_math.yaml' 2024-12-17T11:00:17,118 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_repetitive_algebra.yaml' 2024-12-17T11:00:17,119 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_sig_figs.yaml' 2024-12-17T11:00:17,121 adding 'lm_eval/tasks/inverse_scaling/inverse_scaling_winobias_antistereotype.yaml' 2024-12-17T11:00:17,123 adding 'lm_eval/tasks/japanese_leaderboard/README.md' 2024-12-17T11:00:17,125 adding 'lm_eval/tasks/japanese_leaderboard/_ja_leaderboard.yaml' 2024-12-17T11:00:17,126 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jaqket_v2.yaml' 2024-12-17T11:00:17,127 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.py' 2024-12-17T11:00:17,128 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jcommonsenseqa.yaml' 2024-12-17T11:00:17,130 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jnli.yaml' 2024-12-17T11:00:17,131 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_jsquad.yaml' 2024-12-17T11:00:17,132 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_marc_ja.yaml' 2024-12-17T11:00:17,133 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.py' 2024-12-17T11:00:17,134 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_mgsm.yaml' 2024-12-17T11:00:17,136 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.py' 2024-12-17T11:00:17,137 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xlsum.yaml' 2024-12-17T11:00:17,138 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.py' 2024-12-17T11:00:17,139 adding 'lm_eval/tasks/japanese_leaderboard/ja_leaderboard_xwinograd.yaml' 2024-12-17T11:00:17,140 adding 'lm_eval/tasks/japanese_leaderboard/requirements.txt' 2024-12-17T11:00:17,142 adding 'lm_eval/tasks/kbl/README.md' 2024-12-17T11:00:17,145 adding 'lm_eval/tasks/kbl/bar_exam/civil/_base_em_yaml' 2024-12-17T11:00:17,146 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2012.yaml' 2024-12-17T11:00:17,147 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2013.yaml' 2024-12-17T11:00:17,148 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2014.yaml' 2024-12-17T11:00:17,149 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2015.yaml' 2024-12-17T11:00:17,150 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2016.yaml' 2024-12-17T11:00:17,151 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2017.yaml' 2024-12-17T11:00:17,152 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2018.yaml' 2024-12-17T11:00:17,154 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2019.yaml' 2024-12-17T11:00:17,157 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2020.yaml' 2024-12-17T11:00:17,159 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2021.yaml' 2024-12-17T11:00:17,160 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2022.yaml' 2024-12-17T11:00:17,161 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2023.yaml' 2024-12-17T11:00:17,163 adding 'lm_eval/tasks/kbl/bar_exam/civil/kbl_bar_exam_em_civil_2024.yaml' 2024-12-17T11:00:17,165 adding 'lm_eval/tasks/kbl/bar_exam/criminal/_base_em_yaml' 2024-12-17T11:00:17,166 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2012.yaml' 2024-12-17T11:00:17,167 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2013.yaml' 2024-12-17T11:00:17,168 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2014.yaml' 2024-12-17T11:00:17,169 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2015.yaml' 2024-12-17T11:00:17,170 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2016.yaml' 2024-12-17T11:00:17,171 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2017.yaml' 2024-12-17T11:00:17,173 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2018.yaml' 2024-12-17T11:00:17,174 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2019.yaml' 2024-12-17T11:00:17,175 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2020.yaml' 2024-12-17T11:00:17,176 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2021.yaml' 2024-12-17T11:00:17,177 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2022.yaml' 2024-12-17T11:00:17,178 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2023.yaml' 2024-12-17T11:00:17,179 adding 'lm_eval/tasks/kbl/bar_exam/criminal/kbl_bar_exam_em_criminal_2024.yaml' 2024-12-17T11:00:17,182 adding 'lm_eval/tasks/kbl/bar_exam/public/_base_em_yaml' 2024-12-17T11:00:17,183 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2012.yaml' 2024-12-17T11:00:17,184 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2013.yaml' 2024-12-17T11:00:17,186 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2014.yaml' 2024-12-17T11:00:17,187 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2015.yaml' 2024-12-17T11:00:17,188 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2016.yaml' 2024-12-17T11:00:17,189 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2017.yaml' 2024-12-17T11:00:17,190 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2018.yaml' 2024-12-17T11:00:17,191 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2019.yaml' 2024-12-17T11:00:17,192 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2020.yaml' 2024-12-17T11:00:17,194 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2021.yaml' 2024-12-17T11:00:17,195 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2022.yaml' 2024-12-17T11:00:17,196 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2023.yaml' 2024-12-17T11:00:17,198 adding 'lm_eval/tasks/kbl/bar_exam/public/kbl_bar_exam_em_public_2024.yaml' 2024-12-17T11:00:17,200 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/_base_em_yaml' 2024-12-17T11:00:17,202 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2010.yaml' 2024-12-17T11:00:17,203 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2011.yaml' 2024-12-17T11:00:17,205 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2012.yaml' 2024-12-17T11:00:17,207 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2013.yaml' 2024-12-17T11:00:17,208 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2014.yaml' 2024-12-17T11:00:17,210 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2015.yaml' 2024-12-17T11:00:17,211 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2016.yaml' 2024-12-17T11:00:17,213 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2017.yaml' 2024-12-17T11:00:17,214 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2018.yaml' 2024-12-17T11:00:17,216 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2019.yaml' 2024-12-17T11:00:17,218 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2020.yaml' 2024-12-17T11:00:17,219 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2021.yaml' 2024-12-17T11:00:17,221 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2022.yaml' 2024-12-17T11:00:17,222 adding 'lm_eval/tasks/kbl/bar_exam/responsibility/kbl_bar_exam_em_responsibility_2023.yaml' 2024-12-17T11:00:17,225 adding 'lm_eval/tasks/kbl/knowledge/_kbl_knowledge_yaml' 2024-12-17T11:00:17,226 adding 'lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_em.yaml' 2024-12-17T11:00:17,228 adding 'lm_eval/tasks/kbl/knowledge/kbl_common_legal_mistake_qa_reasoning_em.yaml' 2024-12-17T11:00:17,229 adding 'lm_eval/tasks/kbl/knowledge/kbl_legal_concept_qa_em.yaml' 2024-12-17T11:00:17,231 adding 'lm_eval/tasks/kbl/knowledge/kbl_offense_component_qa_em.yaml' 2024-12-17T11:00:17,233 adding 'lm_eval/tasks/kbl/knowledge/kbl_query_statute_matching_qa_em.yaml' 2024-12-17T11:00:17,234 adding 'lm_eval/tasks/kbl/knowledge/kbl_statute_hallucination_qa_em.yaml' 2024-12-17T11:00:17,236 adding 'lm_eval/tasks/kbl/knowledge/kbl_statute_number_and_content_matching_qa_em.yaml' 2024-12-17T11:00:17,238 adding 'lm_eval/tasks/kbl/reasoning/_kbl_reasoning_yaml' 2024-12-17T11:00:17,240 adding 'lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_p_em.yaml' 2024-12-17T11:00:17,242 adding 'lm_eval/tasks/kbl/reasoning/kbl_case_relevance_qa_q_em.yaml' 2024-12-17T11:00:17,244 adding 'lm_eval/tasks/kbl/reasoning/kbl_causal_reasoning_em.yaml' 2024-12-17T11:00:17,245 adding 'lm_eval/tasks/kbl/reasoning/kbl_statement_consistency_qa_em.yaml' 2024-12-17T11:00:17,247 adding 'lm_eval/tasks/kmmlu/README.md' 2024-12-17T11:00:17,251 adding 'lm_eval/tasks/kmmlu/cot_hard/_cot_kmmlu_yaml' 2024-12-17T11:00:17,253 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_accounting.yaml' 2024-12-17T11:00:17,256 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_agricultural_sciences.yaml' 2024-12-17T11:00:17,259 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_aviation_engineering_and_maintenance.yaml' 2024-12-17T11:00:17,261 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_biology.yaml' 2024-12-17T11:00:17,264 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemical_engineering.yaml' 2024-12-17T11:00:17,266 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_chemistry.yaml' 2024-12-17T11:00:17,269 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_civil_engineering.yaml' 2024-12-17T11:00:17,272 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_computer_science.yaml' 2024-12-17T11:00:17,275 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_construction.yaml' 2024-12-17T11:00:17,278 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_criminal_law.yaml' 2024-12-17T11:00:17,281 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_ecology.yaml' 2024-12-17T11:00:17,284 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_economics.yaml' 2024-12-17T11:00:17,287 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_education.yaml' 2024-12-17T11:00:17,289 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electrical_engineering.yaml' 2024-12-17T11:00:17,292 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_electronics_engineering.yaml' 2024-12-17T11:00:17,295 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_energy_management.yaml' 2024-12-17T11:00:17,297 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_environmental_science.yaml' 2024-12-17T11:00:17,299 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_fashion.yaml' 2024-12-17T11:00:17,301 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_food_processing.yaml' 2024-12-17T11:00:17,303 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_gas_technology_and_engineering.yaml' 2024-12-17T11:00:17,305 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_geomatics.yaml' 2024-12-17T11:00:17,307 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_health.yaml' 2024-12-17T11:00:17,308 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_industrial_engineer.yaml' 2024-12-17T11:00:17,310 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_information_technology.yaml' 2024-12-17T11:00:17,312 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_interior_architecture_and_design.yaml' 2024-12-17T11:00:17,314 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_korean_history.yaml' 2024-12-17T11:00:17,316 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_law.yaml' 2024-12-17T11:00:17,318 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_machine_design_and_manufacturing.yaml' 2024-12-17T11:00:17,320 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_management.yaml' 2024-12-17T11:00:17,322 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_maritime_engineering.yaml' 2024-12-17T11:00:17,324 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_marketing.yaml' 2024-12-17T11:00:17,325 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_materials_engineering.yaml' 2024-12-17T11:00:17,327 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_math.yaml' 2024-12-17T11:00:17,329 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_mechanical_engineering.yaml' 2024-12-17T11:00:17,331 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_nondestructive_testing.yaml' 2024-12-17T11:00:17,333 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_patent.yaml' 2024-12-17T11:00:17,335 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_political_science_and_sociology.yaml' 2024-12-17T11:00:17,337 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_psychology.yaml' 2024-12-17T11:00:17,339 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_public_safety.yaml' 2024-12-17T11:00:17,341 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_railway_and_automotive_engineering.yaml' 2024-12-17T11:00:17,343 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_real_estate.yaml' 2024-12-17T11:00:17,345 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_refrigerating_machinery.yaml' 2024-12-17T11:00:17,347 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_social_welfare.yaml' 2024-12-17T11:00:17,350 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_taxation.yaml' 2024-12-17T11:00:17,352 adding 'lm_eval/tasks/kmmlu/cot_hard/kmmlu_cot_hard_telecommunications_and_wireless_technology.yaml' 2024-12-17T11:00:17,355 adding 'lm_eval/tasks/kmmlu/direct/_direct_kmmlu_yaml' 2024-12-17T11:00:17,356 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_accounting.yaml' 2024-12-17T11:00:17,357 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_agricultural_sciences.yaml' 2024-12-17T11:00:17,358 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_aviation_engineering_and_maintenance.yaml' 2024-12-17T11:00:17,360 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_biology.yaml' 2024-12-17T11:00:17,361 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemical_engineering.yaml' 2024-12-17T11:00:17,362 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_chemistry.yaml' 2024-12-17T11:00:17,364 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_civil_engineering.yaml' 2024-12-17T11:00:17,365 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_computer_science.yaml' 2024-12-17T11:00:17,366 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_construction.yaml' 2024-12-17T11:00:17,367 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_criminal_law.yaml' 2024-12-17T11:00:17,368 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_ecology.yaml' 2024-12-17T11:00:17,370 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_economics.yaml' 2024-12-17T11:00:17,371 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_education.yaml' 2024-12-17T11:00:17,378 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_electrical_engineering.yaml' 2024-12-17T11:00:17,379 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_electronics_engineering.yaml' 2024-12-17T11:00:17,380 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_energy_management.yaml' 2024-12-17T11:00:17,381 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_environmental_science.yaml' 2024-12-17T11:00:17,383 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_fashion.yaml' 2024-12-17T11:00:17,384 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_food_processing.yaml' 2024-12-17T11:00:17,386 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_gas_technology_and_engineering.yaml' 2024-12-17T11:00:17,388 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_geomatics.yaml' 2024-12-17T11:00:17,390 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_health.yaml' 2024-12-17T11:00:17,391 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_industrial_engineer.yaml' 2024-12-17T11:00:17,393 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_information_technology.yaml' 2024-12-17T11:00:17,395 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_interior_architecture_and_design.yaml' 2024-12-17T11:00:17,397 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_korean_history.yaml' 2024-12-17T11:00:17,398 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_law.yaml' 2024-12-17T11:00:17,399 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_machine_design_and_manufacturing.yaml' 2024-12-17T11:00:17,400 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_management.yaml' 2024-12-17T11:00:17,402 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_maritime_engineering.yaml' 2024-12-17T11:00:17,403 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_marketing.yaml' 2024-12-17T11:00:17,404 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_materials_engineering.yaml' 2024-12-17T11:00:17,405 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_math.yaml' 2024-12-17T11:00:17,407 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_mechanical_engineering.yaml' 2024-12-17T11:00:17,408 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_nondestructive_testing.yaml' 2024-12-17T11:00:17,409 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_patent.yaml' 2024-12-17T11:00:17,410 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_political_science_and_sociology.yaml' 2024-12-17T11:00:17,411 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_psychology.yaml' 2024-12-17T11:00:17,412 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_public_safety.yaml' 2024-12-17T11:00:17,413 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_railway_and_automotive_engineering.yaml' 2024-12-17T11:00:17,414 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_real_estate.yaml' 2024-12-17T11:00:17,416 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_refrigerating_machinery.yaml' 2024-12-17T11:00:17,417 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_social_welfare.yaml' 2024-12-17T11:00:17,418 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_taxation.yaml' 2024-12-17T11:00:17,419 adding 'lm_eval/tasks/kmmlu/direct/kmmlu_direct_telecommunications_and_wireless_technology.yaml' 2024-12-17T11:00:17,421 adding 'lm_eval/tasks/kmmlu/direct_hard/_direct_hard_kmmlu_yaml' 2024-12-17T11:00:17,422 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_accounting.yaml' 2024-12-17T11:00:17,424 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_agricultural_sciences.yaml' 2024-12-17T11:00:17,425 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_aviation_engineering_and_maintenance.yaml' 2024-12-17T11:00:17,426 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_biology.yaml' 2024-12-17T11:00:17,427 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemical_engineering.yaml' 2024-12-17T11:00:17,428 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_chemistry.yaml' 2024-12-17T11:00:17,429 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_civil_engineering.yaml' 2024-12-17T11:00:17,431 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_computer_science.yaml' 2024-12-17T11:00:17,432 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_construction.yaml' 2024-12-17T11:00:17,433 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_criminal_law.yaml' 2024-12-17T11:00:17,434 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_ecology.yaml' 2024-12-17T11:00:17,435 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_economics.yaml' 2024-12-17T11:00:17,436 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_education.yaml' 2024-12-17T11:00:17,437 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electrical_engineering.yaml' 2024-12-17T11:00:17,439 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_electronics_engineering.yaml' 2024-12-17T11:00:17,440 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_energy_management.yaml' 2024-12-17T11:00:17,441 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_environmental_science.yaml' 2024-12-17T11:00:17,442 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_fashion.yaml' 2024-12-17T11:00:17,443 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_food_processing.yaml' 2024-12-17T11:00:17,444 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_gas_technology_and_engineering.yaml' 2024-12-17T11:00:17,445 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_geomatics.yaml' 2024-12-17T11:00:17,446 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_health.yaml' 2024-12-17T11:00:17,447 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_industrial_engineer.yaml' 2024-12-17T11:00:17,448 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_information_technology.yaml' 2024-12-17T11:00:17,449 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_interior_architecture_and_design.yaml' 2024-12-17T11:00:17,450 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_korean_history.yaml' 2024-12-17T11:00:17,451 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_law.yaml' 2024-12-17T11:00:17,452 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_machine_design_and_manufacturing.yaml' 2024-12-17T11:00:17,453 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_management.yaml' 2024-12-17T11:00:17,454 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_maritime_engineering.yaml' 2024-12-17T11:00:17,455 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_marketing.yaml' 2024-12-17T11:00:17,456 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_materials_engineering.yaml' 2024-12-17T11:00:17,457 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_math.yaml' 2024-12-17T11:00:17,458 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_mechanical_engineering.yaml' 2024-12-17T11:00:17,460 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_nondestructive_testing.yaml' 2024-12-17T11:00:17,461 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_patent.yaml' 2024-12-17T11:00:17,462 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_political_science_and_sociology.yaml' 2024-12-17T11:00:17,463 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_psychology.yaml' 2024-12-17T11:00:17,464 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_public_safety.yaml' 2024-12-17T11:00:17,465 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_railway_and_automotive_engineering.yaml' 2024-12-17T11:00:17,466 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_real_estate.yaml' 2024-12-17T11:00:17,467 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_refrigerating_machinery.yaml' 2024-12-17T11:00:17,468 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_social_welfare.yaml' 2024-12-17T11:00:17,470 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_taxation.yaml' 2024-12-17T11:00:17,471 adding 'lm_eval/tasks/kmmlu/direct_hard/kmmlu_direct_hard_telecommunications_and_wireless_technology.yaml' 2024-12-17T11:00:17,473 adding 'lm_eval/tasks/kmmlu/hard/_hard_kmmlu_yaml' 2024-12-17T11:00:17,474 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_accounting.yaml' 2024-12-17T11:00:17,476 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_agricultural_sciences.yaml' 2024-12-17T11:00:17,477 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_aviation_engineering_and_maintenance.yaml' 2024-12-17T11:00:17,478 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_biology.yaml' 2024-12-17T11:00:17,479 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemical_engineering.yaml' 2024-12-17T11:00:17,480 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_chemistry.yaml' 2024-12-17T11:00:17,481 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_civil_engineering.yaml' 2024-12-17T11:00:17,482 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_computer_science.yaml' 2024-12-17T11:00:17,484 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_construction.yaml' 2024-12-17T11:00:17,484 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_criminal_law.yaml' 2024-12-17T11:00:17,486 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_ecology.yaml' 2024-12-17T11:00:17,487 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_economics.yaml' 2024-12-17T11:00:17,488 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_education.yaml' 2024-12-17T11:00:17,489 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_electrical_engineering.yaml' 2024-12-17T11:00:17,490 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_electronics_engineering.yaml' 2024-12-17T11:00:17,490 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_energy_management.yaml' 2024-12-17T11:00:17,491 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_environmental_science.yaml' 2024-12-17T11:00:17,493 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_fashion.yaml' 2024-12-17T11:00:17,494 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_food_processing.yaml' 2024-12-17T11:00:17,495 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_gas_technology_and_engineering.yaml' 2024-12-17T11:00:17,496 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_geomatics.yaml' 2024-12-17T11:00:17,497 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_health.yaml' 2024-12-17T11:00:17,498 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_industrial_engineer.yaml' 2024-12-17T11:00:17,499 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_information_technology.yaml' 2024-12-17T11:00:17,500 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_interior_architecture_and_design.yaml' 2024-12-17T11:00:17,501 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_korean_history.yaml' 2024-12-17T11:00:17,502 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_law.yaml' 2024-12-17T11:00:17,503 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_machine_design_and_manufacturing.yaml' 2024-12-17T11:00:17,504 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_management.yaml' 2024-12-17T11:00:17,506 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_maritime_engineering.yaml' 2024-12-17T11:00:17,507 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_marketing.yaml' 2024-12-17T11:00:17,508 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_materials_engineering.yaml' 2024-12-17T11:00:17,509 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_math.yaml' 2024-12-17T11:00:17,510 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_mechanical_engineering.yaml' 2024-12-17T11:00:17,511 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_nondestructive_testing.yaml' 2024-12-17T11:00:17,512 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_patent.yaml' 2024-12-17T11:00:17,513 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_political_science_and_sociology.yaml' 2024-12-17T11:00:17,514 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_psychology.yaml' 2024-12-17T11:00:17,516 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_public_safety.yaml' 2024-12-17T11:00:17,517 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_railway_and_automotive_engineering.yaml' 2024-12-17T11:00:17,518 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_real_estate.yaml' 2024-12-17T11:00:17,519 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_refrigerating_machinery.yaml' 2024-12-17T11:00:17,520 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_social_welfare.yaml' 2024-12-17T11:00:17,522 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_taxation.yaml' 2024-12-17T11:00:17,523 adding 'lm_eval/tasks/kmmlu/hard/kmmlu_hard_telecommunications_and_wireless_technology.yaml' 2024-12-17T11:00:17,525 adding 'lm_eval/tasks/kobest/README.md' 2024-12-17T11:00:17,526 adding 'lm_eval/tasks/kobest/kobest_boolq.yaml' 2024-12-17T11:00:17,527 adding 'lm_eval/tasks/kobest/kobest_copa.yaml' 2024-12-17T11:00:17,529 adding 'lm_eval/tasks/kobest/kobest_hellaswag.yaml' 2024-12-17T11:00:17,530 adding 'lm_eval/tasks/kobest/kobest_sentineg.yaml' 2024-12-17T11:00:17,531 adding 'lm_eval/tasks/kobest/kobest_wic.yaml' 2024-12-17T11:00:17,532 adding 'lm_eval/tasks/kobest/utils.py' 2024-12-17T11:00:17,534 adding 'lm_eval/tasks/kormedmcqa/README.md' 2024-12-17T11:00:17,536 adding 'lm_eval/tasks/kormedmcqa/_kormedmcqa.yaml' 2024-12-17T11:00:17,537 adding 'lm_eval/tasks/kormedmcqa/kormedmcqa_doctor.yaml' 2024-12-17T11:00:17,539 adding 'lm_eval/tasks/kormedmcqa/kormedmcqa_nurse.yaml' 2024-12-17T11:00:17,540 adding 'lm_eval/tasks/kormedmcqa/kormedmcqa_pharm.yaml' 2024-12-17T11:00:17,541 adding 'lm_eval/tasks/lambada/README.md' 2024-12-17T11:00:17,543 adding 'lm_eval/tasks/lambada/lambada_openai.yaml' 2024-12-17T11:00:17,544 adding 'lm_eval/tasks/lambada/lambada_standard.yaml' 2024-12-17T11:00:17,546 adding 'lm_eval/tasks/lambada_cloze/README.md' 2024-12-17T11:00:17,547 adding 'lm_eval/tasks/lambada_cloze/lambada_openai_cloze.yaml' 2024-12-17T11:00:17,548 adding 'lm_eval/tasks/lambada_cloze/lambada_standard_cloze.yaml' 2024-12-17T11:00:17,550 adding 'lm_eval/tasks/lambada_multilingual/README.md' 2024-12-17T11:00:17,551 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_de.yaml' 2024-12-17T11:00:17,552 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_en.yaml' 2024-12-17T11:00:17,554 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_es.yaml' 2024-12-17T11:00:17,555 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_fr.yaml' 2024-12-17T11:00:17,556 adding 'lm_eval/tasks/lambada_multilingual/lambada_mt_it.yaml' 2024-12-17T11:00:17,557 adding 'lm_eval/tasks/lambada_multilingual_stablelm/README.md' 2024-12-17T11:00:17,559 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_de.yaml' 2024-12-17T11:00:17,560 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_en.yaml' 2024-12-17T11:00:17,561 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_es.yaml' 2024-12-17T11:00:17,562 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_fr.yaml' 2024-12-17T11:00:17,563 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_it.yaml' 2024-12-17T11:00:17,564 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_nl.yaml' 2024-12-17T11:00:17,565 adding 'lm_eval/tasks/lambada_multilingual_stablelm/lambada_mt_stablelm_pt.yaml' 2024-12-17T11:00:17,568 adding 'lm_eval/tasks/leaderboard/README.md' 2024-12-17T11:00:17,569 adding 'lm_eval/tasks/leaderboard/leaderboard.yaml' 2024-12-17T11:00:17,571 adding 'lm_eval/tasks/leaderboard/bbh_mc/_fewshot_template_yaml' 2024-12-17T11:00:17,572 adding 'lm_eval/tasks/leaderboard/bbh_mc/_leaderboard_bbh.yaml' 2024-12-17T11:00:17,574 adding 'lm_eval/tasks/leaderboard/bbh_mc/boolean_expressions.yaml' 2024-12-17T11:00:17,575 adding 'lm_eval/tasks/leaderboard/bbh_mc/causal_judgement.yaml' 2024-12-17T11:00:17,576 adding 'lm_eval/tasks/leaderboard/bbh_mc/date_understanding.yaml' 2024-12-17T11:00:17,577 adding 'lm_eval/tasks/leaderboard/bbh_mc/disambiguation_qa.yaml' 2024-12-17T11:00:17,579 adding 'lm_eval/tasks/leaderboard/bbh_mc/formal_fallacies.yaml' 2024-12-17T11:00:17,580 adding 'lm_eval/tasks/leaderboard/bbh_mc/geometric_shapes.yaml' 2024-12-17T11:00:17,582 adding 'lm_eval/tasks/leaderboard/bbh_mc/hyperbaton.yaml' 2024-12-17T11:00:17,583 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_five_objects.yaml' 2024-12-17T11:00:17,584 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_seven_objects.yaml' 2024-12-17T11:00:17,586 adding 'lm_eval/tasks/leaderboard/bbh_mc/logical_deduction_three_objects.yaml' 2024-12-17T11:00:17,587 adding 'lm_eval/tasks/leaderboard/bbh_mc/movie_recommendation.yaml' 2024-12-17T11:00:17,588 adding 'lm_eval/tasks/leaderboard/bbh_mc/navigate.yaml' 2024-12-17T11:00:17,590 adding 'lm_eval/tasks/leaderboard/bbh_mc/object_counting.yaml' 2024-12-17T11:00:17,591 adding 'lm_eval/tasks/leaderboard/bbh_mc/penguins_in_a_table.yaml' 2024-12-17T11:00:17,592 adding 'lm_eval/tasks/leaderboard/bbh_mc/reasoning_about_colored_objects.yaml' 2024-12-17T11:00:17,593 adding 'lm_eval/tasks/leaderboard/bbh_mc/ruin_names.yaml' 2024-12-17T11:00:17,595 adding 'lm_eval/tasks/leaderboard/bbh_mc/salient_translation_error_detection.yaml' 2024-12-17T11:00:17,596 adding 'lm_eval/tasks/leaderboard/bbh_mc/snarks.yaml' 2024-12-17T11:00:17,598 adding 'lm_eval/tasks/leaderboard/bbh_mc/sports_understanding.yaml' 2024-12-17T11:00:17,599 adding 'lm_eval/tasks/leaderboard/bbh_mc/temporal_sequences.yaml' 2024-12-17T11:00:17,600 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_five_objects.yaml' 2024-12-17T11:00:17,601 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_seven_objects.yaml' 2024-12-17T11:00:17,603 adding 'lm_eval/tasks/leaderboard/bbh_mc/tracking_shuffled_objects_three_objects.yaml' 2024-12-17T11:00:17,604 adding 'lm_eval/tasks/leaderboard/bbh_mc/web_of_lies.yaml' 2024-12-17T11:00:17,606 adding 'lm_eval/tasks/leaderboard/gpqa/_leaderboard_gpqa.yaml' 2024-12-17T11:00:17,607 adding 'lm_eval/tasks/leaderboard/gpqa/_template_yaml' 2024-12-17T11:00:17,608 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_diamond_zeroshot.yaml' 2024-12-17T11:00:17,609 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_extended_zeroshot.yaml' 2024-12-17T11:00:17,610 adding 'lm_eval/tasks/leaderboard/gpqa/gpqa_main_zeroshot.yaml' 2024-12-17T11:00:17,611 adding 'lm_eval/tasks/leaderboard/gpqa/utils.py' 2024-12-17T11:00:17,613 adding 'lm_eval/tasks/leaderboard/ifeval/_leaderboard_instruction_following.yaml' 2024-12-17T11:00:17,615 adding 'lm_eval/tasks/leaderboard/ifeval/ifeval.yaml' 2024-12-17T11:00:17,620 adding 'lm_eval/tasks/leaderboard/ifeval/instructions.py' 2024-12-17T11:00:17,621 adding 'lm_eval/tasks/leaderboard/ifeval/instructions_registry.py' 2024-12-17T11:00:17,624 adding 'lm_eval/tasks/leaderboard/ifeval/instructions_util.py' 2024-12-17T11:00:17,626 adding 'lm_eval/tasks/leaderboard/ifeval/utils.py' 2024-12-17T11:00:17,628 adding 'lm_eval/tasks/leaderboard/math/_leaderboard_math.yaml' 2024-12-17T11:00:17,629 adding 'lm_eval/tasks/leaderboard/math/_template_yaml' 2024-12-17T11:00:17,630 adding 'lm_eval/tasks/leaderboard/math/math_algebra.yaml' 2024-12-17T11:00:17,631 adding 'lm_eval/tasks/leaderboard/math/math_counting_and_prob.yaml' 2024-12-17T11:00:17,632 adding 'lm_eval/tasks/leaderboard/math/math_geometry.yaml' 2024-12-17T11:00:17,633 adding 'lm_eval/tasks/leaderboard/math/math_intermediate_algebra.yaml' 2024-12-17T11:00:17,635 adding 'lm_eval/tasks/leaderboard/math/math_num_theory.yaml' 2024-12-17T11:00:17,636 adding 'lm_eval/tasks/leaderboard/math/math_prealgebra.yaml' 2024-12-17T11:00:17,637 adding 'lm_eval/tasks/leaderboard/math/math_precalculus.yaml' 2024-12-17T11:00:17,639 adding 'lm_eval/tasks/leaderboard/math/utils.py' 2024-12-17T11:00:17,640 adding 'lm_eval/tasks/leaderboard/mmlu_pro/mmlu_pro.yaml' 2024-12-17T11:00:17,642 adding 'lm_eval/tasks/leaderboard/mmlu_pro/utils.py' 2024-12-17T11:00:17,643 adding 'lm_eval/tasks/leaderboard/musr/_musr.yaml' 2024-12-17T11:00:17,644 adding 'lm_eval/tasks/leaderboard/musr/_template_yaml' 2024-12-17T11:00:17,645 adding 'lm_eval/tasks/leaderboard/musr/musr_murder_mysteries.yaml' 2024-12-17T11:00:17,646 adding 'lm_eval/tasks/leaderboard/musr/musr_object_placements.yaml' 2024-12-17T11:00:17,648 adding 'lm_eval/tasks/leaderboard/musr/musr_team_allocation.yaml' 2024-12-17T11:00:17,649 adding 'lm_eval/tasks/leaderboard/musr/utils.py' 2024-12-17T11:00:17,651 adding 'lm_eval/tasks/lingoly/README.md' 2024-12-17T11:00:17,652 adding 'lm_eval/tasks/lingoly/lingoly_context.yaml' 2024-12-17T11:00:17,653 adding 'lm_eval/tasks/lingoly/lingoly_group.yaml' 2024-12-17T11:00:17,655 adding 'lm_eval/tasks/lingoly/lingoly_nocontext.yaml' 2024-12-17T11:00:17,656 adding 'lm_eval/tasks/lingoly/script.py' 2024-12-17T11:00:17,657 adding 'lm_eval/tasks/lingoly/utils.py' 2024-12-17T11:00:17,659 adding 'lm_eval/tasks/logiqa/README.md' 2024-12-17T11:00:17,660 adding 'lm_eval/tasks/logiqa/logiqa.yaml' 2024-12-17T11:00:17,662 adding 'lm_eval/tasks/logiqa/utils_logiqa.py' 2024-12-17T11:00:17,663 adding 'lm_eval/tasks/logiqa2/README.md' 2024-12-17T11:00:17,665 adding 'lm_eval/tasks/logiqa2/logieval.yaml' 2024-12-17T11:00:17,666 adding 'lm_eval/tasks/logiqa2/logiqa2.yaml' 2024-12-17T11:00:17,668 adding 'lm_eval/tasks/logiqa2/utils_logiqa2.py' 2024-12-17T11:00:17,669 adding 'lm_eval/tasks/mathqa/README.md' 2024-12-17T11:00:17,670 adding 'lm_eval/tasks/mathqa/mathqa.yaml' 2024-12-17T11:00:17,671 adding 'lm_eval/tasks/mathqa/utils.py' 2024-12-17T11:00:17,674 adding 'lm_eval/tasks/mc_taco/README.md' 2024-12-17T11:00:17,675 adding 'lm_eval/tasks/mc_taco/default.yaml' 2024-12-17T11:00:17,677 adding 'lm_eval/tasks/med_concepts_qa/README.md' 2024-12-17T11:00:17,678 adding 'lm_eval/tasks/med_concepts_qa/_default_template_yaml' 2024-12-17T11:00:17,679 adding 'lm_eval/tasks/med_concepts_qa/_generate_configs.py' 2024-12-17T11:00:17,680 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa.yaml' 2024-12-17T11:00:17,682 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_atc.yaml' 2024-12-17T11:00:17,683 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10cm.yaml' 2024-12-17T11:00:17,684 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd10proc.yaml' 2024-12-17T11:00:17,685 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9cm.yaml' 2024-12-17T11:00:17,686 adding 'lm_eval/tasks/med_concepts_qa/_med_concepts_qa_icd9proc.yaml' 2024-12-17T11:00:17,688 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_easy.yaml' 2024-12-17T11:00:17,689 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_hard.yaml' 2024-12-17T11:00:17,690 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_atc_medium.yaml' 2024-12-17T11:00:17,691 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_easy.yaml' 2024-12-17T11:00:17,692 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_hard.yaml' 2024-12-17T11:00:17,694 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10cm_medium.yaml' 2024-12-17T11:00:17,695 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_easy.yaml' 2024-12-17T11:00:17,696 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_hard.yaml' 2024-12-17T11:00:17,697 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd10proc_medium.yaml' 2024-12-17T11:00:17,698 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_easy.yaml' 2024-12-17T11:00:17,700 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_hard.yaml' 2024-12-17T11:00:17,701 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9cm_medium.yaml' 2024-12-17T11:00:17,702 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_easy.yaml' 2024-12-17T11:00:17,704 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_hard.yaml' 2024-12-17T11:00:17,706 adding 'lm_eval/tasks/med_concepts_qa/med_concepts_qa_icd9proc_medium.yaml' 2024-12-17T11:00:17,708 adding 'lm_eval/tasks/medmcqa/medmcqa.yaml' 2024-12-17T11:00:17,710 adding 'lm_eval/tasks/medmcqa/utils_medmcqa.py' 2024-12-17T11:00:17,713 adding 'lm_eval/tasks/medqa/medqa.yaml' 2024-12-17T11:00:17,714 adding 'lm_eval/tasks/medqa/preprocess_medqa.py' 2024-12-17T11:00:17,717 adding 'lm_eval/tasks/mela/README.md' 2024-12-17T11:00:17,718 adding 'lm_eval/tasks/mela/_mela.yaml' 2024-12-17T11:00:17,719 adding 'lm_eval/tasks/mela/mela_ar.yaml' 2024-12-17T11:00:17,720 adding 'lm_eval/tasks/mela/mela_de.yaml' 2024-12-17T11:00:17,721 adding 'lm_eval/tasks/mela/mela_en.yaml' 2024-12-17T11:00:17,723 adding 'lm_eval/tasks/mela/mela_es.yaml' 2024-12-17T11:00:17,724 adding 'lm_eval/tasks/mela/mela_fr.yaml' 2024-12-17T11:00:17,725 adding 'lm_eval/tasks/mela/mela_is.yaml' 2024-12-17T11:00:17,726 adding 'lm_eval/tasks/mela/mela_it.yaml' 2024-12-17T11:00:17,727 adding 'lm_eval/tasks/mela/mela_ja.yaml' 2024-12-17T11:00:17,728 adding 'lm_eval/tasks/mela/mela_ru.yaml' 2024-12-17T11:00:17,730 adding 'lm_eval/tasks/mela/mela_zh.yaml' 2024-12-17T11:00:17,732 adding 'lm_eval/tasks/metabench/README.md' 2024-12-17T11:00:17,733 adding 'lm_eval/tasks/metabench/metabench.yaml' 2024-12-17T11:00:17,735 adding 'lm_eval/tasks/metabench/metabench_arc.yaml' 2024-12-17T11:00:17,736 adding 'lm_eval/tasks/metabench/metabench_arc_permute.yaml' 2024-12-17T11:00:17,737 adding 'lm_eval/tasks/metabench/metabench_arc_secondary.yaml' 2024-12-17T11:00:17,738 adding 'lm_eval/tasks/metabench/metabench_arc_secondary_permute.yaml' 2024-12-17T11:00:17,739 adding 'lm_eval/tasks/metabench/metabench_gsm8k.yaml' 2024-12-17T11:00:17,740 adding 'lm_eval/tasks/metabench/metabench_gsm8k_secondary.yaml' 2024-12-17T11:00:17,741 adding 'lm_eval/tasks/metabench/metabench_hellaswag.yaml' 2024-12-17T11:00:17,742 adding 'lm_eval/tasks/metabench/metabench_hellaswag_permute.yaml' 2024-12-17T11:00:17,743 adding 'lm_eval/tasks/metabench/metabench_hellaswag_secondary.yaml' 2024-12-17T11:00:17,744 adding 'lm_eval/tasks/metabench/metabench_hellaswag_secondary_permute.yaml' 2024-12-17T11:00:17,745 adding 'lm_eval/tasks/metabench/metabench_mmlu.yaml' 2024-12-17T11:00:17,746 adding 'lm_eval/tasks/metabench/metabench_mmlu_permute.yaml' 2024-12-17T11:00:17,747 adding 'lm_eval/tasks/metabench/metabench_mmlu_secondary.yaml' 2024-12-17T11:00:17,749 adding 'lm_eval/tasks/metabench/metabench_mmlu_secondary_permute.yaml' 2024-12-17T11:00:17,750 adding 'lm_eval/tasks/metabench/metabench_permute.yaml' 2024-12-17T11:00:17,751 adding 'lm_eval/tasks/metabench/metabench_secondary.yaml' 2024-12-17T11:00:17,752 adding 'lm_eval/tasks/metabench/metabench_secondary_permute.yaml' 2024-12-17T11:00:17,753 adding 'lm_eval/tasks/metabench/metabench_truthfulqa.yaml' 2024-12-17T11:00:17,754 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_permute.yaml' 2024-12-17T11:00:17,755 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_secondary.yaml' 2024-12-17T11:00:17,756 adding 'lm_eval/tasks/metabench/metabench_truthfulqa_secondary_permute.yaml' 2024-12-17T11:00:17,757 adding 'lm_eval/tasks/metabench/metabench_winogrande.yaml' 2024-12-17T11:00:17,758 adding 'lm_eval/tasks/metabench/metabench_winogrande_permute.yaml' 2024-12-17T11:00:17,759 adding 'lm_eval/tasks/metabench/metabench_winogrande_secondary.yaml' 2024-12-17T11:00:17,761 adding 'lm_eval/tasks/metabench/metabench_winogrande_secondary_permute.yaml' 2024-12-17T11:00:17,762 adding 'lm_eval/tasks/metabench/process_docs.py' 2024-12-17T11:00:17,764 adding 'lm_eval/tasks/metabench/process_docs_permute.py' 2024-12-17T11:00:17,766 adding 'lm_eval/tasks/mgsm/README.md' 2024-12-17T11:00:17,767 adding 'lm_eval/tasks/mgsm/gen_yaml.sh' 2024-12-17T11:00:17,769 adding 'lm_eval/tasks/mgsm/utils.py' 2024-12-17T11:00:17,771 adding 'lm_eval/tasks/mgsm/direct/direct_yaml' 2024-12-17T11:00:17,772 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_bn.yaml' 2024-12-17T11:00:17,773 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_de.yaml' 2024-12-17T11:00:17,774 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_en.yaml' 2024-12-17T11:00:17,776 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_es.yaml' 2024-12-17T11:00:17,777 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_fr.yaml' 2024-12-17T11:00:17,778 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_ja.yaml' 2024-12-17T11:00:17,779 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_ru.yaml' 2024-12-17T11:00:17,780 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_sw.yaml' 2024-12-17T11:00:17,781 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_te.yaml' 2024-12-17T11:00:17,783 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_th.yaml' 2024-12-17T11:00:17,784 adding 'lm_eval/tasks/mgsm/direct/mgsm_direct_zh.yaml' 2024-12-17T11:00:17,786 adding 'lm_eval/tasks/mgsm/en_cot/cot_yaml' 2024-12-17T11:00:17,787 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_bn.yaml' 2024-12-17T11:00:17,788 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_de.yaml' 2024-12-17T11:00:17,790 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_en.yaml' 2024-12-17T11:00:17,791 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_es.yaml' 2024-12-17T11:00:17,792 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_fr.yaml' 2024-12-17T11:00:17,794 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ja.yaml' 2024-12-17T11:00:17,795 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_ru.yaml' 2024-12-17T11:00:17,796 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_sw.yaml' 2024-12-17T11:00:17,797 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_te.yaml' 2024-12-17T11:00:17,798 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_th.yaml' 2024-12-17T11:00:17,799 adding 'lm_eval/tasks/mgsm/en_cot/mgsm_en_cot_zh.yaml' 2024-12-17T11:00:17,801 adding 'lm_eval/tasks/mgsm/native_cot/cot_yaml' 2024-12-17T11:00:17,803 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_bn.yaml' 2024-12-17T11:00:17,804 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_de.yaml' 2024-12-17T11:00:17,805 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_en.yaml' 2024-12-17T11:00:17,806 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_es.yaml' 2024-12-17T11:00:17,808 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_fr.yaml' 2024-12-17T11:00:17,809 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ja.yaml' 2024-12-17T11:00:17,810 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_ru.yaml' 2024-12-17T11:00:17,811 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_sw.yaml' 2024-12-17T11:00:17,812 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_te.yaml' 2024-12-17T11:00:17,814 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_th.yaml' 2024-12-17T11:00:17,815 adding 'lm_eval/tasks/mgsm/native_cot/mgsm_native_cot_zh.yaml' 2024-12-17T11:00:17,817 adding 'lm_eval/tasks/minerva_math/README.md' 2024-12-17T11:00:17,818 adding 'lm_eval/tasks/minerva_math/minerva_math_algebra.yaml' 2024-12-17T11:00:17,819 adding 'lm_eval/tasks/minerva_math/minerva_math_counting_and_prob.yaml' 2024-12-17T11:00:17,820 adding 'lm_eval/tasks/minerva_math/minerva_math_geometry.yaml' 2024-12-17T11:00:17,821 adding 'lm_eval/tasks/minerva_math/minerva_math_intermediate_algebra.yaml' 2024-12-17T11:00:17,823 adding 'lm_eval/tasks/minerva_math/minerva_math_num_theory.yaml' 2024-12-17T11:00:17,824 adding 'lm_eval/tasks/minerva_math/minerva_math_prealgebra.yaml' 2024-12-17T11:00:17,825 adding 'lm_eval/tasks/minerva_math/minerva_math_precalc.yaml' 2024-12-17T11:00:17,827 adding 'lm_eval/tasks/minerva_math/utils.py' 2024-12-17T11:00:17,829 adding 'lm_eval/tasks/mmlu/README.md' 2024-12-17T11:00:17,831 adding 'lm_eval/tasks/mmlu/_generate_configs.py' 2024-12-17T11:00:17,833 adding 'lm_eval/tasks/mmlu/continuation/_continuation_template_yaml' 2024-12-17T11:00:17,834 adding 'lm_eval/tasks/mmlu/continuation/_mmlu.yaml' 2024-12-17T11:00:17,835 adding 'lm_eval/tasks/mmlu/continuation/mmlu_abstract_algebra.yaml' 2024-12-17T11:00:17,837 adding 'lm_eval/tasks/mmlu/continuation/mmlu_anatomy.yaml' 2024-12-17T11:00:17,838 adding 'lm_eval/tasks/mmlu/continuation/mmlu_astronomy.yaml' 2024-12-17T11:00:17,839 adding 'lm_eval/tasks/mmlu/continuation/mmlu_business_ethics.yaml' 2024-12-17T11:00:17,840 adding 'lm_eval/tasks/mmlu/continuation/mmlu_clinical_knowledge.yaml' 2024-12-17T11:00:17,841 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_biology.yaml' 2024-12-17T11:00:17,842 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_chemistry.yaml' 2024-12-17T11:00:17,844 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_computer_science.yaml' 2024-12-17T11:00:17,845 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_mathematics.yaml' 2024-12-17T11:00:17,846 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_medicine.yaml' 2024-12-17T11:00:17,847 adding 'lm_eval/tasks/mmlu/continuation/mmlu_college_physics.yaml' 2024-12-17T11:00:17,848 adding 'lm_eval/tasks/mmlu/continuation/mmlu_computer_security.yaml' 2024-12-17T11:00:17,849 adding 'lm_eval/tasks/mmlu/continuation/mmlu_conceptual_physics.yaml' 2024-12-17T11:00:17,851 adding 'lm_eval/tasks/mmlu/continuation/mmlu_econometrics.yaml' 2024-12-17T11:00:17,852 adding 'lm_eval/tasks/mmlu/continuation/mmlu_electrical_engineering.yaml' 2024-12-17T11:00:17,853 adding 'lm_eval/tasks/mmlu/continuation/mmlu_elementary_mathematics.yaml' 2024-12-17T11:00:17,854 adding 'lm_eval/tasks/mmlu/continuation/mmlu_formal_logic.yaml' 2024-12-17T11:00:17,856 adding 'lm_eval/tasks/mmlu/continuation/mmlu_global_facts.yaml' 2024-12-17T11:00:17,857 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_biology.yaml' 2024-12-17T11:00:17,858 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_chemistry.yaml' 2024-12-17T11:00:17,859 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_computer_science.yaml' 2024-12-17T11:00:17,860 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_european_history.yaml' 2024-12-17T11:00:17,862 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_geography.yaml' 2024-12-17T11:00:17,863 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_government_and_politics.yaml' 2024-12-17T11:00:17,864 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_macroeconomics.yaml' 2024-12-17T11:00:17,865 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_mathematics.yaml' 2024-12-17T11:00:17,867 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_microeconomics.yaml' 2024-12-17T11:00:17,868 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_physics.yaml' 2024-12-17T11:00:17,869 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_psychology.yaml' 2024-12-17T11:00:17,870 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_statistics.yaml' 2024-12-17T11:00:17,871 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_us_history.yaml' 2024-12-17T11:00:17,872 adding 'lm_eval/tasks/mmlu/continuation/mmlu_high_school_world_history.yaml' 2024-12-17T11:00:17,873 adding 'lm_eval/tasks/mmlu/continuation/mmlu_human_aging.yaml' 2024-12-17T11:00:17,875 adding 'lm_eval/tasks/mmlu/continuation/mmlu_human_sexuality.yaml' 2024-12-17T11:00:17,876 adding 'lm_eval/tasks/mmlu/continuation/mmlu_international_law.yaml' 2024-12-17T11:00:17,877 adding 'lm_eval/tasks/mmlu/continuation/mmlu_jurisprudence.yaml' 2024-12-17T11:00:17,878 adding 'lm_eval/tasks/mmlu/continuation/mmlu_logical_fallacies.yaml' 2024-12-17T11:00:17,879 adding 'lm_eval/tasks/mmlu/continuation/mmlu_machine_learning.yaml' 2024-12-17T11:00:17,880 adding 'lm_eval/tasks/mmlu/continuation/mmlu_management.yaml' 2024-12-17T11:00:17,881 adding 'lm_eval/tasks/mmlu/continuation/mmlu_marketing.yaml' 2024-12-17T11:00:17,883 adding 'lm_eval/tasks/mmlu/continuation/mmlu_medical_genetics.yaml' 2024-12-17T11:00:17,884 adding 'lm_eval/tasks/mmlu/continuation/mmlu_miscellaneous.yaml' 2024-12-17T11:00:17,885 adding 'lm_eval/tasks/mmlu/continuation/mmlu_moral_disputes.yaml' 2024-12-17T11:00:17,886 adding 'lm_eval/tasks/mmlu/continuation/mmlu_moral_scenarios.yaml' 2024-12-17T11:00:17,887 adding 'lm_eval/tasks/mmlu/continuation/mmlu_nutrition.yaml' 2024-12-17T11:00:17,889 adding 'lm_eval/tasks/mmlu/continuation/mmlu_philosophy.yaml' 2024-12-17T11:00:17,890 adding 'lm_eval/tasks/mmlu/continuation/mmlu_prehistory.yaml' 2024-12-17T11:00:17,891 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_accounting.yaml' 2024-12-17T11:00:17,892 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_law.yaml' 2024-12-17T11:00:17,893 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_medicine.yaml' 2024-12-17T11:00:17,894 adding 'lm_eval/tasks/mmlu/continuation/mmlu_professional_psychology.yaml' 2024-12-17T11:00:17,896 adding 'lm_eval/tasks/mmlu/continuation/mmlu_public_relations.yaml' 2024-12-17T11:00:17,897 adding 'lm_eval/tasks/mmlu/continuation/mmlu_security_studies.yaml' 2024-12-17T11:00:17,898 adding 'lm_eval/tasks/mmlu/continuation/mmlu_sociology.yaml' 2024-12-17T11:00:17,899 adding 'lm_eval/tasks/mmlu/continuation/mmlu_us_foreign_policy.yaml' 2024-12-17T11:00:17,900 adding 'lm_eval/tasks/mmlu/continuation/mmlu_virology.yaml' 2024-12-17T11:00:17,902 adding 'lm_eval/tasks/mmlu/continuation/mmlu_world_religions.yaml' 2024-12-17T11:00:17,904 adding 'lm_eval/tasks/mmlu/default/_default_template_yaml' 2024-12-17T11:00:17,906 adding 'lm_eval/tasks/mmlu/default/_mmlu.yaml' 2024-12-17T11:00:17,907 adding 'lm_eval/tasks/mmlu/default/_mmlu_humanities.yaml' 2024-12-17T11:00:17,908 adding 'lm_eval/tasks/mmlu/default/_mmlu_other.yaml' 2024-12-17T11:00:17,909 adding 'lm_eval/tasks/mmlu/default/_mmlu_social_sciences.yaml' 2024-12-17T11:00:17,910 adding 'lm_eval/tasks/mmlu/default/_mmlu_stem.yaml' 2024-12-17T11:00:17,911 adding 'lm_eval/tasks/mmlu/default/mmlu_abstract_algebra.yaml' 2024-12-17T11:00:17,912 adding 'lm_eval/tasks/mmlu/default/mmlu_anatomy.yaml' 2024-12-17T11:00:17,914 adding 'lm_eval/tasks/mmlu/default/mmlu_astronomy.yaml' 2024-12-17T11:00:17,915 adding 'lm_eval/tasks/mmlu/default/mmlu_business_ethics.yaml' 2024-12-17T11:00:17,916 adding 'lm_eval/tasks/mmlu/default/mmlu_clinical_knowledge.yaml' 2024-12-17T11:00:17,917 adding 'lm_eval/tasks/mmlu/default/mmlu_college_biology.yaml' 2024-12-17T11:00:17,918 adding 'lm_eval/tasks/mmlu/default/mmlu_college_chemistry.yaml' 2024-12-17T11:00:17,919 adding 'lm_eval/tasks/mmlu/default/mmlu_college_computer_science.yaml' 2024-12-17T11:00:17,920 adding 'lm_eval/tasks/mmlu/default/mmlu_college_mathematics.yaml' 2024-12-17T11:00:17,921 adding 'lm_eval/tasks/mmlu/default/mmlu_college_medicine.yaml' 2024-12-17T11:00:17,922 adding 'lm_eval/tasks/mmlu/default/mmlu_college_physics.yaml' 2024-12-17T11:00:17,923 adding 'lm_eval/tasks/mmlu/default/mmlu_computer_security.yaml' 2024-12-17T11:00:17,924 adding 'lm_eval/tasks/mmlu/default/mmlu_conceptual_physics.yaml' 2024-12-17T11:00:17,925 adding 'lm_eval/tasks/mmlu/default/mmlu_econometrics.yaml' 2024-12-17T11:00:17,927 adding 'lm_eval/tasks/mmlu/default/mmlu_electrical_engineering.yaml' 2024-12-17T11:00:17,928 adding 'lm_eval/tasks/mmlu/default/mmlu_elementary_mathematics.yaml' 2024-12-17T11:00:17,929 adding 'lm_eval/tasks/mmlu/default/mmlu_formal_logic.yaml' 2024-12-17T11:00:17,930 adding 'lm_eval/tasks/mmlu/default/mmlu_global_facts.yaml' 2024-12-17T11:00:17,931 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_biology.yaml' 2024-12-17T11:00:17,932 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_chemistry.yaml' 2024-12-17T11:00:17,933 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_computer_science.yaml' 2024-12-17T11:00:17,934 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_european_history.yaml' 2024-12-17T11:00:17,935 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_geography.yaml' 2024-12-17T11:00:17,937 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_government_and_politics.yaml' 2024-12-17T11:00:17,938 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_macroeconomics.yaml' 2024-12-17T11:00:17,939 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_mathematics.yaml' 2024-12-17T11:00:17,940 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_microeconomics.yaml' 2024-12-17T11:00:17,941 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_physics.yaml' 2024-12-17T11:00:17,942 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_psychology.yaml' 2024-12-17T11:00:17,944 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_statistics.yaml' 2024-12-17T11:00:17,945 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_us_history.yaml' 2024-12-17T11:00:17,946 adding 'lm_eval/tasks/mmlu/default/mmlu_high_school_world_history.yaml' 2024-12-17T11:00:17,947 adding 'lm_eval/tasks/mmlu/default/mmlu_human_aging.yaml' 2024-12-17T11:00:17,948 adding 'lm_eval/tasks/mmlu/default/mmlu_human_sexuality.yaml' 2024-12-17T11:00:17,949 adding 'lm_eval/tasks/mmlu/default/mmlu_international_law.yaml' 2024-12-17T11:00:17,951 adding 'lm_eval/tasks/mmlu/default/mmlu_jurisprudence.yaml' 2024-12-17T11:00:17,952 adding 'lm_eval/tasks/mmlu/default/mmlu_logical_fallacies.yaml' 2024-12-17T11:00:17,953 adding 'lm_eval/tasks/mmlu/default/mmlu_machine_learning.yaml' 2024-12-17T11:00:17,954 adding 'lm_eval/tasks/mmlu/default/mmlu_management.yaml' 2024-12-17T11:00:17,955 adding 'lm_eval/tasks/mmlu/default/mmlu_marketing.yaml' 2024-12-17T11:00:17,957 adding 'lm_eval/tasks/mmlu/default/mmlu_medical_genetics.yaml' 2024-12-17T11:00:17,958 adding 'lm_eval/tasks/mmlu/default/mmlu_miscellaneous.yaml' 2024-12-17T11:00:17,959 adding 'lm_eval/tasks/mmlu/default/mmlu_moral_disputes.yaml' 2024-12-17T11:00:17,960 adding 'lm_eval/tasks/mmlu/default/mmlu_moral_scenarios.yaml' 2024-12-17T11:00:17,961 adding 'lm_eval/tasks/mmlu/default/mmlu_nutrition.yaml' 2024-12-17T11:00:17,962 adding 'lm_eval/tasks/mmlu/default/mmlu_philosophy.yaml' 2024-12-17T11:00:17,963 adding 'lm_eval/tasks/mmlu/default/mmlu_prehistory.yaml' 2024-12-17T11:00:17,964 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_accounting.yaml' 2024-12-17T11:00:17,965 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_law.yaml' 2024-12-17T11:00:17,966 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_medicine.yaml' 2024-12-17T11:00:17,967 adding 'lm_eval/tasks/mmlu/default/mmlu_professional_psychology.yaml' 2024-12-17T11:00:17,969 adding 'lm_eval/tasks/mmlu/default/mmlu_public_relations.yaml' 2024-12-17T11:00:17,970 adding 'lm_eval/tasks/mmlu/default/mmlu_security_studies.yaml' 2024-12-17T11:00:17,971 adding 'lm_eval/tasks/mmlu/default/mmlu_sociology.yaml' 2024-12-17T11:00:17,972 adding 'lm_eval/tasks/mmlu/default/mmlu_us_foreign_policy.yaml' 2024-12-17T11:00:17,973 adding 'lm_eval/tasks/mmlu/default/mmlu_virology.yaml' 2024-12-17T11:00:17,974 adding 'lm_eval/tasks/mmlu/default/mmlu_world_religions.yaml' 2024-12-17T11:00:18,014 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_cot_prompts.json' 2024-12-17T11:00:18,017 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu.yaml' 2024-12-17T11:00:18,018 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/_mmlu_flan_cot_fewshot_template_yaml' 2024-12-17T11:00:18,019 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_abstract_algebra.yaml' 2024-12-17T11:00:18,021 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_anatomy.yaml' 2024-12-17T11:00:18,022 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_astronomy.yaml' 2024-12-17T11:00:18,024 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_business_ethics.yaml' 2024-12-17T11:00:18,025 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_clinical_knowledge.yaml' 2024-12-17T11:00:18,027 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_biology.yaml' 2024-12-17T11:00:18,028 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_chemistry.yaml' 2024-12-17T11:00:18,030 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_computer_science.yaml' 2024-12-17T11:00:18,032 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_mathematics.yaml' 2024-12-17T11:00:18,033 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_medicine.yaml' 2024-12-17T11:00:18,035 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_college_physics.yaml' 2024-12-17T11:00:18,036 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_computer_security.yaml' 2024-12-17T11:00:18,037 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_conceptual_physics.yaml' 2024-12-17T11:00:18,039 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_econometrics.yaml' 2024-12-17T11:00:18,040 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_electrical_engineering.yaml' 2024-12-17T11:00:18,042 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_elementary_mathematics.yaml' 2024-12-17T11:00:18,043 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_formal_logic.yaml' 2024-12-17T11:00:18,045 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_global_facts.yaml' 2024-12-17T11:00:18,046 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_biology.yaml' 2024-12-17T11:00:18,048 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_chemistry.yaml' 2024-12-17T11:00:18,049 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_computer_science.yaml' 2024-12-17T11:00:18,052 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_european_history.yaml' 2024-12-17T11:00:18,054 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_geography.yaml' 2024-12-17T11:00:18,055 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_government_and_politics.yaml' 2024-12-17T11:00:18,057 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_macroeconomics.yaml' 2024-12-17T11:00:18,058 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_mathematics.yaml' 2024-12-17T11:00:18,060 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_microeconomics.yaml' 2024-12-17T11:00:18,062 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_physics.yaml' 2024-12-17T11:00:18,063 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_psychology.yaml' 2024-12-17T11:00:18,065 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_statistics.yaml' 2024-12-17T11:00:18,067 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_us_history.yaml' 2024-12-17T11:00:18,069 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_high_school_world_history.yaml' 2024-12-17T11:00:18,070 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_aging.yaml' 2024-12-17T11:00:18,071 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_human_sexuality.yaml' 2024-12-17T11:00:18,073 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_international_law.yaml' 2024-12-17T11:00:18,074 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_jurisprudence.yaml' 2024-12-17T11:00:18,076 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml' 2024-12-17T11:00:18,077 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_machine_learning.yaml' 2024-12-17T11:00:18,078 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_management.yaml' 2024-12-17T11:00:18,080 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_marketing.yaml' 2024-12-17T11:00:18,081 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_medical_genetics.yaml' 2024-12-17T11:00:18,082 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_miscellaneous.yaml' 2024-12-17T11:00:18,084 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_disputes.yaml' 2024-12-17T11:00:18,085 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_moral_scenarios.yaml' 2024-12-17T11:00:18,087 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_nutrition.yaml' 2024-12-17T11:00:18,088 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_philosophy.yaml' 2024-12-17T11:00:18,090 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_prehistory.yaml' 2024-12-17T11:00:18,091 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_accounting.yaml' 2024-12-17T11:00:18,093 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_law.yaml' 2024-12-17T11:00:18,095 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_medicine.yaml' 2024-12-17T11:00:18,097 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_professional_psychology.yaml' 2024-12-17T11:00:18,098 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_public_relations.yaml' 2024-12-17T11:00:18,100 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_security_studies.yaml' 2024-12-17T11:00:18,101 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_sociology.yaml' 2024-12-17T11:00:18,103 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_us_foreign_policy.yaml' 2024-12-17T11:00:18,104 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_virology.yaml' 2024-12-17T11:00:18,106 adding 'lm_eval/tasks/mmlu/flan_cot_fewshot/mmlu_world_religions.yaml' 2024-12-17T11:00:18,108 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu.yaml' 2024-12-17T11:00:18,110 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/_mmlu_flan_cot_zeroshot_template_yaml' 2024-12-17T11:00:18,111 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_abstract_algebra.yaml' 2024-12-17T11:00:18,112 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_anatomy.yaml' 2024-12-17T11:00:18,113 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_astronomy.yaml' 2024-12-17T11:00:18,114 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_business_ethics.yaml' 2024-12-17T11:00:18,116 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_clinical_knowledge.yaml' 2024-12-17T11:00:18,117 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_biology.yaml' 2024-12-17T11:00:18,118 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_chemistry.yaml' 2024-12-17T11:00:18,119 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_computer_science.yaml' 2024-12-17T11:00:18,120 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_mathematics.yaml' 2024-12-17T11:00:18,121 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_medicine.yaml' 2024-12-17T11:00:18,123 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_college_physics.yaml' 2024-12-17T11:00:18,124 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_computer_security.yaml' 2024-12-17T11:00:18,125 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_conceptual_physics.yaml' 2024-12-17T11:00:18,126 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_econometrics.yaml' 2024-12-17T11:00:18,127 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_electrical_engineering.yaml' 2024-12-17T11:00:18,128 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_elementary_mathematics.yaml' 2024-12-17T11:00:18,129 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_formal_logic.yaml' 2024-12-17T11:00:18,130 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_global_facts.yaml' 2024-12-17T11:00:18,132 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_biology.yaml' 2024-12-17T11:00:18,133 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_chemistry.yaml' 2024-12-17T11:00:18,134 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_computer_science.yaml' 2024-12-17T11:00:18,135 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_european_history.yaml' 2024-12-17T11:00:18,136 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_geography.yaml' 2024-12-17T11:00:18,137 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_government_and_politics.yaml' 2024-12-17T11:00:18,138 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_macroeconomics.yaml' 2024-12-17T11:00:18,140 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_mathematics.yaml' 2024-12-17T11:00:18,141 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_microeconomics.yaml' 2024-12-17T11:00:18,142 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_physics.yaml' 2024-12-17T11:00:18,143 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_psychology.yaml' 2024-12-17T11:00:18,144 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_statistics.yaml' 2024-12-17T11:00:18,145 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_us_history.yaml' 2024-12-17T11:00:18,146 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_high_school_world_history.yaml' 2024-12-17T11:00:18,148 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_aging.yaml' 2024-12-17T11:00:18,149 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_human_sexuality.yaml' 2024-12-17T11:00:18,150 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_international_law.yaml' 2024-12-17T11:00:18,151 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_jurisprudence.yaml' 2024-12-17T11:00:18,152 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_logical_fallacies.yaml' 2024-12-17T11:00:18,154 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_machine_learning.yaml' 2024-12-17T11:00:18,155 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_management.yaml' 2024-12-17T11:00:18,156 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_marketing.yaml' 2024-12-17T11:00:18,157 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_medical_genetics.yaml' 2024-12-17T11:00:18,158 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_miscellaneous.yaml' 2024-12-17T11:00:18,159 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_disputes.yaml' 2024-12-17T11:00:18,161 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_moral_scenarios.yaml' 2024-12-17T11:00:18,162 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_nutrition.yaml' 2024-12-17T11:00:18,163 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_philosophy.yaml' 2024-12-17T11:00:18,164 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_prehistory.yaml' 2024-12-17T11:00:18,165 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_accounting.yaml' 2024-12-17T11:00:18,167 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_law.yaml' 2024-12-17T11:00:18,168 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_medicine.yaml' 2024-12-17T11:00:18,169 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_professional_psychology.yaml' 2024-12-17T11:00:18,170 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_public_relations.yaml' 2024-12-17T11:00:18,171 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_security_studies.yaml' 2024-12-17T11:00:18,172 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_sociology.yaml' 2024-12-17T11:00:18,173 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_us_foreign_policy.yaml' 2024-12-17T11:00:18,174 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_virology.yaml' 2024-12-17T11:00:18,175 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/mmlu_world_religions.yaml' 2024-12-17T11:00:18,177 adding 'lm_eval/tasks/mmlu/flan_cot_zeroshot/utils.py' 2024-12-17T11:00:18,179 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu.yaml' 2024-12-17T11:00:18,181 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/_mmlu_flan_generative_template_yaml' 2024-12-17T11:00:18,182 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_abstract_algebra.yaml' 2024-12-17T11:00:18,183 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_anatomy.yaml' 2024-12-17T11:00:18,184 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_astronomy.yaml' 2024-12-17T11:00:18,185 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_business_ethics.yaml' 2024-12-17T11:00:18,186 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_clinical_knowledge.yaml' 2024-12-17T11:00:18,187 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_biology.yaml' 2024-12-17T11:00:18,188 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_chemistry.yaml' 2024-12-17T11:00:18,189 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_computer_science.yaml' 2024-12-17T11:00:18,191 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_mathematics.yaml' 2024-12-17T11:00:18,192 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_medicine.yaml' 2024-12-17T11:00:18,193 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_college_physics.yaml' 2024-12-17T11:00:18,194 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_computer_security.yaml' 2024-12-17T11:00:18,195 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_conceptual_physics.yaml' 2024-12-17T11:00:18,196 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_econometrics.yaml' 2024-12-17T11:00:18,197 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_electrical_engineering.yaml' 2024-12-17T11:00:18,199 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_elementary_mathematics.yaml' 2024-12-17T11:00:18,200 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_formal_logic.yaml' 2024-12-17T11:00:18,201 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_global_facts.yaml' 2024-12-17T11:00:18,202 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_biology.yaml' 2024-12-17T11:00:18,203 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_chemistry.yaml' 2024-12-17T11:00:18,204 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_computer_science.yaml' 2024-12-17T11:00:18,206 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_european_history.yaml' 2024-12-17T11:00:18,207 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_geography.yaml' 2024-12-17T11:00:18,208 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_government_and_politics.yaml' 2024-12-17T11:00:18,209 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_macroeconomics.yaml' 2024-12-17T11:00:18,210 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_mathematics.yaml' 2024-12-17T11:00:18,212 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_microeconomics.yaml' 2024-12-17T11:00:18,213 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_physics.yaml' 2024-12-17T11:00:18,214 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_psychology.yaml' 2024-12-17T11:00:18,216 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_statistics.yaml' 2024-12-17T11:00:18,217 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_us_history.yaml' 2024-12-17T11:00:18,218 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_high_school_world_history.yaml' 2024-12-17T11:00:18,219 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_aging.yaml' 2024-12-17T11:00:18,220 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_human_sexuality.yaml' 2024-12-17T11:00:18,221 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_international_law.yaml' 2024-12-17T11:00:18,223 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_jurisprudence.yaml' 2024-12-17T11:00:18,224 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_logical_fallacies.yaml' 2024-12-17T11:00:18,226 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_machine_learning.yaml' 2024-12-17T11:00:18,227 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_management.yaml' 2024-12-17T11:00:18,228 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_marketing.yaml' 2024-12-17T11:00:18,229 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_medical_genetics.yaml' 2024-12-17T11:00:18,230 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_miscellaneous.yaml' 2024-12-17T11:00:18,231 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_disputes.yaml' 2024-12-17T11:00:18,232 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_moral_scenarios.yaml' 2024-12-17T11:00:18,234 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_nutrition.yaml' 2024-12-17T11:00:18,235 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_philosophy.yaml' 2024-12-17T11:00:18,236 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_prehistory.yaml' 2024-12-17T11:00:18,237 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_accounting.yaml' 2024-12-17T11:00:18,238 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_law.yaml' 2024-12-17T11:00:18,239 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_medicine.yaml' 2024-12-17T11:00:18,240 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_professional_psychology.yaml' 2024-12-17T11:00:18,241 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_public_relations.yaml' 2024-12-17T11:00:18,243 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_security_studies.yaml' 2024-12-17T11:00:18,244 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_sociology.yaml' 2024-12-17T11:00:18,245 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_us_foreign_policy.yaml' 2024-12-17T11:00:18,246 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_virology.yaml' 2024-12-17T11:00:18,247 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/mmlu_world_religions.yaml' 2024-12-17T11:00:18,249 adding 'lm_eval/tasks/mmlu/flan_n_shot/generative/utils.py' 2024-12-17T11:00:18,251 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu.yaml' 2024-12-17T11:00:18,252 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/_mmlu_flan_loglikelihood_template_yaml' 2024-12-17T11:00:18,254 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_abstract_algebra.yaml' 2024-12-17T11:00:18,255 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_anatomy.yaml' 2024-12-17T11:00:18,256 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_astronomy.yaml' 2024-12-17T11:00:18,257 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_business_ethics.yaml' 2024-12-17T11:00:18,259 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_clinical_knowledge.yaml' 2024-12-17T11:00:18,260 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_biology.yaml' 2024-12-17T11:00:18,261 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_chemistry.yaml' 2024-12-17T11:00:18,263 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_computer_science.yaml' 2024-12-17T11:00:18,264 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_mathematics.yaml' 2024-12-17T11:00:18,265 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_medicine.yaml' 2024-12-17T11:00:18,267 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_college_physics.yaml' 2024-12-17T11:00:18,268 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_computer_security.yaml' 2024-12-17T11:00:18,269 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_conceptual_physics.yaml' 2024-12-17T11:00:18,270 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_econometrics.yaml' 2024-12-17T11:00:18,271 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_electrical_engineering.yaml' 2024-12-17T11:00:18,272 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_elementary_mathematics.yaml' 2024-12-17T11:00:18,273 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_formal_logic.yaml' 2024-12-17T11:00:18,275 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_global_facts.yaml' 2024-12-17T11:00:18,276 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_biology.yaml' 2024-12-17T11:00:18,277 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_chemistry.yaml' 2024-12-17T11:00:18,278 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_computer_science.yaml' 2024-12-17T11:00:18,279 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_european_history.yaml' 2024-12-17T11:00:18,280 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_geography.yaml' 2024-12-17T11:00:18,282 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_government_and_politics.yaml' 2024-12-17T11:00:18,283 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_macroeconomics.yaml' 2024-12-17T11:00:18,284 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_mathematics.yaml' 2024-12-17T11:00:18,285 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_microeconomics.yaml' 2024-12-17T11:00:18,286 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_physics.yaml' 2024-12-17T11:00:18,287 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_psychology.yaml' 2024-12-17T11:00:18,289 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_statistics.yaml' 2024-12-17T11:00:18,290 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_us_history.yaml' 2024-12-17T11:00:18,291 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_high_school_world_history.yaml' 2024-12-17T11:00:18,292 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_aging.yaml' 2024-12-17T11:00:18,293 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_human_sexuality.yaml' 2024-12-17T11:00:18,295 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_international_law.yaml' 2024-12-17T11:00:18,296 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_jurisprudence.yaml' 2024-12-17T11:00:18,297 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_logical_fallacies.yaml' 2024-12-17T11:00:18,298 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_machine_learning.yaml' 2024-12-17T11:00:18,299 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_management.yaml' 2024-12-17T11:00:18,300 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_marketing.yaml' 2024-12-17T11:00:18,301 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_medical_genetics.yaml' 2024-12-17T11:00:18,303 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_miscellaneous.yaml' 2024-12-17T11:00:18,304 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_disputes.yaml' 2024-12-17T11:00:18,305 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_moral_scenarios.yaml' 2024-12-17T11:00:18,306 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_nutrition.yaml' 2024-12-17T11:00:18,307 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_philosophy.yaml' 2024-12-17T11:00:18,309 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_prehistory.yaml' 2024-12-17T11:00:18,310 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_accounting.yaml' 2024-12-17T11:00:18,311 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_law.yaml' 2024-12-17T11:00:18,312 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_medicine.yaml' 2024-12-17T11:00:18,313 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_professional_psychology.yaml' 2024-12-17T11:00:18,314 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_public_relations.yaml' 2024-12-17T11:00:18,315 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_security_studies.yaml' 2024-12-17T11:00:18,316 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_sociology.yaml' 2024-12-17T11:00:18,318 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_us_foreign_policy.yaml' 2024-12-17T11:00:18,319 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_virology.yaml' 2024-12-17T11:00:18,320 adding 'lm_eval/tasks/mmlu/flan_n_shot/loglikelihood/mmlu_world_religions.yaml' 2024-12-17T11:00:18,323 adding 'lm_eval/tasks/mmlu/generative/_default_template_yaml' 2024-12-17T11:00:18,324 adding 'lm_eval/tasks/mmlu/generative/_mmlu.yaml' 2024-12-17T11:00:18,325 adding 'lm_eval/tasks/mmlu/generative/mmlu_abstract_algebra.yaml' 2024-12-17T11:00:18,326 adding 'lm_eval/tasks/mmlu/generative/mmlu_anatomy.yaml' 2024-12-17T11:00:18,327 adding 'lm_eval/tasks/mmlu/generative/mmlu_astronomy.yaml' 2024-12-17T11:00:18,329 adding 'lm_eval/tasks/mmlu/generative/mmlu_business_ethics.yaml' 2024-12-17T11:00:18,330 adding 'lm_eval/tasks/mmlu/generative/mmlu_clinical_knowledge.yaml' 2024-12-17T11:00:18,331 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_biology.yaml' 2024-12-17T11:00:18,332 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_chemistry.yaml' 2024-12-17T11:00:18,334 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_computer_science.yaml' 2024-12-17T11:00:18,335 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_mathematics.yaml' 2024-12-17T11:00:18,336 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_medicine.yaml' 2024-12-17T11:00:18,338 adding 'lm_eval/tasks/mmlu/generative/mmlu_college_physics.yaml' 2024-12-17T11:00:18,339 adding 'lm_eval/tasks/mmlu/generative/mmlu_computer_security.yaml' 2024-12-17T11:00:18,340 adding 'lm_eval/tasks/mmlu/generative/mmlu_conceptual_physics.yaml' 2024-12-17T11:00:18,341 adding 'lm_eval/tasks/mmlu/generative/mmlu_econometrics.yaml' 2024-12-17T11:00:18,342 adding 'lm_eval/tasks/mmlu/generative/mmlu_electrical_engineering.yaml' 2024-12-17T11:00:18,343 adding 'lm_eval/tasks/mmlu/generative/mmlu_elementary_mathematics.yaml' 2024-12-17T11:00:18,345 adding 'lm_eval/tasks/mmlu/generative/mmlu_formal_logic.yaml' 2024-12-17T11:00:18,346 adding 'lm_eval/tasks/mmlu/generative/mmlu_global_facts.yaml' 2024-12-17T11:00:18,347 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_biology.yaml' 2024-12-17T11:00:18,348 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_chemistry.yaml' 2024-12-17T11:00:18,349 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_computer_science.yaml' 2024-12-17T11:00:18,351 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_european_history.yaml' 2024-12-17T11:00:18,352 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_geography.yaml' 2024-12-17T11:00:18,353 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_government_and_politics.yaml' 2024-12-17T11:00:18,354 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_macroeconomics.yaml' 2024-12-17T11:00:18,355 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_mathematics.yaml' 2024-12-17T11:00:18,357 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_microeconomics.yaml' 2024-12-17T11:00:18,358 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_physics.yaml' 2024-12-17T11:00:18,359 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_psychology.yaml' 2024-12-17T11:00:18,360 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_statistics.yaml' 2024-12-17T11:00:18,361 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_us_history.yaml' 2024-12-17T11:00:18,362 adding 'lm_eval/tasks/mmlu/generative/mmlu_high_school_world_history.yaml' 2024-12-17T11:00:18,364 adding 'lm_eval/tasks/mmlu/generative/mmlu_human_aging.yaml' 2024-12-17T11:00:18,365 adding 'lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml' 2024-12-17T11:00:18,366 adding 'lm_eval/tasks/mmlu/generative/mmlu_international_law.yaml' 2024-12-17T11:00:18,367 adding 'lm_eval/tasks/mmlu/generative/mmlu_jurisprudence.yaml' 2024-12-17T11:00:18,368 adding 'lm_eval/tasks/mmlu/generative/mmlu_logical_fallacies.yaml' 2024-12-17T11:00:18,369 adding 'lm_eval/tasks/mmlu/generative/mmlu_machine_learning.yaml' 2024-12-17T11:00:18,371 adding 'lm_eval/tasks/mmlu/generative/mmlu_management.yaml' 2024-12-17T11:00:18,372 adding 'lm_eval/tasks/mmlu/generative/mmlu_marketing.yaml' 2024-12-17T11:00:18,373 adding 'lm_eval/tasks/mmlu/generative/mmlu_medical_genetics.yaml' 2024-12-17T11:00:18,374 adding 'lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml' 2024-12-17T11:00:18,375 adding 'lm_eval/tasks/mmlu/generative/mmlu_moral_disputes.yaml' 2024-12-17T11:00:18,376 adding 'lm_eval/tasks/mmlu/generative/mmlu_moral_scenarios.yaml' 2024-12-17T11:00:18,378 adding 'lm_eval/tasks/mmlu/generative/mmlu_nutrition.yaml' 2024-12-17T11:00:18,379 adding 'lm_eval/tasks/mmlu/generative/mmlu_philosophy.yaml' 2024-12-17T11:00:18,380 adding 'lm_eval/tasks/mmlu/generative/mmlu_prehistory.yaml' 2024-12-17T11:00:18,381 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_accounting.yaml' 2024-12-17T11:00:18,382 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_law.yaml' 2024-12-17T11:00:18,383 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_medicine.yaml' 2024-12-17T11:00:18,384 adding 'lm_eval/tasks/mmlu/generative/mmlu_professional_psychology.yaml' 2024-12-17T11:00:18,385 adding 'lm_eval/tasks/mmlu/generative/mmlu_public_relations.yaml' 2024-12-17T11:00:18,387 adding 'lm_eval/tasks/mmlu/generative/mmlu_security_studies.yaml' 2024-12-17T11:00:18,388 adding 'lm_eval/tasks/mmlu/generative/mmlu_sociology.yaml' 2024-12-17T11:00:18,389 adding 'lm_eval/tasks/mmlu/generative/mmlu_us_foreign_policy.yaml' 2024-12-17T11:00:18,390 adding 'lm_eval/tasks/mmlu/generative/mmlu_virology.yaml' 2024-12-17T11:00:18,391 adding 'lm_eval/tasks/mmlu/generative/mmlu_world_religions.yaml' 2024-12-17T11:00:18,394 adding 'lm_eval/tasks/mmlu_pro/README.md' 2024-12-17T11:00:18,395 adding 'lm_eval/tasks/mmlu_pro/_default_template_yaml' 2024-12-17T11:00:18,396 adding 'lm_eval/tasks/mmlu_pro/_mmlu_pro.yaml' 2024-12-17T11:00:18,397 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_biology.yaml' 2024-12-17T11:00:18,399 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_business.yaml' 2024-12-17T11:00:18,400 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_chemistry.yaml' 2024-12-17T11:00:18,401 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_computer_science.yaml' 2024-12-17T11:00:18,402 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_economics.yaml' 2024-12-17T11:00:18,403 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_engineering.yaml' 2024-12-17T11:00:18,404 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_health.yaml' 2024-12-17T11:00:18,406 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_history.yaml' 2024-12-17T11:00:18,407 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_law.yaml' 2024-12-17T11:00:18,408 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_math.yaml' 2024-12-17T11:00:18,409 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_other.yaml' 2024-12-17T11:00:18,411 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_philosophy.yaml' 2024-12-17T11:00:18,412 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_physics.yaml' 2024-12-17T11:00:18,413 adding 'lm_eval/tasks/mmlu_pro/mmlu_pro_psychology.yaml' 2024-12-17T11:00:18,415 adding 'lm_eval/tasks/mmlu_pro/utils.py' 2024-12-17T11:00:18,417 adding 'lm_eval/tasks/mmlusr/README.md' 2024-12-17T11:00:18,418 adding 'lm_eval/tasks/mmlusr/config.py' 2024-12-17T11:00:18,421 adding 'lm_eval/tasks/mmlusr/answer_only/_answer_only.yaml' 2024-12-17T11:00:18,422 adding 'lm_eval/tasks/mmlusr/answer_only/_mmlusr_a_yml' 2024-12-17T11:00:18,423 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_abstract_algebra.yaml' 2024-12-17T11:00:18,424 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_anatomy.yaml' 2024-12-17T11:00:18,425 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_astronomy.yaml' 2024-12-17T11:00:18,426 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_business_ethics.yaml' 2024-12-17T11:00:18,427 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_clinical_knowledge.yaml' 2024-12-17T11:00:18,428 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_biology.yaml' 2024-12-17T11:00:18,429 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_chemistry.yaml' 2024-12-17T11:00:18,431 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_computer_science.yaml' 2024-12-17T11:00:18,432 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_mathematics.yaml' 2024-12-17T11:00:18,433 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_medicine.yaml' 2024-12-17T11:00:18,434 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_college_physics.yaml' 2024-12-17T11:00:18,435 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_computer_security.yaml' 2024-12-17T11:00:18,436 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_conceptual_physics.yaml' 2024-12-17T11:00:18,437 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_econometrics.yaml' 2024-12-17T11:00:18,438 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_electrical_engineering.yaml' 2024-12-17T11:00:18,439 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_elementary_mathematics.yaml' 2024-12-17T11:00:18,440 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_formal_logic.yaml' 2024-12-17T11:00:18,442 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_global_facts.yaml' 2024-12-17T11:00:18,443 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_biology.yaml' 2024-12-17T11:00:18,444 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_chemistry.yaml' 2024-12-17T11:00:18,445 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_computer_science.yaml' 2024-12-17T11:00:18,446 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_european_history.yaml' 2024-12-17T11:00:18,448 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_geography.yaml' 2024-12-17T11:00:18,449 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_government_and_politics.yaml' 2024-12-17T11:00:18,450 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_macroeconomics.yaml' 2024-12-17T11:00:18,451 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_mathematics.yaml' 2024-12-17T11:00:18,452 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_microeconomics.yaml' 2024-12-17T11:00:18,453 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_physics.yaml' 2024-12-17T11:00:18,455 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_psychology.yaml' 2024-12-17T11:00:18,456 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_statistics.yaml' 2024-12-17T11:00:18,458 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_us_history.yaml' 2024-12-17T11:00:18,459 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_high_school_world_history.yaml' 2024-12-17T11:00:18,460 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_human_aging.yaml' 2024-12-17T11:00:18,461 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_human_sexuality.yaml' 2024-12-17T11:00:18,463 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_international_law.yaml' 2024-12-17T11:00:18,464 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_jurisprudence.yaml' 2024-12-17T11:00:18,465 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_logical_fallacies.yaml' 2024-12-17T11:00:18,466 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_machine_learning.yaml' 2024-12-17T11:00:18,467 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_management.yaml' 2024-12-17T11:00:18,468 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_marketing.yaml' 2024-12-17T11:00:18,469 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_medical_genetics.yaml' 2024-12-17T11:00:18,470 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_miscellaneous.yaml' 2024-12-17T11:00:18,471 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_moral_disputes.yaml' 2024-12-17T11:00:18,472 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_moral_scenarios.yaml' 2024-12-17T11:00:18,474 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_nutrition.yaml' 2024-12-17T11:00:18,475 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_philosophy.yaml' 2024-12-17T11:00:18,476 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_prehistory.yaml' 2024-12-17T11:00:18,477 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_accounting.yaml' 2024-12-17T11:00:18,478 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_law.yaml' 2024-12-17T11:00:18,479 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_medicine.yaml' 2024-12-17T11:00:18,481 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_professional_psychology.yaml' 2024-12-17T11:00:18,482 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_public_relations.yaml' 2024-12-17T11:00:18,483 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_security_studies.yaml' 2024-12-17T11:00:18,484 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_sociology.yaml' 2024-12-17T11:00:18,485 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_us_foreign_policy.yaml' 2024-12-17T11:00:18,487 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_virology.yaml' 2024-12-17T11:00:18,488 adding 'lm_eval/tasks/mmlusr/answer_only/answer_only_world_religions.yaml' 2024-12-17T11:00:18,489 adding 'lm_eval/tasks/mmlusr/answer_only/utils.py' 2024-12-17T11:00:18,492 adding 'lm_eval/tasks/mmlusr/question_and_answer/_mmlusr_qna_yml' 2024-12-17T11:00:18,493 adding 'lm_eval/tasks/mmlusr/question_and_answer/_question_and_answer.yaml' 2024-12-17T11:00:18,494 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_abstract_algebra.yaml' 2024-12-17T11:00:18,495 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_anatomy.yaml' 2024-12-17T11:00:18,496 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_astronomy.yaml' 2024-12-17T11:00:18,498 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_business_ethics.yaml' 2024-12-17T11:00:18,499 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_clinical_knowledge.yaml' 2024-12-17T11:00:18,500 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_biology.yaml' 2024-12-17T11:00:18,501 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_chemistry.yaml' 2024-12-17T11:00:18,502 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_computer_science.yaml' 2024-12-17T11:00:18,504 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_mathematics.yaml' 2024-12-17T11:00:18,505 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_medicine.yaml' 2024-12-17T11:00:18,506 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_college_physics.yaml' 2024-12-17T11:00:18,507 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_computer_security.yaml' 2024-12-17T11:00:18,508 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_conceptual_physics.yaml' 2024-12-17T11:00:18,509 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_econometrics.yaml' 2024-12-17T11:00:18,511 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_electrical_engineering.yaml' 2024-12-17T11:00:18,512 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_elementary_mathematics.yaml' 2024-12-17T11:00:18,513 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_formal_logic.yaml' 2024-12-17T11:00:18,514 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_global_facts.yaml' 2024-12-17T11:00:18,515 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_biology.yaml' 2024-12-17T11:00:18,516 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_chemistry.yaml' 2024-12-17T11:00:18,517 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_computer_science.yaml' 2024-12-17T11:00:18,519 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_european_history.yaml' 2024-12-17T11:00:18,520 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_geography.yaml' 2024-12-17T11:00:18,521 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_government_and_politics.yaml' 2024-12-17T11:00:18,522 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_macroeconomics.yaml' 2024-12-17T11:00:18,523 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_mathematics.yaml' 2024-12-17T11:00:18,524 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_microeconomics.yaml' 2024-12-17T11:00:18,525 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_physics.yaml' 2024-12-17T11:00:18,527 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_psychology.yaml' 2024-12-17T11:00:18,528 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_statistics.yaml' 2024-12-17T11:00:18,529 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_us_history.yaml' 2024-12-17T11:00:18,530 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_high_school_world_history.yaml' 2024-12-17T11:00:18,531 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_aging.yaml' 2024-12-17T11:00:18,532 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_human_sexuality.yaml' 2024-12-17T11:00:18,533 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_international_law.yaml' 2024-12-17T11:00:18,535 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_jurisprudence.yaml' 2024-12-17T11:00:18,536 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_logical_fallacies.yaml' 2024-12-17T11:00:18,537 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_machine_learning.yaml' 2024-12-17T11:00:18,538 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_management.yaml' 2024-12-17T11:00:18,539 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_marketing.yaml' 2024-12-17T11:00:18,540 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_medical_genetics.yaml' 2024-12-17T11:00:18,542 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_miscellaneous.yaml' 2024-12-17T11:00:18,543 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_disputes.yaml' 2024-12-17T11:00:18,544 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_moral_scenarios.yaml' 2024-12-17T11:00:18,545 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_nutrition.yaml' 2024-12-17T11:00:18,546 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_philosophy.yaml' 2024-12-17T11:00:18,548 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_prehistory.yaml' 2024-12-17T11:00:18,549 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_accounting.yaml' 2024-12-17T11:00:18,551 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_law.yaml' 2024-12-17T11:00:18,552 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_medicine.yaml' 2024-12-17T11:00:18,553 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_professional_psychology.yaml' 2024-12-17T11:00:18,555 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_public_relations.yaml' 2024-12-17T11:00:18,556 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_security_studies.yaml' 2024-12-17T11:00:18,557 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_sociology.yaml' 2024-12-17T11:00:18,558 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_us_foreign_policy.yaml' 2024-12-17T11:00:18,559 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_virology.yaml' 2024-12-17T11:00:18,561 adding 'lm_eval/tasks/mmlusr/question_and_answer/question_and_answer_world_religions.yaml' 2024-12-17T11:00:18,562 adding 'lm_eval/tasks/mmlusr/question_and_answer/utils.py' 2024-12-17T11:00:18,564 adding 'lm_eval/tasks/mmlusr/question_only/_mmlusr_q_yml' 2024-12-17T11:00:18,566 adding 'lm_eval/tasks/mmlusr/question_only/_question_only.yaml' 2024-12-17T11:00:18,567 adding 'lm_eval/tasks/mmlusr/question_only/question_only_abstract_algebra.yaml' 2024-12-17T11:00:18,568 adding 'lm_eval/tasks/mmlusr/question_only/question_only_anatomy.yaml' 2024-12-17T11:00:18,569 adding 'lm_eval/tasks/mmlusr/question_only/question_only_astronomy.yaml' 2024-12-17T11:00:18,570 adding 'lm_eval/tasks/mmlusr/question_only/question_only_business_ethics.yaml' 2024-12-17T11:00:18,571 adding 'lm_eval/tasks/mmlusr/question_only/question_only_clinical_knowledge.yaml' 2024-12-17T11:00:18,573 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_biology.yaml' 2024-12-17T11:00:18,574 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_chemistry.yaml' 2024-12-17T11:00:18,576 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_computer_science.yaml' 2024-12-17T11:00:18,577 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_mathematics.yaml' 2024-12-17T11:00:18,578 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_medicine.yaml' 2024-12-17T11:00:18,579 adding 'lm_eval/tasks/mmlusr/question_only/question_only_college_physics.yaml' 2024-12-17T11:00:18,581 adding 'lm_eval/tasks/mmlusr/question_only/question_only_computer_security.yaml' 2024-12-17T11:00:18,582 adding 'lm_eval/tasks/mmlusr/question_only/question_only_conceptual_physics.yaml' 2024-12-17T11:00:18,583 adding 'lm_eval/tasks/mmlusr/question_only/question_only_econometrics.yaml' 2024-12-17T11:00:18,584 adding 'lm_eval/tasks/mmlusr/question_only/question_only_electrical_engineering.yaml' 2024-12-17T11:00:18,586 adding 'lm_eval/tasks/mmlusr/question_only/question_only_elementary_mathematics.yaml' 2024-12-17T11:00:18,587 adding 'lm_eval/tasks/mmlusr/question_only/question_only_formal_logic.yaml' 2024-12-17T11:00:18,588 adding 'lm_eval/tasks/mmlusr/question_only/question_only_global_facts.yaml' 2024-12-17T11:00:18,589 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_biology.yaml' 2024-12-17T11:00:18,591 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_chemistry.yaml' 2024-12-17T11:00:18,592 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_computer_science.yaml' 2024-12-17T11:00:18,593 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_european_history.yaml' 2024-12-17T11:00:18,594 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_geography.yaml' 2024-12-17T11:00:18,596 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_government_and_politics.yaml' 2024-12-17T11:00:18,597 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_macroeconomics.yaml' 2024-12-17T11:00:18,598 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_mathematics.yaml' 2024-12-17T11:00:18,599 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_microeconomics.yaml' 2024-12-17T11:00:18,600 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_physics.yaml' 2024-12-17T11:00:18,602 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_psychology.yaml' 2024-12-17T11:00:18,603 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_statistics.yaml' 2024-12-17T11:00:18,604 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_us_history.yaml' 2024-12-17T11:00:18,605 adding 'lm_eval/tasks/mmlusr/question_only/question_only_high_school_world_history.yaml' 2024-12-17T11:00:18,606 adding 'lm_eval/tasks/mmlusr/question_only/question_only_human_aging.yaml' 2024-12-17T11:00:18,607 adding 'lm_eval/tasks/mmlusr/question_only/question_only_human_sexuality.yaml' 2024-12-17T11:00:18,608 adding 'lm_eval/tasks/mmlusr/question_only/question_only_international_law.yaml' 2024-12-17T11:00:18,609 adding 'lm_eval/tasks/mmlusr/question_only/question_only_jurisprudence.yaml' 2024-12-17T11:00:18,610 adding 'lm_eval/tasks/mmlusr/question_only/question_only_logical_fallacies.yaml' 2024-12-17T11:00:18,612 adding 'lm_eval/tasks/mmlusr/question_only/question_only_machine_learning.yaml' 2024-12-17T11:00:18,613 adding 'lm_eval/tasks/mmlusr/question_only/question_only_management.yaml' 2024-12-17T11:00:18,614 adding 'lm_eval/tasks/mmlusr/question_only/question_only_marketing.yaml' 2024-12-17T11:00:18,615 adding 'lm_eval/tasks/mmlusr/question_only/question_only_medical_genetics.yaml' 2024-12-17T11:00:18,616 adding 'lm_eval/tasks/mmlusr/question_only/question_only_miscellaneous.yaml' 2024-12-17T11:00:18,619 adding 'lm_eval/tasks/mmlusr/question_only/question_only_moral_disputes.yaml' 2024-12-17T11:00:18,621 adding 'lm_eval/tasks/mmlusr/question_only/question_only_moral_scenarios.yaml' 2024-12-17T11:00:18,623 adding 'lm_eval/tasks/mmlusr/question_only/question_only_nutrition.yaml' 2024-12-17T11:00:18,625 adding 'lm_eval/tasks/mmlusr/question_only/question_only_philosophy.yaml' 2024-12-17T11:00:18,627 adding 'lm_eval/tasks/mmlusr/question_only/question_only_prehistory.yaml' 2024-12-17T11:00:18,628 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_accounting.yaml' 2024-12-17T11:00:18,629 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_law.yaml' 2024-12-17T11:00:18,630 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_medicine.yaml' 2024-12-17T11:00:18,632 adding 'lm_eval/tasks/mmlusr/question_only/question_only_professional_psychology.yaml' 2024-12-17T11:00:18,633 adding 'lm_eval/tasks/mmlusr/question_only/question_only_public_relations.yaml' 2024-12-17T11:00:18,634 adding 'lm_eval/tasks/mmlusr/question_only/question_only_security_studies.yaml' 2024-12-17T11:00:18,635 adding 'lm_eval/tasks/mmlusr/question_only/question_only_sociology.yaml' 2024-12-17T11:00:18,636 adding 'lm_eval/tasks/mmlusr/question_only/question_only_us_foreign_policy.yaml' 2024-12-17T11:00:18,638 adding 'lm_eval/tasks/mmlusr/question_only/question_only_virology.yaml' 2024-12-17T11:00:18,639 adding 'lm_eval/tasks/mmlusr/question_only/question_only_world_religions.yaml' 2024-12-17T11:00:18,640 adding 'lm_eval/tasks/mmlusr/question_only/utils.py' 2024-12-17T11:00:18,647 adding 'lm_eval/tasks/mmmu/README.md' 2024-12-17T11:00:18,652 adding 'lm_eval/tasks/mmmu/_art_and_design.yaml' 2024-12-17T11:00:18,656 adding 'lm_eval/tasks/mmmu/_business.yaml' 2024-12-17T11:00:18,662 adding 'lm_eval/tasks/mmmu/_health_and_medicine.yaml' 2024-12-17T11:00:18,667 adding 'lm_eval/tasks/mmmu/_humanities_and_social_sciences.yaml' 2024-12-17T11:00:18,671 adding 'lm_eval/tasks/mmmu/_mmmu.yaml' 2024-12-17T11:00:18,676 adding 'lm_eval/tasks/mmmu/_science.yaml' 2024-12-17T11:00:18,680 adding 'lm_eval/tasks/mmmu/_tech_and_engineering.yaml' 2024-12-17T11:00:18,683 adding 'lm_eval/tasks/mmmu/_template_yaml' 2024-12-17T11:00:18,687 adding 'lm_eval/tasks/mmmu/mmmu_accounting.yaml' 2024-12-17T11:00:18,690 adding 'lm_eval/tasks/mmmu/mmmu_agriculture.yaml' 2024-12-17T11:00:18,693 adding 'lm_eval/tasks/mmmu/mmmu_architecture_and_engineering.yaml' 2024-12-17T11:00:18,695 adding 'lm_eval/tasks/mmmu/mmmu_art.yaml' 2024-12-17T11:00:18,698 adding 'lm_eval/tasks/mmmu/mmmu_art_theory.yaml' 2024-12-17T11:00:18,700 adding 'lm_eval/tasks/mmmu/mmmu_basic_medical_science.yaml' 2024-12-17T11:00:18,703 adding 'lm_eval/tasks/mmmu/mmmu_biology.yaml' 2024-12-17T11:00:18,705 adding 'lm_eval/tasks/mmmu/mmmu_chemistry.yaml' 2024-12-17T11:00:18,706 adding 'lm_eval/tasks/mmmu/mmmu_clinical_medicine.yaml' 2024-12-17T11:00:18,707 adding 'lm_eval/tasks/mmmu/mmmu_computer_science.yaml' 2024-12-17T11:00:18,708 adding 'lm_eval/tasks/mmmu/mmmu_design.yaml' 2024-12-17T11:00:18,709 adding 'lm_eval/tasks/mmmu/mmmu_diagnostics_and_laboratory_medicine.yaml' 2024-12-17T11:00:18,710 adding 'lm_eval/tasks/mmmu/mmmu_economics.yaml' 2024-12-17T11:00:18,711 adding 'lm_eval/tasks/mmmu/mmmu_electronics.yaml' 2024-12-17T11:00:18,712 adding 'lm_eval/tasks/mmmu/mmmu_energy_and_power.yaml' 2024-12-17T11:00:18,713 adding 'lm_eval/tasks/mmmu/mmmu_finance.yaml' 2024-12-17T11:00:18,714 adding 'lm_eval/tasks/mmmu/mmmu_geography.yaml' 2024-12-17T11:00:18,715 adding 'lm_eval/tasks/mmmu/mmmu_history.yaml' 2024-12-17T11:00:18,716 adding 'lm_eval/tasks/mmmu/mmmu_literature.yaml' 2024-12-17T11:00:18,718 adding 'lm_eval/tasks/mmmu/mmmu_manage.yaml' 2024-12-17T11:00:18,718 adding 'lm_eval/tasks/mmmu/mmmu_marketing.yaml' 2024-12-17T11:00:18,720 adding 'lm_eval/tasks/mmmu/mmmu_materials.yaml' 2024-12-17T11:00:18,721 adding 'lm_eval/tasks/mmmu/mmmu_math.yaml' 2024-12-17T11:00:18,722 adding 'lm_eval/tasks/mmmu/mmmu_mechanical_engineering.yaml' 2024-12-17T11:00:18,723 adding 'lm_eval/tasks/mmmu/mmmu_music.yaml' 2024-12-17T11:00:18,724 adding 'lm_eval/tasks/mmmu/mmmu_pharmacy.yaml' 2024-12-17T11:00:18,725 adding 'lm_eval/tasks/mmmu/mmmu_physics.yaml' 2024-12-17T11:00:18,727 adding 'lm_eval/tasks/mmmu/mmmu_psychology.yaml' 2024-12-17T11:00:18,728 adding 'lm_eval/tasks/mmmu/mmmu_public_health.yaml' 2024-12-17T11:00:18,729 adding 'lm_eval/tasks/mmmu/mmmu_sociology.yaml' 2024-12-17T11:00:18,731 adding 'lm_eval/tasks/mmmu/utils.py' 2024-12-17T11:00:18,734 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/_generate_configs.py' 2024-12-17T11:00:18,735 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/_template_yaml' 2024-12-17T11:00:18,737 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-itself.yaml' 2024-12-17T11:00:18,738 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-ais.yaml' 2024-12-17T11:00:18,739 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-coordinate-other-versions.yaml' 2024-12-17T11:00:18,740 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-less-HHH.yaml' 2024-12-17T11:00:18,741 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-more-HHH.yaml' 2024-12-17T11:00:18,743 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-corrigible-neutral-HHH.yaml' 2024-12-17T11:00:18,744 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-myopic-reward.yaml' 2024-12-17T11:00:18,745 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-one-box-tendency.yaml' 2024-12-17T11:00:18,747 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-power-seeking-inclination.yaml' 2024-12-17T11:00:18,748 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-general-ai.yaml' 2024-12-17T11:00:18,749 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-good-text-model.yaml' 2024-12-17T11:00:18,751 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-text-model.yaml' 2024-12-17T11:00:18,752 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-architecture.yaml' 2024-12-17T11:00:18,753 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-self-awareness-training-web-gpt.yaml' 2024-12-17T11:00:18,754 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-survival-instinct.yaml' 2024-12-17T11:00:18,755 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/fewshot-wealth-seeking-inclination.yaml' 2024-12-17T11:00:18,756 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-itself.yaml' 2024-12-17T11:00:18,757 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-ais.yaml' 2024-12-17T11:00:18,758 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-coordinate-other-versions.yaml' 2024-12-17T11:00:18,759 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-less-HHH.yaml' 2024-12-17T11:00:18,761 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-more-HHH.yaml' 2024-12-17T11:00:18,762 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-corrigible-neutral-HHH.yaml' 2024-12-17T11:00:18,763 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-myopic-reward.yaml' 2024-12-17T11:00:18,764 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-one-box-tendency.yaml' 2024-12-17T11:00:18,765 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-power-seeking-inclination.yaml' 2024-12-17T11:00:18,766 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-general-ai.yaml' 2024-12-17T11:00:18,767 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-good-text-model.yaml' 2024-12-17T11:00:18,769 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-text-model.yaml' 2024-12-17T11:00:18,770 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-training-architecture.yaml' 2024-12-17T11:00:18,772 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-self-awareness-web-gpt.yaml' 2024-12-17T11:00:18,773 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-survival-instinct.yaml' 2024-12-17T11:00:18,774 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/human-wealth-seeking-inclination.yaml' 2024-12-17T11:00:18,776 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-itself.yaml' 2024-12-17T11:00:18,777 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-ais.yaml' 2024-12-17T11:00:18,778 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-coordinate-other-versions.yaml' 2024-12-17T11:00:18,779 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-less-HHH.yaml' 2024-12-17T11:00:18,780 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-more-HHH.yaml' 2024-12-17T11:00:18,781 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-corrigible-neutral-HHH.yaml' 2024-12-17T11:00:18,783 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-myopic-reward.yaml' 2024-12-17T11:00:18,784 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-one-box-tendency.yaml' 2024-12-17T11:00:18,785 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-power-seeking-inclination.yaml' 2024-12-17T11:00:18,786 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-general-ai.yaml' 2024-12-17T11:00:18,788 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-good-text-model.yaml' 2024-12-17T11:00:18,790 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-text-model.yaml' 2024-12-17T11:00:18,791 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-architecture.yaml' 2024-12-17T11:00:18,792 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-nn-architecture.yaml' 2024-12-17T11:00:18,794 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-self-awareness-training-web-gpt.yaml' 2024-12-17T11:00:18,795 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-survival-instinct.yaml' 2024-12-17T11:00:18,796 adding 'lm_eval/tasks/model_written_evals/advanced_ai_risk/lm-wealth-seeking-inclination.yaml' 2024-12-17T11:00:18,800 adding 'lm_eval/tasks/model_written_evals/persona/_generate_configs.py' 2024-12-17T11:00:18,801 adding 'lm_eval/tasks/model_written_evals/persona/_template_yaml' 2024-12-17T11:00:18,802 adding 'lm_eval/tasks/model_written_evals/persona/acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml' 2024-12-17T11:00:18,804 adding 'lm_eval/tasks/model_written_evals/persona/agreeableness.yaml' 2024-12-17T11:00:18,805 adding 'lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml' 2024-12-17T11:00:18,806 adding 'lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml' 2024-12-17T11:00:18,807 adding 'lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml' 2024-12-17T11:00:18,808 adding 'lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml' 2024-12-17T11:00:18,809 adding 'lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml' 2024-12-17T11:00:18,810 adding 'lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml' 2024-12-17T11:00:18,811 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml' 2024-12-17T11:00:18,812 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml' 2024-12-17T11:00:18,813 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml' 2024-12-17T11:00:18,814 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml' 2024-12-17T11:00:18,816 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml' 2024-12-17T11:00:18,817 adding 'lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml' 2024-12-17T11:00:18,818 adding 'lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml' 2024-12-17T11:00:18,819 adding 'lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml' 2024-12-17T11:00:18,820 adding 'lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml' 2024-12-17T11:00:18,821 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml' 2024-12-17T11:00:18,823 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml' 2024-12-17T11:00:18,824 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml' 2024-12-17T11:00:18,825 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml' 2024-12-17T11:00:18,826 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml' 2024-12-17T11:00:18,827 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml' 2024-12-17T11:00:18,829 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml' 2024-12-17T11:00:18,830 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml' 2024-12-17T11:00:18,831 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml' 2024-12-17T11:00:18,832 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml' 2024-12-17T11:00:18,833 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml' 2024-12-17T11:00:18,835 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml' 2024-12-17T11:00:18,836 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml' 2024-12-17T11:00:18,837 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml' 2024-12-17T11:00:18,838 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml' 2024-12-17T11:00:18,839 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml' 2024-12-17T11:00:18,841 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml' 2024-12-17T11:00:18,842 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml' 2024-12-17T11:00:18,843 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml' 2024-12-17T11:00:18,844 adding 'lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml' 2024-12-17T11:00:18,846 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml' 2024-12-17T11:00:18,847 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml' 2024-12-17T11:00:18,848 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml' 2024-12-17T11:00:18,849 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml' 2024-12-17T11:00:18,850 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml' 2024-12-17T11:00:18,851 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml' 2024-12-17T11:00:18,852 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml' 2024-12-17T11:00:18,854 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml' 2024-12-17T11:00:18,855 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml' 2024-12-17T11:00:18,856 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml' 2024-12-17T11:00:18,857 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml' 2024-12-17T11:00:18,858 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml' 2024-12-17T11:00:18,859 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml' 2024-12-17T11:00:18,860 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml' 2024-12-17T11:00:18,862 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml' 2024-12-17T11:00:18,863 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml' 2024-12-17T11:00:18,864 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml' 2024-12-17T11:00:18,865 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml' 2024-12-17T11:00:18,866 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml' 2024-12-17T11:00:18,867 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml' 2024-12-17T11:00:18,869 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml' 2024-12-17T11:00:18,870 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml' 2024-12-17T11:00:18,871 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml' 2024-12-17T11:00:18,872 adding 'lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml' 2024-12-17T11:00:18,873 adding 'lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml' 2024-12-17T11:00:18,874 adding 'lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml' 2024-12-17T11:00:18,875 adding 'lm_eval/tasks/model_written_evals/persona/extraversion.yaml' 2024-12-17T11:00:18,877 adding 'lm_eval/tasks/model_written_evals/persona/has-disability.yaml' 2024-12-17T11:00:18,879 adding 'lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml' 2024-12-17T11:00:18,880 adding 'lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml' 2024-12-17T11:00:18,881 adding 'lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml' 2024-12-17T11:00:18,882 adding 'lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml' 2024-12-17T11:00:18,883 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml' 2024-12-17T11:00:18,884 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml' 2024-12-17T11:00:18,886 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml' 2024-12-17T11:00:18,887 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml' 2024-12-17T11:00:18,888 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml' 2024-12-17T11:00:18,889 adding 'lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml' 2024-12-17T11:00:18,890 adding 'lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml' 2024-12-17T11:00:18,891 adding 'lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml' 2024-12-17T11:00:18,892 adding 'lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml' 2024-12-17T11:00:18,893 adding 'lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml' 2024-12-17T11:00:18,894 adding 'lm_eval/tasks/model_written_evals/persona/narcissism.yaml' 2024-12-17T11:00:18,895 adding 'lm_eval/tasks/model_written_evals/persona/neuroticism.yaml' 2024-12-17T11:00:18,896 adding 'lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml' 2024-12-17T11:00:18,897 adding 'lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml' 2024-12-17T11:00:18,899 adding 'lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml' 2024-12-17T11:00:18,900 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml' 2024-12-17T11:00:18,901 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml' 2024-12-17T11:00:18,902 adding 'lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml' 2024-12-17T11:00:18,903 adding 'lm_eval/tasks/model_written_evals/persona/openness.yaml' 2024-12-17T11:00:18,904 adding 'lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml' 2024-12-17T11:00:18,905 adding 'lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml' 2024-12-17T11:00:18,907 adding 'lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml' 2024-12-17T11:00:18,908 adding 'lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml' 2024-12-17T11:00:18,909 adding 'lm_eval/tasks/model_written_evals/persona/psychopathy.yaml' 2024-12-17T11:00:18,910 adding 'lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml' 2024-12-17T11:00:18,911 adding 'lm_eval/tasks/model_written_evals/persona/risk-averse.yaml' 2024-12-17T11:00:18,912 adding 'lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml' 2024-12-17T11:00:18,913 adding 'lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml' 2024-12-17T11:00:18,915 adding 'lm_eval/tasks/model_written_evals/persona/self-replication.yaml' 2024-12-17T11:00:18,916 adding 'lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml' 2024-12-17T11:00:18,917 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml' 2024-12-17T11:00:18,918 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml' 2024-12-17T11:00:18,919 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml' 2024-12-17T11:00:18,920 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Confucianism.yaml' 2024-12-17T11:00:18,921 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Hinduism.yaml' 2024-12-17T11:00:18,923 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Islam.yaml' 2024-12-17T11:00:18,924 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Judaism.yaml' 2024-12-17T11:00:18,925 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-Taoism.yaml' 2024-12-17T11:00:18,926 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-act-utilitarianism.yaml' 2024-12-17T11:00:18,927 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-average-utilitarianism.yaml' 2024-12-17T11:00:18,928 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-cultural-relativism.yaml' 2024-12-17T11:00:18,929 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-deontology.yaml' 2024-12-17T11:00:18,930 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-moral-nihilism.yaml' 2024-12-17T11:00:18,931 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-rule-utilitarianism.yaml' 2024-12-17T11:00:18,932 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-total-utilitarianism.yaml' 2024-12-17T11:00:18,933 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-utilitarianism.yaml' 2024-12-17T11:00:18,935 adding 'lm_eval/tasks/model_written_evals/persona/subscribes-to-virtue-ethics.yaml' 2024-12-17T11:00:18,936 adding 'lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml' 2024-12-17T11:00:18,937 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml' 2024-12-17T11:00:18,938 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml' 2024-12-17T11:00:18,939 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml' 2024-12-17T11:00:18,940 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml' 2024-12-17T11:00:18,941 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml' 2024-12-17T11:00:18,942 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml' 2024-12-17T11:00:18,944 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml' 2024-12-17T11:00:18,945 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml' 2024-12-17T11:00:18,946 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml' 2024-12-17T11:00:18,947 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml' 2024-12-17T11:00:18,948 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml' 2024-12-17T11:00:18,949 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml' 2024-12-17T11:00:18,951 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml' 2024-12-17T11:00:18,952 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml' 2024-12-17T11:00:18,953 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml' 2024-12-17T11:00:18,954 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml' 2024-12-17T11:00:18,955 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml' 2024-12-17T11:00:18,956 adding 'lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml' 2024-12-17T11:00:18,958 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_nlp_survey.yaml' 2024-12-17T11:00:18,959 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_philpapers2020.yaml' 2024-12-17T11:00:18,960 adding 'lm_eval/tasks/model_written_evals/sycophancy/sycophancy_on_political_typology_quiz.yaml' 2024-12-17T11:00:18,962 adding 'lm_eval/tasks/model_written_evals/winogenerated/winogenerated.yaml' 2024-12-17T11:00:18,964 adding 'lm_eval/tasks/mutual/README.md' 2024-12-17T11:00:18,965 adding 'lm_eval/tasks/mutual/multual_plus.yaml' 2024-12-17T11:00:18,967 adding 'lm_eval/tasks/mutual/mutual.yaml' 2024-12-17T11:00:18,968 adding 'lm_eval/tasks/mutual/utils.py' 2024-12-17T11:00:18,970 adding 'lm_eval/tasks/noticia/README.md' 2024-12-17T11:00:18,971 adding 'lm_eval/tasks/noticia/noticia.yaml' 2024-12-17T11:00:18,973 adding 'lm_eval/tasks/noticia/utils.py' 2024-12-17T11:00:18,974 adding 'lm_eval/tasks/nq_open/README.md' 2024-12-17T11:00:18,975 adding 'lm_eval/tasks/nq_open/nq_open.yaml' 2024-12-17T11:00:18,978 adding 'lm_eval/tasks/okapi/arc_multilingual/README.md' 2024-12-17T11:00:18,979 adding 'lm_eval/tasks/okapi/arc_multilingual/_arc_yaml' 2024-12-17T11:00:18,980 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ar.yaml' 2024-12-17T11:00:18,981 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_bn.yaml' 2024-12-17T11:00:18,982 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ca.yaml' 2024-12-17T11:00:18,984 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_da.yaml' 2024-12-17T11:00:18,985 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_de.yaml' 2024-12-17T11:00:18,986 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_es.yaml' 2024-12-17T11:00:18,987 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_eu.yaml' 2024-12-17T11:00:18,988 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_fr.yaml' 2024-12-17T11:00:18,989 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_gu.yaml' 2024-12-17T11:00:18,990 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hi.yaml' 2024-12-17T11:00:18,991 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hr.yaml' 2024-12-17T11:00:18,993 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hu.yaml' 2024-12-17T11:00:18,994 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_hy.yaml' 2024-12-17T11:00:18,995 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_id.yaml' 2024-12-17T11:00:18,996 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_it.yaml' 2024-12-17T11:00:18,997 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_kn.yaml' 2024-12-17T11:00:18,998 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ml.yaml' 2024-12-17T11:00:19,000 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_mr.yaml' 2024-12-17T11:00:19,001 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ne.yaml' 2024-12-17T11:00:19,002 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_nl.yaml' 2024-12-17T11:00:19,003 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_pt.yaml' 2024-12-17T11:00:19,004 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ro.yaml' 2024-12-17T11:00:19,005 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ru.yaml' 2024-12-17T11:00:19,007 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sk.yaml' 2024-12-17T11:00:19,008 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sr.yaml' 2024-12-17T11:00:19,009 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_sv.yaml' 2024-12-17T11:00:19,010 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_ta.yaml' 2024-12-17T11:00:19,011 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_te.yaml' 2024-12-17T11:00:19,012 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_uk.yaml' 2024-12-17T11:00:19,013 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_vi.yaml' 2024-12-17T11:00:19,015 adding 'lm_eval/tasks/okapi/arc_multilingual/arc_zh.yaml' 2024-12-17T11:00:19,016 adding 'lm_eval/tasks/okapi/arc_multilingual/utils.py' 2024-12-17T11:00:19,018 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/README.md' 2024-12-17T11:00:19,019 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/_hellaswag_yaml' 2024-12-17T11:00:19,021 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ar.yaml' 2024-12-17T11:00:19,022 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_bn.yaml' 2024-12-17T11:00:19,023 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ca.yaml' 2024-12-17T11:00:19,024 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_da.yaml' 2024-12-17T11:00:19,025 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_de.yaml' 2024-12-17T11:00:19,026 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_es.yaml' 2024-12-17T11:00:19,027 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_eu.yaml' 2024-12-17T11:00:19,028 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_fr.yaml' 2024-12-17T11:00:19,030 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_gu.yaml' 2024-12-17T11:00:19,031 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hi.yaml' 2024-12-17T11:00:19,032 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hr.yaml' 2024-12-17T11:00:19,033 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hu.yaml' 2024-12-17T11:00:19,034 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_hy.yaml' 2024-12-17T11:00:19,035 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_id.yaml' 2024-12-17T11:00:19,036 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_it.yaml' 2024-12-17T11:00:19,037 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_kn.yaml' 2024-12-17T11:00:19,039 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ml.yaml' 2024-12-17T11:00:19,040 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_mr.yaml' 2024-12-17T11:00:19,041 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ne.yaml' 2024-12-17T11:00:19,042 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_nl.yaml' 2024-12-17T11:00:19,043 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_pt.yaml' 2024-12-17T11:00:19,044 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ro.yaml' 2024-12-17T11:00:19,045 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ru.yaml' 2024-12-17T11:00:19,046 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sk.yaml' 2024-12-17T11:00:19,047 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sr.yaml' 2024-12-17T11:00:19,048 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_sv.yaml' 2024-12-17T11:00:19,049 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_ta.yaml' 2024-12-17T11:00:19,051 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_te.yaml' 2024-12-17T11:00:19,052 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_uk.yaml' 2024-12-17T11:00:19,053 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/hellaswag_vi.yaml' 2024-12-17T11:00:19,054 adding 'lm_eval/tasks/okapi/hellaswag_multilingual/utils.py' 2024-12-17T11:00:19,056 adding 'lm_eval/tasks/okapi/mmlu_multilingual/_default_yaml' 2024-12-17T11:00:19,058 adding 'lm_eval/tasks/okapi/mmlu_multilingual/_generate_configs.py' 2024-12-17T11:00:19,059 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ar.yaml' 2024-12-17T11:00:19,060 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_bn.yaml' 2024-12-17T11:00:19,061 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ca.yaml' 2024-12-17T11:00:19,062 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_da.yaml' 2024-12-17T11:00:19,063 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_de.yaml' 2024-12-17T11:00:19,064 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_en.yaml' 2024-12-17T11:00:19,066 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_es.yaml' 2024-12-17T11:00:19,067 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_eu.yaml' 2024-12-17T11:00:19,068 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_fr.yaml' 2024-12-17T11:00:19,069 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_gu.yaml' 2024-12-17T11:00:19,070 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hi.yaml' 2024-12-17T11:00:19,071 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hr.yaml' 2024-12-17T11:00:19,073 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hu.yaml' 2024-12-17T11:00:19,074 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_hy.yaml' 2024-12-17T11:00:19,075 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_id.yaml' 2024-12-17T11:00:19,076 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_is.yaml' 2024-12-17T11:00:19,077 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_it.yaml' 2024-12-17T11:00:19,078 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_kn.yaml' 2024-12-17T11:00:19,079 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ml.yaml' 2024-12-17T11:00:19,080 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_mr.yaml' 2024-12-17T11:00:19,081 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nb.yaml' 2024-12-17T11:00:19,082 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ne.yaml' 2024-12-17T11:00:19,084 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_nl.yaml' 2024-12-17T11:00:19,085 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_pt.yaml' 2024-12-17T11:00:19,086 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ro.yaml' 2024-12-17T11:00:19,087 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ru.yaml' 2024-12-17T11:00:19,088 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sk.yaml' 2024-12-17T11:00:19,089 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sr.yaml' 2024-12-17T11:00:19,090 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_sv.yaml' 2024-12-17T11:00:19,091 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_ta.yaml' 2024-12-17T11:00:19,092 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_te.yaml' 2024-12-17T11:00:19,093 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_uk.yaml' 2024-12-17T11:00:19,094 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_vi.yaml' 2024-12-17T11:00:19,096 adding 'lm_eval/tasks/okapi/mmlu_multilingual/m_mmlu_zh.yaml' 2024-12-17T11:00:19,099 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/README.md' 2024-12-17T11:00:19,100 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc1_yaml' 2024-12-17T11:00:19,101 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/_truthfulqa_mc2_yaml' 2024-12-17T11:00:19,102 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc1.yaml' 2024-12-17T11:00:19,104 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ar_mc2.yaml' 2024-12-17T11:00:19,105 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc1.yaml' 2024-12-17T11:00:19,106 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_bn_mc2.yaml' 2024-12-17T11:00:19,107 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc1.yaml' 2024-12-17T11:00:19,108 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ca_mc2.yaml' 2024-12-17T11:00:19,109 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc1.yaml' 2024-12-17T11:00:19,110 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_da_mc2.yaml' 2024-12-17T11:00:19,111 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc1.yaml' 2024-12-17T11:00:19,113 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_de_mc2.yaml' 2024-12-17T11:00:19,114 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc1.yaml' 2024-12-17T11:00:19,115 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_es_mc2.yaml' 2024-12-17T11:00:19,116 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc1.yaml' 2024-12-17T11:00:19,117 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_eu_mc2.yaml' 2024-12-17T11:00:19,118 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml' 2024-12-17T11:00:19,119 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml' 2024-12-17T11:00:19,120 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml' 2024-12-17T11:00:19,122 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml' 2024-12-17T11:00:19,123 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml' 2024-12-17T11:00:19,124 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml' 2024-12-17T11:00:19,125 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml' 2024-12-17T11:00:19,126 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml' 2024-12-17T11:00:19,128 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml' 2024-12-17T11:00:19,129 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml' 2024-12-17T11:00:19,130 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml' 2024-12-17T11:00:19,131 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml' 2024-12-17T11:00:19,132 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml' 2024-12-17T11:00:19,133 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml' 2024-12-17T11:00:19,134 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml' 2024-12-17T11:00:19,135 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml' 2024-12-17T11:00:19,136 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml' 2024-12-17T11:00:19,137 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml' 2024-12-17T11:00:19,138 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml' 2024-12-17T11:00:19,139 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml' 2024-12-17T11:00:19,140 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml' 2024-12-17T11:00:19,141 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml' 2024-12-17T11:00:19,142 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml' 2024-12-17T11:00:19,143 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml' 2024-12-17T11:00:19,144 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml' 2024-12-17T11:00:19,145 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml' 2024-12-17T11:00:19,146 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml' 2024-12-17T11:00:19,147 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml' 2024-12-17T11:00:19,149 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml' 2024-12-17T11:00:19,150 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml' 2024-12-17T11:00:19,151 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml' 2024-12-17T11:00:19,152 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml' 2024-12-17T11:00:19,153 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml' 2024-12-17T11:00:19,154 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml' 2024-12-17T11:00:19,156 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml' 2024-12-17T11:00:19,157 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml' 2024-12-17T11:00:19,158 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml' 2024-12-17T11:00:19,159 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml' 2024-12-17T11:00:19,160 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml' 2024-12-17T11:00:19,161 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml' 2024-12-17T11:00:19,163 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml' 2024-12-17T11:00:19,164 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml' 2024-12-17T11:00:19,165 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml' 2024-12-17T11:00:19,166 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml' 2024-12-17T11:00:19,167 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml' 2024-12-17T11:00:19,168 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc2.yaml' 2024-12-17T11:00:19,169 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc1.yaml' 2024-12-17T11:00:19,171 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_zh_mc2.yaml' 2024-12-17T11:00:19,172 adding 'lm_eval/tasks/okapi/truthfulqa_multilingual/utils.py' 2024-12-17T11:00:19,174 adding 'lm_eval/tasks/openbookqa/README.md' 2024-12-17T11:00:19,175 adding 'lm_eval/tasks/openbookqa/openbookqa.yaml' 2024-12-17T11:00:19,177 adding 'lm_eval/tasks/paloma/README.md' 2024-12-17T11:00:19,178 adding 'lm_eval/tasks/paloma/_paloma_template' 2024-12-17T11:00:19,179 adding 'lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml' 2024-12-17T11:00:19,180 adding 'lm_eval/tasks/paloma/paloma_c4_100_domains.yaml' 2024-12-17T11:00:19,181 adding 'lm_eval/tasks/paloma/paloma_c4_en.yaml' 2024-12-17T11:00:19,182 adding 'lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml' 2024-12-17T11:00:19,184 adding 'lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml' 2024-12-17T11:00:19,185 adding 'lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml' 2024-12-17T11:00:19,186 adding 'lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml' 2024-12-17T11:00:19,188 adding 'lm_eval/tasks/paloma/paloma_gab.yaml' 2024-12-17T11:00:19,189 adding 'lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml' 2024-12-17T11:00:19,191 adding 'lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml' 2024-12-17T11:00:19,193 adding 'lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml' 2024-12-17T11:00:19,194 adding 'lm_eval/tasks/paloma/paloma_mc4.yaml' 2024-12-17T11:00:19,196 adding 'lm_eval/tasks/paloma/paloma_ptb.yaml' 2024-12-17T11:00:19,198 adding 'lm_eval/tasks/paloma/paloma_redpajama.yaml' 2024-12-17T11:00:19,199 adding 'lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml' 2024-12-17T11:00:19,201 adding 'lm_eval/tasks/paloma/paloma_utils.py' 2024-12-17T11:00:19,202 adding 'lm_eval/tasks/paloma/paloma_wikitext_103.yaml' 2024-12-17T11:00:19,204 adding 'lm_eval/tasks/paws-x/README.md' 2024-12-17T11:00:19,205 adding 'lm_eval/tasks/paws-x/_generate_config.py' 2024-12-17T11:00:19,207 adding 'lm_eval/tasks/paws-x/_pawsx.yaml' 2024-12-17T11:00:19,208 adding 'lm_eval/tasks/paws-x/paws_de.yaml' 2024-12-17T11:00:19,209 adding 'lm_eval/tasks/paws-x/paws_en.yaml' 2024-12-17T11:00:19,210 adding 'lm_eval/tasks/paws-x/paws_es.yaml' 2024-12-17T11:00:19,211 adding 'lm_eval/tasks/paws-x/paws_fr.yaml' 2024-12-17T11:00:19,212 adding 'lm_eval/tasks/paws-x/paws_ja.yaml' 2024-12-17T11:00:19,213 adding 'lm_eval/tasks/paws-x/paws_ko.yaml' 2024-12-17T11:00:19,214 adding 'lm_eval/tasks/paws-x/paws_zh.yaml' 2024-12-17T11:00:19,216 adding 'lm_eval/tasks/paws-x/pawsx_template_yaml' 2024-12-17T11:00:19,218 adding 'lm_eval/tasks/pile/README.md' 2024-12-17T11:00:19,219 adding 'lm_eval/tasks/pile/pile_arxiv.yaml' 2024-12-17T11:00:19,220 adding 'lm_eval/tasks/pile/pile_bookcorpus2.yaml' 2024-12-17T11:00:19,222 adding 'lm_eval/tasks/pile/pile_books3.yaml' 2024-12-17T11:00:19,223 adding 'lm_eval/tasks/pile/pile_dm-mathematics.yaml' 2024-12-17T11:00:19,224 adding 'lm_eval/tasks/pile/pile_enron.yaml' 2024-12-17T11:00:19,225 adding 'lm_eval/tasks/pile/pile_europarl.yaml' 2024-12-17T11:00:19,226 adding 'lm_eval/tasks/pile/pile_freelaw.yaml' 2024-12-17T11:00:19,227 adding 'lm_eval/tasks/pile/pile_github.yaml' 2024-12-17T11:00:19,228 adding 'lm_eval/tasks/pile/pile_gutenberg.yaml' 2024-12-17T11:00:19,229 adding 'lm_eval/tasks/pile/pile_hackernews.yaml' 2024-12-17T11:00:19,231 adding 'lm_eval/tasks/pile/pile_nih-exporter.yaml' 2024-12-17T11:00:19,232 adding 'lm_eval/tasks/pile/pile_opensubtitles.yaml' 2024-12-17T11:00:19,233 adding 'lm_eval/tasks/pile/pile_openwebtext2.yaml' 2024-12-17T11:00:19,234 adding 'lm_eval/tasks/pile/pile_philpapers.yaml' 2024-12-17T11:00:19,235 adding 'lm_eval/tasks/pile/pile_pile-cc.yaml' 2024-12-17T11:00:19,236 adding 'lm_eval/tasks/pile/pile_pubmed-abstracts.yaml' 2024-12-17T11:00:19,238 adding 'lm_eval/tasks/pile/pile_pubmed-central.yaml' 2024-12-17T11:00:19,239 adding 'lm_eval/tasks/pile/pile_stackexchange.yaml' 2024-12-17T11:00:19,240 adding 'lm_eval/tasks/pile/pile_ubuntu-irc.yaml' 2024-12-17T11:00:19,241 adding 'lm_eval/tasks/pile/pile_uspto.yaml' 2024-12-17T11:00:19,242 adding 'lm_eval/tasks/pile/pile_wikipedia.yaml' 2024-12-17T11:00:19,243 adding 'lm_eval/tasks/pile/pile_youtubesubtitles.yaml' 2024-12-17T11:00:19,245 adding 'lm_eval/tasks/pile_10k/README.md' 2024-12-17T11:00:19,246 adding 'lm_eval/tasks/pile_10k/pile_10k.yaml' 2024-12-17T11:00:19,247 adding 'lm_eval/tasks/piqa/README.md' 2024-12-17T11:00:19,248 adding 'lm_eval/tasks/piqa/piqa.yaml' 2024-12-17T11:00:19,250 adding 'lm_eval/tasks/polemo2/README.md' 2024-12-17T11:00:19,251 adding 'lm_eval/tasks/polemo2/polemo2_in.yaml' 2024-12-17T11:00:19,252 adding 'lm_eval/tasks/polemo2/polemo2_out.yaml' 2024-12-17T11:00:19,254 adding 'lm_eval/tasks/portuguese_bench/README.md' 2024-12-17T11:00:19,255 adding 'lm_eval/tasks/portuguese_bench/assin_entailment.yaml' 2024-12-17T11:00:19,256 adding 'lm_eval/tasks/portuguese_bench/assin_paraphrase.yaml' 2024-12-17T11:00:19,257 adding 'lm_eval/tasks/portuguese_bench/portuguese_bench.yaml' 2024-12-17T11:00:19,259 adding 'lm_eval/tasks/portuguese_bench/flores_pt/_flores_common_yaml' 2024-12-17T11:00:19,261 adding 'lm_eval/tasks/portuguese_bench/flores_pt/create_yamls_flores_pt.py' 2024-12-17T11:00:19,262 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_ca-pt.yaml' 2024-12-17T11:00:19,263 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_de-pt.yaml' 2024-12-17T11:00:19,264 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_en-pt.yaml' 2024-12-17T11:00:19,265 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_es-pt.yaml' 2024-12-17T11:00:19,266 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_eu-pt.yaml' 2024-12-17T11:00:19,267 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_fr-pt.yaml' 2024-12-17T11:00:19,268 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_gl-pt.yaml' 2024-12-17T11:00:19,269 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_it-pt.yaml' 2024-12-17T11:00:19,271 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-ca.yaml' 2024-12-17T11:00:19,272 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-de.yaml' 2024-12-17T11:00:19,273 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-en.yaml' 2024-12-17T11:00:19,274 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-es.yaml' 2024-12-17T11:00:19,275 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-eu.yaml' 2024-12-17T11:00:19,276 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-fr.yaml' 2024-12-17T11:00:19,277 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-gl.yaml' 2024-12-17T11:00:19,279 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt-it.yaml' 2024-12-17T11:00:19,280 adding 'lm_eval/tasks/portuguese_bench/flores_pt/flores_pt.yaml' 2024-12-17T11:00:19,281 adding 'lm_eval/tasks/prost/README.md' 2024-12-17T11:00:19,283 adding 'lm_eval/tasks/prost/corypaik_prost.yaml' 2024-12-17T11:00:19,285 adding 'lm_eval/tasks/pubmedqa/README.md' 2024-12-17T11:00:19,286 adding 'lm_eval/tasks/pubmedqa/preprocess_pubmedqa.py' 2024-12-17T11:00:19,287 adding 'lm_eval/tasks/pubmedqa/pubmedqa.yaml' 2024-12-17T11:00:19,289 adding 'lm_eval/tasks/qa4mre/README.md' 2024-12-17T11:00:19,290 adding 'lm_eval/tasks/qa4mre/preprocess_qa4mre.py' 2024-12-17T11:00:19,291 adding 'lm_eval/tasks/qa4mre/qa4mre_2011.yaml' 2024-12-17T11:00:19,292 adding 'lm_eval/tasks/qa4mre/qa4mre_2012.yaml' 2024-12-17T11:00:19,293 adding 'lm_eval/tasks/qa4mre/qa4mre_2013.yaml' 2024-12-17T11:00:19,295 adding 'lm_eval/tasks/qasper/README.md' 2024-12-17T11:00:19,296 adding 'lm_eval/tasks/qasper/bool.yaml' 2024-12-17T11:00:19,297 adding 'lm_eval/tasks/qasper/freeform.yaml' 2024-12-17T11:00:19,299 adding 'lm_eval/tasks/qasper/metrics.py' 2024-12-17T11:00:19,300 adding 'lm_eval/tasks/qasper/utils.py' 2024-12-17T11:00:19,302 adding 'lm_eval/tasks/race/README.md' 2024-12-17T11:00:19,303 adding 'lm_eval/tasks/race/preprocess_race.py' 2024-12-17T11:00:19,305 adding 'lm_eval/tasks/race/race.yaml' 2024-12-17T11:00:19,306 adding 'lm_eval/tasks/realtoxicityprompts/metric.py' 2024-12-17T11:00:19,307 adding 'lm_eval/tasks/realtoxicityprompts/realtoxicityprompts.yaml' 2024-12-17T11:00:19,309 adding 'lm_eval/tasks/sciq/README.md' 2024-12-17T11:00:19,310 adding 'lm_eval/tasks/sciq/sciq.yaml' 2024-12-17T11:00:19,312 adding 'lm_eval/tasks/score/NON_GREEDY.md' 2024-12-17T11:00:19,313 adding 'lm_eval/tasks/score/README.md' 2024-12-17T11:00:19,314 adding 'lm_eval/tasks/score/non_greedy.sh' 2024-12-17T11:00:19,316 adding 'lm_eval/tasks/score/non_greedy_summarizer.py' 2024-12-17T11:00:19,317 adding 'lm_eval/tasks/score/score_robustness.yaml' 2024-12-17T11:00:19,319 adding 'lm_eval/tasks/score/utils.py' 2024-12-17T11:00:19,321 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_aqua_rat.yaml' 2024-12-17T11:00:19,322 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_logiqa_en.yaml' 2024-12-17T11:00:19,323 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lsat_rc.yaml' 2024-12-17T11:00:19,324 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_ar.yaml' 2024-12-17T11:00:19,326 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_lstat_lr.yaml' 2024-12-17T11:00:19,327 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_en.yaml' 2024-12-17T11:00:19,328 adding 'lm_eval/tasks/score/agi_eval/non_greedy_robustness_agieval_sat_math.yaml' 2024-12-17T11:00:19,329 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_aqua_rat.yaml' 2024-12-17T11:00:19,331 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_logiqa_en.yaml' 2024-12-17T11:00:19,332 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_ar.yaml' 2024-12-17T11:00:19,333 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_lr.yaml' 2024-12-17T11:00:19,334 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_lsat_rc.yaml' 2024-12-17T11:00:19,335 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_en.yaml' 2024-12-17T11:00:19,336 adding 'lm_eval/tasks/score/agi_eval/option_order_robustness_agieval_sat_math.yaml' 2024-12-17T11:00:19,338 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_aqua_rat.yaml' 2024-12-17T11:00:19,339 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_logiqa_en.yaml' 2024-12-17T11:00:19,340 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lsat_rc.yaml' 2024-12-17T11:00:19,341 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_ar.yaml' 2024-12-17T11:00:19,342 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_lstat_lr.yaml' 2024-12-17T11:00:19,344 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_en.yaml' 2024-12-17T11:00:19,345 adding 'lm_eval/tasks/score/agi_eval/prompt_robustness_agieval_sat_math.yaml' 2024-12-17T11:00:19,346 adding 'lm_eval/tasks/score/agi_eval/prompt_templates.json' 2024-12-17T11:00:19,348 adding 'lm_eval/tasks/score/agi_eval/score_non_greedy_robustness_agieval.yaml' 2024-12-17T11:00:19,349 adding 'lm_eval/tasks/score/agi_eval/score_option_order_robustness_agieval.yaml' 2024-12-17T11:00:19,350 adding 'lm_eval/tasks/score/agi_eval/score_prompt_robustness_agieval.yaml' 2024-12-17T11:00:19,351 adding 'lm_eval/tasks/score/agi_eval/score_robustness_agieval.yaml' 2024-12-17T11:00:19,353 adding 'lm_eval/tasks/score/agi_eval/utils_agieval.py' 2024-12-17T11:00:19,356 adding 'lm_eval/tasks/score/math/math_grader.py' 2024-12-17T11:00:19,358 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_algebra.yaml' 2024-12-17T11:00:19,359 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_counting_and_prob.yaml' 2024-12-17T11:00:19,360 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_geometry.yaml' 2024-12-17T11:00:19,362 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_intermediate_algebra.yaml' 2024-12-17T11:00:19,363 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_num_theory.yaml' 2024-12-17T11:00:19,364 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_prealgebra.yaml' 2024-12-17T11:00:19,365 adding 'lm_eval/tasks/score/math/non_greedy_robustness_math_precalc.yaml' 2024-12-17T11:00:19,366 adding 'lm_eval/tasks/score/math/prompt_robustness_math_algebra.yaml' 2024-12-17T11:00:19,367 adding 'lm_eval/tasks/score/math/prompt_robustness_math_counting_and_prob.yaml' 2024-12-17T11:00:19,368 adding 'lm_eval/tasks/score/math/prompt_robustness_math_geometry.yaml' 2024-12-17T11:00:19,370 adding 'lm_eval/tasks/score/math/prompt_robustness_math_intermediate_algebra.yaml' 2024-12-17T11:00:19,371 adding 'lm_eval/tasks/score/math/prompt_robustness_math_num_theory.yaml' 2024-12-17T11:00:19,372 adding 'lm_eval/tasks/score/math/prompt_robustness_math_prealgebra.yaml' 2024-12-17T11:00:19,373 adding 'lm_eval/tasks/score/math/prompt_robustness_math_precalc.yaml' 2024-12-17T11:00:19,374 adding 'lm_eval/tasks/score/math/prompt_templates.json' 2024-12-17T11:00:19,375 adding 'lm_eval/tasks/score/math/score_non_greedy_robustness_math.yaml' 2024-12-17T11:00:19,377 adding 'lm_eval/tasks/score/math/score_prompt_robustness_math.yaml' 2024-12-17T11:00:19,378 adding 'lm_eval/tasks/score/math/score_robustness_math.yaml' 2024-12-17T11:00:19,379 adding 'lm_eval/tasks/score/math/to_be_fixed_questions.json' 2024-12-17T11:00:19,381 adding 'lm_eval/tasks/score/math/utils_math.py' 2024-12-17T11:00:19,382 adding 'lm_eval/tasks/score/mmlu_pro/prompt_templates.json' 2024-12-17T11:00:19,384 adding 'lm_eval/tasks/score/mmlu_pro/score_non_greedy_robustness_mmlu_pro.yaml' 2024-12-17T11:00:19,385 adding 'lm_eval/tasks/score/mmlu_pro/score_option_order_robustness_mmlu_pro.yaml' 2024-12-17T11:00:19,388 adding 'lm_eval/tasks/score/mmlu_pro/score_prompt_robustness_mmlu_pro.yaml' 2024-12-17T11:00:19,390 adding 'lm_eval/tasks/score/mmlu_pro/utils_mmlu_pro.py' 2024-12-17T11:00:19,392 adding 'lm_eval/tasks/scrolls/README.md' 2024-12-17T11:00:19,393 adding 'lm_eval/tasks/scrolls/scrolls_contractnli.yaml' 2024-12-17T11:00:19,394 adding 'lm_eval/tasks/scrolls/scrolls_govreport.yaml' 2024-12-17T11:00:19,395 adding 'lm_eval/tasks/scrolls/scrolls_narrativeqa.yaml' 2024-12-17T11:00:19,396 adding 'lm_eval/tasks/scrolls/scrolls_qasper.yaml' 2024-12-17T11:00:19,397 adding 'lm_eval/tasks/scrolls/scrolls_qmsum.yaml' 2024-12-17T11:00:19,398 adding 'lm_eval/tasks/scrolls/scrolls_quality.yaml' 2024-12-17T11:00:19,400 adding 'lm_eval/tasks/scrolls/scrolls_summscreenfd.yaml' 2024-12-17T11:00:19,402 adding 'lm_eval/tasks/scrolls/task.py' 2024-12-17T11:00:19,403 adding 'lm_eval/tasks/siqa/README.md' 2024-12-17T11:00:19,405 adding 'lm_eval/tasks/siqa/siqa.yaml' 2024-12-17T11:00:19,407 adding 'lm_eval/tasks/spanish_bench/README.md' 2024-12-17T11:00:19,408 adding 'lm_eval/tasks/spanish_bench/copa_es.yaml' 2024-12-17T11:00:19,409 adding 'lm_eval/tasks/spanish_bench/escola.yaml' 2024-12-17T11:00:19,411 adding 'lm_eval/tasks/spanish_bench/mgsm_direct_es_spanish_bench.yaml' 2024-12-17T11:00:19,412 adding 'lm_eval/tasks/spanish_bench/openbookqa_es.yaml' 2024-12-17T11:00:19,413 adding 'lm_eval/tasks/spanish_bench/paws_es_spanish_bench.yaml' 2024-12-17T11:00:19,414 adding 'lm_eval/tasks/spanish_bench/spanish_bench.yaml' 2024-12-17T11:00:19,416 adding 'lm_eval/tasks/spanish_bench/utils.py' 2024-12-17T11:00:19,417 adding 'lm_eval/tasks/spanish_bench/wnli_es.yaml' 2024-12-17T11:00:19,418 adding 'lm_eval/tasks/spanish_bench/xlsum_es.yaml' 2024-12-17T11:00:19,420 adding 'lm_eval/tasks/spanish_bench/xnli_es_spanish_bench.yaml' 2024-12-17T11:00:19,422 adding 'lm_eval/tasks/spanish_bench/flores_es/_flores_common_yaml' 2024-12-17T11:00:19,424 adding 'lm_eval/tasks/spanish_bench/flores_es/create_yamls_flores_es.py' 2024-12-17T11:00:19,425 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_ca-es.yaml' 2024-12-17T11:00:19,426 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_de-es.yaml' 2024-12-17T11:00:19,427 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_en-es.yaml' 2024-12-17T11:00:19,428 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-ca.yaml' 2024-12-17T11:00:19,429 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-de.yaml' 2024-12-17T11:00:19,430 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-en.yaml' 2024-12-17T11:00:19,431 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-eu.yaml' 2024-12-17T11:00:19,432 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-fr.yaml' 2024-12-17T11:00:19,433 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-gl.yaml' 2024-12-17T11:00:19,434 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-it.yaml' 2024-12-17T11:00:19,435 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es-pt.yaml' 2024-12-17T11:00:19,437 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_es.yaml' 2024-12-17T11:00:19,438 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_eu-es.yaml' 2024-12-17T11:00:19,439 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_fr-es.yaml' 2024-12-17T11:00:19,440 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_gl-es.yaml' 2024-12-17T11:00:19,441 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_it-es.yaml' 2024-12-17T11:00:19,442 adding 'lm_eval/tasks/spanish_bench/flores_es/flores_pt-es.yaml' 2024-12-17T11:00:19,444 adding 'lm_eval/tasks/spanish_bench/phrases_es/_phrases_es_common.yaml' 2024-12-17T11:00:19,445 adding 'lm_eval/tasks/spanish_bench/phrases_es/phrases_es-va.yaml' 2024-12-17T11:00:19,446 adding 'lm_eval/tasks/spanish_bench/phrases_es/phrases_va-es.yaml' 2024-12-17T11:00:19,447 adding 'lm_eval/tasks/squad_completion/README.md' 2024-12-17T11:00:19,448 adding 'lm_eval/tasks/squad_completion/squad_completion.yaml' 2024-12-17T11:00:19,450 adding 'lm_eval/tasks/squad_completion/task.py' 2024-12-17T11:00:19,451 adding 'lm_eval/tasks/squadv2/README.md' 2024-12-17T11:00:19,453 adding 'lm_eval/tasks/squadv2/squadv2.yaml' 2024-12-17T11:00:19,454 adding 'lm_eval/tasks/squadv2/task.py' 2024-12-17T11:00:19,456 adding 'lm_eval/tasks/storycloze/README.md' 2024-12-17T11:00:19,457 adding 'lm_eval/tasks/storycloze/storycloze_2016.yaml' 2024-12-17T11:00:19,458 adding 'lm_eval/tasks/storycloze/storycloze_2018.yaml' 2024-12-17T11:00:19,460 adding 'lm_eval/tasks/super_glue/README.md' 2024-12-17T11:00:19,462 adding 'lm_eval/tasks/super_glue/boolq/default.yaml' 2024-12-17T11:00:19,463 adding 'lm_eval/tasks/super_glue/boolq/seq2seq.yaml' 2024-12-17T11:00:19,464 adding 'lm_eval/tasks/super_glue/boolq/t5-prompt.yaml' 2024-12-17T11:00:19,466 adding 'lm_eval/tasks/super_glue/cb/aggregate.py' 2024-12-17T11:00:19,467 adding 'lm_eval/tasks/super_glue/cb/default.yaml' 2024-12-17T11:00:19,468 adding 'lm_eval/tasks/super_glue/cb/t5-prompt.yaml' 2024-12-17T11:00:19,469 adding 'lm_eval/tasks/super_glue/cb/t5_utils.py' 2024-12-17T11:00:19,471 adding 'lm_eval/tasks/super_glue/copa/default.yaml' 2024-12-17T11:00:19,472 adding 'lm_eval/tasks/super_glue/copa/t5-prompt.yaml' 2024-12-17T11:00:19,473 adding 'lm_eval/tasks/super_glue/copa/utils.py' 2024-12-17T11:00:19,475 adding 'lm_eval/tasks/super_glue/multirc/default.yaml' 2024-12-17T11:00:19,476 adding 'lm_eval/tasks/super_glue/multirc/t5-prompt.yaml' 2024-12-17T11:00:19,478 adding 'lm_eval/tasks/super_glue/multirc/t5_utils.py' 2024-12-17T11:00:19,479 adding 'lm_eval/tasks/super_glue/record/default.yaml' 2024-12-17T11:00:19,480 adding 'lm_eval/tasks/super_glue/record/t5-prompt.yaml' 2024-12-17T11:00:19,482 adding 'lm_eval/tasks/super_glue/record/t5_utils.py' 2024-12-17T11:00:19,483 adding 'lm_eval/tasks/super_glue/record/util.py' 2024-12-17T11:00:19,485 adding 'lm_eval/tasks/super_glue/rte/default.yaml' 2024-12-17T11:00:19,486 adding 'lm_eval/tasks/super_glue/rte/t5-prompt.yaml' 2024-12-17T11:00:19,488 adding 'lm_eval/tasks/super_glue/wic/default.yaml' 2024-12-17T11:00:19,489 adding 'lm_eval/tasks/super_glue/wic/t5-prompt.yaml' 2024-12-17T11:00:19,490 adding 'lm_eval/tasks/super_glue/wsc/default.yaml' 2024-12-17T11:00:19,492 adding 'lm_eval/tasks/super_glue/wsc/preprocess_wsc.py' 2024-12-17T11:00:19,493 adding 'lm_eval/tasks/super_glue/wsc/t5-prompt.yaml' 2024-12-17T11:00:19,494 adding 'lm_eval/tasks/super_glue/wsc/t5_utils.py' 2024-12-17T11:00:19,496 adding 'lm_eval/tasks/swag/README.md' 2024-12-17T11:00:19,497 adding 'lm_eval/tasks/swag/swag.yaml' 2024-12-17T11:00:19,499 adding 'lm_eval/tasks/swde/README.md' 2024-12-17T11:00:19,500 adding 'lm_eval/tasks/swde/swde.yaml' 2024-12-17T11:00:19,501 adding 'lm_eval/tasks/swde/task.py' 2024-12-17T11:00:19,503 adding 'lm_eval/tasks/tinyBenchmarks/README.md' 2024-12-17T11:00:19,504 adding 'lm_eval/tasks/tinyBenchmarks/agg_functions.py' 2024-12-17T11:00:19,506 adding 'lm_eval/tasks/tinyBenchmarks/tinyArc.yaml' 2024-12-17T11:00:19,507 adding 'lm_eval/tasks/tinyBenchmarks/tinyBenchmarks.yaml' 2024-12-17T11:00:19,508 adding 'lm_eval/tasks/tinyBenchmarks/tinyGSM8k.yaml' 2024-12-17T11:00:19,509 adding 'lm_eval/tasks/tinyBenchmarks/tinyHellaswag.yaml' 2024-12-17T11:00:19,510 adding 'lm_eval/tasks/tinyBenchmarks/tinyMMLU.yaml' 2024-12-17T11:00:19,511 adding 'lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc1.yaml' 2024-12-17T11:00:19,512 adding 'lm_eval/tasks/tinyBenchmarks/tinyTruthfulQA_mc2.yaml' 2024-12-17T11:00:19,514 adding 'lm_eval/tasks/tinyBenchmarks/tinyWinogrande.yaml' 2024-12-17T11:00:19,515 adding 'lm_eval/tasks/tinyBenchmarks/utils_hellaswag.py' 2024-12-17T11:00:19,516 adding 'lm_eval/tasks/tinyBenchmarks/utils_truthfulqa.py' 2024-12-17T11:00:19,517 adding 'lm_eval/tasks/tinyBenchmarks/utils_winogrande.py' 2024-12-17T11:00:19,519 adding 'lm_eval/tasks/tmlu/README.md' 2024-12-17T11:00:19,521 adding 'lm_eval/tasks/tmlu/subject.tsv' 2024-12-17T11:00:19,523 adding 'lm_eval/tasks/tmlu/default/_default_template_yaml' 2024-12-17T11:00:19,525 adding 'lm_eval/tasks/tmlu/default/_generate_configs.py' 2024-12-17T11:00:19,526 adding 'lm_eval/tasks/tmlu/default/_tmlu.yaml' 2024-12-17T11:00:19,527 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_biology.yaml' 2024-12-17T11:00:19,528 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_chemistry.yaml' 2024-12-17T11:00:19,529 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_chinese.yaml' 2024-12-17T11:00:19,530 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_civics.yaml' 2024-12-17T11:00:19,532 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_geography.yaml' 2024-12-17T11:00:19,533 adding 'lm_eval/tasks/tmlu/default/tmlu_AST_history.yaml' 2024-12-17T11:00:19,534 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_biology.yaml' 2024-12-17T11:00:19,535 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_chemistry.yaml' 2024-12-17T11:00:19,536 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_chinese.yaml' 2024-12-17T11:00:19,538 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_civics.yaml' 2024-12-17T11:00:19,539 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_earth_science.yaml' 2024-12-17T11:00:19,540 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_geography.yaml' 2024-12-17T11:00:19,541 adding 'lm_eval/tasks/tmlu/default/tmlu_CAP_history.yaml' 2024-12-17T11:00:19,542 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_biology.yaml' 2024-12-17T11:00:19,544 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_chemistry.yaml' 2024-12-17T11:00:19,545 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_chinese.yaml' 2024-12-17T11:00:19,546 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_civics.yaml' 2024-12-17T11:00:19,547 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_earth_science.yaml' 2024-12-17T11:00:19,548 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_geography.yaml' 2024-12-17T11:00:19,550 adding 'lm_eval/tasks/tmlu/default/tmlu_GSAT_history.yaml' 2024-12-17T11:00:19,551 adding 'lm_eval/tasks/tmlu/default/tmlu_accountant.yaml' 2024-12-17T11:00:19,552 adding 'lm_eval/tasks/tmlu/default/tmlu_basic_traditional_chinese_medicine.yaml' 2024-12-17T11:00:19,553 adding 'lm_eval/tasks/tmlu/default/tmlu_clinical_psychologist.yaml' 2024-12-17T11:00:19,555 adding 'lm_eval/tasks/tmlu/default/tmlu_clinical_traditional_chinese_medicine.yaml' 2024-12-17T11:00:19,556 adding 'lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml' 2024-12-17T11:00:19,557 adding 'lm_eval/tasks/tmlu/default/tmlu_lawyer_qualification.yaml' 2024-12-17T11:00:19,559 adding 'lm_eval/tasks/tmlu/default/tmlu_nutritionist.yaml' 2024-12-17T11:00:19,560 adding 'lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml' 2024-12-17T11:00:19,561 adding 'lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml' 2024-12-17T11:00:19,562 adding 'lm_eval/tasks/tmlu/default/tmlu_tour_guide.yaml' 2024-12-17T11:00:19,563 adding 'lm_eval/tasks/tmlu/default/tmlu_tour_leader.yaml' 2024-12-17T11:00:19,564 adding 'lm_eval/tasks/tmlu/default/utils.py' 2024-12-17T11:00:19,566 adding 'lm_eval/tasks/tmmluplus/README.md' 2024-12-17T11:00:19,567 adding 'lm_eval/tasks/tmmluplus/subject.tsv' 2024-12-17T11:00:19,570 adding 'lm_eval/tasks/tmmluplus/default/_generate_configs.py' 2024-12-17T11:00:19,572 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus.yaml' 2024-12-17T11:00:19,573 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_STEM.yaml' 2024-12-17T11:00:19,574 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_humanities.yaml' 2024-12-17T11:00:19,575 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_other.yaml' 2024-12-17T11:00:19,576 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_social_sciences.yaml' 2024-12-17T11:00:19,577 adding 'lm_eval/tasks/tmmluplus/default/_tmmluplus_template_yaml' 2024-12-17T11:00:19,579 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_accounting.yaml' 2024-12-17T11:00:19,580 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_administrative_law.yaml' 2024-12-17T11:00:19,581 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_advance_chemistry.yaml' 2024-12-17T11:00:19,582 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_agriculture.yaml' 2024-12-17T11:00:19,583 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_anti_money_laundering.yaml' 2024-12-17T11:00:19,584 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_auditing.yaml' 2024-12-17T11:00:19,585 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_basic_medical_science.yaml' 2024-12-17T11:00:19,587 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_business_management.yaml' 2024-12-17T11:00:19,588 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_chinese_language_and_literature.yaml' 2024-12-17T11:00:19,589 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_clinical_psychology.yaml' 2024-12-17T11:00:19,590 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_computer_science.yaml' 2024-12-17T11:00:19,591 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_culinary_skills.yaml' 2024-12-17T11:00:19,593 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_dentistry.yaml' 2024-12-17T11:00:19,594 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_economics.yaml' 2024-12-17T11:00:19,595 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_education.yaml' 2024-12-17T11:00:19,596 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_education_(profession_level).yaml' 2024-12-17T11:00:19,597 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_educational_psychology.yaml' 2024-12-17T11:00:19,599 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_engineering_math.yaml' 2024-12-17T11:00:19,600 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_finance_banking.yaml' 2024-12-17T11:00:19,601 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_financial_analysis.yaml' 2024-12-17T11:00:19,602 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_fire_science.yaml' 2024-12-17T11:00:19,603 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_general_principles_of_law.yaml' 2024-12-17T11:00:19,604 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_geography_of_taiwan.yaml' 2024-12-17T11:00:19,605 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml' 2024-12-17T11:00:19,607 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml' 2024-12-17T11:00:19,608 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml' 2024-12-17T11:00:19,609 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml' 2024-12-17T11:00:19,610 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml' 2024-12-17T11:00:19,611 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml' 2024-12-17T11:00:19,612 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml' 2024-12-17T11:00:19,614 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml' 2024-12-17T11:00:19,615 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml' 2024-12-17T11:00:19,616 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml' 2024-12-17T11:00:19,617 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml' 2024-12-17T11:00:19,618 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml' 2024-12-17T11:00:19,619 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml' 2024-12-17T11:00:19,620 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml' 2024-12-17T11:00:19,622 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml' 2024-12-17T11:00:19,623 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml' 2024-12-17T11:00:19,624 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml' 2024-12-17T11:00:19,625 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml' 2024-12-17T11:00:19,627 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml' 2024-12-17T11:00:19,628 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml' 2024-12-17T11:00:19,629 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml' 2024-12-17T11:00:19,630 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml' 2024-12-17T11:00:19,632 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml' 2024-12-17T11:00:19,633 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml' 2024-12-17T11:00:19,634 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml' 2024-12-17T11:00:19,635 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml' 2024-12-17T11:00:19,636 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml' 2024-12-17T11:00:19,638 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml' 2024-12-17T11:00:19,639 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml' 2024-12-17T11:00:19,640 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml' 2024-12-17T11:00:19,641 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml' 2024-12-17T11:00:19,642 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml' 2024-12-17T11:00:19,643 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml' 2024-12-17T11:00:19,645 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml' 2024-12-17T11:00:19,646 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml' 2024-12-17T11:00:19,647 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml' 2024-12-17T11:00:19,649 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml' 2024-12-17T11:00:19,651 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml' 2024-12-17T11:00:19,652 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml' 2024-12-17T11:00:19,653 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml' 2024-12-17T11:00:19,654 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_mathematics.yaml' 2024-12-17T11:00:19,656 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_tve_natural_sciences.yaml' 2024-12-17T11:00:19,657 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pathology.yaml' 2024-12-17T11:00:19,658 adding 'lm_eval/tasks/tmmluplus/default/tmmluplus_veterinary_pharmacology.yaml' 2024-12-17T11:00:19,659 adding 'lm_eval/tasks/tmmluplus/default/utils.py' 2024-12-17T11:00:19,662 adding 'lm_eval/tasks/toxigen/README.md' 2024-12-17T11:00:19,663 adding 'lm_eval/tasks/toxigen/toxigen.yaml' 2024-12-17T11:00:19,664 adding 'lm_eval/tasks/toxigen/utils.py' 2024-12-17T11:00:19,665 adding 'lm_eval/tasks/translation/README.md' 2024-12-17T11:00:19,666 adding 'lm_eval/tasks/translation/iwslt2017_ar-en.yaml' 2024-12-17T11:00:19,667 adding 'lm_eval/tasks/translation/iwslt2017_en-ar.yaml' 2024-12-17T11:00:19,669 adding 'lm_eval/tasks/translation/utils.py' 2024-12-17T11:00:19,670 adding 'lm_eval/tasks/translation/wmt14_en-fr.yaml' 2024-12-17T11:00:19,671 adding 'lm_eval/tasks/translation/wmt14_fr-en.yaml' 2024-12-17T11:00:19,672 adding 'lm_eval/tasks/translation/wmt16_de-en.yaml' 2024-12-17T11:00:19,673 adding 'lm_eval/tasks/translation/wmt16_en-de.yaml' 2024-12-17T11:00:19,675 adding 'lm_eval/tasks/translation/wmt16_en-ro.yaml' 2024-12-17T11:00:19,676 adding 'lm_eval/tasks/translation/wmt16_ro-en.yaml' 2024-12-17T11:00:19,678 adding 'lm_eval/tasks/translation/wmt_common_yaml' 2024-12-17T11:00:19,680 adding 'lm_eval/tasks/triviaqa/README.md' 2024-12-17T11:00:19,681 adding 'lm_eval/tasks/triviaqa/default.yaml' 2024-12-17T11:00:19,683 adding 'lm_eval/tasks/truthfulqa/README.md' 2024-12-17T11:00:19,684 adding 'lm_eval/tasks/truthfulqa/truthfulqa_gen.yaml' 2024-12-17T11:00:19,686 adding 'lm_eval/tasks/truthfulqa/truthfulqa_mc1.yaml' 2024-12-17T11:00:19,687 adding 'lm_eval/tasks/truthfulqa/truthfulqa_mc2.yaml' 2024-12-17T11:00:19,689 adding 'lm_eval/tasks/truthfulqa/utils.py' 2024-12-17T11:00:19,691 adding 'lm_eval/tasks/turkishmmlu/README.md' 2024-12-17T11:00:19,694 adding 'lm_eval/tasks/turkishmmlu/config/Biology.yaml' 2024-12-17T11:00:19,695 adding 'lm_eval/tasks/turkishmmlu/config/Chemistry.yaml' 2024-12-17T11:00:19,696 adding 'lm_eval/tasks/turkishmmlu/config/Geography.yaml' 2024-12-17T11:00:19,697 adding 'lm_eval/tasks/turkishmmlu/config/History.yaml' 2024-12-17T11:00:19,698 adding 'lm_eval/tasks/turkishmmlu/config/Mathematics.yaml' 2024-12-17T11:00:19,699 adding 'lm_eval/tasks/turkishmmlu/config/Philosophy.yaml' 2024-12-17T11:00:19,700 adding 'lm_eval/tasks/turkishmmlu/config/Physics.yaml' 2024-12-17T11:00:19,702 adding 'lm_eval/tasks/turkishmmlu/config/Religion_and_Ethics.yaml' 2024-12-17T11:00:19,703 adding 'lm_eval/tasks/turkishmmlu/config/Turkish_Language_and_Literature.yaml' 2024-12-17T11:00:19,704 adding 'lm_eval/tasks/turkishmmlu/config/_turkishmmlu_default_yaml' 2024-12-17T11:00:19,707 adding 'lm_eval/tasks/turkishmmlu/config_cot/Biology.yaml' 2024-12-17T11:00:19,709 adding 'lm_eval/tasks/turkishmmlu/config_cot/Chemistry.yaml' 2024-12-17T11:00:19,710 adding 'lm_eval/tasks/turkishmmlu/config_cot/Geography.yaml' 2024-12-17T11:00:19,713 adding 'lm_eval/tasks/turkishmmlu/config_cot/History.yaml' 2024-12-17T11:00:19,714 adding 'lm_eval/tasks/turkishmmlu/config_cot/Mathematics.yaml' 2024-12-17T11:00:19,716 adding 'lm_eval/tasks/turkishmmlu/config_cot/Philosophy.yaml' 2024-12-17T11:00:19,719 adding 'lm_eval/tasks/turkishmmlu/config_cot/Physics.yaml' 2024-12-17T11:00:19,720 adding 'lm_eval/tasks/turkishmmlu/config_cot/Religion_and_Ethics.yaml' 2024-12-17T11:00:19,722 adding 'lm_eval/tasks/turkishmmlu/config_cot/Turkish_Language_and_Literature.yaml' 2024-12-17T11:00:19,724 adding 'lm_eval/tasks/turkishmmlu/config_cot/_turkishmmlu_cot_default_yaml' 2024-12-17T11:00:19,727 adding 'lm_eval/tasks/unitxt/20_newsgroups.yaml' 2024-12-17T11:00:19,728 adding 'lm_eval/tasks/unitxt/README.md' 2024-12-17T11:00:19,729 adding 'lm_eval/tasks/unitxt/ag_news.yaml' 2024-12-17T11:00:19,731 adding 'lm_eval/tasks/unitxt/argument_topic.yaml' 2024-12-17T11:00:19,732 adding 'lm_eval/tasks/unitxt/atis.yaml' 2024-12-17T11:00:19,733 adding 'lm_eval/tasks/unitxt/banking77.yaml' 2024-12-17T11:00:19,735 adding 'lm_eval/tasks/unitxt/claim_stance_topic.yaml' 2024-12-17T11:00:19,736 adding 'lm_eval/tasks/unitxt/cnn_dailymail.yaml' 2024-12-17T11:00:19,737 adding 'lm_eval/tasks/unitxt/coedit_gec.yaml' 2024-12-17T11:00:19,738 adding 'lm_eval/tasks/unitxt/dbpedia_14.yaml' 2024-12-17T11:00:19,739 adding 'lm_eval/tasks/unitxt/doc_vqa.yaml' 2024-12-17T11:00:19,740 adding 'lm_eval/tasks/unitxt/ethos_binary.yaml' 2024-12-17T11:00:19,742 adding 'lm_eval/tasks/unitxt/financial_tweets.yaml' 2024-12-17T11:00:19,743 adding 'lm_eval/tasks/unitxt/law_stack_exchange.yaml' 2024-12-17T11:00:19,744 adding 'lm_eval/tasks/unitxt/ledgar.yaml' 2024-12-17T11:00:19,745 adding 'lm_eval/tasks/unitxt/medical_abstracts.yaml' 2024-12-17T11:00:19,746 adding 'lm_eval/tasks/unitxt/stsb.yaml' 2024-12-17T11:00:19,748 adding 'lm_eval/tasks/unitxt/task.py' 2024-12-17T11:00:19,749 adding 'lm_eval/tasks/unitxt/unfair_tos.yaml' 2024-12-17T11:00:19,750 adding 'lm_eval/tasks/unitxt/unitxt' 2024-12-17T11:00:19,751 adding 'lm_eval/tasks/unitxt/unitxt_multimodal' 2024-12-17T11:00:19,752 adding 'lm_eval/tasks/unitxt/xsum.yaml' 2024-12-17T11:00:19,753 adding 'lm_eval/tasks/unitxt/yahoo_answers_topics.yaml' 2024-12-17T11:00:19,755 adding 'lm_eval/tasks/unscramble/README.md' 2024-12-17T11:00:19,756 adding 'lm_eval/tasks/unscramble/anagrams1.yaml' 2024-12-17T11:00:19,757 adding 'lm_eval/tasks/unscramble/anagrams2.yaml' 2024-12-17T11:00:19,758 adding 'lm_eval/tasks/unscramble/cycle_letters.yaml' 2024-12-17T11:00:19,759 adding 'lm_eval/tasks/unscramble/random_insertion.yaml' 2024-12-17T11:00:19,760 adding 'lm_eval/tasks/unscramble/reversed_words.yaml' 2024-12-17T11:00:19,762 adding 'lm_eval/tasks/webqs/README.md' 2024-12-17T11:00:19,763 adding 'lm_eval/tasks/webqs/utils.py' 2024-12-17T11:00:19,764 adding 'lm_eval/tasks/webqs/webqs.yaml' 2024-12-17T11:00:19,766 adding 'lm_eval/tasks/wikitext/README.md' 2024-12-17T11:00:19,767 adding 'lm_eval/tasks/wikitext/preprocess_wikitext.py' 2024-12-17T11:00:19,769 adding 'lm_eval/tasks/wikitext/wikitext.yaml' 2024-12-17T11:00:19,770 adding 'lm_eval/tasks/winogrande/README.md' 2024-12-17T11:00:19,771 adding 'lm_eval/tasks/winogrande/default.yaml' 2024-12-17T11:00:19,773 adding 'lm_eval/tasks/winogrande/preprocess_winogrande.py' 2024-12-17T11:00:19,775 adding 'lm_eval/tasks/wmdp/README.md' 2024-12-17T11:00:19,776 adding 'lm_eval/tasks/wmdp/_default_template_yaml' 2024-12-17T11:00:19,777 adding 'lm_eval/tasks/wmdp/_wmdp.yaml' 2024-12-17T11:00:19,778 adding 'lm_eval/tasks/wmdp/wmdp_bio.yaml' 2024-12-17T11:00:19,779 adding 'lm_eval/tasks/wmdp/wmdp_chem.yaml' 2024-12-17T11:00:19,780 adding 'lm_eval/tasks/wmdp/wmdp_cyber.yaml' 2024-12-17T11:00:19,782 adding 'lm_eval/tasks/wmt2016/README.md' 2024-12-17T11:00:19,783 adding 'lm_eval/tasks/wmt2016/metrics.py' 2024-12-17T11:00:19,784 adding 'lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml' 2024-12-17T11:00:19,786 adding 'lm_eval/tasks/wsc273/README.md' 2024-12-17T11:00:19,787 adding 'lm_eval/tasks/wsc273/default.yaml' 2024-12-17T11:00:19,789 adding 'lm_eval/tasks/wsc273/utils.py' 2024-12-17T11:00:19,790 adding 'lm_eval/tasks/xcopa/README.md' 2024-12-17T11:00:19,792 adding 'lm_eval/tasks/xcopa/_xcopa.yaml' 2024-12-17T11:00:19,793 adding 'lm_eval/tasks/xcopa/default_et.yaml' 2024-12-17T11:00:19,794 adding 'lm_eval/tasks/xcopa/default_ht.yaml' 2024-12-17T11:00:19,795 adding 'lm_eval/tasks/xcopa/default_id.yaml' 2024-12-17T11:00:19,796 adding 'lm_eval/tasks/xcopa/default_it.yaml' 2024-12-17T11:00:19,798 adding 'lm_eval/tasks/xcopa/default_qu.yaml' 2024-12-17T11:00:19,799 adding 'lm_eval/tasks/xcopa/default_sw.yaml' 2024-12-17T11:00:19,800 adding 'lm_eval/tasks/xcopa/default_ta.yaml' 2024-12-17T11:00:19,801 adding 'lm_eval/tasks/xcopa/default_th.yaml' 2024-12-17T11:00:19,802 adding 'lm_eval/tasks/xcopa/default_tr.yaml' 2024-12-17T11:00:19,803 adding 'lm_eval/tasks/xcopa/default_vi.yaml' 2024-12-17T11:00:19,805 adding 'lm_eval/tasks/xcopa/default_zh.yaml' 2024-12-17T11:00:19,806 adding 'lm_eval/tasks/xcopa/utils.py' 2024-12-17T11:00:19,808 adding 'lm_eval/tasks/xnli/README.md' 2024-12-17T11:00:19,810 adding 'lm_eval/tasks/xnli/_xnli.yaml' 2024-12-17T11:00:19,812 adding 'lm_eval/tasks/xnli/utils.py' 2024-12-17T11:00:19,814 adding 'lm_eval/tasks/xnli/xnli_ar.yaml' 2024-12-17T11:00:19,816 adding 'lm_eval/tasks/xnli/xnli_bg.yaml' 2024-12-17T11:00:19,817 adding 'lm_eval/tasks/xnli/xnli_common_yaml' 2024-12-17T11:00:19,818 adding 'lm_eval/tasks/xnli/xnli_de.yaml' 2024-12-17T11:00:19,819 adding 'lm_eval/tasks/xnli/xnli_el.yaml' 2024-12-17T11:00:19,820 adding 'lm_eval/tasks/xnli/xnli_en.yaml' 2024-12-17T11:00:19,821 adding 'lm_eval/tasks/xnli/xnli_es.yaml' 2024-12-17T11:00:19,822 adding 'lm_eval/tasks/xnli/xnli_fr.yaml' 2024-12-17T11:00:19,823 adding 'lm_eval/tasks/xnli/xnli_hi.yaml' 2024-12-17T11:00:19,824 adding 'lm_eval/tasks/xnli/xnli_ru.yaml' 2024-12-17T11:00:19,825 adding 'lm_eval/tasks/xnli/xnli_sw.yaml' 2024-12-17T11:00:19,826 adding 'lm_eval/tasks/xnli/xnli_th.yaml' 2024-12-17T11:00:19,827 adding 'lm_eval/tasks/xnli/xnli_tr.yaml' 2024-12-17T11:00:19,828 adding 'lm_eval/tasks/xnli/xnli_ur.yaml' 2024-12-17T11:00:19,830 adding 'lm_eval/tasks/xnli/xnli_vi.yaml' 2024-12-17T11:00:19,831 adding 'lm_eval/tasks/xnli/xnli_zh.yaml' 2024-12-17T11:00:19,833 adding 'lm_eval/tasks/xnli_eu/README.md' 2024-12-17T11:00:19,834 adding 'lm_eval/tasks/xnli_eu/xnli_common_yaml' 2024-12-17T11:00:19,835 adding 'lm_eval/tasks/xnli_eu/xnli_eu.yaml' 2024-12-17T11:00:19,836 adding 'lm_eval/tasks/xnli_eu/xnli_eu_mt.yaml' 2024-12-17T11:00:19,837 adding 'lm_eval/tasks/xnli_eu/xnli_eu_native.yaml' 2024-12-17T11:00:19,839 adding 'lm_eval/tasks/xquad/README.md' 2024-12-17T11:00:19,840 adding 'lm_eval/tasks/xquad/utils.py' 2024-12-17T11:00:19,841 adding 'lm_eval/tasks/xquad/xquad_ar.yaml' 2024-12-17T11:00:19,842 adding 'lm_eval/tasks/xquad/xquad_common_yaml' 2024-12-17T11:00:19,844 adding 'lm_eval/tasks/xquad/xquad_de.yaml' 2024-12-17T11:00:19,845 adding 'lm_eval/tasks/xquad/xquad_el.yaml' 2024-12-17T11:00:19,846 adding 'lm_eval/tasks/xquad/xquad_en.yaml' 2024-12-17T11:00:19,847 adding 'lm_eval/tasks/xquad/xquad_es.yaml' 2024-12-17T11:00:19,848 adding 'lm_eval/tasks/xquad/xquad_hi.yaml' 2024-12-17T11:00:19,849 adding 'lm_eval/tasks/xquad/xquad_ro.yaml' 2024-12-17T11:00:19,850 adding 'lm_eval/tasks/xquad/xquad_ru.yaml' 2024-12-17T11:00:19,851 adding 'lm_eval/tasks/xquad/xquad_th.yaml' 2024-12-17T11:00:19,853 adding 'lm_eval/tasks/xquad/xquad_tr.yaml' 2024-12-17T11:00:19,854 adding 'lm_eval/tasks/xquad/xquad_vi.yaml' 2024-12-17T11:00:19,855 adding 'lm_eval/tasks/xquad/xquad_zh.yaml' 2024-12-17T11:00:19,857 adding 'lm_eval/tasks/xstorycloze/README.md' 2024-12-17T11:00:19,858 adding 'lm_eval/tasks/xstorycloze/_xstorycloze.yaml' 2024-12-17T11:00:19,859 adding 'lm_eval/tasks/xstorycloze/default_ar.yaml' 2024-12-17T11:00:19,860 adding 'lm_eval/tasks/xstorycloze/default_en.yaml' 2024-12-17T11:00:19,861 adding 'lm_eval/tasks/xstorycloze/default_es.yaml' 2024-12-17T11:00:19,862 adding 'lm_eval/tasks/xstorycloze/default_eu.yaml' 2024-12-17T11:00:19,863 adding 'lm_eval/tasks/xstorycloze/default_hi.yaml' 2024-12-17T11:00:19,864 adding 'lm_eval/tasks/xstorycloze/default_id.yaml' 2024-12-17T11:00:19,866 adding 'lm_eval/tasks/xstorycloze/default_my.yaml' 2024-12-17T11:00:19,867 adding 'lm_eval/tasks/xstorycloze/default_ru.yaml' 2024-12-17T11:00:19,868 adding 'lm_eval/tasks/xstorycloze/default_sw.yaml' 2024-12-17T11:00:19,869 adding 'lm_eval/tasks/xstorycloze/default_te.yaml' 2024-12-17T11:00:19,870 adding 'lm_eval/tasks/xstorycloze/default_zh.yaml' 2024-12-17T11:00:19,872 adding 'lm_eval/tasks/xwinograd/README.md' 2024-12-17T11:00:19,874 adding 'lm_eval/tasks/xwinograd/_xwinograd.yaml' 2024-12-17T11:00:19,875 adding 'lm_eval/tasks/xwinograd/utils.py' 2024-12-17T11:00:19,876 adding 'lm_eval/tasks/xwinograd/xwinograd_common_yaml' 2024-12-17T11:00:19,877 adding 'lm_eval/tasks/xwinograd/xwinograd_en.yaml' 2024-12-17T11:00:19,878 adding 'lm_eval/tasks/xwinograd/xwinograd_fr.yaml' 2024-12-17T11:00:19,880 adding 'lm_eval/tasks/xwinograd/xwinograd_jp.yaml' 2024-12-17T11:00:19,881 adding 'lm_eval/tasks/xwinograd/xwinograd_pt.yaml' 2024-12-17T11:00:19,882 adding 'lm_eval/tasks/xwinograd/xwinograd_ru.yaml' 2024-12-17T11:00:19,883 adding 'lm_eval/tasks/xwinograd/xwinograd_zh.yaml' 2024-12-17T11:00:19,885 adding 'lm_eval-0.4.7.dist-info/LICENSE.md' 2024-12-17T11:00:19,890 adding 'lm_eval-0.4.7.dist-info/METADATA' 2024-12-17T11:00:19,891 adding 'lm_eval-0.4.7.dist-info/WHEEL' 2024-12-17T11:00:19,892 adding 'lm_eval-0.4.7.dist-info/entry_points.txt' 2024-12-17T11:00:19,893 adding 'lm_eval-0.4.7.dist-info/top_level.txt' 2024-12-17T11:00:19,965 adding 'lm_eval-0.4.7.dist-info/RECORD' 2024-12-17T11:00:20,038 removing build/bdist.linux-armv7l/wheel 2024-12-17T11:00:21,036 Building wheel for lm-eval (pyproject.toml): finished with status 'done' 2024-12-17T11:00:21,099 Created wheel for lm-eval: filename=lm_eval-0.4.7-py3-none-any.whl size=2518804 sha256=3b462a73021c5411e6b4491d07d5c4c009843435a2c9350ae5949fbf4a196ed9 2024-12-17T11:00:21,101 Stored in directory: /tmp/pip-ephem-wheel-cache-uprp6irc/wheels/9f/82/eb/9d0854874914d37ee461e30e9d97de4fd404b96beabcda0025 2024-12-17T11:00:21,242 Successfully built lm-eval 2024-12-17T11:00:21,315 Removed build tracker: '/tmp/pip-build-tracker-v_j8oion'