2024-03-29T17:29:03,069 Created temporary directory: /tmp/pip-build-tracker-ih_lh53z 2024-03-29T17:29:03,071 Initialized build tracking at /tmp/pip-build-tracker-ih_lh53z 2024-03-29T17:29:03,071 Created build tracker: /tmp/pip-build-tracker-ih_lh53z 2024-03-29T17:29:03,072 Entered build tracker: /tmp/pip-build-tracker-ih_lh53z 2024-03-29T17:29:03,072 Created temporary directory: /tmp/pip-wheel-0t49g_xw 2024-03-29T17:29:03,076 Created temporary directory: /tmp/pip-ephem-wheel-cache-k8h8awv8 2024-03-29T17:29:03,098 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-29T17:29:03,102 2 location(s) to search for versions of lighteval: 2024-03-29T17:29:03,102 * https://pypi.org/simple/lighteval/ 2024-03-29T17:29:03,102 * https://www.piwheels.org/simple/lighteval/ 2024-03-29T17:29:03,103 Fetching project page and analyzing links: https://pypi.org/simple/lighteval/ 2024-03-29T17:29:03,103 Getting page https://pypi.org/simple/lighteval/ 2024-03-29T17:29:03,105 Found index url https://pypi.org/simple/ 2024-03-29T17:29:03,332 Fetched page https://pypi.org/simple/lighteval/ as application/vnd.pypi.simple.v1+json 2024-03-29T17:29:03,336 Found link https://files.pythonhosted.org/packages/91/70/3a0c520287b432278921dafe9b4b20e4d639ecb62a1cdb8dfc14a7cf1122/lighteval-0.0.1.tar.gz (from https://pypi.org/simple/lighteval/), version: 0.0.1 2024-03-29T17:29:03,336 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/83/b0/7dbdeffab3e2d3a0791f1747818c65c3e76e4c343593712aaaee990bea93/lighteval-0.0.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:29:03,337 Found link https://files.pythonhosted.org/packages/b5/e9/30eaccb5bfb4ca9802bbc3b105b7c8888bdd9bff72d7a7b85ffcb6cd4ad1/lighteval-0.0.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.0.2 2024-03-29T17:29:03,338 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/ce/22/8e9fb7ef899f757df0eafed9e29fd8db9d4c694a3ba7e276bedc5c8a4dc3/lighteval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:29:03,339 Found link https://files.pythonhosted.org/packages/72/c3/07b4cb157f8fa1c0465c32f505418de1df659c67b2bbfa543c5bc9ff9dde/lighteval-0.1.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.0 2024-03-29T17:29:03,340 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/af/d8/92cee84f102f5c801240e90e6380a1f2958aa8ae977fe3f7a6b9804214a0/lighteval-0.1.1.dev0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:29:03,341 Found link https://files.pythonhosted.org/packages/73/b2/0b510938a01164061a56b871af8b138f4ade7fdea6bb96ed5180e345ba2a/lighteval-0.1.1.dev0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.1.dev0 2024-03-29T17:29:03,342 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/a4/f7/9385103352347eaa2500b3060929a2242143db19c937eb56e488753a4d99/lighteval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:29:03,343 Found link https://files.pythonhosted.org/packages/aa/10/97c3a28e599d930aefaa173edc596980df23dc593883a5b0a3ad00c0e2f5/lighteval-0.1.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.1 2024-03-29T17:29:03,343 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/51/0b/304021094a01fbc94a98b7729b2044106475b23286031083fa9217fea981/lighteval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:29:03,344 Found link https://files.pythonhosted.org/packages/c2/b3/dc97dfbdd406d8ce4a7f50d86ef5a24d561e4bfb649783da0807f7cc6cb8/lighteval-0.2.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.2.0 2024-03-29T17:29:03,345 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/14/e2/4c1dc89e6a6c71c6d4745ffd1657e57ca4381dfc48d2c2af6d38215f9f01/lighteval-0.3.0a0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:29:03,346 Found link https://files.pythonhosted.org/packages/e9/5f/9bff4b2f649b9838411bf5a3e29b8eaef0287baee2af56419c7845f43a25/lighteval-0.3.0a0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.3.0a0 2024-03-29T17:29:03,347 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/f5/e7/33f933d80fe537dacdf2677df18437ba8b90e6228936564dd246c295809a/lighteval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:29:03,348 Found link https://files.pythonhosted.org/packages/02/d7/8c52ae664c106385547c5e895b8614b58eb97e1a721ccee0e278739bd0ff/lighteval-0.3.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.3.0 2024-03-29T17:29:03,349 Fetching project page and analyzing links: https://www.piwheels.org/simple/lighteval/ 2024-03-29T17:29:03,349 Getting page https://www.piwheels.org/simple/lighteval/ 2024-03-29T17:29:03,350 Found index url https://www.piwheels.org/simple/ 2024-03-29T17:29:04,322 Fetched page https://www.piwheels.org/simple/lighteval/ as text/html 2024-03-29T17:29:04,328 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.2.0-py3-none-any.whl#sha256=f4dfdbe773e3f0a3958dddfd65b958a347095d693191d5c453d00de9f30344ae (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:29:04,329 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.1.1-py3-none-any.whl#sha256=296c95ef71b3014c30e8fe406bb95469a3d484c721fa61efbb1fe99dce67f950 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:29:04,331 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.1.1.dev0-py3-none-any.whl#sha256=e96ff26cffee66313bad7d96cc3522f90457ccc3fa292862034af2db96f4ef73 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:29:04,331 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.1.0-py3-none-any.whl#sha256=780a9fdd33d3b41060347f899486cd3ffab6f44f46af6c5d9a18ff10e725731d (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:29:04,332 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.0.2-py3-none-any.whl#sha256=08472d569e00511c2d1803932a9b21c03e4424d68970bf1e67d0ab490ef59019 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:29:04,333 Skipping link: not a file: https://www.piwheels.org/simple/lighteval/ 2024-03-29T17:29:04,334 Skipping link: not a file: https://pypi.org/simple/lighteval/ 2024-03-29T17:29:04,380 Given no hashes to check 1 links for project 'lighteval': discarding no candidates 2024-03-29T17:29:04,423 Collecting lighteval==0.3.0a0 2024-03-29T17:29:04,426 Created temporary directory: /tmp/pip-unpack-uufuqha0 2024-03-29T17:29:04,762 Downloading lighteval-0.3.0a0.tar.gz (199 kB) 2024-03-29T17:29:05,081 Added lighteval==0.3.0a0 from https://files.pythonhosted.org/packages/e9/5f/9bff4b2f649b9838411bf5a3e29b8eaef0287baee2af56419c7845f43a25/lighteval-0.3.0a0.tar.gz to build tracker '/tmp/pip-build-tracker-ih_lh53z' 2024-03-29T17:29:05,087 Created temporary directory: /tmp/pip-build-env-35_2_nt6 2024-03-29T17:29:05,091 Installing build dependencies: started 2024-03-29T17:29:05,093 Running command pip subprocess to install build dependencies 2024-03-29T17:29:06,507 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-03-29T17:29:07,052 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-29T17:29:08,539 Collecting setuptools>=61.0 2024-03-29T17:29:08,559 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.2.0-py3-none-any.whl (821 kB) 2024-03-29T17:29:11,463 Installing collected packages: setuptools 2024-03-29T17:29:13,923 Successfully installed setuptools-69.2.0 2024-03-29T17:29:14,493 Installing build dependencies: finished with status 'done' 2024-03-29T17:29:14,711 Getting requirements to build wheel: started 2024-03-29T17:29:14,712 Running command Getting requirements to build wheel 2024-03-29T17:29:15,724 running egg_info 2024-03-29T17:29:15,728 writing src/lighteval.egg-info/PKG-INFO 2024-03-29T17:29:15,740 writing dependency_links to src/lighteval.egg-info/dependency_links.txt 2024-03-29T17:29:15,745 writing requirements to src/lighteval.egg-info/requires.txt 2024-03-29T17:29:15,747 writing top-level names to src/lighteval.egg-info/top_level.txt 2024-03-29T17:29:15,775 reading manifest file 'src/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:29:15,778 reading manifest template 'MANIFEST.in' 2024-03-29T17:29:15,779 adding license file 'LICENSE' 2024-03-29T17:29:15,783 writing manifest file 'src/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:29:15,894 Getting requirements to build wheel: finished with status 'done' 2024-03-29T17:29:15,902 Installing backend dependencies: started 2024-03-29T17:29:15,903 Running command pip subprocess to install backend dependencies 2024-03-29T17:29:17,056 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-03-29T17:29:17,601 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-29T17:29:18,254 Collecting wheel 2024-03-29T17:29:18,269 Using cached https://www.piwheels.org/simple/wheel/wheel-0.43.0-py3-none-any.whl (65 kB) 2024-03-29T17:29:20,533 Installing collected packages: wheel 2024-03-29T17:29:20,997 Creating /tmp/pip-build-env-35_2_nt6/normal/local/bin 2024-03-29T17:29:20,999 changing mode of /tmp/pip-build-env-35_2_nt6/normal/local/bin/wheel to 755 2024-03-29T17:29:21,011 Successfully installed wheel-0.43.0 2024-03-29T17:29:21,544 Installing backend dependencies: finished with status 'done' 2024-03-29T17:29:21,546 Created temporary directory: /tmp/pip-modern-metadata-8nqs9dxg 2024-03-29T17:29:21,548 Preparing metadata (pyproject.toml): started 2024-03-29T17:29:21,549 Running command Preparing metadata (pyproject.toml) 2024-03-29T17:29:22,387 running dist_info 2024-03-29T17:29:22,391 creating /tmp/pip-modern-metadata-8nqs9dxg/lighteval.egg-info 2024-03-29T17:29:22,395 writing /tmp/pip-modern-metadata-8nqs9dxg/lighteval.egg-info/PKG-INFO 2024-03-29T17:29:22,406 writing dependency_links to /tmp/pip-modern-metadata-8nqs9dxg/lighteval.egg-info/dependency_links.txt 2024-03-29T17:29:22,412 writing requirements to /tmp/pip-modern-metadata-8nqs9dxg/lighteval.egg-info/requires.txt 2024-03-29T17:29:22,413 writing top-level names to /tmp/pip-modern-metadata-8nqs9dxg/lighteval.egg-info/top_level.txt 2024-03-29T17:29:22,415 writing manifest file '/tmp/pip-modern-metadata-8nqs9dxg/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:29:22,447 reading manifest file '/tmp/pip-modern-metadata-8nqs9dxg/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:29:22,449 reading manifest template 'MANIFEST.in' 2024-03-29T17:29:22,450 adding license file 'LICENSE' 2024-03-29T17:29:22,454 writing manifest file '/tmp/pip-modern-metadata-8nqs9dxg/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:29:22,455 creating '/tmp/pip-modern-metadata-8nqs9dxg/lighteval-0.3.0a0.dist-info' 2024-03-29T17:29:22,618 Preparing metadata (pyproject.toml): finished with status 'done' 2024-03-29T17:29:22,624 Source in /tmp/pip-wheel-0t49g_xw/lighteval_410cbf9986984cfea07708aee13b3941 has version 0.3.0a0, which satisfies requirement lighteval==0.3.0a0 from https://files.pythonhosted.org/packages/e9/5f/9bff4b2f649b9838411bf5a3e29b8eaef0287baee2af56419c7845f43a25/lighteval-0.3.0a0.tar.gz 2024-03-29T17:29:22,625 Removed lighteval==0.3.0a0 from https://files.pythonhosted.org/packages/e9/5f/9bff4b2f649b9838411bf5a3e29b8eaef0287baee2af56419c7845f43a25/lighteval-0.3.0a0.tar.gz from build tracker '/tmp/pip-build-tracker-ih_lh53z' 2024-03-29T17:29:22,634 Created temporary directory: /tmp/pip-unpack-w0y2tl01 2024-03-29T17:29:22,635 Created temporary directory: /tmp/pip-unpack-18pdr5ky 2024-03-29T17:29:22,698 Building wheels for collected packages: lighteval 2024-03-29T17:29:22,702 Created temporary directory: /tmp/pip-wheel-nmrlrti4 2024-03-29T17:29:22,703 Destination directory: /tmp/pip-wheel-nmrlrti4 2024-03-29T17:29:22,705 Building wheel for lighteval (pyproject.toml): started 2024-03-29T17:29:22,706 Running command Building wheel for lighteval (pyproject.toml) 2024-03-29T17:29:23,474 running bdist_wheel 2024-03-29T17:29:23,490 running build 2024-03-29T17:29:23,491 running build_py 2024-03-29T17:29:23,495 creating build 2024-03-29T17:29:23,496 creating build/lib 2024-03-29T17:29:23,496 creating build/lib/lighteval 2024-03-29T17:29:23,498 copying src/lighteval/__init__.py -> build/lib/lighteval 2024-03-29T17:29:23,500 copying src/lighteval/main_accelerate.py -> build/lib/lighteval 2024-03-29T17:29:23,502 copying src/lighteval/main_nanotron.py -> build/lib/lighteval 2024-03-29T17:29:23,505 copying src/lighteval/few_shot_manager.py -> build/lib/lighteval 2024-03-29T17:29:23,508 copying src/lighteval/evaluator.py -> build/lib/lighteval 2024-03-29T17:29:23,510 copying src/lighteval/utils.py -> build/lib/lighteval 2024-03-29T17:29:23,513 copying src/lighteval/data.py -> build/lib/lighteval 2024-03-29T17:29:23,515 copying src/lighteval/utils_parallelism.py -> build/lib/lighteval 2024-03-29T17:29:23,518 creating build/lib/lighteval/tasks 2024-03-29T17:29:23,519 copying src/lighteval/tasks/tasks_prompt_formatting.py -> build/lib/lighteval/tasks 2024-03-29T17:29:23,524 copying src/lighteval/tasks/requests.py -> build/lib/lighteval/tasks 2024-03-29T17:29:23,526 copying src/lighteval/tasks/lighteval_task.py -> build/lib/lighteval/tasks 2024-03-29T17:29:23,529 copying src/lighteval/tasks/registry.py -> build/lib/lighteval/tasks 2024-03-29T17:29:23,532 creating build/lib/lighteval/logging 2024-03-29T17:29:23,533 copying src/lighteval/logging/hierarchical_logger.py -> build/lib/lighteval/logging 2024-03-29T17:29:23,536 copying src/lighteval/logging/info_loggers.py -> build/lib/lighteval/logging 2024-03-29T17:29:23,539 copying src/lighteval/logging/evaluation_tracker.py -> build/lib/lighteval/logging 2024-03-29T17:29:23,542 creating build/lib/lighteval/models 2024-03-29T17:29:23,544 copying src/lighteval/models/base_model.py -> build/lib/lighteval/models 2024-03-29T17:29:23,547 copying src/lighteval/models/model_config.py -> build/lib/lighteval/models 2024-03-29T17:29:23,550 copying src/lighteval/models/model_output.py -> build/lib/lighteval/models 2024-03-29T17:29:23,553 copying src/lighteval/models/model_loader.py -> build/lib/lighteval/models 2024-03-29T17:29:23,555 copying src/lighteval/models/endpoint_model.py -> build/lib/lighteval/models 2024-03-29T17:29:23,559 copying src/lighteval/models/tgi_model.py -> build/lib/lighteval/models 2024-03-29T17:29:23,561 copying src/lighteval/models/nanotron_model.py -> build/lib/lighteval/models 2024-03-29T17:29:23,566 copying src/lighteval/models/delta_model.py -> build/lib/lighteval/models 2024-03-29T17:29:23,568 copying src/lighteval/models/adapter_model.py -> build/lib/lighteval/models 2024-03-29T17:29:23,571 copying src/lighteval/models/utils.py -> build/lib/lighteval/models 2024-03-29T17:29:23,574 copying src/lighteval/models/abstract_model.py -> build/lib/lighteval/models 2024-03-29T17:29:23,577 creating build/lib/lighteval/metrics 2024-03-29T17:29:23,578 copying src/lighteval/metrics/__init__.py -> build/lib/lighteval/metrics 2024-03-29T17:29:23,581 copying src/lighteval/metrics/metrics.py -> build/lib/lighteval/metrics 2024-03-29T17:29:23,585 copying src/lighteval/metrics/metrics_sample.py -> build/lib/lighteval/metrics 2024-03-29T17:29:23,588 copying src/lighteval/metrics/stderr.py -> build/lib/lighteval/metrics 2024-03-29T17:29:23,591 copying src/lighteval/metrics/metrics_corpus.py -> build/lib/lighteval/metrics 2024-03-29T17:29:23,594 copying src/lighteval/metrics/sample_preparator.py -> build/lib/lighteval/metrics 2024-03-29T17:29:23,597 copying src/lighteval/metrics/normalizations.py -> build/lib/lighteval/metrics 2024-03-29T17:29:23,599 copying src/lighteval/metrics/utils.py -> build/lib/lighteval/metrics 2024-03-29T17:29:23,602 creating build/lib/lighteval/tasks/extended 2024-03-29T17:29:23,604 copying src/lighteval/tasks/extended/__init__.py -> build/lib/lighteval/tasks/extended 2024-03-29T17:29:23,607 creating build/lib/lighteval/tasks/extended/mt_bench 2024-03-29T17:29:23,608 copying src/lighteval/tasks/extended/mt_bench/main.py -> build/lib/lighteval/tasks/extended/mt_bench 2024-03-29T17:29:23,611 copying src/lighteval/tasks/extended/mt_bench/judges.py -> build/lib/lighteval/tasks/extended/mt_bench 2024-03-29T17:29:23,615 creating build/lib/lighteval/tasks/extended/tiny_benchmarks 2024-03-29T17:29:23,616 copying src/lighteval/tasks/extended/tiny_benchmarks/main.py -> build/lib/lighteval/tasks/extended/tiny_benchmarks 2024-03-29T17:29:23,620 creating build/lib/lighteval/tasks/extended/ifeval 2024-03-29T17:29:23,621 copying src/lighteval/tasks/extended/ifeval/main.py -> build/lib/lighteval/tasks/extended/ifeval 2024-03-29T17:29:23,624 copying src/lighteval/tasks/extended/ifeval/instructions.py -> build/lib/lighteval/tasks/extended/ifeval 2024-03-29T17:29:23,630 copying src/lighteval/tasks/extended/ifeval/instructions_utils.py -> build/lib/lighteval/tasks/extended/ifeval 2024-03-29T17:29:23,634 copying src/lighteval/tasks/extended/ifeval/instructions_registry.py -> build/lib/lighteval/tasks/extended/ifeval 2024-03-29T17:29:23,637 creating build/lib/lighteval/metrics/imports 2024-03-29T17:29:23,638 copying src/lighteval/metrics/imports/bert_scorer.py -> build/lib/lighteval/metrics/imports 2024-03-29T17:29:23,641 copying src/lighteval/metrics/imports/summac.py -> build/lib/lighteval/metrics/imports 2024-03-29T17:29:23,644 copying src/lighteval/metrics/imports/data_stats_metric.py -> build/lib/lighteval/metrics/imports 2024-03-29T17:29:23,647 copying src/lighteval/metrics/imports/data_stats_utils.py -> build/lib/lighteval/metrics/imports 2024-03-29T17:29:23,650 creating build/lib/lighteval/metrics/harness_compatibility 2024-03-29T17:29:23,651 copying src/lighteval/metrics/harness_compatibility/drop.py -> build/lib/lighteval/metrics/harness_compatibility 2024-03-29T17:29:23,654 copying src/lighteval/metrics/harness_compatibility/truthful_qa.py -> build/lib/lighteval/metrics/harness_compatibility 2024-03-29T17:29:23,658 running egg_info 2024-03-29T17:29:23,662 writing src/lighteval.egg-info/PKG-INFO 2024-03-29T17:29:23,672 writing dependency_links to src/lighteval.egg-info/dependency_links.txt 2024-03-29T17:29:23,677 writing requirements to src/lighteval.egg-info/requires.txt 2024-03-29T17:29:23,679 writing top-level names to src/lighteval.egg-info/top_level.txt 2024-03-29T17:29:23,696 reading manifest file 'src/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:29:23,699 reading manifest template 'MANIFEST.in' 2024-03-29T17:29:23,701 adding license file 'LICENSE' 2024-03-29T17:29:23,705 writing manifest file 'src/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:29:23,713 copying src/lighteval/tasks/tasks_table.jsonl -> build/lib/lighteval/tasks 2024-03-29T17:29:23,746 installing to build/bdist.linux-armv7l/wheel 2024-03-29T17:29:23,746 running install 2024-03-29T17:29:23,771 running install_lib 2024-03-29T17:29:23,775 creating build/bdist.linux-armv7l 2024-03-29T17:29:23,776 creating build/bdist.linux-armv7l/wheel 2024-03-29T17:29:23,779 creating build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:29:23,782 creating build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-03-29T17:29:23,784 copying build/lib/lighteval/tasks/tasks_prompt_formatting.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-03-29T17:29:23,791 copying build/lib/lighteval/tasks/requests.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-03-29T17:29:23,795 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/extended 2024-03-29T17:29:23,797 copying build/lib/lighteval/tasks/extended/__init__.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended 2024-03-29T17:29:23,800 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/mt_bench 2024-03-29T17:29:23,801 copying build/lib/lighteval/tasks/extended/mt_bench/main.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/mt_bench 2024-03-29T17:29:23,804 copying build/lib/lighteval/tasks/extended/mt_bench/judges.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/mt_bench 2024-03-29T17:29:23,807 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/tiny_benchmarks 2024-03-29T17:29:23,808 copying build/lib/lighteval/tasks/extended/tiny_benchmarks/main.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/tiny_benchmarks 2024-03-29T17:29:23,812 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/ifeval 2024-03-29T17:29:23,813 copying build/lib/lighteval/tasks/extended/ifeval/main.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/ifeval 2024-03-29T17:29:23,816 copying build/lib/lighteval/tasks/extended/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/ifeval 2024-03-29T17:29:23,821 copying build/lib/lighteval/tasks/extended/ifeval/instructions_utils.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/ifeval 2024-03-29T17:29:23,825 copying build/lib/lighteval/tasks/extended/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/ifeval 2024-03-29T17:29:23,828 copying build/lib/lighteval/tasks/lighteval_task.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-03-29T17:29:23,833 copying build/lib/lighteval/tasks/tasks_table.jsonl -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-03-29T17:29:23,850 copying build/lib/lighteval/tasks/registry.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-03-29T17:29:23,853 copying build/lib/lighteval/__init__.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:29:23,855 copying build/lib/lighteval/main_accelerate.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:29:23,858 creating build/bdist.linux-armv7l/wheel/lighteval/logging 2024-03-29T17:29:23,860 copying build/lib/lighteval/logging/hierarchical_logger.py -> build/bdist.linux-armv7l/wheel/lighteval/logging 2024-03-29T17:29:23,862 copying build/lib/lighteval/logging/info_loggers.py -> build/bdist.linux-armv7l/wheel/lighteval/logging 2024-03-29T17:29:23,866 copying build/lib/lighteval/logging/evaluation_tracker.py -> build/bdist.linux-armv7l/wheel/lighteval/logging 2024-03-29T17:29:23,870 copying build/lib/lighteval/main_nanotron.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:29:23,874 creating build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:29:23,875 copying build/lib/lighteval/models/base_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:29:23,881 copying build/lib/lighteval/models/model_config.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:29:23,886 copying build/lib/lighteval/models/model_output.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:29:23,888 copying build/lib/lighteval/models/model_loader.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:29:23,891 copying build/lib/lighteval/models/endpoint_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:29:23,894 copying build/lib/lighteval/models/tgi_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:29:23,896 copying build/lib/lighteval/models/nanotron_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:29:23,900 copying build/lib/lighteval/models/delta_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:29:23,902 copying build/lib/lighteval/models/adapter_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:29:23,905 copying build/lib/lighteval/models/utils.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:29:23,907 copying build/lib/lighteval/models/abstract_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:29:23,910 creating build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:29:23,912 copying build/lib/lighteval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:29:23,915 copying build/lib/lighteval/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:29:23,918 copying build/lib/lighteval/metrics/metrics_sample.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:29:23,923 copying build/lib/lighteval/metrics/stderr.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:29:23,925 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-03-29T17:29:23,927 copying build/lib/lighteval/metrics/imports/bert_scorer.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-03-29T17:29:23,931 copying build/lib/lighteval/metrics/imports/summac.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-03-29T17:29:23,935 copying build/lib/lighteval/metrics/imports/data_stats_metric.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-03-29T17:29:23,939 copying build/lib/lighteval/metrics/imports/data_stats_utils.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-03-29T17:29:23,943 copying build/lib/lighteval/metrics/metrics_corpus.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:29:23,946 copying build/lib/lighteval/metrics/sample_preparator.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:29:23,951 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/harness_compatibility 2024-03-29T17:29:23,953 copying build/lib/lighteval/metrics/harness_compatibility/drop.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/harness_compatibility 2024-03-29T17:29:23,957 copying build/lib/lighteval/metrics/harness_compatibility/truthful_qa.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/harness_compatibility 2024-03-29T17:29:23,959 copying build/lib/lighteval/metrics/normalizations.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:29:23,962 copying build/lib/lighteval/metrics/utils.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:29:23,964 copying build/lib/lighteval/few_shot_manager.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:29:23,967 copying build/lib/lighteval/evaluator.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:29:23,970 copying build/lib/lighteval/utils.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:29:23,973 copying build/lib/lighteval/data.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:29:23,976 copying build/lib/lighteval/utils_parallelism.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:29:23,979 running install_egg_info 2024-03-29T17:29:23,984 Copying src/lighteval.egg-info to build/bdist.linux-armv7l/wheel/lighteval-0.3.0a0-py3.11.egg-info 2024-03-29T17:29:23,999 running install_scripts 2024-03-29T17:29:24,032 creating build/bdist.linux-armv7l/wheel/lighteval-0.3.0a0.dist-info/WHEEL 2024-03-29T17:29:24,036 creating '/tmp/pip-wheel-nmrlrti4/.tmp-iphhwkg2/lighteval-0.3.0a0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-03-29T17:29:24,038 adding 'lighteval/__init__.py' 2024-03-29T17:29:24,041 adding 'lighteval/data.py' 2024-03-29T17:29:24,043 adding 'lighteval/evaluator.py' 2024-03-29T17:29:24,045 adding 'lighteval/few_shot_manager.py' 2024-03-29T17:29:24,047 adding 'lighteval/main_accelerate.py' 2024-03-29T17:29:24,049 adding 'lighteval/main_nanotron.py' 2024-03-29T17:29:24,050 adding 'lighteval/utils.py' 2024-03-29T17:29:24,052 adding 'lighteval/utils_parallelism.py' 2024-03-29T17:29:24,056 adding 'lighteval/logging/evaluation_tracker.py' 2024-03-29T17:29:24,058 adding 'lighteval/logging/hierarchical_logger.py' 2024-03-29T17:29:24,061 adding 'lighteval/logging/info_loggers.py' 2024-03-29T17:29:24,063 adding 'lighteval/metrics/__init__.py' 2024-03-29T17:29:24,065 adding 'lighteval/metrics/metrics.py' 2024-03-29T17:29:24,067 adding 'lighteval/metrics/metrics_corpus.py' 2024-03-29T17:29:24,070 adding 'lighteval/metrics/metrics_sample.py' 2024-03-29T17:29:24,072 adding 'lighteval/metrics/normalizations.py' 2024-03-29T17:29:24,073 adding 'lighteval/metrics/sample_preparator.py' 2024-03-29T17:29:24,075 adding 'lighteval/metrics/stderr.py' 2024-03-29T17:29:24,076 adding 'lighteval/metrics/utils.py' 2024-03-29T17:29:24,078 adding 'lighteval/metrics/harness_compatibility/drop.py' 2024-03-29T17:29:24,080 adding 'lighteval/metrics/harness_compatibility/truthful_qa.py' 2024-03-29T17:29:24,083 adding 'lighteval/metrics/imports/bert_scorer.py' 2024-03-29T17:29:24,084 adding 'lighteval/metrics/imports/data_stats_metric.py' 2024-03-29T17:29:24,086 adding 'lighteval/metrics/imports/data_stats_utils.py' 2024-03-29T17:29:24,088 adding 'lighteval/metrics/imports/summac.py' 2024-03-29T17:29:24,090 adding 'lighteval/models/abstract_model.py' 2024-03-29T17:29:24,091 adding 'lighteval/models/adapter_model.py' 2024-03-29T17:29:24,097 adding 'lighteval/models/base_model.py' 2024-03-29T17:29:24,099 adding 'lighteval/models/delta_model.py' 2024-03-29T17:29:24,101 adding 'lighteval/models/endpoint_model.py' 2024-03-29T17:29:24,103 adding 'lighteval/models/model_config.py' 2024-03-29T17:29:24,105 adding 'lighteval/models/model_loader.py' 2024-03-29T17:29:24,106 adding 'lighteval/models/model_output.py' 2024-03-29T17:29:24,112 adding 'lighteval/models/nanotron_model.py' 2024-03-29T17:29:24,114 adding 'lighteval/models/tgi_model.py' 2024-03-29T17:29:24,116 adding 'lighteval/models/utils.py' 2024-03-29T17:29:24,120 adding 'lighteval/tasks/lighteval_task.py' 2024-03-29T17:29:24,122 adding 'lighteval/tasks/registry.py' 2024-03-29T17:29:24,123 adding 'lighteval/tasks/requests.py' 2024-03-29T17:29:24,133 adding 'lighteval/tasks/tasks_prompt_formatting.py' 2024-03-29T17:29:24,154 adding 'lighteval/tasks/tasks_table.jsonl' 2024-03-29T17:29:24,159 adding 'lighteval/tasks/extended/__init__.py' 2024-03-29T17:29:24,165 adding 'lighteval/tasks/extended/ifeval/instructions.py' 2024-03-29T17:29:24,167 adding 'lighteval/tasks/extended/ifeval/instructions_registry.py' 2024-03-29T17:29:24,170 adding 'lighteval/tasks/extended/ifeval/instructions_utils.py' 2024-03-29T17:29:24,172 adding 'lighteval/tasks/extended/ifeval/main.py' 2024-03-29T17:29:24,175 adding 'lighteval/tasks/extended/mt_bench/judges.py' 2024-03-29T17:29:24,176 adding 'lighteval/tasks/extended/mt_bench/main.py' 2024-03-29T17:29:24,179 adding 'lighteval/tasks/extended/tiny_benchmarks/main.py' 2024-03-29T17:29:24,181 adding 'lighteval-0.3.0a0.dist-info/LICENSE' 2024-03-29T17:29:24,185 adding 'lighteval-0.3.0a0.dist-info/METADATA' 2024-03-29T17:29:24,186 adding 'lighteval-0.3.0a0.dist-info/WHEEL' 2024-03-29T17:29:24,187 adding 'lighteval-0.3.0a0.dist-info/top_level.txt' 2024-03-29T17:29:24,188 adding 'lighteval-0.3.0a0.dist-info/RECORD' 2024-03-29T17:29:24,194 removing build/bdist.linux-armv7l/wheel 2024-03-29T17:29:24,332 Building wheel for lighteval (pyproject.toml): finished with status 'done' 2024-03-29T17:29:24,342 Created wheel for lighteval: filename=lighteval-0.3.0a0-py3-none-any.whl size=227403 sha256=ca834b38d37c41993d1573606b9f64d28e1218494118389f552f4fbc5c7fe4fd 2024-03-29T17:29:24,344 Stored in directory: /tmp/pip-ephem-wheel-cache-k8h8awv8/wheels/66/20/dc/7002b0c19d6cc4704bd923997e4c7a6fdd40c089bc44cf7c10 2024-03-29T17:29:24,362 Successfully built lighteval 2024-03-29T17:29:24,377 Removed build tracker: '/tmp/pip-build-tracker-ih_lh53z'