2024-02-09T12:28:36,162 Created temporary directory: /tmp/pip-build-tracker-g0_568p6 2024-02-09T12:28:36,163 Initialized build tracking at /tmp/pip-build-tracker-g0_568p6 2024-02-09T12:28:36,164 Created build tracker: /tmp/pip-build-tracker-g0_568p6 2024-02-09T12:28:36,164 Entered build tracker: /tmp/pip-build-tracker-g0_568p6 2024-02-09T12:28:36,165 Created temporary directory: /tmp/pip-wheel-q3f0uv1i 2024-02-09T12:28:36,168 Created temporary directory: /tmp/pip-ephem-wheel-cache-ij4zj8jc 2024-02-09T12:28:36,190 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-02-09T12:28:36,193 2 location(s) to search for versions of lighteval: 2024-02-09T12:28:36,193 * https://pypi.org/simple/lighteval/ 2024-02-09T12:28:36,193 * https://www.piwheels.org/simple/lighteval/ 2024-02-09T12:28:36,194 Fetching project page and analyzing links: https://pypi.org/simple/lighteval/ 2024-02-09T12:28:36,195 Getting page https://pypi.org/simple/lighteval/ 2024-02-09T12:28:36,196 Found index url https://pypi.org/simple/ 2024-02-09T12:28:36,334 Fetched page https://pypi.org/simple/lighteval/ as application/vnd.pypi.simple.v1+json 2024-02-09T12:28:36,337 Found link https://files.pythonhosted.org/packages/91/70/3a0c520287b432278921dafe9b4b20e4d639ecb62a1cdb8dfc14a7cf1122/lighteval-0.0.1.tar.gz (from https://pypi.org/simple/lighteval/), version: 0.0.1 2024-02-09T12:28:36,337 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/83/b0/7dbdeffab3e2d3a0791f1747818c65c3e76e4c343593712aaaee990bea93/lighteval-0.0.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-02-09T12:28:36,338 Found link https://files.pythonhosted.org/packages/b5/e9/30eaccb5bfb4ca9802bbc3b105b7c8888bdd9bff72d7a7b85ffcb6cd4ad1/lighteval-0.0.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.0.2 2024-02-09T12:28:36,339 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/ce/22/8e9fb7ef899f757df0eafed9e29fd8db9d4c694a3ba7e276bedc5c8a4dc3/lighteval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-02-09T12:28:36,340 Found link https://files.pythonhosted.org/packages/72/c3/07b4cb157f8fa1c0465c32f505418de1df659c67b2bbfa543c5bc9ff9dde/lighteval-0.1.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.0 2024-02-09T12:28:36,340 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/af/d8/92cee84f102f5c801240e90e6380a1f2958aa8ae977fe3f7a6b9804214a0/lighteval-0.1.1.dev0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-02-09T12:28:36,341 Found link https://files.pythonhosted.org/packages/73/b2/0b510938a01164061a56b871af8b138f4ade7fdea6bb96ed5180e345ba2a/lighteval-0.1.1.dev0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.1.dev0 2024-02-09T12:28:36,342 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/a4/f7/9385103352347eaa2500b3060929a2242143db19c937eb56e488753a4d99/lighteval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-02-09T12:28:36,343 Found link https://files.pythonhosted.org/packages/aa/10/97c3a28e599d930aefaa173edc596980df23dc593883a5b0a3ad00c0e2f5/lighteval-0.1.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.1 2024-02-09T12:28:36,344 Fetching project page and analyzing links: https://www.piwheels.org/simple/lighteval/ 2024-02-09T12:28:36,344 Getting page https://www.piwheels.org/simple/lighteval/ 2024-02-09T12:28:36,346 Found index url https://www.piwheels.org/simple/ 2024-02-09T12:28:36,510 Fetched page https://www.piwheels.org/simple/lighteval/ as text/html 2024-02-09T12:28:36,512 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.1.0-py3-none-any.whl#sha256=780a9fdd33d3b41060347f899486cd3ffab6f44f46af6c5d9a18ff10e725731d (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2024-02-09T12:28:36,513 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.0.2-py3-none-any.whl#sha256=08472d569e00511c2d1803932a9b21c03e4424d68970bf1e67d0ab490ef59019 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2024-02-09T12:28:36,514 Skipping link: not a file: https://www.piwheels.org/simple/lighteval/ 2024-02-09T12:28:36,515 Skipping link: not a file: https://pypi.org/simple/lighteval/ 2024-02-09T12:28:36,533 Given no hashes to check 1 links for project 'lighteval': discarding no candidates 2024-02-09T12:28:36,551 Collecting lighteval==0.1.1 2024-02-09T12:28:36,553 Created temporary directory: /tmp/pip-unpack-v_o1_xlx 2024-02-09T12:28:36,762 Downloading lighteval-0.1.1.tar.gz (155 kB) 2024-02-09T12:28:36,970 Added lighteval==0.1.1 from https://files.pythonhosted.org/packages/aa/10/97c3a28e599d930aefaa173edc596980df23dc593883a5b0a3ad00c0e2f5/lighteval-0.1.1.tar.gz to build tracker '/tmp/pip-build-tracker-g0_568p6' 2024-02-09T12:28:36,976 Created temporary directory: /tmp/pip-build-env-mq7pjqvz 2024-02-09T12:28:36,980 Installing build dependencies: started 2024-02-09T12:28:36,981 Running command pip subprocess to install build dependencies 2024-02-09T12:28:38,156 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-02-09T12:28:38,685 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-02-09T12:28:40,116 Collecting setuptools>=61.0 2024-02-09T12:28:40,131 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.0.3-py3-none-any.whl (819 kB) 2024-02-09T12:28:42,735 Installing collected packages: setuptools 2024-02-09T12:28:45,909 Successfully installed setuptools-69.0.3 2024-02-09T12:28:46,189 [notice] A new release of pip is available: 23.3.1 -> 24.0 2024-02-09T12:28:46,190 [notice] To update, run: python3 -m pip install --upgrade pip 2024-02-09T12:28:46,451 Installing build dependencies: finished with status 'done' 2024-02-09T12:28:46,454 Getting requirements to build wheel: started 2024-02-09T12:28:46,455 Running command Getting requirements to build wheel 2024-02-09T12:28:47,254 running egg_info 2024-02-09T12:28:47,257 writing src/lighteval.egg-info/PKG-INFO 2024-02-09T12:28:47,265 writing dependency_links to src/lighteval.egg-info/dependency_links.txt 2024-02-09T12:28:47,269 writing requirements to src/lighteval.egg-info/requires.txt 2024-02-09T12:28:47,270 writing top-level names to src/lighteval.egg-info/top_level.txt 2024-02-09T12:28:47,293 reading manifest file 'src/lighteval.egg-info/SOURCES.txt' 2024-02-09T12:28:47,296 reading manifest template 'MANIFEST.in' 2024-02-09T12:28:47,300 writing manifest file 'src/lighteval.egg-info/SOURCES.txt' 2024-02-09T12:28:47,411 Getting requirements to build wheel: finished with status 'done' 2024-02-09T12:28:47,419 Installing backend dependencies: started 2024-02-09T12:28:47,420 Running command pip subprocess to install backend dependencies 2024-02-09T12:28:48,563 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-02-09T12:28:49,090 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-02-09T12:28:49,609 Collecting wheel 2024-02-09T12:28:49,625 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2024-02-09T12:28:51,878 Installing collected packages: wheel 2024-02-09T12:28:52,106 Creating /tmp/pip-build-env-mq7pjqvz/normal/local/bin 2024-02-09T12:28:52,108 changing mode of /tmp/pip-build-env-mq7pjqvz/normal/local/bin/wheel to 755 2024-02-09T12:28:52,120 Successfully installed wheel-0.42.0 2024-02-09T12:28:53,482 [notice] A new release of pip is available: 23.3.1 -> 24.0 2024-02-09T12:28:53,483 [notice] To update, run: python3 -m pip install --upgrade pip 2024-02-09T12:28:53,757 Installing backend dependencies: finished with status 'done' 2024-02-09T12:28:53,759 Created temporary directory: /tmp/pip-modern-metadata-faj6pwsr 2024-02-09T12:28:53,762 Preparing metadata (pyproject.toml): started 2024-02-09T12:28:53,764 Running command Preparing metadata (pyproject.toml) 2024-02-09T12:28:54,680 running dist_info 2024-02-09T12:28:54,685 creating /tmp/pip-modern-metadata-faj6pwsr/lighteval.egg-info 2024-02-09T12:28:54,689 writing /tmp/pip-modern-metadata-faj6pwsr/lighteval.egg-info/PKG-INFO 2024-02-09T12:28:54,697 writing dependency_links to /tmp/pip-modern-metadata-faj6pwsr/lighteval.egg-info/dependency_links.txt 2024-02-09T12:28:54,701 writing requirements to /tmp/pip-modern-metadata-faj6pwsr/lighteval.egg-info/requires.txt 2024-02-09T12:28:54,702 writing top-level names to /tmp/pip-modern-metadata-faj6pwsr/lighteval.egg-info/top_level.txt 2024-02-09T12:28:54,704 writing manifest file '/tmp/pip-modern-metadata-faj6pwsr/lighteval.egg-info/SOURCES.txt' 2024-02-09T12:28:54,732 reading manifest file '/tmp/pip-modern-metadata-faj6pwsr/lighteval.egg-info/SOURCES.txt' 2024-02-09T12:28:54,734 reading manifest template 'MANIFEST.in' 2024-02-09T12:28:54,738 writing manifest file '/tmp/pip-modern-metadata-faj6pwsr/lighteval.egg-info/SOURCES.txt' 2024-02-09T12:28:54,739 creating '/tmp/pip-modern-metadata-faj6pwsr/lighteval-0.1.1.dist-info' 2024-02-09T12:28:54,895 Preparing metadata (pyproject.toml): finished with status 'done' 2024-02-09T12:28:54,901 Source in /tmp/pip-wheel-q3f0uv1i/lighteval_cb5cbdd6743a457ea42b0f2b0a09e328 has version 0.1.1, which satisfies requirement lighteval==0.1.1 from https://files.pythonhosted.org/packages/aa/10/97c3a28e599d930aefaa173edc596980df23dc593883a5b0a3ad00c0e2f5/lighteval-0.1.1.tar.gz 2024-02-09T12:28:54,902 Removed lighteval==0.1.1 from https://files.pythonhosted.org/packages/aa/10/97c3a28e599d930aefaa173edc596980df23dc593883a5b0a3ad00c0e2f5/lighteval-0.1.1.tar.gz from build tracker '/tmp/pip-build-tracker-g0_568p6' 2024-02-09T12:28:54,910 Created temporary directory: /tmp/pip-unpack-lfxt9fmf 2024-02-09T12:28:54,911 Created temporary directory: /tmp/pip-unpack-rmehh98v 2024-02-09T12:28:54,959 Building wheels for collected packages: lighteval 2024-02-09T12:28:54,963 Created temporary directory: /tmp/pip-wheel-9wf4t64q 2024-02-09T12:28:54,964 Destination directory: /tmp/pip-wheel-9wf4t64q 2024-02-09T12:28:54,966 Building wheel for lighteval (pyproject.toml): started 2024-02-09T12:28:54,968 Running command Building wheel for lighteval (pyproject.toml) 2024-02-09T12:28:55,736 running bdist_wheel 2024-02-09T12:28:55,751 running build 2024-02-09T12:28:55,752 running build_py 2024-02-09T12:28:55,756 creating build 2024-02-09T12:28:55,757 creating build/lib 2024-02-09T12:28:55,757 creating build/lib/lighteval 2024-02-09T12:28:55,759 copying src/lighteval/evaluator.py -> build/lib/lighteval 2024-02-09T12:28:55,761 copying src/lighteval/few_shot_manager.py -> build/lib/lighteval 2024-02-09T12:28:55,763 copying src/lighteval/utils_parallelism.py -> build/lib/lighteval 2024-02-09T12:28:55,765 copying src/lighteval/__init__.py -> build/lib/lighteval 2024-02-09T12:28:55,767 copying src/lighteval/data.py -> build/lib/lighteval 2024-02-09T12:28:55,769 copying src/lighteval/main_nanotron.py -> build/lib/lighteval 2024-02-09T12:28:55,771 copying src/lighteval/main_accelerate.py -> build/lib/lighteval 2024-02-09T12:28:55,773 copying src/lighteval/utils.py -> build/lib/lighteval 2024-02-09T12:28:55,776 creating build/lib/lighteval/metrics 2024-02-09T12:28:55,777 copying src/lighteval/metrics/metrics_corpus.py -> build/lib/lighteval/metrics 2024-02-09T12:28:55,779 copying src/lighteval/metrics/sample_preparator.py -> build/lib/lighteval/metrics 2024-02-09T12:28:55,781 copying src/lighteval/metrics/normalizations.py -> build/lib/lighteval/metrics 2024-02-09T12:28:55,783 copying src/lighteval/metrics/metrics_sample.py -> build/lib/lighteval/metrics 2024-02-09T12:28:55,785 copying src/lighteval/metrics/__init__.py -> build/lib/lighteval/metrics 2024-02-09T12:28:55,788 copying src/lighteval/metrics/metrics.py -> build/lib/lighteval/metrics 2024-02-09T12:28:55,790 copying src/lighteval/metrics/stderr.py -> build/lib/lighteval/metrics 2024-02-09T12:28:55,792 copying src/lighteval/metrics/utils.py -> build/lib/lighteval/metrics 2024-02-09T12:28:55,795 creating build/lib/lighteval/models 2024-02-09T12:28:55,796 copying src/lighteval/models/abstract_model.py -> build/lib/lighteval/models 2024-02-09T12:28:55,797 copying src/lighteval/models/model_loader.py -> build/lib/lighteval/models 2024-02-09T12:28:55,799 copying src/lighteval/models/nanotron_model.py -> build/lib/lighteval/models 2024-02-09T12:28:55,802 copying src/lighteval/models/endpoint_model.py -> build/lib/lighteval/models 2024-02-09T12:28:55,805 copying src/lighteval/models/adapter_model.py -> build/lib/lighteval/models 2024-02-09T12:28:55,807 copying src/lighteval/models/model_config.py -> build/lib/lighteval/models 2024-02-09T12:28:55,809 copying src/lighteval/models/delta_model.py -> build/lib/lighteval/models 2024-02-09T12:28:55,811 copying src/lighteval/models/tgi_model.py -> build/lib/lighteval/models 2024-02-09T12:28:55,813 copying src/lighteval/models/model_output.py -> build/lib/lighteval/models 2024-02-09T12:28:55,815 copying src/lighteval/models/base_model.py -> build/lib/lighteval/models 2024-02-09T12:28:55,818 copying src/lighteval/models/utils.py -> build/lib/lighteval/models 2024-02-09T12:28:55,820 creating build/lib/lighteval/logging 2024-02-09T12:28:55,821 copying src/lighteval/logging/evaluation_tracker.py -> build/lib/lighteval/logging 2024-02-09T12:28:55,824 copying src/lighteval/logging/info_loggers.py -> build/lib/lighteval/logging 2024-02-09T12:28:55,827 copying src/lighteval/logging/hierarchical_logger.py -> build/lib/lighteval/logging 2024-02-09T12:28:55,829 creating build/lib/lighteval/tasks 2024-02-09T12:28:55,830 copying src/lighteval/tasks/tasks_prompt_formatting.py -> build/lib/lighteval/tasks 2024-02-09T12:28:55,835 copying src/lighteval/tasks/registry.py -> build/lib/lighteval/tasks 2024-02-09T12:28:55,837 copying src/lighteval/tasks/lighteval_task.py -> build/lib/lighteval/tasks 2024-02-09T12:28:55,839 copying src/lighteval/tasks/requests.py -> build/lib/lighteval/tasks 2024-02-09T12:28:55,842 creating build/lib/lighteval/metrics/harness_compatibility 2024-02-09T12:28:55,843 copying src/lighteval/metrics/harness_compatibility/truthful_qa.py -> build/lib/lighteval/metrics/harness_compatibility 2024-02-09T12:28:55,845 copying src/lighteval/metrics/harness_compatibility/drop.py -> build/lib/lighteval/metrics/harness_compatibility 2024-02-09T12:28:55,847 creating build/lib/lighteval/metrics/imports 2024-02-09T12:28:55,848 copying src/lighteval/metrics/imports/bert_scorer.py -> build/lib/lighteval/metrics/imports 2024-02-09T12:28:55,851 copying src/lighteval/metrics/imports/data_stats_utils.py -> build/lib/lighteval/metrics/imports 2024-02-09T12:28:55,853 copying src/lighteval/metrics/imports/data_stats_metric.py -> build/lib/lighteval/metrics/imports 2024-02-09T12:28:55,856 copying src/lighteval/metrics/imports/summac.py -> build/lib/lighteval/metrics/imports 2024-02-09T12:28:55,858 running egg_info 2024-02-09T12:28:55,861 writing src/lighteval.egg-info/PKG-INFO 2024-02-09T12:28:55,868 writing dependency_links to src/lighteval.egg-info/dependency_links.txt 2024-02-09T12:28:55,872 writing requirements to src/lighteval.egg-info/requires.txt 2024-02-09T12:28:55,873 writing top-level names to src/lighteval.egg-info/top_level.txt 2024-02-09T12:28:56,102 reading manifest file 'src/lighteval.egg-info/SOURCES.txt' 2024-02-09T12:28:56,104 reading manifest template 'MANIFEST.in' 2024-02-09T12:28:56,108 writing manifest file 'src/lighteval.egg-info/SOURCES.txt' 2024-02-09T12:28:56,113 copying src/lighteval/tasks/tasks_table.jsonl -> build/lib/lighteval/tasks 2024-02-09T12:28:56,133 installing to build/bdist.linux-armv7l/wheel 2024-02-09T12:28:56,133 running install 2024-02-09T12:28:56,157 running install_lib 2024-02-09T12:28:56,161 creating build/bdist.linux-armv7l 2024-02-09T12:28:56,162 creating build/bdist.linux-armv7l/wheel 2024-02-09T12:28:56,164 creating build/bdist.linux-armv7l/wheel/lighteval 2024-02-09T12:28:56,165 copying build/lib/lighteval/evaluator.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-02-09T12:28:56,167 copying build/lib/lighteval/few_shot_manager.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-02-09T12:28:56,169 copying build/lib/lighteval/utils_parallelism.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-02-09T12:28:56,171 copying build/lib/lighteval/__init__.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-02-09T12:28:56,173 creating build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-02-09T12:28:56,175 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/harness_compatibility 2024-02-09T12:28:56,176 copying build/lib/lighteval/metrics/harness_compatibility/truthful_qa.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/harness_compatibility 2024-02-09T12:28:56,178 copying build/lib/lighteval/metrics/harness_compatibility/drop.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/harness_compatibility 2024-02-09T12:28:56,180 copying build/lib/lighteval/metrics/metrics_corpus.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-02-09T12:28:56,182 copying build/lib/lighteval/metrics/sample_preparator.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-02-09T12:28:56,183 copying build/lib/lighteval/metrics/normalizations.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-02-09T12:28:56,186 copying build/lib/lighteval/metrics/metrics_sample.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-02-09T12:28:56,188 copying build/lib/lighteval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-02-09T12:28:56,191 copying build/lib/lighteval/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-02-09T12:28:56,193 copying build/lib/lighteval/metrics/stderr.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-02-09T12:28:56,195 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-02-09T12:28:56,196 copying build/lib/lighteval/metrics/imports/bert_scorer.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-02-09T12:28:56,199 copying build/lib/lighteval/metrics/imports/data_stats_utils.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-02-09T12:28:56,201 copying build/lib/lighteval/metrics/imports/data_stats_metric.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-02-09T12:28:56,203 copying build/lib/lighteval/metrics/imports/summac.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-02-09T12:28:56,205 copying build/lib/lighteval/metrics/utils.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-02-09T12:28:56,207 copying build/lib/lighteval/data.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-02-09T12:28:56,209 copying build/lib/lighteval/main_nanotron.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-02-09T12:28:56,212 creating build/bdist.linux-armv7l/wheel/lighteval/models 2024-02-09T12:28:56,213 copying build/lib/lighteval/models/abstract_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-02-09T12:28:56,215 copying build/lib/lighteval/models/model_loader.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-02-09T12:28:56,217 copying build/lib/lighteval/models/nanotron_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-02-09T12:28:56,220 copying build/lib/lighteval/models/endpoint_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-02-09T12:28:56,222 copying build/lib/lighteval/models/adapter_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-02-09T12:28:56,224 copying build/lib/lighteval/models/model_config.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-02-09T12:28:56,227 copying build/lib/lighteval/models/delta_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-02-09T12:28:56,228 copying build/lib/lighteval/models/tgi_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-02-09T12:28:56,231 copying build/lib/lighteval/models/model_output.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-02-09T12:28:56,232 copying build/lib/lighteval/models/base_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-02-09T12:28:56,235 copying build/lib/lighteval/models/utils.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-02-09T12:28:56,237 creating build/bdist.linux-armv7l/wheel/lighteval/logging 2024-02-09T12:28:56,238 copying build/lib/lighteval/logging/evaluation_tracker.py -> build/bdist.linux-armv7l/wheel/lighteval/logging 2024-02-09T12:28:56,241 copying build/lib/lighteval/logging/info_loggers.py -> build/bdist.linux-armv7l/wheel/lighteval/logging 2024-02-09T12:28:56,243 copying build/lib/lighteval/logging/hierarchical_logger.py -> build/bdist.linux-armv7l/wheel/lighteval/logging 2024-02-09T12:28:56,245 creating build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-02-09T12:28:56,246 copying build/lib/lighteval/tasks/tasks_prompt_formatting.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-02-09T12:28:56,250 copying build/lib/lighteval/tasks/registry.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-02-09T12:28:56,253 copying build/lib/lighteval/tasks/lighteval_task.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-02-09T12:28:56,255 copying build/lib/lighteval/tasks/tasks_table.jsonl -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-02-09T12:28:56,265 copying build/lib/lighteval/tasks/requests.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-02-09T12:28:56,267 copying build/lib/lighteval/main_accelerate.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-02-09T12:28:56,269 copying build/lib/lighteval/utils.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-02-09T12:28:56,271 running install_egg_info 2024-02-09T12:28:56,275 Copying src/lighteval.egg-info to build/bdist.linux-armv7l/wheel/lighteval-0.1.1-py3.11.egg-info 2024-02-09T12:28:56,285 running install_scripts 2024-02-09T12:28:56,305 creating build/bdist.linux-armv7l/wheel/lighteval-0.1.1.dist-info/WHEEL 2024-02-09T12:28:56,308 creating '/tmp/pip-wheel-9wf4t64q/.tmp-8q269ygt/lighteval-0.1.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-02-09T12:28:56,310 adding 'lighteval/__init__.py' 2024-02-09T12:28:56,312 adding 'lighteval/data.py' 2024-02-09T12:28:56,314 adding 'lighteval/evaluator.py' 2024-02-09T12:28:56,316 adding 'lighteval/few_shot_manager.py' 2024-02-09T12:28:56,317 adding 'lighteval/main_accelerate.py' 2024-02-09T12:28:56,319 adding 'lighteval/main_nanotron.py' 2024-02-09T12:28:56,321 adding 'lighteval/utils.py' 2024-02-09T12:28:56,322 adding 'lighteval/utils_parallelism.py' 2024-02-09T12:28:56,327 adding 'lighteval/logging/evaluation_tracker.py' 2024-02-09T12:28:56,328 adding 'lighteval/logging/hierarchical_logger.py' 2024-02-09T12:28:56,332 adding 'lighteval/logging/info_loggers.py' 2024-02-09T12:28:56,334 adding 'lighteval/metrics/__init__.py' 2024-02-09T12:28:56,336 adding 'lighteval/metrics/metrics.py' 2024-02-09T12:28:56,337 adding 'lighteval/metrics/metrics_corpus.py' 2024-02-09T12:28:56,340 adding 'lighteval/metrics/metrics_sample.py' 2024-02-09T12:28:56,342 adding 'lighteval/metrics/normalizations.py' 2024-02-09T12:28:56,344 adding 'lighteval/metrics/sample_preparator.py' 2024-02-09T12:28:56,345 adding 'lighteval/metrics/stderr.py' 2024-02-09T12:28:56,346 adding 'lighteval/metrics/utils.py' 2024-02-09T12:28:56,348 adding 'lighteval/metrics/harness_compatibility/drop.py' 2024-02-09T12:28:56,350 adding 'lighteval/metrics/harness_compatibility/truthful_qa.py' 2024-02-09T12:28:56,353 adding 'lighteval/metrics/imports/bert_scorer.py' 2024-02-09T12:28:56,354 adding 'lighteval/metrics/imports/data_stats_metric.py' 2024-02-09T12:28:56,356 adding 'lighteval/metrics/imports/data_stats_utils.py' 2024-02-09T12:28:56,358 adding 'lighteval/metrics/imports/summac.py' 2024-02-09T12:28:56,360 adding 'lighteval/models/abstract_model.py' 2024-02-09T12:28:56,361 adding 'lighteval/models/adapter_model.py' 2024-02-09T12:28:56,366 adding 'lighteval/models/base_model.py' 2024-02-09T12:28:56,367 adding 'lighteval/models/delta_model.py' 2024-02-09T12:28:56,369 adding 'lighteval/models/endpoint_model.py' 2024-02-09T12:28:56,371 adding 'lighteval/models/model_config.py' 2024-02-09T12:28:56,373 adding 'lighteval/models/model_loader.py' 2024-02-09T12:28:56,374 adding 'lighteval/models/model_output.py' 2024-02-09T12:28:56,380 adding 'lighteval/models/nanotron_model.py' 2024-02-09T12:28:56,382 adding 'lighteval/models/tgi_model.py' 2024-02-09T12:28:56,383 adding 'lighteval/models/utils.py' 2024-02-09T12:28:56,387 adding 'lighteval/tasks/lighteval_task.py' 2024-02-09T12:28:56,389 adding 'lighteval/tasks/registry.py' 2024-02-09T12:28:56,390 adding 'lighteval/tasks/requests.py' 2024-02-09T12:28:56,399 adding 'lighteval/tasks/tasks_prompt_formatting.py' 2024-02-09T12:28:56,431 adding 'lighteval/tasks/tasks_table.jsonl' 2024-02-09T12:28:56,443 adding 'lighteval-0.1.1.dist-info/METADATA' 2024-02-09T12:28:56,445 adding 'lighteval-0.1.1.dist-info/WHEEL' 2024-02-09T12:28:56,446 adding 'lighteval-0.1.1.dist-info/top_level.txt' 2024-02-09T12:28:56,449 adding 'lighteval-0.1.1.dist-info/RECORD' 2024-02-09T12:28:56,453 removing build/bdist.linux-armv7l/wheel 2024-02-09T12:28:56,600 Building wheel for lighteval (pyproject.toml): finished with status 'done' 2024-02-09T12:28:56,609 Created wheel for lighteval: filename=lighteval-0.1.1-py3-none-any.whl size=159951 sha256=296c95ef71b3014c30e8fe406bb95469a3d484c721fa61efbb1fe99dce67f950 2024-02-09T12:28:56,610 Stored in directory: /tmp/pip-ephem-wheel-cache-ij4zj8jc/wheels/34/f5/6b/b19e399527ede6750c261b5b0a578c23c9b0461905b6fd45e1 2024-02-09T12:28:56,625 Successfully built lighteval 2024-02-09T12:28:56,633 Removed build tracker: '/tmp/pip-build-tracker-g0_568p6'