2024-03-29T17:30:10,780 Created temporary directory: /tmp/pip-build-tracker-capibn43 2024-03-29T17:30:10,781 Initialized build tracking at /tmp/pip-build-tracker-capibn43 2024-03-29T17:30:10,782 Created build tracker: /tmp/pip-build-tracker-capibn43 2024-03-29T17:30:10,782 Entered build tracker: /tmp/pip-build-tracker-capibn43 2024-03-29T17:30:10,783 Created temporary directory: /tmp/pip-wheel-fbgb735e 2024-03-29T17:30:10,786 Created temporary directory: /tmp/pip-ephem-wheel-cache-eu2uufhy 2024-03-29T17:30:10,809 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-29T17:30:10,812 2 location(s) to search for versions of lighteval: 2024-03-29T17:30:10,812 * https://pypi.org/simple/lighteval/ 2024-03-29T17:30:10,812 * https://www.piwheels.org/simple/lighteval/ 2024-03-29T17:30:10,813 Fetching project page and analyzing links: https://pypi.org/simple/lighteval/ 2024-03-29T17:30:10,814 Getting page https://pypi.org/simple/lighteval/ 2024-03-29T17:30:10,815 Found index url https://pypi.org/simple/ 2024-03-29T17:30:10,956 Fetched page https://pypi.org/simple/lighteval/ as application/vnd.pypi.simple.v1+json 2024-03-29T17:30:10,960 Found link https://files.pythonhosted.org/packages/91/70/3a0c520287b432278921dafe9b4b20e4d639ecb62a1cdb8dfc14a7cf1122/lighteval-0.0.1.tar.gz (from https://pypi.org/simple/lighteval/), version: 0.0.1 2024-03-29T17:30:10,960 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/83/b0/7dbdeffab3e2d3a0791f1747818c65c3e76e4c343593712aaaee990bea93/lighteval-0.0.2-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:30:10,961 Found link https://files.pythonhosted.org/packages/b5/e9/30eaccb5bfb4ca9802bbc3b105b7c8888bdd9bff72d7a7b85ffcb6cd4ad1/lighteval-0.0.2.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.0.2 2024-03-29T17:30:10,962 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/ce/22/8e9fb7ef899f757df0eafed9e29fd8db9d4c694a3ba7e276bedc5c8a4dc3/lighteval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:30:10,963 Found link https://files.pythonhosted.org/packages/72/c3/07b4cb157f8fa1c0465c32f505418de1df659c67b2bbfa543c5bc9ff9dde/lighteval-0.1.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.0 2024-03-29T17:30:10,964 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/af/d8/92cee84f102f5c801240e90e6380a1f2958aa8ae977fe3f7a6b9804214a0/lighteval-0.1.1.dev0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:30:10,965 Found link https://files.pythonhosted.org/packages/73/b2/0b510938a01164061a56b871af8b138f4ade7fdea6bb96ed5180e345ba2a/lighteval-0.1.1.dev0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.1.dev0 2024-03-29T17:30:10,965 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/a4/f7/9385103352347eaa2500b3060929a2242143db19c937eb56e488753a4d99/lighteval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:30:10,966 Found link https://files.pythonhosted.org/packages/aa/10/97c3a28e599d930aefaa173edc596980df23dc593883a5b0a3ad00c0e2f5/lighteval-0.1.1.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.1.1 2024-03-29T17:30:10,967 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/51/0b/304021094a01fbc94a98b7729b2044106475b23286031083fa9217fea981/lighteval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:30:10,968 Found link https://files.pythonhosted.org/packages/c2/b3/dc97dfbdd406d8ce4a7f50d86ef5a24d561e4bfb649783da0807f7cc6cb8/lighteval-0.2.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.2.0 2024-03-29T17:30:10,969 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/14/e2/4c1dc89e6a6c71c6d4745ffd1657e57ca4381dfc48d2c2af6d38215f9f01/lighteval-0.3.0a0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:30:10,970 Found link https://files.pythonhosted.org/packages/e9/5f/9bff4b2f649b9838411bf5a3e29b8eaef0287baee2af56419c7845f43a25/lighteval-0.3.0a0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.3.0a0 2024-03-29T17:30:10,971 Skipping link: No binaries permitted for lighteval: https://files.pythonhosted.org/packages/f5/e7/33f933d80fe537dacdf2677df18437ba8b90e6228936564dd246c295809a/lighteval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:30:10,971 Found link https://files.pythonhosted.org/packages/02/d7/8c52ae664c106385547c5e895b8614b58eb97e1a721ccee0e278739bd0ff/lighteval-0.3.0.tar.gz (from https://pypi.org/simple/lighteval/) (requires-python:>=3.10), version: 0.3.0 2024-03-29T17:30:10,972 Fetching project page and analyzing links: https://www.piwheels.org/simple/lighteval/ 2024-03-29T17:30:10,973 Getting page https://www.piwheels.org/simple/lighteval/ 2024-03-29T17:30:10,974 Found index url https://www.piwheels.org/simple/ 2024-03-29T17:30:11,740 Fetched page https://www.piwheels.org/simple/lighteval/ as text/html 2024-03-29T17:30:11,746 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.2.0-py3-none-any.whl#sha256=f4dfdbe773e3f0a3958dddfd65b958a347095d693191d5c453d00de9f30344ae (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:30:11,747 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.1.1-py3-none-any.whl#sha256=296c95ef71b3014c30e8fe406bb95469a3d484c721fa61efbb1fe99dce67f950 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:30:11,748 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.1.1.dev0-py3-none-any.whl#sha256=e96ff26cffee66313bad7d96cc3522f90457ccc3fa292862034af2db96f4ef73 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:30:11,749 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.1.0-py3-none-any.whl#sha256=780a9fdd33d3b41060347f899486cd3ffab6f44f46af6c5d9a18ff10e725731d (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:30:11,750 Skipping link: No binaries permitted for lighteval: https://www.piwheels.org/simple/lighteval/lighteval-0.0.2-py3-none-any.whl#sha256=08472d569e00511c2d1803932a9b21c03e4424d68970bf1e67d0ab490ef59019 (from https://www.piwheels.org/simple/lighteval/) (requires-python:>=3.10) 2024-03-29T17:30:11,751 Skipping link: not a file: https://www.piwheels.org/simple/lighteval/ 2024-03-29T17:30:11,752 Skipping link: not a file: https://pypi.org/simple/lighteval/ 2024-03-29T17:30:11,798 Given no hashes to check 1 links for project 'lighteval': discarding no candidates 2024-03-29T17:30:11,839 Collecting lighteval==0.3.0 2024-03-29T17:30:11,842 Created temporary directory: /tmp/pip-unpack-p_0qbf69 2024-03-29T17:30:12,084 Downloading lighteval-0.3.0.tar.gz (200 kB) 2024-03-29T17:30:12,410 Added lighteval==0.3.0 from https://files.pythonhosted.org/packages/02/d7/8c52ae664c106385547c5e895b8614b58eb97e1a721ccee0e278739bd0ff/lighteval-0.3.0.tar.gz to build tracker '/tmp/pip-build-tracker-capibn43' 2024-03-29T17:30:12,415 Created temporary directory: /tmp/pip-build-env-6i3eikpx 2024-03-29T17:30:12,420 Installing build dependencies: started 2024-03-29T17:30:12,421 Running command pip subprocess to install build dependencies 2024-03-29T17:30:13,600 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-03-29T17:30:14,138 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-29T17:30:15,585 Collecting setuptools>=61.0 2024-03-29T17:30:15,611 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.2.0-py3-none-any.whl (821 kB) 2024-03-29T17:30:18,255 Installing collected packages: setuptools 2024-03-29T17:30:20,914 Successfully installed setuptools-69.2.0 2024-03-29T17:30:21,521 Installing build dependencies: finished with status 'done' 2024-03-29T17:30:21,525 Getting requirements to build wheel: started 2024-03-29T17:30:21,527 Running command Getting requirements to build wheel 2024-03-29T17:30:22,306 running egg_info 2024-03-29T17:30:22,310 writing src/lighteval.egg-info/PKG-INFO 2024-03-29T17:30:22,320 writing dependency_links to src/lighteval.egg-info/dependency_links.txt 2024-03-29T17:30:22,325 writing requirements to src/lighteval.egg-info/requires.txt 2024-03-29T17:30:22,327 writing top-level names to src/lighteval.egg-info/top_level.txt 2024-03-29T17:30:22,353 reading manifest file 'src/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:30:22,356 reading manifest template 'MANIFEST.in' 2024-03-29T17:30:22,357 adding license file 'LICENSE' 2024-03-29T17:30:22,361 writing manifest file 'src/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:30:22,472 Getting requirements to build wheel: finished with status 'done' 2024-03-29T17:30:22,480 Installing backend dependencies: started 2024-03-29T17:30:22,481 Running command pip subprocess to install backend dependencies 2024-03-29T17:30:23,671 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-03-29T17:30:24,232 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-29T17:30:24,976 Collecting wheel 2024-03-29T17:30:27,682 Using cached https://www.piwheels.org/simple/wheel/wheel-0.43.0-py3-none-any.whl (65 kB) 2024-03-29T17:30:29,990 Installing collected packages: wheel 2024-03-29T17:30:30,244 Creating /tmp/pip-build-env-6i3eikpx/normal/local/bin 2024-03-29T17:30:30,247 changing mode of /tmp/pip-build-env-6i3eikpx/normal/local/bin/wheel to 755 2024-03-29T17:30:30,260 Successfully installed wheel-0.43.0 2024-03-29T17:30:30,792 Installing backend dependencies: finished with status 'done' 2024-03-29T17:30:30,794 Created temporary directory: /tmp/pip-modern-metadata-xpzcprb3 2024-03-29T17:30:30,797 Preparing metadata (pyproject.toml): started 2024-03-29T17:30:30,798 Running command Preparing metadata (pyproject.toml) 2024-03-29T17:30:31,645 running dist_info 2024-03-29T17:30:31,650 creating /tmp/pip-modern-metadata-xpzcprb3/lighteval.egg-info 2024-03-29T17:30:31,654 writing /tmp/pip-modern-metadata-xpzcprb3/lighteval.egg-info/PKG-INFO 2024-03-29T17:30:31,665 writing dependency_links to /tmp/pip-modern-metadata-xpzcprb3/lighteval.egg-info/dependency_links.txt 2024-03-29T17:30:31,670 writing requirements to /tmp/pip-modern-metadata-xpzcprb3/lighteval.egg-info/requires.txt 2024-03-29T17:30:31,671 writing top-level names to /tmp/pip-modern-metadata-xpzcprb3/lighteval.egg-info/top_level.txt 2024-03-29T17:30:31,673 writing manifest file '/tmp/pip-modern-metadata-xpzcprb3/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:30:31,707 reading manifest file '/tmp/pip-modern-metadata-xpzcprb3/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:30:31,709 reading manifest template 'MANIFEST.in' 2024-03-29T17:30:31,710 adding license file 'LICENSE' 2024-03-29T17:30:31,713 writing manifest file '/tmp/pip-modern-metadata-xpzcprb3/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:30:31,715 creating '/tmp/pip-modern-metadata-xpzcprb3/lighteval-0.3.0.dist-info' 2024-03-29T17:30:31,875 Preparing metadata (pyproject.toml): finished with status 'done' 2024-03-29T17:30:31,881 Source in /tmp/pip-wheel-fbgb735e/lighteval_e491104a3c0844d9a7655a854e1fbc49 has version 0.3.0, which satisfies requirement lighteval==0.3.0 from https://files.pythonhosted.org/packages/02/d7/8c52ae664c106385547c5e895b8614b58eb97e1a721ccee0e278739bd0ff/lighteval-0.3.0.tar.gz 2024-03-29T17:30:31,882 Removed lighteval==0.3.0 from https://files.pythonhosted.org/packages/02/d7/8c52ae664c106385547c5e895b8614b58eb97e1a721ccee0e278739bd0ff/lighteval-0.3.0.tar.gz from build tracker '/tmp/pip-build-tracker-capibn43' 2024-03-29T17:30:31,891 Created temporary directory: /tmp/pip-unpack-ogndw7wj 2024-03-29T17:30:31,892 Created temporary directory: /tmp/pip-unpack-_r9__oor 2024-03-29T17:30:31,955 Building wheels for collected packages: lighteval 2024-03-29T17:30:31,961 Created temporary directory: /tmp/pip-wheel-ujqg9cv_ 2024-03-29T17:30:31,961 Destination directory: /tmp/pip-wheel-ujqg9cv_ 2024-03-29T17:30:31,964 Building wheel for lighteval (pyproject.toml): started 2024-03-29T17:30:31,965 Running command Building wheel for lighteval (pyproject.toml) 2024-03-29T17:30:33,181 running bdist_wheel 2024-03-29T17:30:33,197 running build 2024-03-29T17:30:33,197 running build_py 2024-03-29T17:30:33,201 creating build 2024-03-29T17:30:33,202 creating build/lib 2024-03-29T17:30:33,203 creating build/lib/lighteval 2024-03-29T17:30:33,204 copying src/lighteval/__init__.py -> build/lib/lighteval 2024-03-29T17:30:33,206 copying src/lighteval/main_accelerate.py -> build/lib/lighteval 2024-03-29T17:30:33,209 copying src/lighteval/main_nanotron.py -> build/lib/lighteval 2024-03-29T17:30:33,211 copying src/lighteval/few_shot_manager.py -> build/lib/lighteval 2024-03-29T17:30:33,213 copying src/lighteval/evaluator.py -> build/lib/lighteval 2024-03-29T17:30:33,215 copying src/lighteval/utils.py -> build/lib/lighteval 2024-03-29T17:30:33,218 copying src/lighteval/data.py -> build/lib/lighteval 2024-03-29T17:30:33,220 copying src/lighteval/utils_parallelism.py -> build/lib/lighteval 2024-03-29T17:30:33,224 creating build/lib/lighteval/tasks 2024-03-29T17:30:33,225 copying src/lighteval/tasks/tasks_prompt_formatting.py -> build/lib/lighteval/tasks 2024-03-29T17:30:33,230 copying src/lighteval/tasks/requests.py -> build/lib/lighteval/tasks 2024-03-29T17:30:33,232 copying src/lighteval/tasks/lighteval_task.py -> build/lib/lighteval/tasks 2024-03-29T17:30:33,236 copying src/lighteval/tasks/registry.py -> build/lib/lighteval/tasks 2024-03-29T17:30:33,240 creating build/lib/lighteval/logging 2024-03-29T17:30:33,241 copying src/lighteval/logging/hierarchical_logger.py -> build/lib/lighteval/logging 2024-03-29T17:30:33,244 copying src/lighteval/logging/info_loggers.py -> build/lib/lighteval/logging 2024-03-29T17:30:33,247 copying src/lighteval/logging/evaluation_tracker.py -> build/lib/lighteval/logging 2024-03-29T17:30:33,251 creating build/lib/lighteval/models 2024-03-29T17:30:33,252 copying src/lighteval/models/base_model.py -> build/lib/lighteval/models 2024-03-29T17:30:33,257 copying src/lighteval/models/model_config.py -> build/lib/lighteval/models 2024-03-29T17:30:33,259 copying src/lighteval/models/model_output.py -> build/lib/lighteval/models 2024-03-29T17:30:33,261 copying src/lighteval/models/model_loader.py -> build/lib/lighteval/models 2024-03-29T17:30:33,263 copying src/lighteval/models/endpoint_model.py -> build/lib/lighteval/models 2024-03-29T17:30:33,266 copying src/lighteval/models/tgi_model.py -> build/lib/lighteval/models 2024-03-29T17:30:33,268 copying src/lighteval/models/nanotron_model.py -> build/lib/lighteval/models 2024-03-29T17:30:33,273 copying src/lighteval/models/delta_model.py -> build/lib/lighteval/models 2024-03-29T17:30:33,275 copying src/lighteval/models/adapter_model.py -> build/lib/lighteval/models 2024-03-29T17:30:33,277 copying src/lighteval/models/utils.py -> build/lib/lighteval/models 2024-03-29T17:30:33,279 copying src/lighteval/models/abstract_model.py -> build/lib/lighteval/models 2024-03-29T17:30:33,282 creating build/lib/lighteval/metrics 2024-03-29T17:30:33,283 copying src/lighteval/metrics/__init__.py -> build/lib/lighteval/metrics 2024-03-29T17:30:33,285 copying src/lighteval/metrics/metrics.py -> build/lib/lighteval/metrics 2024-03-29T17:30:33,288 copying src/lighteval/metrics/metrics_sample.py -> build/lib/lighteval/metrics 2024-03-29T17:30:33,291 copying src/lighteval/metrics/stderr.py -> build/lib/lighteval/metrics 2024-03-29T17:30:33,294 copying src/lighteval/metrics/metrics_corpus.py -> build/lib/lighteval/metrics 2024-03-29T17:30:33,296 copying src/lighteval/metrics/sample_preparator.py -> build/lib/lighteval/metrics 2024-03-29T17:30:33,299 copying src/lighteval/metrics/normalizations.py -> build/lib/lighteval/metrics 2024-03-29T17:30:33,301 copying src/lighteval/metrics/utils.py -> build/lib/lighteval/metrics 2024-03-29T17:30:33,304 creating build/lib/lighteval/tasks/extended 2024-03-29T17:30:33,305 copying src/lighteval/tasks/extended/__init__.py -> build/lib/lighteval/tasks/extended 2024-03-29T17:30:33,307 creating build/lib/lighteval/tasks/extended/mt_bench 2024-03-29T17:30:33,308 copying src/lighteval/tasks/extended/mt_bench/main.py -> build/lib/lighteval/tasks/extended/mt_bench 2024-03-29T17:30:33,311 copying src/lighteval/tasks/extended/mt_bench/judges.py -> build/lib/lighteval/tasks/extended/mt_bench 2024-03-29T17:30:33,314 creating build/lib/lighteval/tasks/extended/tiny_benchmarks 2024-03-29T17:30:33,314 copying src/lighteval/tasks/extended/tiny_benchmarks/main.py -> build/lib/lighteval/tasks/extended/tiny_benchmarks 2024-03-29T17:30:33,318 creating build/lib/lighteval/tasks/extended/ifeval 2024-03-29T17:30:33,319 copying src/lighteval/tasks/extended/ifeval/main.py -> build/lib/lighteval/tasks/extended/ifeval 2024-03-29T17:30:33,322 copying src/lighteval/tasks/extended/ifeval/instructions.py -> build/lib/lighteval/tasks/extended/ifeval 2024-03-29T17:30:33,325 copying src/lighteval/tasks/extended/ifeval/instructions_utils.py -> build/lib/lighteval/tasks/extended/ifeval 2024-03-29T17:30:33,328 copying src/lighteval/tasks/extended/ifeval/instructions_registry.py -> build/lib/lighteval/tasks/extended/ifeval 2024-03-29T17:30:33,331 creating build/lib/lighteval/metrics/imports 2024-03-29T17:30:33,332 copying src/lighteval/metrics/imports/bert_scorer.py -> build/lib/lighteval/metrics/imports 2024-03-29T17:30:33,335 copying src/lighteval/metrics/imports/summac.py -> build/lib/lighteval/metrics/imports 2024-03-29T17:30:33,337 copying src/lighteval/metrics/imports/data_stats_metric.py -> build/lib/lighteval/metrics/imports 2024-03-29T17:30:33,340 copying src/lighteval/metrics/imports/data_stats_utils.py -> build/lib/lighteval/metrics/imports 2024-03-29T17:30:33,343 creating build/lib/lighteval/metrics/harness_compatibility 2024-03-29T17:30:33,344 copying src/lighteval/metrics/harness_compatibility/drop.py -> build/lib/lighteval/metrics/harness_compatibility 2024-03-29T17:30:33,347 copying src/lighteval/metrics/harness_compatibility/truthful_qa.py -> build/lib/lighteval/metrics/harness_compatibility 2024-03-29T17:30:33,349 running egg_info 2024-03-29T17:30:33,353 writing src/lighteval.egg-info/PKG-INFO 2024-03-29T17:30:33,362 writing dependency_links to src/lighteval.egg-info/dependency_links.txt 2024-03-29T17:30:33,367 writing requirements to src/lighteval.egg-info/requires.txt 2024-03-29T17:30:33,368 writing top-level names to src/lighteval.egg-info/top_level.txt 2024-03-29T17:30:33,386 reading manifest file 'src/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:30:33,389 reading manifest template 'MANIFEST.in' 2024-03-29T17:30:33,390 adding license file 'LICENSE' 2024-03-29T17:30:33,394 writing manifest file 'src/lighteval.egg-info/SOURCES.txt' 2024-03-29T17:30:33,401 copying src/lighteval/tasks/tasks_table.jsonl -> build/lib/lighteval/tasks 2024-03-29T17:30:33,439 installing to build/bdist.linux-armv7l/wheel 2024-03-29T17:30:33,440 running install 2024-03-29T17:30:33,479 running install_lib 2024-03-29T17:30:33,485 creating build/bdist.linux-armv7l 2024-03-29T17:30:33,486 creating build/bdist.linux-armv7l/wheel 2024-03-29T17:30:33,489 creating build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:30:33,491 creating build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-03-29T17:30:33,493 copying build/lib/lighteval/tasks/tasks_prompt_formatting.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-03-29T17:30:33,499 copying build/lib/lighteval/tasks/requests.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-03-29T17:30:33,503 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/extended 2024-03-29T17:30:33,505 copying build/lib/lighteval/tasks/extended/__init__.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended 2024-03-29T17:30:33,508 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/mt_bench 2024-03-29T17:30:33,509 copying build/lib/lighteval/tasks/extended/mt_bench/main.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/mt_bench 2024-03-29T17:30:33,511 copying build/lib/lighteval/tasks/extended/mt_bench/judges.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/mt_bench 2024-03-29T17:30:33,515 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/tiny_benchmarks 2024-03-29T17:30:33,516 copying build/lib/lighteval/tasks/extended/tiny_benchmarks/main.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/tiny_benchmarks 2024-03-29T17:30:33,520 creating build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/ifeval 2024-03-29T17:30:33,521 copying build/lib/lighteval/tasks/extended/ifeval/main.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/ifeval 2024-03-29T17:30:33,524 copying build/lib/lighteval/tasks/extended/ifeval/instructions.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/ifeval 2024-03-29T17:30:33,529 copying build/lib/lighteval/tasks/extended/ifeval/instructions_utils.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/ifeval 2024-03-29T17:30:33,533 copying build/lib/lighteval/tasks/extended/ifeval/instructions_registry.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks/extended/ifeval 2024-03-29T17:30:33,536 copying build/lib/lighteval/tasks/lighteval_task.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-03-29T17:30:33,539 copying build/lib/lighteval/tasks/tasks_table.jsonl -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-03-29T17:30:33,593 copying build/lib/lighteval/tasks/registry.py -> build/bdist.linux-armv7l/wheel/lighteval/tasks 2024-03-29T17:30:33,595 copying build/lib/lighteval/__init__.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:30:33,598 copying build/lib/lighteval/main_accelerate.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:30:33,601 creating build/bdist.linux-armv7l/wheel/lighteval/logging 2024-03-29T17:30:33,602 copying build/lib/lighteval/logging/hierarchical_logger.py -> build/bdist.linux-armv7l/wheel/lighteval/logging 2024-03-29T17:30:33,604 copying build/lib/lighteval/logging/info_loggers.py -> build/bdist.linux-armv7l/wheel/lighteval/logging 2024-03-29T17:30:33,607 copying build/lib/lighteval/logging/evaluation_tracker.py -> build/bdist.linux-armv7l/wheel/lighteval/logging 2024-03-29T17:30:33,610 copying build/lib/lighteval/main_nanotron.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:30:33,613 creating build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:30:33,614 copying build/lib/lighteval/models/base_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:30:33,619 copying build/lib/lighteval/models/model_config.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:30:33,622 copying build/lib/lighteval/models/model_output.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:30:33,625 copying build/lib/lighteval/models/model_loader.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:30:33,628 copying build/lib/lighteval/models/endpoint_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:30:33,630 copying build/lib/lighteval/models/tgi_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:30:33,633 copying build/lib/lighteval/models/nanotron_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:30:33,636 copying build/lib/lighteval/models/delta_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:30:33,638 copying build/lib/lighteval/models/adapter_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:30:33,640 copying build/lib/lighteval/models/utils.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:30:33,642 copying build/lib/lighteval/models/abstract_model.py -> build/bdist.linux-armv7l/wheel/lighteval/models 2024-03-29T17:30:33,645 creating build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:30:33,646 copying build/lib/lighteval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:30:33,649 copying build/lib/lighteval/metrics/metrics.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:30:33,653 copying build/lib/lighteval/metrics/metrics_sample.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:30:33,656 copying build/lib/lighteval/metrics/stderr.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:30:33,659 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-03-29T17:30:33,660 copying build/lib/lighteval/metrics/imports/bert_scorer.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-03-29T17:30:33,663 copying build/lib/lighteval/metrics/imports/summac.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-03-29T17:30:33,666 copying build/lib/lighteval/metrics/imports/data_stats_metric.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-03-29T17:30:33,668 copying build/lib/lighteval/metrics/imports/data_stats_utils.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/imports 2024-03-29T17:30:33,670 copying build/lib/lighteval/metrics/metrics_corpus.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:30:33,672 copying build/lib/lighteval/metrics/sample_preparator.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:30:33,675 creating build/bdist.linux-armv7l/wheel/lighteval/metrics/harness_compatibility 2024-03-29T17:30:33,676 copying build/lib/lighteval/metrics/harness_compatibility/drop.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/harness_compatibility 2024-03-29T17:30:33,678 copying build/lib/lighteval/metrics/harness_compatibility/truthful_qa.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics/harness_compatibility 2024-03-29T17:30:33,680 copying build/lib/lighteval/metrics/normalizations.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:30:33,682 copying build/lib/lighteval/metrics/utils.py -> build/bdist.linux-armv7l/wheel/lighteval/metrics 2024-03-29T17:30:33,684 copying build/lib/lighteval/few_shot_manager.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:30:33,687 copying build/lib/lighteval/evaluator.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:30:33,690 copying build/lib/lighteval/utils.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:30:33,693 copying build/lib/lighteval/data.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:30:33,695 copying build/lib/lighteval/utils_parallelism.py -> build/bdist.linux-armv7l/wheel/lighteval 2024-03-29T17:30:33,697 running install_egg_info 2024-03-29T17:30:33,702 Copying src/lighteval.egg-info to build/bdist.linux-armv7l/wheel/lighteval-0.3.0-py3.11.egg-info 2024-03-29T17:30:33,713 running install_scripts 2024-03-29T17:30:33,738 creating build/bdist.linux-armv7l/wheel/lighteval-0.3.0.dist-info/WHEEL 2024-03-29T17:30:33,741 creating '/tmp/pip-wheel-ujqg9cv_/.tmp-jeh3lx68/lighteval-0.3.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-03-29T17:30:33,743 adding 'lighteval/__init__.py' 2024-03-29T17:30:33,745 adding 'lighteval/data.py' 2024-03-29T17:30:33,747 adding 'lighteval/evaluator.py' 2024-03-29T17:30:33,750 adding 'lighteval/few_shot_manager.py' 2024-03-29T17:30:33,752 adding 'lighteval/main_accelerate.py' 2024-03-29T17:30:33,753 adding 'lighteval/main_nanotron.py' 2024-03-29T17:30:33,755 adding 'lighteval/utils.py' 2024-03-29T17:30:33,757 adding 'lighteval/utils_parallelism.py' 2024-03-29T17:30:33,762 adding 'lighteval/logging/evaluation_tracker.py' 2024-03-29T17:30:33,763 adding 'lighteval/logging/hierarchical_logger.py' 2024-03-29T17:30:33,767 adding 'lighteval/logging/info_loggers.py' 2024-03-29T17:30:33,769 adding 'lighteval/metrics/__init__.py' 2024-03-29T17:30:33,771 adding 'lighteval/metrics/metrics.py' 2024-03-29T17:30:33,773 adding 'lighteval/metrics/metrics_corpus.py' 2024-03-29T17:30:33,776 adding 'lighteval/metrics/metrics_sample.py' 2024-03-29T17:30:33,778 adding 'lighteval/metrics/normalizations.py' 2024-03-29T17:30:33,780 adding 'lighteval/metrics/sample_preparator.py' 2024-03-29T17:30:33,781 adding 'lighteval/metrics/stderr.py' 2024-03-29T17:30:33,783 adding 'lighteval/metrics/utils.py' 2024-03-29T17:30:33,785 adding 'lighteval/metrics/harness_compatibility/drop.py' 2024-03-29T17:30:33,786 adding 'lighteval/metrics/harness_compatibility/truthful_qa.py' 2024-03-29T17:30:33,789 adding 'lighteval/metrics/imports/bert_scorer.py' 2024-03-29T17:30:33,790 adding 'lighteval/metrics/imports/data_stats_metric.py' 2024-03-29T17:30:33,792 adding 'lighteval/metrics/imports/data_stats_utils.py' 2024-03-29T17:30:33,794 adding 'lighteval/metrics/imports/summac.py' 2024-03-29T17:30:33,797 adding 'lighteval/models/abstract_model.py' 2024-03-29T17:30:33,798 adding 'lighteval/models/adapter_model.py' 2024-03-29T17:30:33,804 adding 'lighteval/models/base_model.py' 2024-03-29T17:30:33,806 adding 'lighteval/models/delta_model.py' 2024-03-29T17:30:33,808 adding 'lighteval/models/endpoint_model.py' 2024-03-29T17:30:33,810 adding 'lighteval/models/model_config.py' 2024-03-29T17:30:33,812 adding 'lighteval/models/model_loader.py' 2024-03-29T17:30:33,813 adding 'lighteval/models/model_output.py' 2024-03-29T17:30:33,820 adding 'lighteval/models/nanotron_model.py' 2024-03-29T17:30:33,822 adding 'lighteval/models/tgi_model.py' 2024-03-29T17:30:33,823 adding 'lighteval/models/utils.py' 2024-03-29T17:30:33,827 adding 'lighteval/tasks/lighteval_task.py' 2024-03-29T17:30:33,829 adding 'lighteval/tasks/registry.py' 2024-03-29T17:30:33,831 adding 'lighteval/tasks/requests.py' 2024-03-29T17:30:33,841 adding 'lighteval/tasks/tasks_prompt_formatting.py' 2024-03-29T17:30:33,861 adding 'lighteval/tasks/tasks_table.jsonl' 2024-03-29T17:30:33,867 adding 'lighteval/tasks/extended/__init__.py' 2024-03-29T17:30:33,872 adding 'lighteval/tasks/extended/ifeval/instructions.py' 2024-03-29T17:30:33,874 adding 'lighteval/tasks/extended/ifeval/instructions_registry.py' 2024-03-29T17:30:33,878 adding 'lighteval/tasks/extended/ifeval/instructions_utils.py' 2024-03-29T17:30:33,879 adding 'lighteval/tasks/extended/ifeval/main.py' 2024-03-29T17:30:33,882 adding 'lighteval/tasks/extended/mt_bench/judges.py' 2024-03-29T17:30:33,884 adding 'lighteval/tasks/extended/mt_bench/main.py' 2024-03-29T17:30:33,887 adding 'lighteval/tasks/extended/tiny_benchmarks/main.py' 2024-03-29T17:30:33,889 adding 'lighteval-0.3.0.dist-info/LICENSE' 2024-03-29T17:30:33,893 adding 'lighteval-0.3.0.dist-info/METADATA' 2024-03-29T17:30:33,894 adding 'lighteval-0.3.0.dist-info/WHEEL' 2024-03-29T17:30:33,895 adding 'lighteval-0.3.0.dist-info/top_level.txt' 2024-03-29T17:30:33,896 adding 'lighteval-0.3.0.dist-info/RECORD' 2024-03-29T17:30:33,902 removing build/bdist.linux-armv7l/wheel 2024-03-29T17:30:34,040 Building wheel for lighteval (pyproject.toml): finished with status 'done' 2024-03-29T17:30:34,051 Created wheel for lighteval: filename=lighteval-0.3.0-py3-none-any.whl size=227379 sha256=278613752d9402caf51c2a009228c2c91bb801a71dadc88586c41a764477da7a 2024-03-29T17:30:34,052 Stored in directory: /tmp/pip-ephem-wheel-cache-eu2uufhy/wheels/d8/0e/1e/436b7b1ccfe8ef7579ab6efaf315e551bf358c5eec21aeb611 2024-03-29T17:30:34,070 Successfully built lighteval 2024-03-29T17:30:34,080 Removed build tracker: '/tmp/pip-build-tracker-capibn43'