2021-09-02T02:46:17,266 Created temporary directory: /tmp/pip-ephem-wheel-cache-dguplpq_ 2021-09-02T02:46:17,269 Created temporary directory: /tmp/pip-req-tracker-vjiwzkcu 2021-09-02T02:46:17,269 Initialized build tracking at /tmp/pip-req-tracker-vjiwzkcu 2021-09-02T02:46:17,269 Created build tracker: /tmp/pip-req-tracker-vjiwzkcu 2021-09-02T02:46:17,269 Entered build tracker: /tmp/pip-req-tracker-vjiwzkcu 2021-09-02T02:46:17,270 Created temporary directory: /tmp/pip-wheel-mz24ohot 2021-09-02T02:46:17,302 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2021-09-02T02:46:17,305 2 location(s) to search for versions of lm-eval: 2021-09-02T02:46:17,305 * https://pypi.org/simple/lm-eval/ 2021-09-02T02:46:17,305 * https://www.piwheels.org/simple/lm-eval/ 2021-09-02T02:46:17,305 Fetching project page and analyzing links: https://pypi.org/simple/lm-eval/ 2021-09-02T02:46:17,306 Getting page https://pypi.org/simple/lm-eval/ 2021-09-02T02:46:17,307 Found index url https://pypi.org/simple 2021-09-02T02:46:17,395 Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/1b/5f/7841febb99c12ffb453d33a67b9841e89dba18c388b644bf22b81d137fc4/lm_eval-0.0.1-py3-none-any.whl#sha256=bdaced3e4b56313c1e70d1207a788e42615bb29010687abf775d312dbd4ce7e2 (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6) 2021-09-02T02:46:17,396 Found link https://files.pythonhosted.org/packages/21/5a/feb5ff3a1591ca963c54873d39116b0e6a4f80e493e961ac08569709c5d7/lm_eval-0.0.1.tar.gz#sha256=d6d2356c206065d80489bd89802c0b23534c56906bae07e2dbe367261f3fc35f (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.0.1 2021-09-02T02:46:17,396 Fetching project page and analyzing links: https://www.piwheels.org/simple/lm-eval/ 2021-09-02T02:46:17,396 Getting page https://www.piwheels.org/simple/lm-eval/ 2021-09-02T02:46:17,397 Found index url https://www.piwheels.org/simple 2021-09-02T02:46:17,507 Skipping link: not a file: https://www.piwheels.org/simple/lm-eval/ 2021-09-02T02:46:17,508 Skipping link: not a file: https://pypi.org/simple/lm-eval/ 2021-09-02T02:46:17,530 Given no hashes to check 1 links for project 'lm-eval': discarding no candidates 2021-09-02T02:46:17,545 Collecting lm-eval==0.0.1 2021-09-02T02:46:17,547 Created temporary directory: /tmp/pip-unpack-vstn7_0_ 2021-09-02T02:46:17,736 Downloading lm_eval-0.0.1.tar.gz (84 kB) 2021-09-02T02:46:17,962 Added lm-eval==0.0.1 from https://files.pythonhosted.org/packages/21/5a/feb5ff3a1591ca963c54873d39116b0e6a4f80e493e961ac08569709c5d7/lm_eval-0.0.1.tar.gz#sha256=d6d2356c206065d80489bd89802c0b23534c56906bae07e2dbe367261f3fc35f to build tracker '/tmp/pip-req-tracker-vjiwzkcu' 2021-09-02T02:46:17,963 Running setup.py (path:/tmp/pip-wheel-mz24ohot/lm-eval_eba464793e0d4a009a8defc416058979/setup.py) egg_info for package lm-eval 2021-09-02T02:46:17,964 Created temporary directory: /tmp/pip-pip-egg-info-lpyyv1wp 2021-09-02T02:46:17,964 Running command python setup.py egg_info 2021-09-02T02:46:18,907 running egg_info 2021-09-02T02:46:18,910 creating /tmp/pip-pip-egg-info-lpyyv1wp/lm_eval.egg-info 2021-09-02T02:46:18,911 writing /tmp/pip-pip-egg-info-lpyyv1wp/lm_eval.egg-info/PKG-INFO 2021-09-02T02:46:18,914 writing dependency_links to /tmp/pip-pip-egg-info-lpyyv1wp/lm_eval.egg-info/dependency_links.txt 2021-09-02T02:46:18,917 writing requirements to /tmp/pip-pip-egg-info-lpyyv1wp/lm_eval.egg-info/requires.txt 2021-09-02T02:46:18,918 writing top-level names to /tmp/pip-pip-egg-info-lpyyv1wp/lm_eval.egg-info/top_level.txt 2021-09-02T02:46:18,919 writing manifest file '/tmp/pip-pip-egg-info-lpyyv1wp/lm_eval.egg-info/SOURCES.txt' 2021-09-02T02:46:19,061 reading manifest file '/tmp/pip-pip-egg-info-lpyyv1wp/lm_eval.egg-info/SOURCES.txt' 2021-09-02T02:46:19,066 writing manifest file '/tmp/pip-pip-egg-info-lpyyv1wp/lm_eval.egg-info/SOURCES.txt' 2021-09-02T02:46:19,130 Source in /tmp/pip-wheel-mz24ohot/lm-eval_eba464793e0d4a009a8defc416058979 has version 0.0.1, which satisfies requirement lm-eval==0.0.1 from https://files.pythonhosted.org/packages/21/5a/feb5ff3a1591ca963c54873d39116b0e6a4f80e493e961ac08569709c5d7/lm_eval-0.0.1.tar.gz#sha256=d6d2356c206065d80489bd89802c0b23534c56906bae07e2dbe367261f3fc35f 2021-09-02T02:46:19,131 Removed lm-eval==0.0.1 from https://files.pythonhosted.org/packages/21/5a/feb5ff3a1591ca963c54873d39116b0e6a4f80e493e961ac08569709c5d7/lm_eval-0.0.1.tar.gz#sha256=d6d2356c206065d80489bd89802c0b23534c56906bae07e2dbe367261f3fc35f from build tracker '/tmp/pip-req-tracker-vjiwzkcu' 2021-09-02T02:46:19,139 Created temporary directory: /tmp/pip-unpack-olkv7_fl 2021-09-02T02:46:19,139 Building wheels for collected packages: lm-eval 2021-09-02T02:46:19,144 Created temporary directory: /tmp/pip-wheel-jvjqz9jt 2021-09-02T02:46:19,144 Building wheel for lm-eval (setup.py): started 2021-09-02T02:46:19,144 Destination directory: /tmp/pip-wheel-jvjqz9jt 2021-09-02T02:46:19,145 Running command /usr/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-wheel-mz24ohot/lm-eval_eba464793e0d4a009a8defc416058979/setup.py'"'"'; __file__='"'"'/tmp/pip-wheel-mz24ohot/lm-eval_eba464793e0d4a009a8defc416058979/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-jvjqz9jt 2021-09-02T02:46:20,070 running bdist_wheel 2021-09-02T02:46:20,074 running build 2021-09-02T02:46:20,075 running build_py 2021-09-02T02:46:20,200 creating build 2021-09-02T02:46:20,200 creating build/lib 2021-09-02T02:46:20,201 creating build/lib/scripts 2021-09-02T02:46:20,202 copying scripts/make_gpt2_test_cases.py -> build/lib/scripts 2021-09-02T02:46:20,204 copying scripts/__init__.py -> build/lib/scripts 2021-09-02T02:46:20,206 copying scripts/write_out.py -> build/lib/scripts 2021-09-02T02:46:20,208 copying scripts/cost_estimate.py -> build/lib/scripts 2021-09-02T02:46:20,209 copying scripts/get_prompts.py -> build/lib/scripts 2021-09-02T02:46:20,211 copying scripts/make_table_tasks.py -> build/lib/scripts 2021-09-02T02:46:20,213 copying scripts/fewshot_description_experiment.py -> build/lib/scripts 2021-09-02T02:46:20,216 creating build/lib/lm_eval 2021-09-02T02:46:20,216 copying lm_eval/__init__.py -> build/lib/lm_eval 2021-09-02T02:46:20,218 copying lm_eval/metrics.py -> build/lib/lm_eval 2021-09-02T02:46:20,220 copying lm_eval/utils.py -> build/lib/lm_eval 2021-09-02T02:46:20,222 copying lm_eval/evaluator.py -> build/lib/lm_eval 2021-09-02T02:46:20,224 copying lm_eval/base.py -> build/lib/lm_eval 2021-09-02T02:46:20,228 creating build/lib/scripts/clean_training_data 2021-09-02T02:46:20,229 copying scripts/clean_training_data/generate_13_grams.py -> build/lib/scripts/clean_training_data 2021-09-02T02:46:20,231 copying scripts/clean_training_data/__init__.py -> build/lib/scripts/clean_training_data 2021-09-02T02:46:20,233 copying scripts/clean_training_data/archiver.py -> build/lib/scripts/clean_training_data 2021-09-02T02:46:20,235 copying scripts/clean_training_data/process_sorted_buckets.py -> build/lib/scripts/clean_training_data 2021-09-02T02:46:20,237 copying scripts/clean_training_data/sort_13_gram_buckets.py -> build/lib/scripts/clean_training_data 2021-09-02T02:46:20,239 copying scripts/clean_training_data/janitor.py -> build/lib/scripts/clean_training_data 2021-09-02T02:46:20,245 creating build/lib/lm_eval/tasks 2021-09-02T02:46:20,246 copying lm_eval/tasks/hellaswag.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,248 copying lm_eval/tasks/mathqa.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,249 copying lm_eval/tasks/lambada.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,251 copying lm_eval/tasks/openbookqa.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,253 copying lm_eval/tasks/anli.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,255 copying lm_eval/tasks/arithmetic.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,258 copying lm_eval/tasks/__init__.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,260 copying lm_eval/tasks/mc_taco.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,262 copying lm_eval/tasks/triviaqa.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,264 copying lm_eval/tasks/race.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,267 copying lm_eval/tasks/winogrande.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,269 copying lm_eval/tasks/headqa.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,270 copying lm_eval/tasks/hendrycks_test.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,273 copying lm_eval/tasks/translation.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,275 copying lm_eval/tasks/lambada_multilingual.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,277 copying lm_eval/tasks/coqa.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,279 copying lm_eval/tasks/pubmedqa.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,281 copying lm_eval/tasks/storycloze.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,283 copying lm_eval/tasks/squad.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,286 copying lm_eval/tasks/logiqa.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,288 copying lm_eval/tasks/hendrycks_math.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,290 copying lm_eval/tasks/lambada_cloze.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,292 copying lm_eval/tasks/glue.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,294 copying lm_eval/tasks/drop.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,297 copying lm_eval/tasks/sat.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,299 copying lm_eval/tasks/naturalqs.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,301 copying lm_eval/tasks/wsc273.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,303 copying lm_eval/tasks/qa4mre.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,305 copying lm_eval/tasks/hendrycks_ethics.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,307 copying lm_eval/tasks/unscramble.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,309 copying lm_eval/tasks/wikitext.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,311 copying lm_eval/tasks/piqa.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,313 copying lm_eval/tasks/common.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,315 copying lm_eval/tasks/quac.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,317 copying lm_eval/tasks/webqs.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,319 copying lm_eval/tasks/pile.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,321 copying lm_eval/tasks/mutual.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,323 copying lm_eval/tasks/arc.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,325 copying lm_eval/tasks/cbt.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,326 copying lm_eval/tasks/superglue.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,329 copying lm_eval/tasks/prost.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,331 copying lm_eval/tasks/sciq.py -> build/lib/lm_eval/tasks 2021-09-02T02:46:20,333 creating build/lib/lm_eval/models 2021-09-02T02:46:20,335 copying lm_eval/models/__init__.py -> build/lib/lm_eval/models 2021-09-02T02:46:20,337 copying lm_eval/models/gpt3.py -> build/lib/lm_eval/models 2021-09-02T02:46:20,339 copying lm_eval/models/dummy.py -> build/lib/lm_eval/models 2021-09-02T02:46:20,341 copying lm_eval/models/gpt2.py -> build/lib/lm_eval/models 2021-09-02T02:46:20,354 installing to build/bdist.linux-armv7l/wheel 2021-09-02T02:46:20,355 running install 2021-09-02T02:46:20,356 running install_lib 2021-09-02T02:46:20,360 creating build/bdist.linux-armv7l 2021-09-02T02:46:20,361 creating build/bdist.linux-armv7l/wheel 2021-09-02T02:46:20,362 creating build/bdist.linux-armv7l/wheel/scripts 2021-09-02T02:46:20,363 copying build/lib/scripts/make_gpt2_test_cases.py -> build/bdist.linux-armv7l/wheel/scripts 2021-09-02T02:46:20,366 copying build/lib/scripts/__init__.py -> build/bdist.linux-armv7l/wheel/scripts 2021-09-02T02:46:20,367 copying build/lib/scripts/write_out.py -> build/bdist.linux-armv7l/wheel/scripts 2021-09-02T02:46:20,369 copying build/lib/scripts/cost_estimate.py -> build/bdist.linux-armv7l/wheel/scripts 2021-09-02T02:46:20,371 copying build/lib/scripts/get_prompts.py -> build/bdist.linux-armv7l/wheel/scripts 2021-09-02T02:46:20,373 copying build/lib/scripts/make_table_tasks.py -> build/bdist.linux-armv7l/wheel/scripts 2021-09-02T02:46:20,375 creating build/bdist.linux-armv7l/wheel/scripts/clean_training_data 2021-09-02T02:46:20,376 copying build/lib/scripts/clean_training_data/generate_13_grams.py -> build/bdist.linux-armv7l/wheel/scripts/clean_training_data 2021-09-02T02:46:20,378 copying build/lib/scripts/clean_training_data/__init__.py -> build/bdist.linux-armv7l/wheel/scripts/clean_training_data 2021-09-02T02:46:20,379 copying build/lib/scripts/clean_training_data/archiver.py -> build/bdist.linux-armv7l/wheel/scripts/clean_training_data 2021-09-02T02:46:20,381 copying build/lib/scripts/clean_training_data/process_sorted_buckets.py -> build/bdist.linux-armv7l/wheel/scripts/clean_training_data 2021-09-02T02:46:20,383 copying build/lib/scripts/clean_training_data/sort_13_gram_buckets.py -> build/bdist.linux-armv7l/wheel/scripts/clean_training_data 2021-09-02T02:46:20,385 copying build/lib/scripts/clean_training_data/janitor.py -> build/bdist.linux-armv7l/wheel/scripts/clean_training_data 2021-09-02T02:46:20,387 copying build/lib/scripts/fewshot_description_experiment.py -> build/bdist.linux-armv7l/wheel/scripts 2021-09-02T02:46:20,390 creating build/bdist.linux-armv7l/wheel/lm_eval 2021-09-02T02:46:20,392 creating build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,393 copying build/lib/lm_eval/tasks/hellaswag.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,395 copying build/lib/lm_eval/tasks/mathqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,397 copying build/lib/lm_eval/tasks/lambada.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,399 copying build/lib/lm_eval/tasks/openbookqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,401 copying build/lib/lm_eval/tasks/anli.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,402 copying build/lib/lm_eval/tasks/arithmetic.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,405 copying build/lib/lm_eval/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,407 copying build/lib/lm_eval/tasks/mc_taco.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,410 copying build/lib/lm_eval/tasks/triviaqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,411 copying build/lib/lm_eval/tasks/race.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,414 copying build/lib/lm_eval/tasks/winogrande.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,416 copying build/lib/lm_eval/tasks/headqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,417 copying build/lib/lm_eval/tasks/hendrycks_test.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,420 copying build/lib/lm_eval/tasks/translation.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,422 copying build/lib/lm_eval/tasks/lambada_multilingual.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,424 copying build/lib/lm_eval/tasks/coqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,426 copying build/lib/lm_eval/tasks/pubmedqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,428 copying build/lib/lm_eval/tasks/storycloze.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,430 copying build/lib/lm_eval/tasks/squad.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,432 copying build/lib/lm_eval/tasks/logiqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,434 copying build/lib/lm_eval/tasks/hendrycks_math.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,437 copying build/lib/lm_eval/tasks/lambada_cloze.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,439 copying build/lib/lm_eval/tasks/glue.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,441 copying build/lib/lm_eval/tasks/drop.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,444 copying build/lib/lm_eval/tasks/sat.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,446 copying build/lib/lm_eval/tasks/naturalqs.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,447 copying build/lib/lm_eval/tasks/wsc273.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,450 copying build/lib/lm_eval/tasks/qa4mre.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,452 copying build/lib/lm_eval/tasks/hendrycks_ethics.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,454 copying build/lib/lm_eval/tasks/unscramble.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,456 copying build/lib/lm_eval/tasks/wikitext.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,458 copying build/lib/lm_eval/tasks/piqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,460 copying build/lib/lm_eval/tasks/common.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,461 copying build/lib/lm_eval/tasks/quac.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,464 copying build/lib/lm_eval/tasks/webqs.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,466 copying build/lib/lm_eval/tasks/pile.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,468 copying build/lib/lm_eval/tasks/mutual.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,470 copying build/lib/lm_eval/tasks/arc.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,472 copying build/lib/lm_eval/tasks/cbt.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,473 copying build/lib/lm_eval/tasks/superglue.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,476 copying build/lib/lm_eval/tasks/prost.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,478 copying build/lib/lm_eval/tasks/sciq.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks 2021-09-02T02:46:20,480 copying build/lib/lm_eval/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval 2021-09-02T02:46:20,481 copying build/lib/lm_eval/metrics.py -> build/bdist.linux-armv7l/wheel/lm_eval 2021-09-02T02:46:20,484 creating build/bdist.linux-armv7l/wheel/lm_eval/models 2021-09-02T02:46:20,485 copying build/lib/lm_eval/models/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/models 2021-09-02T02:46:20,487 copying build/lib/lm_eval/models/gpt3.py -> build/bdist.linux-armv7l/wheel/lm_eval/models 2021-09-02T02:46:20,489 copying build/lib/lm_eval/models/dummy.py -> build/bdist.linux-armv7l/wheel/lm_eval/models 2021-09-02T02:46:20,491 copying build/lib/lm_eval/models/gpt2.py -> build/bdist.linux-armv7l/wheel/lm_eval/models 2021-09-02T02:46:20,494 copying build/lib/lm_eval/utils.py -> build/bdist.linux-armv7l/wheel/lm_eval 2021-09-02T02:46:20,496 copying build/lib/lm_eval/evaluator.py -> build/bdist.linux-armv7l/wheel/lm_eval 2021-09-02T02:46:20,498 copying build/lib/lm_eval/base.py -> build/bdist.linux-armv7l/wheel/lm_eval 2021-09-02T02:46:20,500 running install_egg_info 2021-09-02T02:46:20,521 running egg_info 2021-09-02T02:46:20,522 writing lm_eval.egg-info/PKG-INFO 2021-09-02T02:46:20,525 writing dependency_links to lm_eval.egg-info/dependency_links.txt 2021-09-02T02:46:20,527 writing requirements to lm_eval.egg-info/requires.txt 2021-09-02T02:46:20,528 writing top-level names to lm_eval.egg-info/top_level.txt 2021-09-02T02:46:20,537 reading manifest file 'lm_eval.egg-info/SOURCES.txt' 2021-09-02T02:46:20,545 writing manifest file 'lm_eval.egg-info/SOURCES.txt' 2021-09-02T02:46:20,547 Copying lm_eval.egg-info to build/bdist.linux-armv7l/wheel/lm_eval-0.0.1-py3.7.egg-info 2021-09-02T02:46:20,558 running install_scripts 2021-09-02T02:46:20,659 creating build/bdist.linux-armv7l/wheel/lm_eval-0.0.1.dist-info/WHEEL 2021-09-02T02:46:20,661 creating '/tmp/pip-wheel-jvjqz9jt/lm_eval-0.0.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2021-09-02T02:46:20,664 adding 'lm_eval/__init__.py' 2021-09-02T02:46:20,666 adding 'lm_eval/base.py' 2021-09-02T02:46:20,668 adding 'lm_eval/evaluator.py' 2021-09-02T02:46:20,670 adding 'lm_eval/metrics.py' 2021-09-02T02:46:20,671 adding 'lm_eval/utils.py' 2021-09-02T02:46:20,673 adding 'lm_eval/models/__init__.py' 2021-09-02T02:46:20,674 adding 'lm_eval/models/dummy.py' 2021-09-02T02:46:20,676 adding 'lm_eval/models/gpt2.py' 2021-09-02T02:46:20,677 adding 'lm_eval/models/gpt3.py' 2021-09-02T02:46:20,680 adding 'lm_eval/tasks/__init__.py' 2021-09-02T02:46:20,682 adding 'lm_eval/tasks/anli.py' 2021-09-02T02:46:20,683 adding 'lm_eval/tasks/arc.py' 2021-09-02T02:46:20,684 adding 'lm_eval/tasks/arithmetic.py' 2021-09-02T02:46:20,686 adding 'lm_eval/tasks/cbt.py' 2021-09-02T02:46:20,687 adding 'lm_eval/tasks/common.py' 2021-09-02T02:46:20,688 adding 'lm_eval/tasks/coqa.py' 2021-09-02T02:46:20,690 adding 'lm_eval/tasks/drop.py' 2021-09-02T02:46:20,692 adding 'lm_eval/tasks/glue.py' 2021-09-02T02:46:20,693 adding 'lm_eval/tasks/headqa.py' 2021-09-02T02:46:20,694 adding 'lm_eval/tasks/hellaswag.py' 2021-09-02T02:46:20,696 adding 'lm_eval/tasks/hendrycks_ethics.py' 2021-09-02T02:46:20,698 adding 'lm_eval/tasks/hendrycks_math.py' 2021-09-02T02:46:20,700 adding 'lm_eval/tasks/hendrycks_test.py' 2021-09-02T02:46:20,701 adding 'lm_eval/tasks/lambada.py' 2021-09-02T02:46:20,702 adding 'lm_eval/tasks/lambada_cloze.py' 2021-09-02T02:46:20,703 adding 'lm_eval/tasks/lambada_multilingual.py' 2021-09-02T02:46:20,704 adding 'lm_eval/tasks/logiqa.py' 2021-09-02T02:46:20,706 adding 'lm_eval/tasks/mathqa.py' 2021-09-02T02:46:20,707 adding 'lm_eval/tasks/mc_taco.py' 2021-09-02T02:46:20,708 adding 'lm_eval/tasks/mutual.py' 2021-09-02T02:46:20,710 adding 'lm_eval/tasks/naturalqs.py' 2021-09-02T02:46:20,711 adding 'lm_eval/tasks/openbookqa.py' 2021-09-02T02:46:20,712 adding 'lm_eval/tasks/pile.py' 2021-09-02T02:46:20,713 adding 'lm_eval/tasks/piqa.py' 2021-09-02T02:46:20,714 adding 'lm_eval/tasks/prost.py' 2021-09-02T02:46:20,716 adding 'lm_eval/tasks/pubmedqa.py' 2021-09-02T02:46:20,717 adding 'lm_eval/tasks/qa4mre.py' 2021-09-02T02:46:20,718 adding 'lm_eval/tasks/quac.py' 2021-09-02T02:46:20,720 adding 'lm_eval/tasks/race.py' 2021-09-02T02:46:20,721 adding 'lm_eval/tasks/sat.py' 2021-09-02T02:46:20,722 adding 'lm_eval/tasks/sciq.py' 2021-09-02T02:46:20,724 adding 'lm_eval/tasks/squad.py' 2021-09-02T02:46:20,725 adding 'lm_eval/tasks/storycloze.py' 2021-09-02T02:46:20,727 adding 'lm_eval/tasks/superglue.py' 2021-09-02T02:46:20,729 adding 'lm_eval/tasks/translation.py' 2021-09-02T02:46:20,730 adding 'lm_eval/tasks/triviaqa.py' 2021-09-02T02:46:20,731 adding 'lm_eval/tasks/unscramble.py' 2021-09-02T02:46:20,732 adding 'lm_eval/tasks/webqs.py' 2021-09-02T02:46:20,734 adding 'lm_eval/tasks/wikitext.py' 2021-09-02T02:46:20,735 adding 'lm_eval/tasks/winogrande.py' 2021-09-02T02:46:20,737 adding 'lm_eval/tasks/wsc273.py' 2021-09-02T02:46:20,739 adding 'scripts/__init__.py' 2021-09-02T02:46:20,741 adding 'scripts/cost_estimate.py' 2021-09-02T02:46:20,742 adding 'scripts/fewshot_description_experiment.py' 2021-09-02T02:46:20,743 adding 'scripts/get_prompts.py' 2021-09-02T02:46:20,745 adding 'scripts/make_gpt2_test_cases.py' 2021-09-02T02:46:20,746 adding 'scripts/make_table_tasks.py' 2021-09-02T02:46:20,747 adding 'scripts/write_out.py' 2021-09-02T02:46:20,749 adding 'scripts/clean_training_data/__init__.py' 2021-09-02T02:46:20,750 adding 'scripts/clean_training_data/archiver.py' 2021-09-02T02:46:20,751 adding 'scripts/clean_training_data/generate_13_grams.py' 2021-09-02T02:46:20,753 adding 'scripts/clean_training_data/janitor.py' 2021-09-02T02:46:20,755 adding 'scripts/clean_training_data/process_sorted_buckets.py' 2021-09-02T02:46:20,756 adding 'scripts/clean_training_data/sort_13_gram_buckets.py' 2021-09-02T02:46:20,759 adding 'lm_eval-0.0.1.dist-info/METADATA' 2021-09-02T02:46:20,760 adding 'lm_eval-0.0.1.dist-info/WHEEL' 2021-09-02T02:46:20,761 adding 'lm_eval-0.0.1.dist-info/top_level.txt' 2021-09-02T02:46:20,762 adding 'lm_eval-0.0.1.dist-info/RECORD' 2021-09-02T02:46:20,766 removing build/bdist.linux-armv7l/wheel 2021-09-02T02:46:20,854 Building wheel for lm-eval (setup.py): finished with status 'done' 2021-09-02T02:46:20,857 Created wheel for lm-eval: filename=lm_eval-0.0.1-py3-none-any.whl size=102050 sha256=0afc289f69286f71017fb9811dfea6cda7c703bf693ad43106fbbff1f164cf14 2021-09-02T02:46:20,858 Stored in directory: /tmp/pip-ephem-wheel-cache-dguplpq_/wheels/ec/46/8f/963e56490a7c1f5c7488a683dda66f655172625aa36f658657 2021-09-02T02:46:20,872 Successfully built lm-eval 2021-09-02T02:46:20,881 Removed build tracker: '/tmp/pip-req-tracker-vjiwzkcu'