2022-12-08T08:25:06,119 Created temporary directory: /tmp/pip-ephem-wheel-cache-lrtpm04q
2022-12-08T08:25:06,124 Created temporary directory: /tmp/pip-build-tracker-9h6h1uxk
2022-12-08T08:25:06,124 Initialized build tracking at /tmp/pip-build-tracker-9h6h1uxk
2022-12-08T08:25:06,125 Created build tracker: /tmp/pip-build-tracker-9h6h1uxk
2022-12-08T08:25:06,125 Entered build tracker: /tmp/pip-build-tracker-9h6h1uxk
2022-12-08T08:25:06,126 Created temporary directory: /tmp/pip-wheel-p7hegx38
2022-12-08T08:25:06,134 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453
2022-12-08T08:25:06,139 Created temporary directory: /tmp/pip-ephem-wheel-cache-53exuaaz
2022-12-08T08:25:06,196 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2022-12-08T08:25:06,204 2 location(s) to search for versions of lm-eval:
2022-12-08T08:25:06,204 * https://pypi.org/simple/lm-eval/
2022-12-08T08:25:06,204 * https://www.piwheels.org/simple/lm-eval/
2022-12-08T08:25:06,205 Fetching project page and analyzing links: https://pypi.org/simple/lm-eval/
2022-12-08T08:25:06,206 Getting page https://pypi.org/simple/lm-eval/
2022-12-08T08:25:06,209 Found index url https://pypi.org/simple
2022-12-08T08:25:06,396 Fetched page https://pypi.org/simple/lm-eval/ as application/vnd.pypi.simple.v1+json
2022-12-08T08:25:06,400   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/1b/5f/7841febb99c12ffb453d33a67b9841e89dba18c388b644bf22b81d137fc4/lm_eval-0.0.1-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6)
2022-12-08T08:25:06,402   Found link https://files.pythonhosted.org/packages/21/5a/feb5ff3a1591ca963c54873d39116b0e6a4f80e493e961ac08569709c5d7/lm_eval-0.0.1.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.0.1
2022-12-08T08:25:06,402   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/f3/a7/63cbce8b51de25fabb1c49f3a3fd1704faaacadb5ed816401f800e4d2dbd/lm_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6)
2022-12-08T08:25:06,404   Found link https://files.pythonhosted.org/packages/c5/fd/edd21b0f258b4ec0260f99f5b2ac3864f7cddc8fb7c83bbb2379a6aab975/lm_eval-0.2.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.2.0
2022-12-08T08:25:06,404   Skipping link: No binaries permitted for lm-eval: https://files.pythonhosted.org/packages/61/c5/bff92e6b61fc2b0c1b7ac769633731910152e5176a404912ce7c07329ba0/lm_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6)
2022-12-08T08:25:06,405   Found link https://files.pythonhosted.org/packages/c4/f8/58abc65390a758c8c2e5f1d8bb9b58d7885d02535d5f48de27006453d07e/lm_eval-0.3.0.tar.gz (from https://pypi.org/simple/lm-eval/) (requires-python:>=3.6), version: 0.3.0
2022-12-08T08:25:06,406 Fetching project page and analyzing links: https://www.piwheels.org/simple/lm-eval/
2022-12-08T08:25:06,407 Getting page https://www.piwheels.org/simple/lm-eval/
2022-12-08T08:25:06,409 Found index url https://www.piwheels.org/simple
2022-12-08T08:25:06,655 Fetched page https://www.piwheels.org/simple/lm-eval/ as text/html
2022-12-08T08:25:06,659   Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.2.0-py3-none-any.whl#sha256=e06d3d7b6016be832e6889cbc9c4787b99156ba57f8feb31d3aeb27304c6558c (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6)
2022-12-08T08:25:06,659   Skipping link: No binaries permitted for lm-eval: https://www.piwheels.org/simple/lm-eval/lm_eval-0.0.1-py3-none-any.whl#sha256=0afc289f69286f71017fb9811dfea6cda7c703bf693ad43106fbbff1f164cf14 (from https://www.piwheels.org/simple/lm-eval/) (requires-python:>=3.6)
2022-12-08T08:25:06,660 Skipping link: not a file: https://www.piwheels.org/simple/lm-eval/
2022-12-08T08:25:06,660 Skipping link: not a file: https://pypi.org/simple/lm-eval/
2022-12-08T08:25:06,694 Given no hashes to check 1 links for project 'lm-eval': discarding no candidates
2022-12-08T08:25:06,727 Collecting lm-eval==0.3.0
2022-12-08T08:25:06,731   Created temporary directory: /tmp/pip-unpack-m9cyaba_
2022-12-08T08:25:06,969   Downloading lm_eval-0.3.0.tar.gz (120 kB)
2022-12-08T08:25:07,542   Added lm-eval==0.3.0 from https://files.pythonhosted.org/packages/c4/f8/58abc65390a758c8c2e5f1d8bb9b58d7885d02535d5f48de27006453d07e/lm_eval-0.3.0.tar.gz to build tracker '/tmp/pip-build-tracker-9h6h1uxk'
2022-12-08T08:25:07,546   Running setup.py (path:/tmp/pip-wheel-p7hegx38/lm-eval_86abbd0ad37e4b0a81c31016427935af/setup.py) egg_info for package lm-eval
2022-12-08T08:25:07,547   Created temporary directory: /tmp/pip-pip-egg-info-r0la12dd
2022-12-08T08:25:07,547   Preparing metadata (setup.py): started
2022-12-08T08:25:07,550   Running command python setup.py egg_info
2022-12-08T08:25:10,184   running egg_info
2022-12-08T08:25:10,189   creating /tmp/pip-pip-egg-info-r0la12dd/lm_eval.egg-info
2022-12-08T08:25:10,251   writing /tmp/pip-pip-egg-info-r0la12dd/lm_eval.egg-info/PKG-INFO
2022-12-08T08:25:10,256   writing dependency_links to /tmp/pip-pip-egg-info-r0la12dd/lm_eval.egg-info/dependency_links.txt
2022-12-08T08:25:10,260   writing requirements to /tmp/pip-pip-egg-info-r0la12dd/lm_eval.egg-info/requires.txt
2022-12-08T08:25:10,262   writing top-level names to /tmp/pip-pip-egg-info-r0la12dd/lm_eval.egg-info/top_level.txt
2022-12-08T08:25:10,265   writing manifest file '/tmp/pip-pip-egg-info-r0la12dd/lm_eval.egg-info/SOURCES.txt'
2022-12-08T08:25:10,496   reading manifest file '/tmp/pip-pip-egg-info-r0la12dd/lm_eval.egg-info/SOURCES.txt'
2022-12-08T08:25:10,498   adding license file 'LICENSE.md'
2022-12-08T08:25:10,512   writing manifest file '/tmp/pip-pip-egg-info-r0la12dd/lm_eval.egg-info/SOURCES.txt'
2022-12-08T08:25:10,716   Preparing metadata (setup.py): finished with status 'done'
2022-12-08T08:25:10,731   Source in /tmp/pip-wheel-p7hegx38/lm-eval_86abbd0ad37e4b0a81c31016427935af has version 0.3.0, which satisfies requirement lm-eval==0.3.0 from https://files.pythonhosted.org/packages/c4/f8/58abc65390a758c8c2e5f1d8bb9b58d7885d02535d5f48de27006453d07e/lm_eval-0.3.0.tar.gz
2022-12-08T08:25:10,733   Removed lm-eval==0.3.0 from https://files.pythonhosted.org/packages/c4/f8/58abc65390a758c8c2e5f1d8bb9b58d7885d02535d5f48de27006453d07e/lm_eval-0.3.0.tar.gz from build tracker '/tmp/pip-build-tracker-9h6h1uxk'
2022-12-08T08:25:10,749 Created temporary directory: /tmp/pip-unpack-6ol6q6co
2022-12-08T08:25:10,750 Building wheels for collected packages: lm-eval
2022-12-08T08:25:10,759   Created temporary directory: /tmp/pip-wheel-spgy6d49
2022-12-08T08:25:10,760   Building wheel for lm-eval (setup.py): started
2022-12-08T08:25:10,762   Destination directory: /tmp/pip-wheel-spgy6d49
2022-12-08T08:25:10,762   Running command python setup.py bdist_wheel
2022-12-08T08:25:13,394   running bdist_wheel
2022-12-08T08:25:14,192   running build
2022-12-08T08:25:14,193   running build_py
2022-12-08T08:25:14,262   creating build
2022-12-08T08:25:14,263   creating build/lib
2022-12-08T08:25:14,264   creating build/lib/scripts
2022-12-08T08:25:14,266   copying scripts/__init__.py -> build/lib/scripts
2022-12-08T08:25:14,270   copying scripts/make_gpt2_test_cases.py -> build/lib/scripts
2022-12-08T08:25:14,274   copying scripts/cost_estimate.py -> build/lib/scripts
2022-12-08T08:25:14,278   copying scripts/make_table_tasks.py -> build/lib/scripts
2022-12-08T08:25:14,282   copying scripts/get_prompts.py -> build/lib/scripts
2022-12-08T08:25:14,286   copying scripts/write_out.py -> build/lib/scripts
2022-12-08T08:25:14,291   creating build/lib/lm_eval
2022-12-08T08:25:14,292   copying lm_eval/metrics.py -> build/lib/lm_eval
2022-12-08T08:25:14,297   copying lm_eval/evaluator.py -> build/lib/lm_eval
2022-12-08T08:25:14,301   copying lm_eval/__init__.py -> build/lib/lm_eval
2022-12-08T08:25:14,304   copying lm_eval/utils.py -> build/lib/lm_eval
2022-12-08T08:25:14,309   copying lm_eval/base.py -> build/lib/lm_eval
2022-12-08T08:25:14,316   creating build/lib/scripts/clean_training_data
2022-12-08T08:25:14,318   copying scripts/clean_training_data/investigate_pile.py -> build/lib/scripts/clean_training_data
2022-12-08T08:25:14,322   copying scripts/clean_training_data/generate_13_grams.py -> build/lib/scripts/clean_training_data
2022-12-08T08:25:14,326   copying scripts/clean_training_data/process_sorted_buckets.py -> build/lib/scripts/clean_training_data
2022-12-08T08:25:14,330   copying scripts/clean_training_data/__init__.py -> build/lib/scripts/clean_training_data
2022-12-08T08:25:14,333   copying scripts/clean_training_data/compress_and_package.py -> build/lib/scripts/clean_training_data
2022-12-08T08:25:14,337   copying scripts/clean_training_data/sort_13_gram_buckets.py -> build/lib/scripts/clean_training_data
2022-12-08T08:25:14,341   creating build/lib/lm_eval/decontamination
2022-12-08T08:25:14,342   copying lm_eval/decontamination/__init__.py -> build/lib/lm_eval/decontamination
2022-12-08T08:25:14,346   copying lm_eval/decontamination/archiver.py -> build/lib/lm_eval/decontamination
2022-12-08T08:25:14,350   copying lm_eval/decontamination/janitor.py -> build/lib/lm_eval/decontamination
2022-12-08T08:25:14,354   copying lm_eval/decontamination/decontaminate.py -> build/lib/lm_eval/decontamination
2022-12-08T08:25:14,359   creating build/lib/lm_eval/models
2022-12-08T08:25:14,361   copying lm_eval/models/textsynth.py -> build/lib/lm_eval/models
2022-12-08T08:25:14,366   copying lm_eval/models/gpt3.py -> build/lib/lm_eval/models
2022-12-08T08:25:14,370   copying lm_eval/models/__init__.py -> build/lib/lm_eval/models
2022-12-08T08:25:14,373   copying lm_eval/models/gpt2.py -> build/lib/lm_eval/models
2022-12-08T08:25:14,376   copying lm_eval/models/dummy.py -> build/lib/lm_eval/models
2022-12-08T08:25:14,381   creating build/lib/lm_eval/datasets
2022-12-08T08:25:14,382   copying lm_eval/datasets/__init__.py -> build/lib/lm_eval/datasets
2022-12-08T08:25:14,391   creating build/lib/lm_eval/tasks
2022-12-08T08:25:14,392   copying lm_eval/tasks/hellaswag.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,396   copying lm_eval/tasks/mathqa.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,400   copying lm_eval/tasks/mutual.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,404   copying lm_eval/tasks/quac.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,408   copying lm_eval/tasks/blimp.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,413   copying lm_eval/tasks/coqa.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,418   copying lm_eval/tasks/lambada_cloze.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,422   copying lm_eval/tasks/cbt.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,426   copying lm_eval/tasks/lambada.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,430   copying lm_eval/tasks/sat.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,434   copying lm_eval/tasks/squad.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,438   copying lm_eval/tasks/__init__.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,443   copying lm_eval/tasks/superglue.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,447   copying lm_eval/tasks/glue.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,452   copying lm_eval/tasks/arithmetic.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,455   copying lm_eval/tasks/asdiv.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,458   copying lm_eval/tasks/qa4mre.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,462   copying lm_eval/tasks/headqa.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,465   copying lm_eval/tasks/anli.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,469   copying lm_eval/tasks/hendrycks_ethics.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,473   copying lm_eval/tasks/wikitext.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,476   copying lm_eval/tasks/drop.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,481   copying lm_eval/tasks/qasper.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,485   copying lm_eval/tasks/winogrande.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,489   copying lm_eval/tasks/truthfulqa.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,493   copying lm_eval/tasks/lambada_multilingual.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,497   copying lm_eval/tasks/triviaqa.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,500   copying lm_eval/tasks/arc.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,503   copying lm_eval/tasks/race.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,507   copying lm_eval/tasks/mc_taco.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,512   copying lm_eval/tasks/translation.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,516   copying lm_eval/tasks/pile.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,519   copying lm_eval/tasks/piqa.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,523   copying lm_eval/tasks/sciq.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,526   copying lm_eval/tasks/hendrycks_test.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,530   copying lm_eval/tasks/hendrycks_math.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,535   copying lm_eval/tasks/swag.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,538   copying lm_eval/tasks/unscramble.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,542   copying lm_eval/tasks/storycloze.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,546   copying lm_eval/tasks/logiqa.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,550   copying lm_eval/tasks/webqs.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,554   copying lm_eval/tasks/openbookqa.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,557   copying lm_eval/tasks/pubmedqa.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,560   copying lm_eval/tasks/prost.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,564   copying lm_eval/tasks/wsc273.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,568   copying lm_eval/tasks/gsm8k.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,571   copying lm_eval/tasks/naturalqs.py -> build/lib/lm_eval/tasks
2022-12-08T08:25:14,576   creating build/lib/lm_eval/datasets/quac
2022-12-08T08:25:14,578   copying lm_eval/datasets/quac/quac.py -> build/lib/lm_eval/datasets/quac
2022-12-08T08:25:14,582   copying lm_eval/datasets/quac/__init__.py -> build/lib/lm_eval/datasets/quac
2022-12-08T08:25:14,586   creating build/lib/lm_eval/datasets/hendrycks_math
2022-12-08T08:25:14,587   copying lm_eval/datasets/hendrycks_math/__init__.py -> build/lib/lm_eval/datasets/hendrycks_math
2022-12-08T08:25:14,590   copying lm_eval/datasets/hendrycks_math/hendrycks_math.py -> build/lib/lm_eval/datasets/hendrycks_math
2022-12-08T08:25:14,595   creating build/lib/lm_eval/datasets/logiqa
2022-12-08T08:25:14,596   copying lm_eval/datasets/logiqa/__init__.py -> build/lib/lm_eval/datasets/logiqa
2022-12-08T08:25:14,599   copying lm_eval/datasets/logiqa/logiqa.py -> build/lib/lm_eval/datasets/logiqa
2022-12-08T08:25:14,604   creating build/lib/lm_eval/datasets/drop
2022-12-08T08:25:14,605   copying lm_eval/datasets/drop/__init__.py -> build/lib/lm_eval/datasets/drop
2022-12-08T08:25:14,609   copying lm_eval/datasets/drop/drop.py -> build/lib/lm_eval/datasets/drop
2022-12-08T08:25:14,613   creating build/lib/lm_eval/datasets/pile
2022-12-08T08:25:14,615   copying lm_eval/datasets/pile/__init__.py -> build/lib/lm_eval/datasets/pile
2022-12-08T08:25:14,618   copying lm_eval/datasets/pile/pile.py -> build/lib/lm_eval/datasets/pile
2022-12-08T08:25:14,623   creating build/lib/lm_eval/datasets/asdiv
2022-12-08T08:25:14,624   copying lm_eval/datasets/asdiv/__init__.py -> build/lib/lm_eval/datasets/asdiv
2022-12-08T08:25:14,627   copying lm_eval/datasets/asdiv/asdiv.py -> build/lib/lm_eval/datasets/asdiv
2022-12-08T08:25:14,632   creating build/lib/lm_eval/datasets/triviaqa
2022-12-08T08:25:14,634   copying lm_eval/datasets/triviaqa/__init__.py -> build/lib/lm_eval/datasets/triviaqa
2022-12-08T08:25:14,637   copying lm_eval/datasets/triviaqa/triviaqa.py -> build/lib/lm_eval/datasets/triviaqa
2022-12-08T08:25:14,642   creating build/lib/lm_eval/datasets/headqa
2022-12-08T08:25:14,643   copying lm_eval/datasets/headqa/__init__.py -> build/lib/lm_eval/datasets/headqa
2022-12-08T08:25:14,646   copying lm_eval/datasets/headqa/headqa.py -> build/lib/lm_eval/datasets/headqa
2022-12-08T08:25:14,651   creating build/lib/lm_eval/datasets/sat_analogies
2022-12-08T08:25:14,653   copying lm_eval/datasets/sat_analogies/__init__.py -> build/lib/lm_eval/datasets/sat_analogies
2022-12-08T08:25:14,656   copying lm_eval/datasets/sat_analogies/sat_analogies.py -> build/lib/lm_eval/datasets/sat_analogies
2022-12-08T08:25:14,661   creating build/lib/lm_eval/datasets/coqa
2022-12-08T08:25:14,662   copying lm_eval/datasets/coqa/coqa.py -> build/lib/lm_eval/datasets/coqa
2022-12-08T08:25:14,667   copying lm_eval/datasets/coqa/__init__.py -> build/lib/lm_eval/datasets/coqa
2022-12-08T08:25:14,670   creating build/lib/lm_eval/datasets/lambada_openai
2022-12-08T08:25:14,672   copying lm_eval/datasets/lambada_openai/lambada_openai.py -> build/lib/lm_eval/datasets/lambada_openai
2022-12-08T08:25:14,676   copying lm_eval/datasets/lambada_openai/__init__.py -> build/lib/lm_eval/datasets/lambada_openai
2022-12-08T08:25:14,680   creating build/lib/lm_eval/datasets/arithmetic
2022-12-08T08:25:14,681   copying lm_eval/datasets/arithmetic/__init__.py -> build/lib/lm_eval/datasets/arithmetic
2022-12-08T08:25:14,684   copying lm_eval/datasets/arithmetic/arithmetic.py -> build/lib/lm_eval/datasets/arithmetic
2022-12-08T08:25:14,689   creating build/lib/lm_eval/datasets/unscramble
2022-12-08T08:25:14,691   copying lm_eval/datasets/unscramble/__init__.py -> build/lib/lm_eval/datasets/unscramble
2022-12-08T08:25:14,694   copying lm_eval/datasets/unscramble/unscramble.py -> build/lib/lm_eval/datasets/unscramble
2022-12-08T08:25:14,699   creating build/lib/lm_eval/datasets/wikitext
2022-12-08T08:25:14,700   copying lm_eval/datasets/wikitext/__init__.py -> build/lib/lm_eval/datasets/wikitext
2022-12-08T08:25:14,703   copying lm_eval/datasets/wikitext/wikitext.py -> build/lib/lm_eval/datasets/wikitext
2022-12-08T08:25:14,708   creating build/lib/lm_eval/datasets/hendrycks_ethics
2022-12-08T08:25:14,710   copying lm_eval/datasets/hendrycks_ethics/__init__.py -> build/lib/lm_eval/datasets/hendrycks_ethics
2022-12-08T08:25:14,713   copying lm_eval/datasets/hendrycks_ethics/hendrycks_ethics.py -> build/lib/lm_eval/datasets/hendrycks_ethics
2022-12-08T08:25:14,718   creating build/lib/lm_eval/datasets/mutual
2022-12-08T08:25:14,720   copying lm_eval/datasets/mutual/mutual.py -> build/lib/lm_eval/datasets/mutual
2022-12-08T08:25:14,724   copying lm_eval/datasets/mutual/__init__.py -> build/lib/lm_eval/datasets/mutual
2022-12-08T08:25:14,831   /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
2022-12-08T08:25:14,831     setuptools.SetuptoolsDeprecationWarning,
2022-12-08T08:25:14,894   installing to build/bdist.linux-armv7l/wheel
2022-12-08T08:25:14,895   running install
2022-12-08T08:25:14,956   running install_lib
2022-12-08T08:25:15,023   creating build/bdist.linux-armv7l
2022-12-08T08:25:15,024   creating build/bdist.linux-armv7l/wheel
2022-12-08T08:25:15,028   creating build/bdist.linux-armv7l/wheel/scripts
2022-12-08T08:25:15,030   copying build/lib/scripts/__init__.py -> build/bdist.linux-armv7l/wheel/scripts
2022-12-08T08:25:15,033   copying build/lib/scripts/make_gpt2_test_cases.py -> build/bdist.linux-armv7l/wheel/scripts
2022-12-08T08:25:15,037   copying build/lib/scripts/cost_estimate.py -> build/bdist.linux-armv7l/wheel/scripts
2022-12-08T08:25:15,042   creating build/bdist.linux-armv7l/wheel/scripts/clean_training_data
2022-12-08T08:25:15,043   copying build/lib/scripts/clean_training_data/investigate_pile.py -> build/bdist.linux-armv7l/wheel/scripts/clean_training_data
2022-12-08T08:25:15,047   copying build/lib/scripts/clean_training_data/generate_13_grams.py -> build/bdist.linux-armv7l/wheel/scripts/clean_training_data
2022-12-08T08:25:15,051   copying build/lib/scripts/clean_training_data/process_sorted_buckets.py -> build/bdist.linux-armv7l/wheel/scripts/clean_training_data
2022-12-08T08:25:15,055   copying build/lib/scripts/clean_training_data/__init__.py -> build/bdist.linux-armv7l/wheel/scripts/clean_training_data
2022-12-08T08:25:15,057   copying build/lib/scripts/clean_training_data/compress_and_package.py -> build/bdist.linux-armv7l/wheel/scripts/clean_training_data
2022-12-08T08:25:15,061   copying build/lib/scripts/clean_training_data/sort_13_gram_buckets.py -> build/bdist.linux-armv7l/wheel/scripts/clean_training_data
2022-12-08T08:25:15,064   copying build/lib/scripts/make_table_tasks.py -> build/bdist.linux-armv7l/wheel/scripts
2022-12-08T08:25:15,068   copying build/lib/scripts/get_prompts.py -> build/bdist.linux-armv7l/wheel/scripts
2022-12-08T08:25:15,071   copying build/lib/scripts/write_out.py -> build/bdist.linux-armv7l/wheel/scripts
2022-12-08T08:25:15,076   creating build/bdist.linux-armv7l/wheel/lm_eval
2022-12-08T08:25:15,078   creating build/bdist.linux-armv7l/wheel/lm_eval/decontamination
2022-12-08T08:25:15,080   copying build/lib/lm_eval/decontamination/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/decontamination
2022-12-08T08:25:15,083   copying build/lib/lm_eval/decontamination/archiver.py -> build/bdist.linux-armv7l/wheel/lm_eval/decontamination
2022-12-08T08:25:15,087   copying build/lib/lm_eval/decontamination/janitor.py -> build/bdist.linux-armv7l/wheel/lm_eval/decontamination
2022-12-08T08:25:15,092   copying build/lib/lm_eval/decontamination/decontaminate.py -> build/bdist.linux-armv7l/wheel/lm_eval/decontamination
2022-12-08T08:25:15,097   creating build/bdist.linux-armv7l/wheel/lm_eval/models
2022-12-08T08:25:15,099   copying build/lib/lm_eval/models/textsynth.py -> build/bdist.linux-armv7l/wheel/lm_eval/models
2022-12-08T08:25:15,103   copying build/lib/lm_eval/models/gpt3.py -> build/bdist.linux-armv7l/wheel/lm_eval/models
2022-12-08T08:25:15,107   copying build/lib/lm_eval/models/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/models
2022-12-08T08:25:15,110   copying build/lib/lm_eval/models/gpt2.py -> build/bdist.linux-armv7l/wheel/lm_eval/models
2022-12-08T08:25:15,114   copying build/lib/lm_eval/models/dummy.py -> build/bdist.linux-armv7l/wheel/lm_eval/models
2022-12-08T08:25:15,117   copying build/lib/lm_eval/metrics.py -> build/bdist.linux-armv7l/wheel/lm_eval
2022-12-08T08:25:15,121   copying build/lib/lm_eval/evaluator.py -> build/bdist.linux-armv7l/wheel/lm_eval
2022-12-08T08:25:15,127   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets
2022-12-08T08:25:15,130   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/quac
2022-12-08T08:25:15,131   copying build/lib/lm_eval/datasets/quac/quac.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/quac
2022-12-08T08:25:15,135   copying build/lib/lm_eval/datasets/quac/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/quac
2022-12-08T08:25:15,139   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/hendrycks_math
2022-12-08T08:25:15,141   copying build/lib/lm_eval/datasets/hendrycks_math/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/hendrycks_math
2022-12-08T08:25:15,144   copying build/lib/lm_eval/datasets/hendrycks_math/hendrycks_math.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/hendrycks_math
2022-12-08T08:25:15,148   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/logiqa
2022-12-08T08:25:15,150   copying build/lib/lm_eval/datasets/logiqa/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/logiqa
2022-12-08T08:25:15,152   copying build/lib/lm_eval/datasets/logiqa/logiqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/logiqa
2022-12-08T08:25:15,156   copying build/lib/lm_eval/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets
2022-12-08T08:25:15,160   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/drop
2022-12-08T08:25:15,161   copying build/lib/lm_eval/datasets/drop/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/drop
2022-12-08T08:25:15,164   copying build/lib/lm_eval/datasets/drop/drop.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/drop
2022-12-08T08:25:15,169   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/pile
2022-12-08T08:25:15,170   copying build/lib/lm_eval/datasets/pile/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/pile
2022-12-08T08:25:15,173   copying build/lib/lm_eval/datasets/pile/pile.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/pile
2022-12-08T08:25:15,178   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/asdiv
2022-12-08T08:25:15,179   copying build/lib/lm_eval/datasets/asdiv/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/asdiv
2022-12-08T08:25:15,182   copying build/lib/lm_eval/datasets/asdiv/asdiv.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/asdiv
2022-12-08T08:25:15,187   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/triviaqa
2022-12-08T08:25:15,188   copying build/lib/lm_eval/datasets/triviaqa/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/triviaqa
2022-12-08T08:25:15,191   copying build/lib/lm_eval/datasets/triviaqa/triviaqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/triviaqa
2022-12-08T08:25:15,196   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/headqa
2022-12-08T08:25:15,198   copying build/lib/lm_eval/datasets/headqa/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/headqa
2022-12-08T08:25:15,201   copying build/lib/lm_eval/datasets/headqa/headqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/headqa
2022-12-08T08:25:15,206   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/sat_analogies
2022-12-08T08:25:15,207   copying build/lib/lm_eval/datasets/sat_analogies/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/sat_analogies
2022-12-08T08:25:15,210   copying build/lib/lm_eval/datasets/sat_analogies/sat_analogies.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/sat_analogies
2022-12-08T08:25:15,215   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/coqa
2022-12-08T08:25:15,216   copying build/lib/lm_eval/datasets/coqa/coqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/coqa
2022-12-08T08:25:15,221   copying build/lib/lm_eval/datasets/coqa/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/coqa
2022-12-08T08:25:15,224   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/lambada_openai
2022-12-08T08:25:15,226   copying build/lib/lm_eval/datasets/lambada_openai/lambada_openai.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/lambada_openai
2022-12-08T08:25:15,230   copying build/lib/lm_eval/datasets/lambada_openai/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/lambada_openai
2022-12-08T08:25:15,234   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/arithmetic
2022-12-08T08:25:15,235   copying build/lib/lm_eval/datasets/arithmetic/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/arithmetic
2022-12-08T08:25:15,238   copying build/lib/lm_eval/datasets/arithmetic/arithmetic.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/arithmetic
2022-12-08T08:25:15,243   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/unscramble
2022-12-08T08:25:15,244   copying build/lib/lm_eval/datasets/unscramble/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/unscramble
2022-12-08T08:25:15,248   copying build/lib/lm_eval/datasets/unscramble/unscramble.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/unscramble
2022-12-08T08:25:15,252   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/wikitext
2022-12-08T08:25:15,254   copying build/lib/lm_eval/datasets/wikitext/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/wikitext
2022-12-08T08:25:15,257   copying build/lib/lm_eval/datasets/wikitext/wikitext.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/wikitext
2022-12-08T08:25:15,262   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/hendrycks_ethics
2022-12-08T08:25:15,263   copying build/lib/lm_eval/datasets/hendrycks_ethics/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/hendrycks_ethics
2022-12-08T08:25:15,266   copying build/lib/lm_eval/datasets/hendrycks_ethics/hendrycks_ethics.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/hendrycks_ethics
2022-12-08T08:25:15,271   creating build/bdist.linux-armv7l/wheel/lm_eval/datasets/mutual
2022-12-08T08:25:15,273   copying build/lib/lm_eval/datasets/mutual/mutual.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/mutual
2022-12-08T08:25:15,277   copying build/lib/lm_eval/datasets/mutual/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/datasets/mutual
2022-12-08T08:25:15,280   copying build/lib/lm_eval/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval
2022-12-08T08:25:15,282   copying build/lib/lm_eval/utils.py -> build/bdist.linux-armv7l/wheel/lm_eval
2022-12-08T08:25:15,288   creating build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,290   copying build/lib/lm_eval/tasks/hellaswag.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,293   copying build/lib/lm_eval/tasks/mathqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,296   copying build/lib/lm_eval/tasks/mutual.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,300   copying build/lib/lm_eval/tasks/quac.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,303   copying build/lib/lm_eval/tasks/blimp.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,307   copying build/lib/lm_eval/tasks/coqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,311   copying build/lib/lm_eval/tasks/lambada_cloze.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,314   copying build/lib/lm_eval/tasks/cbt.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,318   copying build/lib/lm_eval/tasks/lambada.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,322   copying build/lib/lm_eval/tasks/sat.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,325   copying build/lib/lm_eval/tasks/squad.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,329   copying build/lib/lm_eval/tasks/__init__.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,333   copying build/lib/lm_eval/tasks/superglue.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,337   copying build/lib/lm_eval/tasks/glue.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,341   copying build/lib/lm_eval/tasks/arithmetic.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,345   copying build/lib/lm_eval/tasks/asdiv.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,348   copying build/lib/lm_eval/tasks/qa4mre.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,351   copying build/lib/lm_eval/tasks/headqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,354   copying build/lib/lm_eval/tasks/anli.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,358   copying build/lib/lm_eval/tasks/hendrycks_ethics.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,362   copying build/lib/lm_eval/tasks/wikitext.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,365   copying build/lib/lm_eval/tasks/drop.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,369   copying build/lib/lm_eval/tasks/qasper.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,373   copying build/lib/lm_eval/tasks/winogrande.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,377   copying build/lib/lm_eval/tasks/truthfulqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,381   copying build/lib/lm_eval/tasks/lambada_multilingual.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,384   copying build/lib/lm_eval/tasks/triviaqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,387   copying build/lib/lm_eval/tasks/arc.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,391   copying build/lib/lm_eval/tasks/race.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,394   copying build/lib/lm_eval/tasks/mc_taco.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,398   copying build/lib/lm_eval/tasks/translation.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,402   copying build/lib/lm_eval/tasks/pile.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,405   copying build/lib/lm_eval/tasks/piqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,408   copying build/lib/lm_eval/tasks/sciq.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,411   copying build/lib/lm_eval/tasks/hendrycks_test.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,415   copying build/lib/lm_eval/tasks/hendrycks_math.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,419   copying build/lib/lm_eval/tasks/swag.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,422   copying build/lib/lm_eval/tasks/unscramble.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,425   copying build/lib/lm_eval/tasks/storycloze.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,429   copying build/lib/lm_eval/tasks/logiqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,432   copying build/lib/lm_eval/tasks/webqs.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,435   copying build/lib/lm_eval/tasks/openbookqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,438   copying build/lib/lm_eval/tasks/pubmedqa.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,441   copying build/lib/lm_eval/tasks/prost.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,444   copying build/lib/lm_eval/tasks/wsc273.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,448   copying build/lib/lm_eval/tasks/gsm8k.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,452   copying build/lib/lm_eval/tasks/naturalqs.py -> build/bdist.linux-armv7l/wheel/lm_eval/tasks
2022-12-08T08:25:15,455   copying build/lib/lm_eval/base.py -> build/bdist.linux-armv7l/wheel/lm_eval
2022-12-08T08:25:15,460   running install_egg_info
2022-12-08T08:25:15,617   running egg_info
2022-12-08T08:25:15,677   writing lm_eval.egg-info/PKG-INFO
2022-12-08T08:25:15,680   writing dependency_links to lm_eval.egg-info/dependency_links.txt
2022-12-08T08:25:15,684   writing requirements to lm_eval.egg-info/requires.txt
2022-12-08T08:25:15,687   writing top-level names to lm_eval.egg-info/top_level.txt
2022-12-08T08:25:15,785   reading manifest file 'lm_eval.egg-info/SOURCES.txt'
2022-12-08T08:25:15,795   adding license file 'LICENSE.md'
2022-12-08T08:25:15,812   writing manifest file 'lm_eval.egg-info/SOURCES.txt'
2022-12-08T08:25:15,815   Copying lm_eval.egg-info to build/bdist.linux-armv7l/wheel/lm_eval-0.3.0-py3.7.egg-info
2022-12-08T08:25:15,834   running install_scripts
2022-12-08T08:25:16,038   adding license file "LICENSE.md" (matched pattern "LICEN[CS]E*")
2022-12-08T08:25:16,045   creating build/bdist.linux-armv7l/wheel/lm_eval-0.3.0.dist-info/WHEEL
2022-12-08T08:25:16,049   creating '/tmp/pip-wheel-spgy6d49/lm_eval-0.3.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2022-12-08T08:25:16,053   adding 'lm_eval/__init__.py'
2022-12-08T08:25:16,062   adding 'lm_eval/base.py'
2022-12-08T08:25:16,067   adding 'lm_eval/evaluator.py'
2022-12-08T08:25:16,071   adding 'lm_eval/metrics.py'
2022-12-08T08:25:16,075   adding 'lm_eval/utils.py'
2022-12-08T08:25:16,078   adding 'lm_eval/datasets/__init__.py'
2022-12-08T08:25:16,081   adding 'lm_eval/datasets/arithmetic/__init__.py'
2022-12-08T08:25:16,084   adding 'lm_eval/datasets/arithmetic/arithmetic.py'
2022-12-08T08:25:16,087   adding 'lm_eval/datasets/asdiv/__init__.py'
2022-12-08T08:25:16,090   adding 'lm_eval/datasets/asdiv/asdiv.py'
2022-12-08T08:25:16,093   adding 'lm_eval/datasets/coqa/__init__.py'
2022-12-08T08:25:16,096   adding 'lm_eval/datasets/coqa/coqa.py'
2022-12-08T08:25:16,100   adding 'lm_eval/datasets/drop/__init__.py'
2022-12-08T08:25:16,103   adding 'lm_eval/datasets/drop/drop.py'
2022-12-08T08:25:16,106   adding 'lm_eval/datasets/headqa/__init__.py'
2022-12-08T08:25:16,109   adding 'lm_eval/datasets/headqa/headqa.py'
2022-12-08T08:25:16,112   adding 'lm_eval/datasets/hendrycks_ethics/__init__.py'
2022-12-08T08:25:16,115   adding 'lm_eval/datasets/hendrycks_ethics/hendrycks_ethics.py'
2022-12-08T08:25:16,119   adding 'lm_eval/datasets/hendrycks_math/__init__.py'
2022-12-08T08:25:16,121   adding 'lm_eval/datasets/hendrycks_math/hendrycks_math.py'
2022-12-08T08:25:16,124   adding 'lm_eval/datasets/lambada_openai/__init__.py'
2022-12-08T08:25:16,127   adding 'lm_eval/datasets/lambada_openai/lambada_openai.py'
2022-12-08T08:25:16,131   adding 'lm_eval/datasets/logiqa/__init__.py'
2022-12-08T08:25:16,133   adding 'lm_eval/datasets/logiqa/logiqa.py'
2022-12-08T08:25:16,137   adding 'lm_eval/datasets/mutual/__init__.py'
2022-12-08T08:25:16,139   adding 'lm_eval/datasets/mutual/mutual.py'
2022-12-08T08:25:16,143   adding 'lm_eval/datasets/pile/__init__.py'
2022-12-08T08:25:16,145   adding 'lm_eval/datasets/pile/pile.py'
2022-12-08T08:25:16,149   adding 'lm_eval/datasets/quac/__init__.py'
2022-12-08T08:25:16,152   adding 'lm_eval/datasets/quac/quac.py'
2022-12-08T08:25:16,155   adding 'lm_eval/datasets/sat_analogies/__init__.py'
2022-12-08T08:25:16,157   adding 'lm_eval/datasets/sat_analogies/sat_analogies.py'
2022-12-08T08:25:16,161   adding 'lm_eval/datasets/triviaqa/__init__.py'
2022-12-08T08:25:16,164   adding 'lm_eval/datasets/triviaqa/triviaqa.py'
2022-12-08T08:25:16,167   adding 'lm_eval/datasets/unscramble/__init__.py'
2022-12-08T08:25:16,170   adding 'lm_eval/datasets/unscramble/unscramble.py'
2022-12-08T08:25:16,173   adding 'lm_eval/datasets/wikitext/__init__.py'
2022-12-08T08:25:16,176   adding 'lm_eval/datasets/wikitext/wikitext.py'
2022-12-08T08:25:16,180   adding 'lm_eval/decontamination/__init__.py'
2022-12-08T08:25:16,183   adding 'lm_eval/decontamination/archiver.py'
2022-12-08T08:25:16,186   adding 'lm_eval/decontamination/decontaminate.py'
2022-12-08T08:25:16,191   adding 'lm_eval/decontamination/janitor.py'
2022-12-08T08:25:16,195   adding 'lm_eval/models/__init__.py'
2022-12-08T08:25:16,197   adding 'lm_eval/models/dummy.py'
2022-12-08T08:25:16,200   adding 'lm_eval/models/gpt2.py'
2022-12-08T08:25:16,203   adding 'lm_eval/models/gpt3.py'
2022-12-08T08:25:16,206   adding 'lm_eval/models/textsynth.py'
2022-12-08T08:25:16,213   adding 'lm_eval/tasks/__init__.py'
2022-12-08T08:25:16,216   adding 'lm_eval/tasks/anli.py'
2022-12-08T08:25:16,219   adding 'lm_eval/tasks/arc.py'
2022-12-08T08:25:16,221   adding 'lm_eval/tasks/arithmetic.py'
2022-12-08T08:25:16,224   adding 'lm_eval/tasks/asdiv.py'
2022-12-08T08:25:16,228   adding 'lm_eval/tasks/blimp.py'
2022-12-08T08:25:16,231   adding 'lm_eval/tasks/cbt.py'
2022-12-08T08:25:16,234   adding 'lm_eval/tasks/coqa.py'
2022-12-08T08:25:16,238   adding 'lm_eval/tasks/drop.py'
2022-12-08T08:25:16,243   adding 'lm_eval/tasks/glue.py'
2022-12-08T08:25:16,246   adding 'lm_eval/tasks/gsm8k.py'
2022-12-08T08:25:16,248   adding 'lm_eval/tasks/headqa.py'
2022-12-08T08:25:16,251   adding 'lm_eval/tasks/hellaswag.py'
2022-12-08T08:25:16,255   adding 'lm_eval/tasks/hendrycks_ethics.py'
2022-12-08T08:25:16,258   adding 'lm_eval/tasks/hendrycks_math.py'
2022-12-08T08:25:16,262   adding 'lm_eval/tasks/hendrycks_test.py'
2022-12-08T08:25:16,264   adding 'lm_eval/tasks/lambada.py'
2022-12-08T08:25:16,267   adding 'lm_eval/tasks/lambada_cloze.py'
2022-12-08T08:25:16,269   adding 'lm_eval/tasks/lambada_multilingual.py'
2022-12-08T08:25:16,272   adding 'lm_eval/tasks/logiqa.py'
2022-12-08T08:25:16,275   adding 'lm_eval/tasks/mathqa.py'
2022-12-08T08:25:16,278   adding 'lm_eval/tasks/mc_taco.py'
2022-12-08T08:25:16,281   adding 'lm_eval/tasks/mutual.py'
2022-12-08T08:25:16,284   adding 'lm_eval/tasks/naturalqs.py'
2022-12-08T08:25:16,286   adding 'lm_eval/tasks/openbookqa.py'
2022-12-08T08:25:16,289   adding 'lm_eval/tasks/pile.py'
2022-12-08T08:25:16,291   adding 'lm_eval/tasks/piqa.py'
2022-12-08T08:25:16,294   adding 'lm_eval/tasks/prost.py'
2022-12-08T08:25:16,296   adding 'lm_eval/tasks/pubmedqa.py'
2022-12-08T08:25:16,299   adding 'lm_eval/tasks/qa4mre.py'
2022-12-08T08:25:16,302   adding 'lm_eval/tasks/qasper.py'
2022-12-08T08:25:16,305   adding 'lm_eval/tasks/quac.py'
2022-12-08T08:25:16,308   adding 'lm_eval/tasks/race.py'
2022-12-08T08:25:16,311   adding 'lm_eval/tasks/sat.py'
2022-12-08T08:25:16,313   adding 'lm_eval/tasks/sciq.py'
2022-12-08T08:25:16,316   adding 'lm_eval/tasks/squad.py'
2022-12-08T08:25:16,319   adding 'lm_eval/tasks/storycloze.py'
2022-12-08T08:25:16,323   adding 'lm_eval/tasks/superglue.py'
2022-12-08T08:25:16,326   adding 'lm_eval/tasks/swag.py'
2022-12-08T08:25:16,330   adding 'lm_eval/tasks/translation.py'
2022-12-08T08:25:16,333   adding 'lm_eval/tasks/triviaqa.py'
2022-12-08T08:25:16,337   adding 'lm_eval/tasks/truthfulqa.py'
2022-12-08T08:25:16,340   adding 'lm_eval/tasks/unscramble.py'
2022-12-08T08:25:16,343   adding 'lm_eval/tasks/webqs.py'
2022-12-08T08:25:16,345   adding 'lm_eval/tasks/wikitext.py'
2022-12-08T08:25:16,348   adding 'lm_eval/tasks/winogrande.py'
2022-12-08T08:25:16,351   adding 'lm_eval/tasks/wsc273.py'
2022-12-08T08:25:16,357   adding 'scripts/__init__.py'
2022-12-08T08:25:16,360   adding 'scripts/cost_estimate.py'
2022-12-08T08:25:16,362   adding 'scripts/get_prompts.py'
2022-12-08T08:25:16,365   adding 'scripts/make_gpt2_test_cases.py'
2022-12-08T08:25:16,367   adding 'scripts/make_table_tasks.py'
2022-12-08T08:25:16,369   adding 'scripts/write_out.py'
2022-12-08T08:25:16,373   adding 'scripts/clean_training_data/__init__.py'
2022-12-08T08:25:16,375   adding 'scripts/clean_training_data/compress_and_package.py'
2022-12-08T08:25:16,379   adding 'scripts/clean_training_data/generate_13_grams.py'
2022-12-08T08:25:16,381   adding 'scripts/clean_training_data/investigate_pile.py'
2022-12-08T08:25:16,384   adding 'scripts/clean_training_data/process_sorted_buckets.py'
2022-12-08T08:25:16,387   adding 'scripts/clean_training_data/sort_13_gram_buckets.py'
2022-12-08T08:25:16,389   adding 'lm_eval-0.3.0.dist-info/LICENSE.md'
2022-12-08T08:25:16,392   adding 'lm_eval-0.3.0.dist-info/METADATA'
2022-12-08T08:25:16,393   adding 'lm_eval-0.3.0.dist-info/WHEEL'
2022-12-08T08:25:16,395   adding 'lm_eval-0.3.0.dist-info/top_level.txt'
2022-12-08T08:25:16,400   adding 'lm_eval-0.3.0.dist-info/RECORD'
2022-12-08T08:25:16,411   removing build/bdist.linux-armv7l/wheel
2022-12-08T08:25:16,725   Building wheel for lm-eval (setup.py): finished with status 'done'
2022-12-08T08:25:16,737   Created wheel for lm-eval: filename=lm_eval-0.3.0-py3-none-any.whl size=178653 sha256=498b8b8954c1f9c17f46e3ec096e9be6b9c96ee70560ee613a4eb9c7b9d31644
2022-12-08T08:25:16,740   Stored in directory: /tmp/pip-ephem-wheel-cache-53exuaaz/wheels/36/af/ae/43c23b3a3bb3a811be90cac32fb1cf6464655008d90af8ebf7
2022-12-08T08:25:16,776 Successfully built lm-eval
2022-12-08T08:25:16,804 Removed build tracker: '/tmp/pip-build-tracker-9h6h1uxk'