2023-11-25T08:21:45,811 Created temporary directory: /tmp/pip-build-tracker-tdez15hp 2023-11-25T08:21:45,812 Initialized build tracking at /tmp/pip-build-tracker-tdez15hp 2023-11-25T08:21:45,812 Created build tracker: /tmp/pip-build-tracker-tdez15hp 2023-11-25T08:21:45,813 Entered build tracker: /tmp/pip-build-tracker-tdez15hp 2023-11-25T08:21:45,814 Created temporary directory: /tmp/pip-wheel-6iue9mmy 2023-11-25T08:21:45,817 Created temporary directory: /tmp/pip-ephem-wheel-cache-yk02f7pi 2023-11-25T08:21:45,841 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-11-25T08:21:45,844 2 location(s) to search for versions of llm-foundry: 2023-11-25T08:21:45,844 * https://pypi.org/simple/llm-foundry/ 2023-11-25T08:21:45,844 * https://www.piwheels.org/simple/llm-foundry/ 2023-11-25T08:21:45,845 Fetching project page and analyzing links: https://pypi.org/simple/llm-foundry/ 2023-11-25T08:21:45,846 Getting page https://pypi.org/simple/llm-foundry/ 2023-11-25T08:21:45,847 Found index url https://pypi.org/simple/ 2023-11-25T08:21:46,060 Fetched page https://pypi.org/simple/llm-foundry/ as application/vnd.pypi.simple.v1+json 2023-11-25T08:21:46,063 Found link https://files.pythonhosted.org/packages/3a/ae/57c3346bd35154ba2f506fc13cb07b38cefc4f5511cb34705c1c34c568f1/llm-foundry-0.1.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.1.0 2023-11-25T08:21:46,064 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/d7/32/b1afffb2d76c0be72fcda3184050bc4ebc32695a645ef95bdb35103007ad/llm_foundry-0.1.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2023-11-25T08:21:46,065 Found link https://files.pythonhosted.org/packages/61/7d/a152ff61601e702027412187760d34832d34dc2c6c96d8baa4979769b49e/llm-foundry-0.2.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.2.0 2023-11-25T08:21:46,065 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/7c/19/2dfb92b041c0a18b105e98a71009732ac03bc504c22c0a6dd4b62f50c0b7/llm_foundry-0.2.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2023-11-25T08:21:46,066 Found link https://files.pythonhosted.org/packages/74/dd/f7204d13bcb9bc41f586f13556f7cec412d4401b834abb0f6827df89da3a/llm-foundry-0.3.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.3.0 2023-11-25T08:21:46,067 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/cc/87/e0b2af411af8933ff85fdc34b8fdf28cde01d4c050d75dca5959de0aa7a2/llm_foundry-0.3.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2023-11-25T08:21:46,068 Found link https://files.pythonhosted.org/packages/ec/6c/2f776ccc71541901f2b9b9f776c415c65ed551eab2ddecf7fb89566511f7/llm-foundry-0.4.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.4.0 2023-11-25T08:21:46,069 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/e6/d0/f2c4899b0dc4fab34a0a79f53fddf94c77e8aeb84c6ac0ec785bc498a8c7/llm_foundry-0.4.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2023-11-25T08:21:46,070 Fetching project page and analyzing links: https://www.piwheels.org/simple/llm-foundry/ 2023-11-25T08:21:46,070 Getting page https://www.piwheels.org/simple/llm-foundry/ 2023-11-25T08:21:46,072 Found index url https://www.piwheels.org/simple/ 2023-11-25T08:21:46,250 Fetched page https://www.piwheels.org/simple/llm-foundry/ as text/html 2023-11-25T08:21:46,252 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.3.0-py3-none-any.whl#sha256=4e22006806faee0afc389aea07fdcb9c522cdaf230c87693e24fe113b26af7e3 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2023-11-25T08:21:46,253 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.2.0-py3-none-any.whl#sha256=d04a1d00b014fa919b4e35d6d0910ba7e796c754b7451c846391e890cb108566 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2023-11-25T08:21:46,253 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.1.0-py3-none-any.whl#sha256=49868c9a1fd20882f6038ead8e4a4abcf5c795b75bb0686011ce460f237eae18 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2023-11-25T08:21:46,254 Skipping link: not a file: https://www.piwheels.org/simple/llm-foundry/ 2023-11-25T08:21:46,255 Skipping link: not a file: https://pypi.org/simple/llm-foundry/ 2023-11-25T08:21:46,273 Given no hashes to check 1 links for project 'llm-foundry': discarding no candidates 2023-11-25T08:21:46,291 Collecting llm-foundry==0.4.0 2023-11-25T08:21:46,293 Created temporary directory: /tmp/pip-unpack-5i0xlxgg 2023-11-25T08:21:46,540 Downloading llm-foundry-0.4.0.tar.gz (201 kB) 2023-11-25T08:21:46,859 Added llm-foundry==0.4.0 from https://files.pythonhosted.org/packages/ec/6c/2f776ccc71541901f2b9b9f776c415c65ed551eab2ddecf7fb89566511f7/llm-foundry-0.4.0.tar.gz to build tracker '/tmp/pip-build-tracker-tdez15hp' 2023-11-25T08:21:46,867 Created temporary directory: /tmp/pip-build-env-yib9eo0i 2023-11-25T08:21:46,871 Installing build dependencies: started 2023-11-25T08:21:46,873 Running command pip subprocess to install build dependencies 2023-11-25T08:21:48,038 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2023-11-25T08:21:48,559 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-11-25T08:21:50,043 Collecting setuptools<68.0.0 2023-11-25T08:21:50,056 Downloading https://www.piwheels.org/simple/setuptools/setuptools-67.8.0-py3-none-any.whl (1.1 MB) 2023-11-25T08:21:50,160 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 11.5 MB/s eta 0:00:00 2023-11-25T08:21:52,717 Installing collected packages: setuptools 2023-11-25T08:21:54,951 Successfully installed setuptools-67.8.0 2023-11-25T08:21:55,543 Installing build dependencies: finished with status 'done' 2023-11-25T08:21:55,546 Getting requirements to build wheel: started 2023-11-25T08:21:55,547 Running command Getting requirements to build wheel 2023-11-25T08:21:56,165 running egg_info 2023-11-25T08:21:56,169 writing llm_foundry.egg-info/PKG-INFO 2023-11-25T08:21:56,172 writing dependency_links to llm_foundry.egg-info/dependency_links.txt 2023-11-25T08:21:56,175 writing requirements to llm_foundry.egg-info/requires.txt 2023-11-25T08:21:56,176 writing top-level names to llm_foundry.egg-info/top_level.txt 2023-11-25T08:21:56,203 reading manifest file 'llm_foundry.egg-info/SOURCES.txt' 2023-11-25T08:21:56,207 adding license file 'LICENSE' 2023-11-25T08:21:56,212 writing manifest file 'llm_foundry.egg-info/SOURCES.txt' 2023-11-25T08:21:56,289 Getting requirements to build wheel: finished with status 'done' 2023-11-25T08:21:56,297 Installing backend dependencies: started 2023-11-25T08:21:56,298 Running command pip subprocess to install backend dependencies 2023-11-25T08:21:57,435 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2023-11-25T08:21:57,954 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-11-25T08:21:58,423 Collecting wheel 2023-11-25T08:21:58,437 Using cached https://www.piwheels.org/simple/wheel/wheel-0.41.3-py3-none-any.whl (65 kB) 2023-11-25T08:22:00,663 Installing collected packages: wheel 2023-11-25T08:22:00,887 Creating /tmp/pip-build-env-yib9eo0i/normal/local/bin 2023-11-25T08:22:00,889 changing mode of /tmp/pip-build-env-yib9eo0i/normal/local/bin/wheel to 755 2023-11-25T08:22:00,900 Successfully installed wheel-0.41.3 2023-11-25T08:22:01,461 Installing backend dependencies: finished with status 'done' 2023-11-25T08:22:01,463 Created temporary directory: /tmp/pip-modern-metadata-ic2j0up0 2023-11-25T08:22:01,465 Preparing metadata (pyproject.toml): started 2023-11-25T08:22:01,467 Running command Preparing metadata (pyproject.toml) 2023-11-25T08:22:02,068 running dist_info 2023-11-25T08:22:02,090 creating /tmp/pip-modern-metadata-ic2j0up0/llm_foundry.egg-info 2023-11-25T08:22:02,094 writing /tmp/pip-modern-metadata-ic2j0up0/llm_foundry.egg-info/PKG-INFO 2023-11-25T08:22:02,097 writing dependency_links to /tmp/pip-modern-metadata-ic2j0up0/llm_foundry.egg-info/dependency_links.txt 2023-11-25T08:22:02,100 writing requirements to /tmp/pip-modern-metadata-ic2j0up0/llm_foundry.egg-info/requires.txt 2023-11-25T08:22:02,101 writing top-level names to /tmp/pip-modern-metadata-ic2j0up0/llm_foundry.egg-info/top_level.txt 2023-11-25T08:22:02,103 writing manifest file '/tmp/pip-modern-metadata-ic2j0up0/llm_foundry.egg-info/SOURCES.txt' 2023-11-25T08:22:02,138 reading manifest file '/tmp/pip-modern-metadata-ic2j0up0/llm_foundry.egg-info/SOURCES.txt' 2023-11-25T08:22:02,140 adding license file 'LICENSE' 2023-11-25T08:22:02,144 writing manifest file '/tmp/pip-modern-metadata-ic2j0up0/llm_foundry.egg-info/SOURCES.txt' 2023-11-25T08:22:02,145 creating '/tmp/pip-modern-metadata-ic2j0up0/llm_foundry-0.4.0.dist-info' 2023-11-25T08:22:02,393 Preparing metadata (pyproject.toml): finished with status 'done' 2023-11-25T08:22:02,399 Source in /tmp/pip-wheel-6iue9mmy/llm-foundry_cb637a1a5d73432988b07866724b4fde has version 0.4.0, which satisfies requirement llm-foundry==0.4.0 from https://files.pythonhosted.org/packages/ec/6c/2f776ccc71541901f2b9b9f776c415c65ed551eab2ddecf7fb89566511f7/llm-foundry-0.4.0.tar.gz 2023-11-25T08:22:02,400 Removed llm-foundry==0.4.0 from https://files.pythonhosted.org/packages/ec/6c/2f776ccc71541901f2b9b9f776c415c65ed551eab2ddecf7fb89566511f7/llm-foundry-0.4.0.tar.gz from build tracker '/tmp/pip-build-tracker-tdez15hp' 2023-11-25T08:22:02,410 Created temporary directory: /tmp/pip-unpack-9nhfghgt 2023-11-25T08:22:02,411 Created temporary directory: /tmp/pip-unpack-y6viqiv4 2023-11-25T08:22:02,654 Building wheels for collected packages: llm-foundry 2023-11-25T08:22:02,658 Created temporary directory: /tmp/pip-wheel-4smf7ce1 2023-11-25T08:22:02,659 Destination directory: /tmp/pip-wheel-4smf7ce1 2023-11-25T08:22:02,661 Building wheel for llm-foundry (pyproject.toml): started 2023-11-25T08:22:02,662 Running command Building wheel for llm-foundry (pyproject.toml) 2023-11-25T08:22:03,315 running bdist_wheel 2023-11-25T08:22:03,355 running build 2023-11-25T08:22:03,355 running build_py 2023-11-25T08:22:03,362 creating build 2023-11-25T08:22:03,362 creating build/lib 2023-11-25T08:22:03,363 creating build/lib/llmfoundry 2023-11-25T08:22:03,365 copying llmfoundry/__init__.py -> build/lib/llmfoundry 2023-11-25T08:22:03,367 creating build/lib/llmfoundry/utils 2023-11-25T08:22:03,368 copying llmfoundry/utils/model_download_utils.py -> build/lib/llmfoundry/utils 2023-11-25T08:22:03,371 copying llmfoundry/utils/builders.py -> build/lib/llmfoundry/utils 2023-11-25T08:22:03,373 copying llmfoundry/utils/checkpoint_conversion_helpers.py -> build/lib/llmfoundry/utils 2023-11-25T08:22:03,376 copying llmfoundry/utils/huggingface_hub_utils.py -> build/lib/llmfoundry/utils 2023-11-25T08:22:03,378 copying llmfoundry/utils/config_utils.py -> build/lib/llmfoundry/utils 2023-11-25T08:22:03,380 copying llmfoundry/utils/__init__.py -> build/lib/llmfoundry/utils 2023-11-25T08:22:03,382 copying llmfoundry/utils/data_prep_utils.py -> build/lib/llmfoundry/utils 2023-11-25T08:22:03,384 creating build/lib/llmfoundry/optim 2023-11-25T08:22:03,385 copying llmfoundry/optim/scheduler.py -> build/lib/llmfoundry/optim 2023-11-25T08:22:03,388 copying llmfoundry/optim/outlier_detection.py -> build/lib/llmfoundry/optim 2023-11-25T08:22:03,390 copying llmfoundry/optim/lion8b.py -> build/lib/llmfoundry/optim 2023-11-25T08:22:03,393 copying llmfoundry/optim/adaptive_lion.py -> build/lib/llmfoundry/optim 2023-11-25T08:22:03,396 copying llmfoundry/optim/lion.py -> build/lib/llmfoundry/optim 2023-11-25T08:22:03,398 copying llmfoundry/optim/__init__.py -> build/lib/llmfoundry/optim 2023-11-25T08:22:03,401 creating build/lib/llmfoundry/data 2023-11-25T08:22:03,401 copying llmfoundry/data/dataloader.py -> build/lib/llmfoundry/data 2023-11-25T08:22:03,403 copying llmfoundry/data/text_data.py -> build/lib/llmfoundry/data 2023-11-25T08:22:03,406 copying llmfoundry/data/packing.py -> build/lib/llmfoundry/data 2023-11-25T08:22:03,408 copying llmfoundry/data/data.py -> build/lib/llmfoundry/data 2023-11-25T08:22:03,410 copying llmfoundry/data/denoising.py -> build/lib/llmfoundry/data 2023-11-25T08:22:03,413 copying llmfoundry/data/__init__.py -> build/lib/llmfoundry/data 2023-11-25T08:22:03,415 creating build/lib/llmfoundry/models 2023-11-25T08:22:03,416 copying llmfoundry/models/model_registry.py -> build/lib/llmfoundry/models 2023-11-25T08:22:03,417 copying llmfoundry/models/__init__.py -> build/lib/llmfoundry/models 2023-11-25T08:22:03,420 creating build/lib/llmfoundry/callbacks 2023-11-25T08:22:03,421 copying llmfoundry/callbacks/hf_checkpointer.py -> build/lib/llmfoundry/callbacks 2023-11-25T08:22:03,423 copying llmfoundry/callbacks/generate_callback.py -> build/lib/llmfoundry/callbacks 2023-11-25T08:22:03,425 copying llmfoundry/callbacks/scheduled_gc_callback.py -> build/lib/llmfoundry/callbacks 2023-11-25T08:22:03,427 copying llmfoundry/callbacks/eval_gauntlet_callback.py -> build/lib/llmfoundry/callbacks 2023-11-25T08:22:03,429 copying llmfoundry/callbacks/monolithic_ckpt_callback.py -> build/lib/llmfoundry/callbacks 2023-11-25T08:22:03,431 copying llmfoundry/callbacks/model_gauntlet_callback.py -> build/lib/llmfoundry/callbacks 2023-11-25T08:22:03,433 copying llmfoundry/callbacks/fdiff_callback.py -> build/lib/llmfoundry/callbacks 2023-11-25T08:22:03,435 copying llmfoundry/callbacks/resumption_callbacks.py -> build/lib/llmfoundry/callbacks 2023-11-25T08:22:03,437 copying llmfoundry/callbacks/__init__.py -> build/lib/llmfoundry/callbacks 2023-11-25T08:22:03,439 creating build/lib/llmfoundry/tokenizers 2023-11-25T08:22:03,440 copying llmfoundry/tokenizers/tiktoken.py -> build/lib/llmfoundry/tokenizers 2023-11-25T08:22:03,443 copying llmfoundry/tokenizers/__init__.py -> build/lib/llmfoundry/tokenizers 2023-11-25T08:22:03,445 creating build/lib/llmfoundry/data/finetuning 2023-11-25T08:22:03,446 copying llmfoundry/data/finetuning/dataloader.py -> build/lib/llmfoundry/data/finetuning 2023-11-25T08:22:03,448 copying llmfoundry/data/finetuning/tasks.py -> build/lib/llmfoundry/data/finetuning 2023-11-25T08:22:03,451 copying llmfoundry/data/finetuning/collator.py -> build/lib/llmfoundry/data/finetuning 2023-11-25T08:22:03,454 copying llmfoundry/data/finetuning/__init__.py -> build/lib/llmfoundry/data/finetuning 2023-11-25T08:22:03,456 creating build/lib/llmfoundry/models/utils 2023-11-25T08:22:03,457 copying llmfoundry/models/utils/hf_prefixlm_converter.py -> build/lib/llmfoundry/models/utils 2023-11-25T08:22:03,459 copying llmfoundry/models/utils/param_init_fns.py -> build/lib/llmfoundry/models/utils 2023-11-25T08:22:03,462 copying llmfoundry/models/utils/adapt_tokenizer.py -> build/lib/llmfoundry/models/utils 2023-11-25T08:22:03,464 copying llmfoundry/models/utils/meta_init_context.py -> build/lib/llmfoundry/models/utils 2023-11-25T08:22:03,466 copying llmfoundry/models/utils/__init__.py -> build/lib/llmfoundry/models/utils 2023-11-25T08:22:03,468 creating build/lib/llmfoundry/models/hf 2023-11-25T08:22:03,469 copying llmfoundry/models/hf/hf_prefix_lm.py -> build/lib/llmfoundry/models/hf 2023-11-25T08:22:03,472 copying llmfoundry/models/hf/hf_fsdp.py -> build/lib/llmfoundry/models/hf 2023-11-25T08:22:03,474 copying llmfoundry/models/hf/hf_t5.py -> build/lib/llmfoundry/models/hf 2023-11-25T08:22:03,477 copying llmfoundry/models/hf/hf_causal_lm.py -> build/lib/llmfoundry/models/hf 2023-11-25T08:22:03,480 copying llmfoundry/models/hf/model_wrapper.py -> build/lib/llmfoundry/models/hf 2023-11-25T08:22:03,482 copying llmfoundry/models/hf/__init__.py -> build/lib/llmfoundry/models/hf 2023-11-25T08:22:03,485 creating build/lib/llmfoundry/models/inference_api_wrapper 2023-11-25T08:22:03,486 copying llmfoundry/models/inference_api_wrapper/openai_causal_lm.py -> build/lib/llmfoundry/models/inference_api_wrapper 2023-11-25T08:22:03,488 copying llmfoundry/models/inference_api_wrapper/interface.py -> build/lib/llmfoundry/models/inference_api_wrapper 2023-11-25T08:22:03,490 copying llmfoundry/models/inference_api_wrapper/__init__.py -> build/lib/llmfoundry/models/inference_api_wrapper 2023-11-25T08:22:03,493 creating build/lib/llmfoundry/models/mpt 2023-11-25T08:22:03,493 copying llmfoundry/models/mpt/configuration_mpt.py -> build/lib/llmfoundry/models/mpt 2023-11-25T08:22:03,496 copying llmfoundry/models/mpt/__init__.py -> build/lib/llmfoundry/models/mpt 2023-11-25T08:22:03,498 copying llmfoundry/models/mpt/modeling_mpt.py -> build/lib/llmfoundry/models/mpt 2023-11-25T08:22:03,501 creating build/lib/llmfoundry/models/layers 2023-11-25T08:22:03,502 copying llmfoundry/models/layers/norm.py -> build/lib/llmfoundry/models/layers 2023-11-25T08:22:03,504 copying llmfoundry/models/layers/llama_attention_monkeypatch.py -> build/lib/llmfoundry/models/layers 2023-11-25T08:22:03,506 copying llmfoundry/models/layers/flash_attn_triton.py -> build/lib/llmfoundry/models/layers 2023-11-25T08:22:03,509 copying llmfoundry/models/layers/fc.py -> build/lib/llmfoundry/models/layers 2023-11-25T08:22:03,511 copying llmfoundry/models/layers/blocks.py -> build/lib/llmfoundry/models/layers 2023-11-25T08:22:03,513 copying llmfoundry/models/layers/ffn.py -> build/lib/llmfoundry/models/layers 2023-11-25T08:22:03,515 copying llmfoundry/models/layers/custom_embedding.py -> build/lib/llmfoundry/models/layers 2023-11-25T08:22:03,517 copying llmfoundry/models/layers/__init__.py -> build/lib/llmfoundry/models/layers 2023-11-25T08:22:03,518 copying llmfoundry/models/layers/attention.py -> build/lib/llmfoundry/models/layers 2023-11-25T08:22:03,537 installing to build/bdist.linux-armv7l/wheel 2023-11-25T08:22:03,538 running install 2023-11-25T08:22:03,562 running install_lib 2023-11-25T08:22:03,568 creating build/bdist.linux-armv7l 2023-11-25T08:22:03,568 creating build/bdist.linux-armv7l/wheel 2023-11-25T08:22:03,570 creating build/bdist.linux-armv7l/wheel/llmfoundry 2023-11-25T08:22:03,572 creating build/bdist.linux-armv7l/wheel/llmfoundry/utils 2023-11-25T08:22:03,573 copying build/lib/llmfoundry/utils/model_download_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2023-11-25T08:22:03,575 copying build/lib/llmfoundry/utils/builders.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2023-11-25T08:22:03,578 copying build/lib/llmfoundry/utils/checkpoint_conversion_helpers.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2023-11-25T08:22:03,580 copying build/lib/llmfoundry/utils/huggingface_hub_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2023-11-25T08:22:03,583 copying build/lib/llmfoundry/utils/config_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2023-11-25T08:22:03,585 copying build/lib/llmfoundry/utils/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2023-11-25T08:22:03,587 copying build/lib/llmfoundry/utils/data_prep_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2023-11-25T08:22:03,589 creating build/bdist.linux-armv7l/wheel/llmfoundry/optim 2023-11-25T08:22:03,591 copying build/lib/llmfoundry/optim/scheduler.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2023-11-25T08:22:03,593 copying build/lib/llmfoundry/optim/outlier_detection.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2023-11-25T08:22:03,595 copying build/lib/llmfoundry/optim/lion8b.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2023-11-25T08:22:03,598 copying build/lib/llmfoundry/optim/adaptive_lion.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2023-11-25T08:22:03,602 copying build/lib/llmfoundry/optim/lion.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2023-11-25T08:22:03,604 copying build/lib/llmfoundry/optim/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2023-11-25T08:22:03,608 creating build/bdist.linux-armv7l/wheel/llmfoundry/data 2023-11-25T08:22:03,610 copying build/lib/llmfoundry/data/dataloader.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2023-11-25T08:22:03,613 copying build/lib/llmfoundry/data/text_data.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2023-11-25T08:22:03,619 creating build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2023-11-25T08:22:03,621 copying build/lib/llmfoundry/data/finetuning/dataloader.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2023-11-25T08:22:03,624 copying build/lib/llmfoundry/data/finetuning/tasks.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2023-11-25T08:22:03,627 copying build/lib/llmfoundry/data/finetuning/collator.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2023-11-25T08:22:03,630 copying build/lib/llmfoundry/data/finetuning/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2023-11-25T08:22:03,632 copying build/lib/llmfoundry/data/packing.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2023-11-25T08:22:03,637 copying build/lib/llmfoundry/data/data.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2023-11-25T08:22:03,641 copying build/lib/llmfoundry/data/denoising.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2023-11-25T08:22:03,646 copying build/lib/llmfoundry/data/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2023-11-25T08:22:03,648 creating build/bdist.linux-armv7l/wheel/llmfoundry/models 2023-11-25T08:22:03,650 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2023-11-25T08:22:03,651 copying build/lib/llmfoundry/models/utils/hf_prefixlm_converter.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2023-11-25T08:22:03,654 copying build/lib/llmfoundry/models/utils/param_init_fns.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2023-11-25T08:22:03,658 copying build/lib/llmfoundry/models/utils/adapt_tokenizer.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2023-11-25T08:22:03,660 copying build/lib/llmfoundry/models/utils/meta_init_context.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2023-11-25T08:22:03,663 copying build/lib/llmfoundry/models/utils/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2023-11-25T08:22:03,666 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2023-11-25T08:22:03,668 copying build/lib/llmfoundry/models/hf/hf_prefix_lm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2023-11-25T08:22:03,672 copying build/lib/llmfoundry/models/hf/hf_fsdp.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2023-11-25T08:22:03,676 copying build/lib/llmfoundry/models/hf/hf_t5.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2023-11-25T08:22:03,679 copying build/lib/llmfoundry/models/hf/hf_causal_lm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2023-11-25T08:22:03,682 copying build/lib/llmfoundry/models/hf/model_wrapper.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2023-11-25T08:22:03,686 copying build/lib/llmfoundry/models/hf/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2023-11-25T08:22:03,690 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2023-11-25T08:22:03,692 copying build/lib/llmfoundry/models/inference_api_wrapper/openai_causal_lm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2023-11-25T08:22:03,696 copying build/lib/llmfoundry/models/inference_api_wrapper/interface.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2023-11-25T08:22:03,699 copying build/lib/llmfoundry/models/inference_api_wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2023-11-25T08:22:03,701 copying build/lib/llmfoundry/models/model_registry.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models 2023-11-25T08:22:03,704 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2023-11-25T08:22:03,705 copying build/lib/llmfoundry/models/mpt/configuration_mpt.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2023-11-25T08:22:03,709 copying build/lib/llmfoundry/models/mpt/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2023-11-25T08:22:03,711 copying build/lib/llmfoundry/models/mpt/modeling_mpt.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2023-11-25T08:22:03,718 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2023-11-25T08:22:03,720 copying build/lib/llmfoundry/models/layers/norm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2023-11-25T08:22:03,725 copying build/lib/llmfoundry/models/layers/llama_attention_monkeypatch.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2023-11-25T08:22:03,731 copying build/lib/llmfoundry/models/layers/flash_attn_triton.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2023-11-25T08:22:03,739 copying build/lib/llmfoundry/models/layers/fc.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2023-11-25T08:22:03,740 copying build/lib/llmfoundry/models/layers/blocks.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2023-11-25T08:22:03,742 copying build/lib/llmfoundry/models/layers/ffn.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2023-11-25T08:22:03,744 copying build/lib/llmfoundry/models/layers/custom_embedding.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2023-11-25T08:22:03,747 copying build/lib/llmfoundry/models/layers/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2023-11-25T08:22:03,749 copying build/lib/llmfoundry/models/layers/attention.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2023-11-25T08:22:03,754 copying build/lib/llmfoundry/models/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models 2023-11-25T08:22:03,760 creating build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2023-11-25T08:22:03,762 copying build/lib/llmfoundry/callbacks/hf_checkpointer.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2023-11-25T08:22:03,768 copying build/lib/llmfoundry/callbacks/generate_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2023-11-25T08:22:03,771 copying build/lib/llmfoundry/callbacks/scheduled_gc_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2023-11-25T08:22:03,774 copying build/lib/llmfoundry/callbacks/eval_gauntlet_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2023-11-25T08:22:03,776 copying build/lib/llmfoundry/callbacks/monolithic_ckpt_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2023-11-25T08:22:03,779 copying build/lib/llmfoundry/callbacks/model_gauntlet_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2023-11-25T08:22:03,781 copying build/lib/llmfoundry/callbacks/fdiff_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2023-11-25T08:22:03,784 copying build/lib/llmfoundry/callbacks/resumption_callbacks.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2023-11-25T08:22:03,786 copying build/lib/llmfoundry/callbacks/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2023-11-25T08:22:03,788 copying build/lib/llmfoundry/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry 2023-11-25T08:22:03,790 creating build/bdist.linux-armv7l/wheel/llmfoundry/tokenizers 2023-11-25T08:22:03,791 copying build/lib/llmfoundry/tokenizers/tiktoken.py -> build/bdist.linux-armv7l/wheel/llmfoundry/tokenizers 2023-11-25T08:22:03,795 copying build/lib/llmfoundry/tokenizers/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/tokenizers 2023-11-25T08:22:03,797 running install_egg_info 2023-11-25T08:22:03,809 running egg_info 2023-11-25T08:22:03,813 writing llm_foundry.egg-info/PKG-INFO 2023-11-25T08:22:03,816 writing dependency_links to llm_foundry.egg-info/dependency_links.txt 2023-11-25T08:22:03,818 writing requirements to llm_foundry.egg-info/requires.txt 2023-11-25T08:22:03,819 writing top-level names to llm_foundry.egg-info/top_level.txt 2023-11-25T08:22:03,836 reading manifest file 'llm_foundry.egg-info/SOURCES.txt' 2023-11-25T08:22:03,840 adding license file 'LICENSE' 2023-11-25T08:22:03,845 writing manifest file 'llm_foundry.egg-info/SOURCES.txt' 2023-11-25T08:22:03,847 Copying llm_foundry.egg-info to build/bdist.linux-armv7l/wheel/llm_foundry-0.4.0-py3.11.egg-info 2023-11-25T08:22:03,857 running install_scripts 2023-11-25T08:22:03,903 creating build/bdist.linux-armv7l/wheel/llm_foundry-0.4.0.dist-info/WHEEL 2023-11-25T08:22:03,906 creating '/tmp/pip-wheel-4smf7ce1/.tmp-wf9_2s48/llm_foundry-0.4.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-11-25T08:22:03,909 adding 'llmfoundry/__init__.py' 2023-11-25T08:22:03,911 adding 'llmfoundry/callbacks/__init__.py' 2023-11-25T08:22:03,913 adding 'llmfoundry/callbacks/eval_gauntlet_callback.py' 2023-11-25T08:22:03,915 adding 'llmfoundry/callbacks/fdiff_callback.py' 2023-11-25T08:22:03,916 adding 'llmfoundry/callbacks/generate_callback.py' 2023-11-25T08:22:03,918 adding 'llmfoundry/callbacks/hf_checkpointer.py' 2023-11-25T08:22:03,920 adding 'llmfoundry/callbacks/model_gauntlet_callback.py' 2023-11-25T08:22:03,921 adding 'llmfoundry/callbacks/monolithic_ckpt_callback.py' 2023-11-25T08:22:03,923 adding 'llmfoundry/callbacks/resumption_callbacks.py' 2023-11-25T08:22:03,924 adding 'llmfoundry/callbacks/scheduled_gc_callback.py' 2023-11-25T08:22:03,926 adding 'llmfoundry/data/__init__.py' 2023-11-25T08:22:03,928 adding 'llmfoundry/data/data.py' 2023-11-25T08:22:03,929 adding 'llmfoundry/data/dataloader.py' 2023-11-25T08:22:03,935 adding 'llmfoundry/data/denoising.py' 2023-11-25T08:22:03,938 adding 'llmfoundry/data/packing.py' 2023-11-25T08:22:03,940 adding 'llmfoundry/data/text_data.py' 2023-11-25T08:22:03,942 adding 'llmfoundry/data/finetuning/__init__.py' 2023-11-25T08:22:03,945 adding 'llmfoundry/data/finetuning/collator.py' 2023-11-25T08:22:03,948 adding 'llmfoundry/data/finetuning/dataloader.py' 2023-11-25T08:22:03,951 adding 'llmfoundry/data/finetuning/tasks.py' 2023-11-25T08:22:03,953 adding 'llmfoundry/models/__init__.py' 2023-11-25T08:22:03,954 adding 'llmfoundry/models/model_registry.py' 2023-11-25T08:22:03,956 adding 'llmfoundry/models/hf/__init__.py' 2023-11-25T08:22:03,958 adding 'llmfoundry/models/hf/hf_causal_lm.py' 2023-11-25T08:22:03,960 adding 'llmfoundry/models/hf/hf_fsdp.py' 2023-11-25T08:22:03,962 adding 'llmfoundry/models/hf/hf_prefix_lm.py' 2023-11-25T08:22:03,964 adding 'llmfoundry/models/hf/hf_t5.py' 2023-11-25T08:22:03,966 adding 'llmfoundry/models/hf/model_wrapper.py' 2023-11-25T08:22:03,967 adding 'llmfoundry/models/inference_api_wrapper/__init__.py' 2023-11-25T08:22:03,969 adding 'llmfoundry/models/inference_api_wrapper/interface.py' 2023-11-25T08:22:03,971 adding 'llmfoundry/models/inference_api_wrapper/openai_causal_lm.py' 2023-11-25T08:22:03,973 adding 'llmfoundry/models/layers/__init__.py' 2023-11-25T08:22:03,977 adding 'llmfoundry/models/layers/attention.py' 2023-11-25T08:22:03,978 adding 'llmfoundry/models/layers/blocks.py' 2023-11-25T08:22:03,980 adding 'llmfoundry/models/layers/custom_embedding.py' 2023-11-25T08:22:03,981 adding 'llmfoundry/models/layers/fc.py' 2023-11-25T08:22:03,983 adding 'llmfoundry/models/layers/ffn.py' 2023-11-25T08:22:03,986 adding 'llmfoundry/models/layers/flash_attn_triton.py' 2023-11-25T08:22:03,989 adding 'llmfoundry/models/layers/llama_attention_monkeypatch.py' 2023-11-25T08:22:03,990 adding 'llmfoundry/models/layers/norm.py' 2023-11-25T08:22:03,992 adding 'llmfoundry/models/mpt/__init__.py' 2023-11-25T08:22:03,994 adding 'llmfoundry/models/mpt/configuration_mpt.py' 2023-11-25T08:22:03,999 adding 'llmfoundry/models/mpt/modeling_mpt.py' 2023-11-25T08:22:04,001 adding 'llmfoundry/models/utils/__init__.py' 2023-11-25T08:22:04,003 adding 'llmfoundry/models/utils/adapt_tokenizer.py' 2023-11-25T08:22:04,005 adding 'llmfoundry/models/utils/hf_prefixlm_converter.py' 2023-11-25T08:22:04,006 adding 'llmfoundry/models/utils/meta_init_context.py' 2023-11-25T08:22:04,008 adding 'llmfoundry/models/utils/param_init_fns.py' 2023-11-25T08:22:04,010 adding 'llmfoundry/optim/__init__.py' 2023-11-25T08:22:04,012 adding 'llmfoundry/optim/adaptive_lion.py' 2023-11-25T08:22:04,014 adding 'llmfoundry/optim/lion.py' 2023-11-25T08:22:04,017 adding 'llmfoundry/optim/lion8b.py' 2023-11-25T08:22:04,018 adding 'llmfoundry/optim/outlier_detection.py' 2023-11-25T08:22:04,020 adding 'llmfoundry/optim/scheduler.py' 2023-11-25T08:22:04,022 adding 'llmfoundry/tokenizers/__init__.py' 2023-11-25T08:22:04,024 adding 'llmfoundry/tokenizers/tiktoken.py' 2023-11-25T08:22:04,026 adding 'llmfoundry/utils/__init__.py' 2023-11-25T08:22:04,028 adding 'llmfoundry/utils/builders.py' 2023-11-25T08:22:04,030 adding 'llmfoundry/utils/checkpoint_conversion_helpers.py' 2023-11-25T08:22:04,032 adding 'llmfoundry/utils/config_utils.py' 2023-11-25T08:22:04,034 adding 'llmfoundry/utils/data_prep_utils.py' 2023-11-25T08:22:04,035 adding 'llmfoundry/utils/huggingface_hub_utils.py' 2023-11-25T08:22:04,037 adding 'llmfoundry/utils/model_download_utils.py' 2023-11-25T08:22:04,039 adding 'llm_foundry-0.4.0.dist-info/LICENSE' 2023-11-25T08:22:04,042 adding 'llm_foundry-0.4.0.dist-info/METADATA' 2023-11-25T08:22:04,043 adding 'llm_foundry-0.4.0.dist-info/WHEEL' 2023-11-25T08:22:04,044 adding 'llm_foundry-0.4.0.dist-info/top_level.txt' 2023-11-25T08:22:04,046 adding 'llm_foundry-0.4.0.dist-info/RECORD' 2023-11-25T08:22:04,050 removing build/bdist.linux-armv7l/wheel 2023-11-25T08:22:04,169 Building wheel for llm-foundry (pyproject.toml): finished with status 'done' 2023-11-25T08:22:04,177 Created wheel for llm-foundry: filename=llm_foundry-0.4.0-py3-none-any.whl size=171552 sha256=5cf2e21930468450f4f78cab10cac25e368036d3a0dcaa6048f1a2ced06cf42c 2023-11-25T08:22:04,178 Stored in directory: /tmp/pip-ephem-wheel-cache-yk02f7pi/wheels/85/6e/24/be910b162c2c2d194999b8fde5622bf216b6384ba58a7c36c8 2023-11-25T08:22:04,196 Successfully built llm-foundry 2023-11-25T08:22:04,205 Removed build tracker: '/tmp/pip-build-tracker-tdez15hp'