2024-02-08T00:52:27,477 Created temporary directory: /tmp/pip-build-tracker-mci5qs4l 2024-02-08T00:52:27,478 Initialized build tracking at /tmp/pip-build-tracker-mci5qs4l 2024-02-08T00:52:27,479 Created build tracker: /tmp/pip-build-tracker-mci5qs4l 2024-02-08T00:52:27,479 Entered build tracker: /tmp/pip-build-tracker-mci5qs4l 2024-02-08T00:52:27,480 Created temporary directory: /tmp/pip-wheel-k44ylqlr 2024-02-08T00:52:27,483 Created temporary directory: /tmp/pip-ephem-wheel-cache-izbplyzk 2024-02-08T00:52:27,505 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-02-08T00:52:27,509 2 location(s) to search for versions of llm-foundry: 2024-02-08T00:52:27,509 * https://pypi.org/simple/llm-foundry/ 2024-02-08T00:52:27,509 * https://www.piwheels.org/simple/llm-foundry/ 2024-02-08T00:52:27,509 Fetching project page and analyzing links: https://pypi.org/simple/llm-foundry/ 2024-02-08T00:52:27,510 Getting page https://pypi.org/simple/llm-foundry/ 2024-02-08T00:52:27,512 Found index url https://pypi.org/simple/ 2024-02-08T00:52:27,726 Fetched page https://pypi.org/simple/llm-foundry/ as application/vnd.pypi.simple.v1+json 2024-02-08T00:52:27,729 Found link https://files.pythonhosted.org/packages/3a/ae/57c3346bd35154ba2f506fc13cb07b38cefc4f5511cb34705c1c34c568f1/llm-foundry-0.1.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.1.0 2024-02-08T00:52:27,730 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/d7/32/b1afffb2d76c0be72fcda3184050bc4ebc32695a645ef95bdb35103007ad/llm_foundry-0.1.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-02-08T00:52:27,731 Found link https://files.pythonhosted.org/packages/61/7d/a152ff61601e702027412187760d34832d34dc2c6c96d8baa4979769b49e/llm-foundry-0.2.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.2.0 2024-02-08T00:52:27,731 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/7c/19/2dfb92b041c0a18b105e98a71009732ac03bc504c22c0a6dd4b62f50c0b7/llm_foundry-0.2.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-02-08T00:52:27,733 Found link https://files.pythonhosted.org/packages/74/dd/f7204d13bcb9bc41f586f13556f7cec412d4401b834abb0f6827df89da3a/llm-foundry-0.3.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.3.0 2024-02-08T00:52:27,733 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/cc/87/e0b2af411af8933ff85fdc34b8fdf28cde01d4c050d75dca5959de0aa7a2/llm_foundry-0.3.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-02-08T00:52:27,734 Found link https://files.pythonhosted.org/packages/ec/6c/2f776ccc71541901f2b9b9f776c415c65ed551eab2ddecf7fb89566511f7/llm-foundry-0.4.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.4.0 2024-02-08T00:52:27,735 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/e6/d0/f2c4899b0dc4fab34a0a79f53fddf94c77e8aeb84c6ac0ec785bc498a8c7/llm_foundry-0.4.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-02-08T00:52:27,736 Found link https://files.pythonhosted.org/packages/2a/7d/472c26d98dcb053169a8f8871f13131566b5ced88e363d735cd6ec7365bc/llm-foundry-0.5.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.5.0 2024-02-08T00:52:27,737 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/8a/30/a9986cdde61701f476416793862c057e8e98d6c88503a5c4f41d564f79f4/llm_foundry-0.5.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-02-08T00:52:27,738 Fetching project page and analyzing links: https://www.piwheels.org/simple/llm-foundry/ 2024-02-08T00:52:27,738 Getting page https://www.piwheels.org/simple/llm-foundry/ 2024-02-08T00:52:27,740 Found index url https://www.piwheels.org/simple/ 2024-02-08T00:52:27,888 Fetched page https://www.piwheels.org/simple/llm-foundry/ as text/html 2024-02-08T00:52:27,891 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.4.0-py3-none-any.whl#sha256=5cf2e21930468450f4f78cab10cac25e368036d3a0dcaa6048f1a2ced06cf42c (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-02-08T00:52:27,892 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.3.0-py3-none-any.whl#sha256=4e22006806faee0afc389aea07fdcb9c522cdaf230c87693e24fe113b26af7e3 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-02-08T00:52:27,892 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.2.0-py3-none-any.whl#sha256=d04a1d00b014fa919b4e35d6d0910ba7e796c754b7451c846391e890cb108566 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-02-08T00:52:27,893 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.1.0-py3-none-any.whl#sha256=49868c9a1fd20882f6038ead8e4a4abcf5c795b75bb0686011ce460f237eae18 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-02-08T00:52:27,893 Skipping link: not a file: https://www.piwheels.org/simple/llm-foundry/ 2024-02-08T00:52:27,894 Skipping link: not a file: https://pypi.org/simple/llm-foundry/ 2024-02-08T00:52:27,912 Given no hashes to check 1 links for project 'llm-foundry': discarding no candidates 2024-02-08T00:52:27,930 Collecting llm-foundry==0.5.0 2024-02-08T00:52:27,932 Created temporary directory: /tmp/pip-unpack-8y3b3cq3 2024-02-08T00:52:28,154 Downloading llm-foundry-0.5.0.tar.gz (159 kB) 2024-02-08T00:52:28,386 Added llm-foundry==0.5.0 from https://files.pythonhosted.org/packages/2a/7d/472c26d98dcb053169a8f8871f13131566b5ced88e363d735cd6ec7365bc/llm-foundry-0.5.0.tar.gz to build tracker '/tmp/pip-build-tracker-mci5qs4l' 2024-02-08T00:52:28,394 Created temporary directory: /tmp/pip-build-env-slucufi3 2024-02-08T00:52:28,398 Installing build dependencies: started 2024-02-08T00:52:28,400 Running command pip subprocess to install build dependencies 2024-02-08T00:52:29,534 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-02-08T00:52:30,031 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-02-08T00:52:31,516 Collecting setuptools<68.0.0 2024-02-08T00:52:31,533 Using cached https://www.piwheels.org/simple/setuptools/setuptools-67.8.0-py3-none-any.whl (1.1 MB) 2024-02-08T00:52:34,116 Installing collected packages: setuptools 2024-02-08T00:52:36,280 Successfully installed setuptools-67.8.0 2024-02-08T00:52:36,530 [notice] A new release of pip is available: 23.3.1 -> 24.0 2024-02-08T00:52:36,531 [notice] To update, run: python3 -m pip install --upgrade pip 2024-02-08T00:52:36,794 Installing build dependencies: finished with status 'done' 2024-02-08T00:52:36,797 Getting requirements to build wheel: started 2024-02-08T00:52:36,799 Running command Getting requirements to build wheel 2024-02-08T00:52:37,411 running egg_info 2024-02-08T00:52:37,415 writing llm_foundry.egg-info/PKG-INFO 2024-02-08T00:52:37,418 writing dependency_links to llm_foundry.egg-info/dependency_links.txt 2024-02-08T00:52:37,421 writing requirements to llm_foundry.egg-info/requires.txt 2024-02-08T00:52:37,422 writing top-level names to llm_foundry.egg-info/top_level.txt 2024-02-08T00:52:37,448 reading manifest file 'llm_foundry.egg-info/SOURCES.txt' 2024-02-08T00:52:37,451 adding license file 'LICENSE' 2024-02-08T00:52:37,455 writing manifest file 'llm_foundry.egg-info/SOURCES.txt' 2024-02-08T00:52:37,533 Getting requirements to build wheel: finished with status 'done' 2024-02-08T00:52:37,540 Installing backend dependencies: started 2024-02-08T00:52:37,542 Running command pip subprocess to install backend dependencies 2024-02-08T00:52:38,675 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-02-08T00:52:39,174 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-02-08T00:52:39,638 Collecting wheel 2024-02-08T00:52:39,653 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2024-02-08T00:52:41,892 Installing collected packages: wheel 2024-02-08T00:52:42,112 Creating /tmp/pip-build-env-slucufi3/normal/local/bin 2024-02-08T00:52:42,114 changing mode of /tmp/pip-build-env-slucufi3/normal/local/bin/wheel to 755 2024-02-08T00:52:42,125 Successfully installed wheel-0.42.0 2024-02-08T00:52:42,376 [notice] A new release of pip is available: 23.3.1 -> 24.0 2024-02-08T00:52:42,377 [notice] To update, run: python3 -m pip install --upgrade pip 2024-02-08T00:52:42,605 Installing backend dependencies: finished with status 'done' 2024-02-08T00:52:42,606 Created temporary directory: /tmp/pip-modern-metadata-rgajajum 2024-02-08T00:52:42,609 Preparing metadata (pyproject.toml): started 2024-02-08T00:52:42,610 Running command Preparing metadata (pyproject.toml) 2024-02-08T00:52:43,194 running dist_info 2024-02-08T00:52:43,213 creating /tmp/pip-modern-metadata-rgajajum/llm_foundry.egg-info 2024-02-08T00:52:43,216 writing /tmp/pip-modern-metadata-rgajajum/llm_foundry.egg-info/PKG-INFO 2024-02-08T00:52:43,219 writing dependency_links to /tmp/pip-modern-metadata-rgajajum/llm_foundry.egg-info/dependency_links.txt 2024-02-08T00:52:43,222 writing requirements to /tmp/pip-modern-metadata-rgajajum/llm_foundry.egg-info/requires.txt 2024-02-08T00:52:43,223 writing top-level names to /tmp/pip-modern-metadata-rgajajum/llm_foundry.egg-info/top_level.txt 2024-02-08T00:52:43,224 writing manifest file '/tmp/pip-modern-metadata-rgajajum/llm_foundry.egg-info/SOURCES.txt' 2024-02-08T00:52:43,247 reading manifest file '/tmp/pip-modern-metadata-rgajajum/llm_foundry.egg-info/SOURCES.txt' 2024-02-08T00:52:43,249 adding license file 'LICENSE' 2024-02-08T00:52:43,260 writing manifest file '/tmp/pip-modern-metadata-rgajajum/llm_foundry.egg-info/SOURCES.txt' 2024-02-08T00:52:43,261 creating '/tmp/pip-modern-metadata-rgajajum/llm_foundry-0.5.0.dist-info' 2024-02-08T00:52:43,478 Preparing metadata (pyproject.toml): finished with status 'done' 2024-02-08T00:52:43,484 Source in /tmp/pip-wheel-k44ylqlr/llm-foundry_fb3029cda1494ab3b8c949586c6e8e1e has version 0.5.0, which satisfies requirement llm-foundry==0.5.0 from https://files.pythonhosted.org/packages/2a/7d/472c26d98dcb053169a8f8871f13131566b5ced88e363d735cd6ec7365bc/llm-foundry-0.5.0.tar.gz 2024-02-08T00:52:43,485 Removed llm-foundry==0.5.0 from https://files.pythonhosted.org/packages/2a/7d/472c26d98dcb053169a8f8871f13131566b5ced88e363d735cd6ec7365bc/llm-foundry-0.5.0.tar.gz from build tracker '/tmp/pip-build-tracker-mci5qs4l' 2024-02-08T00:52:43,495 Created temporary directory: /tmp/pip-unpack-eraiu031 2024-02-08T00:52:43,496 Created temporary directory: /tmp/pip-unpack-e3hbv9jg 2024-02-08T00:52:43,744 Building wheels for collected packages: llm-foundry 2024-02-08T00:52:43,748 Created temporary directory: /tmp/pip-wheel-49nt3vdy 2024-02-08T00:52:43,748 Destination directory: /tmp/pip-wheel-49nt3vdy 2024-02-08T00:52:43,750 Building wheel for llm-foundry (pyproject.toml): started 2024-02-08T00:52:43,752 Running command Building wheel for llm-foundry (pyproject.toml) 2024-02-08T00:52:44,379 running bdist_wheel 2024-02-08T00:52:44,419 running build 2024-02-08T00:52:44,420 running build_py 2024-02-08T00:52:44,426 creating build 2024-02-08T00:52:44,427 creating build/lib 2024-02-08T00:52:44,427 creating build/lib/llmfoundry 2024-02-08T00:52:44,429 copying llmfoundry/__init__.py -> build/lib/llmfoundry 2024-02-08T00:52:44,431 creating build/lib/llmfoundry/tokenizers 2024-02-08T00:52:44,432 copying llmfoundry/tokenizers/tiktoken.py -> build/lib/llmfoundry/tokenizers 2024-02-08T00:52:44,434 copying llmfoundry/tokenizers/__init__.py -> build/lib/llmfoundry/tokenizers 2024-02-08T00:52:44,437 creating build/lib/llmfoundry/callbacks 2024-02-08T00:52:44,438 copying llmfoundry/callbacks/async_eval_callback.py -> build/lib/llmfoundry/callbacks 2024-02-08T00:52:44,440 copying llmfoundry/callbacks/monolithic_ckpt_callback.py -> build/lib/llmfoundry/callbacks 2024-02-08T00:52:44,442 copying llmfoundry/callbacks/fdiff_callback.py -> build/lib/llmfoundry/callbacks 2024-02-08T00:52:44,443 copying llmfoundry/callbacks/hf_checkpointer.py -> build/lib/llmfoundry/callbacks 2024-02-08T00:52:44,446 copying llmfoundry/callbacks/eval_gauntlet_callback.py -> build/lib/llmfoundry/callbacks 2024-02-08T00:52:44,448 copying llmfoundry/callbacks/__init__.py -> build/lib/llmfoundry/callbacks 2024-02-08T00:52:44,449 copying llmfoundry/callbacks/scheduled_gc_callback.py -> build/lib/llmfoundry/callbacks 2024-02-08T00:52:44,451 copying llmfoundry/callbacks/resumption_callbacks.py -> build/lib/llmfoundry/callbacks 2024-02-08T00:52:44,453 creating build/lib/llmfoundry/optim 2024-02-08T00:52:44,454 copying llmfoundry/optim/outlier_detection.py -> build/lib/llmfoundry/optim 2024-02-08T00:52:44,456 copying llmfoundry/optim/scheduler.py -> build/lib/llmfoundry/optim 2024-02-08T00:52:44,458 copying llmfoundry/optim/lion.py -> build/lib/llmfoundry/optim 2024-02-08T00:52:44,460 copying llmfoundry/optim/__init__.py -> build/lib/llmfoundry/optim 2024-02-08T00:52:44,461 copying llmfoundry/optim/adaptive_lion.py -> build/lib/llmfoundry/optim 2024-02-08T00:52:44,463 copying llmfoundry/optim/lion8b.py -> build/lib/llmfoundry/optim 2024-02-08T00:52:44,466 creating build/lib/llmfoundry/models 2024-02-08T00:52:44,467 copying llmfoundry/models/__init__.py -> build/lib/llmfoundry/models 2024-02-08T00:52:44,469 copying llmfoundry/models/model_registry.py -> build/lib/llmfoundry/models 2024-02-08T00:52:44,471 creating build/lib/llmfoundry/utils 2024-02-08T00:52:44,472 copying llmfoundry/utils/model_download_utils.py -> build/lib/llmfoundry/utils 2024-02-08T00:52:44,474 copying llmfoundry/utils/builders.py -> build/lib/llmfoundry/utils 2024-02-08T00:52:44,476 copying llmfoundry/utils/logging_utils.py -> build/lib/llmfoundry/utils 2024-02-08T00:52:44,478 copying llmfoundry/utils/checkpoint_conversion_helpers.py -> build/lib/llmfoundry/utils 2024-02-08T00:52:44,480 copying llmfoundry/utils/prompt_files.py -> build/lib/llmfoundry/utils 2024-02-08T00:52:44,482 copying llmfoundry/utils/data_prep_utils.py -> build/lib/llmfoundry/utils 2024-02-08T00:52:44,483 copying llmfoundry/utils/huggingface_hub_utils.py -> build/lib/llmfoundry/utils 2024-02-08T00:52:44,486 copying llmfoundry/utils/__init__.py -> build/lib/llmfoundry/utils 2024-02-08T00:52:44,487 copying llmfoundry/utils/config_utils.py -> build/lib/llmfoundry/utils 2024-02-08T00:52:44,489 copying llmfoundry/utils/warnings.py -> build/lib/llmfoundry/utils 2024-02-08T00:52:44,491 creating build/lib/llmfoundry/data 2024-02-08T00:52:44,492 copying llmfoundry/data/dataloader.py -> build/lib/llmfoundry/data 2024-02-08T00:52:44,494 copying llmfoundry/data/data.py -> build/lib/llmfoundry/data 2024-02-08T00:52:44,496 copying llmfoundry/data/__init__.py -> build/lib/llmfoundry/data 2024-02-08T00:52:44,498 copying llmfoundry/data/denoising.py -> build/lib/llmfoundry/data 2024-02-08T00:52:44,501 copying llmfoundry/data/packing.py -> build/lib/llmfoundry/data 2024-02-08T00:52:44,503 copying llmfoundry/data/text_data.py -> build/lib/llmfoundry/data 2024-02-08T00:52:44,506 creating build/lib/llmfoundry/models/mpt 2024-02-08T00:52:44,507 copying llmfoundry/models/mpt/configuration_mpt.py -> build/lib/llmfoundry/models/mpt 2024-02-08T00:52:44,510 copying llmfoundry/models/mpt/modeling_mpt.py -> build/lib/llmfoundry/models/mpt 2024-02-08T00:52:44,513 copying llmfoundry/models/mpt/__init__.py -> build/lib/llmfoundry/models/mpt 2024-02-08T00:52:44,515 creating build/lib/llmfoundry/models/inference_api_wrapper 2024-02-08T00:52:44,516 copying llmfoundry/models/inference_api_wrapper/fmapi.py -> build/lib/llmfoundry/models/inference_api_wrapper 2024-02-08T00:52:44,518 copying llmfoundry/models/inference_api_wrapper/__init__.py -> build/lib/llmfoundry/models/inference_api_wrapper 2024-02-08T00:52:44,520 copying llmfoundry/models/inference_api_wrapper/interface.py -> build/lib/llmfoundry/models/inference_api_wrapper 2024-02-08T00:52:44,522 copying llmfoundry/models/inference_api_wrapper/openai_causal_lm.py -> build/lib/llmfoundry/models/inference_api_wrapper 2024-02-08T00:52:44,524 creating build/lib/llmfoundry/models/layers 2024-02-08T00:52:44,525 copying llmfoundry/models/layers/llama_attention_monkeypatch.py -> build/lib/llmfoundry/models/layers 2024-02-08T00:52:44,527 copying llmfoundry/models/layers/norm.py -> build/lib/llmfoundry/models/layers 2024-02-08T00:52:44,529 copying llmfoundry/models/layers/fc.py -> build/lib/llmfoundry/models/layers 2024-02-08T00:52:44,531 copying llmfoundry/models/layers/__init__.py -> build/lib/llmfoundry/models/layers 2024-02-08T00:52:44,532 copying llmfoundry/models/layers/ffn.py -> build/lib/llmfoundry/models/layers 2024-02-08T00:52:44,534 copying llmfoundry/models/layers/custom_embedding.py -> build/lib/llmfoundry/models/layers 2024-02-08T00:52:44,536 copying llmfoundry/models/layers/attention.py -> build/lib/llmfoundry/models/layers 2024-02-08T00:52:44,538 copying llmfoundry/models/layers/blocks.py -> build/lib/llmfoundry/models/layers 2024-02-08T00:52:44,540 copying llmfoundry/models/layers/flash_attn_triton.py -> build/lib/llmfoundry/models/layers 2024-02-08T00:52:44,543 creating build/lib/llmfoundry/models/hf 2024-02-08T00:52:44,544 copying llmfoundry/models/hf/hf_prefix_lm.py -> build/lib/llmfoundry/models/hf 2024-02-08T00:52:44,546 copying llmfoundry/models/hf/model_wrapper.py -> build/lib/llmfoundry/models/hf 2024-02-08T00:52:44,548 copying llmfoundry/models/hf/hf_t5.py -> build/lib/llmfoundry/models/hf 2024-02-08T00:52:44,550 copying llmfoundry/models/hf/__init__.py -> build/lib/llmfoundry/models/hf 2024-02-08T00:52:44,552 copying llmfoundry/models/hf/hf_fsdp.py -> build/lib/llmfoundry/models/hf 2024-02-08T00:52:44,554 copying llmfoundry/models/hf/hf_causal_lm.py -> build/lib/llmfoundry/models/hf 2024-02-08T00:52:44,557 creating build/lib/llmfoundry/models/utils 2024-02-08T00:52:44,558 copying llmfoundry/models/utils/hf_prefixlm_converter.py -> build/lib/llmfoundry/models/utils 2024-02-08T00:52:44,561 copying llmfoundry/models/utils/param_init_fns.py -> build/lib/llmfoundry/models/utils 2024-02-08T00:52:44,563 copying llmfoundry/models/utils/__init__.py -> build/lib/llmfoundry/models/utils 2024-02-08T00:52:44,564 copying llmfoundry/models/utils/meta_init_context.py -> build/lib/llmfoundry/models/utils 2024-02-08T00:52:44,566 copying llmfoundry/models/utils/adapt_tokenizer.py -> build/lib/llmfoundry/models/utils 2024-02-08T00:52:44,569 creating build/lib/llmfoundry/data/finetuning 2024-02-08T00:52:44,569 copying llmfoundry/data/finetuning/dataloader.py -> build/lib/llmfoundry/data/finetuning 2024-02-08T00:52:44,572 copying llmfoundry/data/finetuning/__init__.py -> build/lib/llmfoundry/data/finetuning 2024-02-08T00:52:44,574 copying llmfoundry/data/finetuning/tasks.py -> build/lib/llmfoundry/data/finetuning 2024-02-08T00:52:44,576 copying llmfoundry/data/finetuning/collator.py -> build/lib/llmfoundry/data/finetuning 2024-02-08T00:52:44,595 installing to build/bdist.linux-armv7l/wheel 2024-02-08T00:52:44,596 running install 2024-02-08T00:52:44,619 running install_lib 2024-02-08T00:52:44,626 creating build/bdist.linux-armv7l 2024-02-08T00:52:44,626 creating build/bdist.linux-armv7l/wheel 2024-02-08T00:52:44,628 creating build/bdist.linux-armv7l/wheel/llmfoundry 2024-02-08T00:52:44,629 creating build/bdist.linux-armv7l/wheel/llmfoundry/tokenizers 2024-02-08T00:52:44,630 copying build/lib/llmfoundry/tokenizers/tiktoken.py -> build/bdist.linux-armv7l/wheel/llmfoundry/tokenizers 2024-02-08T00:52:44,633 copying build/lib/llmfoundry/tokenizers/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/tokenizers 2024-02-08T00:52:44,635 creating build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-02-08T00:52:44,636 copying build/lib/llmfoundry/callbacks/async_eval_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-02-08T00:52:44,639 copying build/lib/llmfoundry/callbacks/monolithic_ckpt_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-02-08T00:52:44,641 copying build/lib/llmfoundry/callbacks/fdiff_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-02-08T00:52:44,643 copying build/lib/llmfoundry/callbacks/hf_checkpointer.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-02-08T00:52:44,645 copying build/lib/llmfoundry/callbacks/eval_gauntlet_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-02-08T00:52:44,647 copying build/lib/llmfoundry/callbacks/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-02-08T00:52:44,649 copying build/lib/llmfoundry/callbacks/scheduled_gc_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-02-08T00:52:44,650 copying build/lib/llmfoundry/callbacks/resumption_callbacks.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-02-08T00:52:44,652 copying build/lib/llmfoundry/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry 2024-02-08T00:52:44,654 creating build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-02-08T00:52:44,655 copying build/lib/llmfoundry/optim/outlier_detection.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-02-08T00:52:44,657 copying build/lib/llmfoundry/optim/scheduler.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-02-08T00:52:44,659 copying build/lib/llmfoundry/optim/lion.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-02-08T00:52:44,661 copying build/lib/llmfoundry/optim/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-02-08T00:52:44,662 copying build/lib/llmfoundry/optim/adaptive_lion.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-02-08T00:52:44,665 copying build/lib/llmfoundry/optim/lion8b.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-02-08T00:52:44,668 creating build/bdist.linux-armv7l/wheel/llmfoundry/models 2024-02-08T00:52:44,669 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2024-02-08T00:52:44,670 copying build/lib/llmfoundry/models/mpt/configuration_mpt.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2024-02-08T00:52:44,672 copying build/lib/llmfoundry/models/mpt/modeling_mpt.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2024-02-08T00:52:44,675 copying build/lib/llmfoundry/models/mpt/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2024-02-08T00:52:44,677 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-02-08T00:52:44,678 copying build/lib/llmfoundry/models/inference_api_wrapper/fmapi.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-02-08T00:52:44,680 copying build/lib/llmfoundry/models/inference_api_wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-02-08T00:52:44,682 copying build/lib/llmfoundry/models/inference_api_wrapper/interface.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-02-08T00:52:44,684 copying build/lib/llmfoundry/models/inference_api_wrapper/openai_causal_lm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-02-08T00:52:44,687 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-02-08T00:52:44,688 copying build/lib/llmfoundry/models/layers/llama_attention_monkeypatch.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-02-08T00:52:44,691 copying build/lib/llmfoundry/models/layers/norm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-02-08T00:52:44,692 copying build/lib/llmfoundry/models/layers/fc.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-02-08T00:52:44,694 copying build/lib/llmfoundry/models/layers/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-02-08T00:52:44,696 copying build/lib/llmfoundry/models/layers/ffn.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-02-08T00:52:44,698 copying build/lib/llmfoundry/models/layers/custom_embedding.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-02-08T00:52:44,700 copying build/lib/llmfoundry/models/layers/attention.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-02-08T00:52:44,702 copying build/lib/llmfoundry/models/layers/blocks.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-02-08T00:52:44,704 copying build/lib/llmfoundry/models/layers/flash_attn_triton.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-02-08T00:52:44,707 copying build/lib/llmfoundry/models/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models 2024-02-08T00:52:44,709 copying build/lib/llmfoundry/models/model_registry.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models 2024-02-08T00:52:44,710 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-02-08T00:52:44,711 copying build/lib/llmfoundry/models/hf/hf_prefix_lm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-02-08T00:52:44,713 copying build/lib/llmfoundry/models/hf/model_wrapper.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-02-08T00:52:44,715 copying build/lib/llmfoundry/models/hf/hf_t5.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-02-08T00:52:44,717 copying build/lib/llmfoundry/models/hf/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-02-08T00:52:44,719 copying build/lib/llmfoundry/models/hf/hf_fsdp.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-02-08T00:52:44,721 copying build/lib/llmfoundry/models/hf/hf_causal_lm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-02-08T00:52:44,724 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-02-08T00:52:44,724 copying build/lib/llmfoundry/models/utils/hf_prefixlm_converter.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-02-08T00:52:44,727 copying build/lib/llmfoundry/models/utils/param_init_fns.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-02-08T00:52:44,729 copying build/lib/llmfoundry/models/utils/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-02-08T00:52:44,731 copying build/lib/llmfoundry/models/utils/meta_init_context.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-02-08T00:52:44,733 copying build/lib/llmfoundry/models/utils/adapt_tokenizer.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-02-08T00:52:44,735 creating build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-02-08T00:52:44,736 copying build/lib/llmfoundry/utils/model_download_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-02-08T00:52:44,738 copying build/lib/llmfoundry/utils/builders.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-02-08T00:52:44,741 copying build/lib/llmfoundry/utils/logging_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-02-08T00:52:44,742 copying build/lib/llmfoundry/utils/checkpoint_conversion_helpers.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-02-08T00:52:44,745 copying build/lib/llmfoundry/utils/prompt_files.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-02-08T00:52:44,747 copying build/lib/llmfoundry/utils/data_prep_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-02-08T00:52:44,748 copying build/lib/llmfoundry/utils/huggingface_hub_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-02-08T00:52:44,750 copying build/lib/llmfoundry/utils/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-02-08T00:52:44,752 copying build/lib/llmfoundry/utils/config_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-02-08T00:52:44,754 copying build/lib/llmfoundry/utils/warnings.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-02-08T00:52:44,757 creating build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-02-08T00:52:44,758 creating build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-02-08T00:52:44,759 copying build/lib/llmfoundry/data/finetuning/dataloader.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-02-08T00:52:44,761 copying build/lib/llmfoundry/data/finetuning/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-02-08T00:52:44,763 copying build/lib/llmfoundry/data/finetuning/tasks.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-02-08T00:52:44,765 copying build/lib/llmfoundry/data/finetuning/collator.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-02-08T00:52:44,768 copying build/lib/llmfoundry/data/dataloader.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-02-08T00:52:44,769 copying build/lib/llmfoundry/data/data.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-02-08T00:52:44,771 copying build/lib/llmfoundry/data/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-02-08T00:52:44,773 copying build/lib/llmfoundry/data/denoising.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-02-08T00:52:44,776 copying build/lib/llmfoundry/data/packing.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-02-08T00:52:44,778 copying build/lib/llmfoundry/data/text_data.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-02-08T00:52:44,781 running install_egg_info 2024-02-08T00:52:44,791 running egg_info 2024-02-08T00:52:44,795 writing llm_foundry.egg-info/PKG-INFO 2024-02-08T00:52:44,797 writing dependency_links to llm_foundry.egg-info/dependency_links.txt 2024-02-08T00:52:44,799 writing requirements to llm_foundry.egg-info/requires.txt 2024-02-08T00:52:44,800 writing top-level names to llm_foundry.egg-info/top_level.txt 2024-02-08T00:52:44,812 reading manifest file 'llm_foundry.egg-info/SOURCES.txt' 2024-02-08T00:52:44,815 adding license file 'LICENSE' 2024-02-08T00:52:44,820 writing manifest file 'llm_foundry.egg-info/SOURCES.txt' 2024-02-08T00:52:44,821 Copying llm_foundry.egg-info to build/bdist.linux-armv7l/wheel/llm_foundry-0.5.0-py3.11.egg-info 2024-02-08T00:52:44,831 running install_scripts 2024-02-08T00:52:44,879 creating build/bdist.linux-armv7l/wheel/llm_foundry-0.5.0.dist-info/WHEEL 2024-02-08T00:52:44,881 creating '/tmp/pip-wheel-49nt3vdy/.tmp-ro3cckiw/llm_foundry-0.5.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-02-08T00:52:44,884 adding 'llmfoundry/__init__.py' 2024-02-08T00:52:44,886 adding 'llmfoundry/callbacks/__init__.py' 2024-02-08T00:52:44,889 adding 'llmfoundry/callbacks/async_eval_callback.py' 2024-02-08T00:52:44,891 adding 'llmfoundry/callbacks/eval_gauntlet_callback.py' 2024-02-08T00:52:44,893 adding 'llmfoundry/callbacks/fdiff_callback.py' 2024-02-08T00:52:44,895 adding 'llmfoundry/callbacks/hf_checkpointer.py' 2024-02-08T00:52:44,897 adding 'llmfoundry/callbacks/monolithic_ckpt_callback.py' 2024-02-08T00:52:44,899 adding 'llmfoundry/callbacks/resumption_callbacks.py' 2024-02-08T00:52:44,900 adding 'llmfoundry/callbacks/scheduled_gc_callback.py' 2024-02-08T00:52:44,902 adding 'llmfoundry/data/__init__.py' 2024-02-08T00:52:44,904 adding 'llmfoundry/data/data.py' 2024-02-08T00:52:44,906 adding 'llmfoundry/data/dataloader.py' 2024-02-08T00:52:44,911 adding 'llmfoundry/data/denoising.py' 2024-02-08T00:52:44,914 adding 'llmfoundry/data/packing.py' 2024-02-08T00:52:44,916 adding 'llmfoundry/data/text_data.py' 2024-02-08T00:52:44,918 adding 'llmfoundry/data/finetuning/__init__.py' 2024-02-08T00:52:44,921 adding 'llmfoundry/data/finetuning/collator.py' 2024-02-08T00:52:44,924 adding 'llmfoundry/data/finetuning/dataloader.py' 2024-02-08T00:52:44,928 adding 'llmfoundry/data/finetuning/tasks.py' 2024-02-08T00:52:44,930 adding 'llmfoundry/models/__init__.py' 2024-02-08T00:52:44,931 adding 'llmfoundry/models/model_registry.py' 2024-02-08T00:52:44,933 adding 'llmfoundry/models/hf/__init__.py' 2024-02-08T00:52:44,935 adding 'llmfoundry/models/hf/hf_causal_lm.py' 2024-02-08T00:52:44,937 adding 'llmfoundry/models/hf/hf_fsdp.py' 2024-02-08T00:52:44,939 adding 'llmfoundry/models/hf/hf_prefix_lm.py' 2024-02-08T00:52:44,941 adding 'llmfoundry/models/hf/hf_t5.py' 2024-02-08T00:52:44,942 adding 'llmfoundry/models/hf/model_wrapper.py' 2024-02-08T00:52:44,944 adding 'llmfoundry/models/inference_api_wrapper/__init__.py' 2024-02-08T00:52:44,945 adding 'llmfoundry/models/inference_api_wrapper/fmapi.py' 2024-02-08T00:52:44,947 adding 'llmfoundry/models/inference_api_wrapper/interface.py' 2024-02-08T00:52:44,949 adding 'llmfoundry/models/inference_api_wrapper/openai_causal_lm.py' 2024-02-08T00:52:44,951 adding 'llmfoundry/models/layers/__init__.py' 2024-02-08T00:52:44,954 adding 'llmfoundry/models/layers/attention.py' 2024-02-08T00:52:44,956 adding 'llmfoundry/models/layers/blocks.py' 2024-02-08T00:52:44,957 adding 'llmfoundry/models/layers/custom_embedding.py' 2024-02-08T00:52:44,958 adding 'llmfoundry/models/layers/fc.py' 2024-02-08T00:52:44,960 adding 'llmfoundry/models/layers/ffn.py' 2024-02-08T00:52:44,963 adding 'llmfoundry/models/layers/flash_attn_triton.py' 2024-02-08T00:52:44,965 adding 'llmfoundry/models/layers/llama_attention_monkeypatch.py' 2024-02-08T00:52:44,967 adding 'llmfoundry/models/layers/norm.py' 2024-02-08T00:52:44,969 adding 'llmfoundry/models/mpt/__init__.py' 2024-02-08T00:52:44,971 adding 'llmfoundry/models/mpt/configuration_mpt.py' 2024-02-08T00:52:44,976 adding 'llmfoundry/models/mpt/modeling_mpt.py' 2024-02-08T00:52:44,978 adding 'llmfoundry/models/utils/__init__.py' 2024-02-08T00:52:44,980 adding 'llmfoundry/models/utils/adapt_tokenizer.py' 2024-02-08T00:52:44,982 adding 'llmfoundry/models/utils/hf_prefixlm_converter.py' 2024-02-08T00:52:44,983 adding 'llmfoundry/models/utils/meta_init_context.py' 2024-02-08T00:52:44,985 adding 'llmfoundry/models/utils/param_init_fns.py' 2024-02-08T00:52:44,987 adding 'llmfoundry/optim/__init__.py' 2024-02-08T00:52:44,989 adding 'llmfoundry/optim/adaptive_lion.py' 2024-02-08T00:52:44,991 adding 'llmfoundry/optim/lion.py' 2024-02-08T00:52:44,994 adding 'llmfoundry/optim/lion8b.py' 2024-02-08T00:52:44,995 adding 'llmfoundry/optim/outlier_detection.py' 2024-02-08T00:52:44,997 adding 'llmfoundry/optim/scheduler.py' 2024-02-08T00:52:44,999 adding 'llmfoundry/tokenizers/__init__.py' 2024-02-08T00:52:45,001 adding 'llmfoundry/tokenizers/tiktoken.py' 2024-02-08T00:52:45,003 adding 'llmfoundry/utils/__init__.py' 2024-02-08T00:52:45,006 adding 'llmfoundry/utils/builders.py' 2024-02-08T00:52:45,008 adding 'llmfoundry/utils/checkpoint_conversion_helpers.py' 2024-02-08T00:52:45,010 adding 'llmfoundry/utils/config_utils.py' 2024-02-08T00:52:45,011 adding 'llmfoundry/utils/data_prep_utils.py' 2024-02-08T00:52:45,013 adding 'llmfoundry/utils/huggingface_hub_utils.py' 2024-02-08T00:52:45,014 adding 'llmfoundry/utils/logging_utils.py' 2024-02-08T00:52:45,016 adding 'llmfoundry/utils/model_download_utils.py' 2024-02-08T00:52:45,018 adding 'llmfoundry/utils/prompt_files.py' 2024-02-08T00:52:45,019 adding 'llmfoundry/utils/warnings.py' 2024-02-08T00:52:45,021 adding 'llm_foundry-0.5.0.dist-info/LICENSE' 2024-02-08T00:52:45,024 adding 'llm_foundry-0.5.0.dist-info/METADATA' 2024-02-08T00:52:45,025 adding 'llm_foundry-0.5.0.dist-info/WHEEL' 2024-02-08T00:52:45,026 adding 'llm_foundry-0.5.0.dist-info/top_level.txt' 2024-02-08T00:52:45,028 adding 'llm_foundry-0.5.0.dist-info/RECORD' 2024-02-08T00:52:45,032 removing build/bdist.linux-armv7l/wheel 2024-02-08T00:52:45,143 Building wheel for llm-foundry (pyproject.toml): finished with status 'done' 2024-02-08T00:52:45,151 Created wheel for llm-foundry: filename=llm_foundry-0.5.0-py3-none-any.whl size=188819 sha256=37244e95dfa42508065d585a3183615c53553c518e8e719dcf76d1513aef5fdc 2024-02-08T00:52:45,153 Stored in directory: /tmp/pip-ephem-wheel-cache-izbplyzk/wheels/c7/00/db/0467ce741077ed3598f399dd52feb6c4ccbb36201382e5887b 2024-02-08T00:52:45,170 Successfully built llm-foundry 2024-02-08T00:52:45,180 Removed build tracker: '/tmp/pip-build-tracker-mci5qs4l'