2024-05-08T02:50:43,003 Created temporary directory: /tmp/pip-build-tracker-86_xw2rx 2024-05-08T02:50:43,005 Initialized build tracking at /tmp/pip-build-tracker-86_xw2rx 2024-05-08T02:50:43,005 Created build tracker: /tmp/pip-build-tracker-86_xw2rx 2024-05-08T02:50:43,006 Entered build tracker: /tmp/pip-build-tracker-86_xw2rx 2024-05-08T02:50:43,007 Created temporary directory: /tmp/pip-wheel-1l6zplzh 2024-05-08T02:50:43,010 Created temporary directory: /tmp/pip-ephem-wheel-cache-d8vuygdb 2024-05-08T02:50:43,032 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-05-08T02:50:43,036 2 location(s) to search for versions of llm-foundry: 2024-05-08T02:50:43,036 * https://pypi.org/simple/llm-foundry/ 2024-05-08T02:50:43,036 * https://www.piwheels.org/simple/llm-foundry/ 2024-05-08T02:50:43,037 Fetching project page and analyzing links: https://pypi.org/simple/llm-foundry/ 2024-05-08T02:50:43,038 Getting page https://pypi.org/simple/llm-foundry/ 2024-05-08T02:50:43,039 Found index url https://pypi.org/simple/ 2024-05-08T02:50:43,175 Fetched page https://pypi.org/simple/llm-foundry/ as application/vnd.pypi.simple.v1+json 2024-05-08T02:50:43,180 Found link https://files.pythonhosted.org/packages/3a/ae/57c3346bd35154ba2f506fc13cb07b38cefc4f5511cb34705c1c34c568f1/llm-foundry-0.1.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.1.0 2024-05-08T02:50:43,181 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/d7/32/b1afffb2d76c0be72fcda3184050bc4ebc32695a645ef95bdb35103007ad/llm_foundry-0.1.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-05-08T02:50:43,182 Found link https://files.pythonhosted.org/packages/61/7d/a152ff61601e702027412187760d34832d34dc2c6c96d8baa4979769b49e/llm-foundry-0.2.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.2.0 2024-05-08T02:50:43,182 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/7c/19/2dfb92b041c0a18b105e98a71009732ac03bc504c22c0a6dd4b62f50c0b7/llm_foundry-0.2.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-05-08T02:50:43,183 Found link https://files.pythonhosted.org/packages/74/dd/f7204d13bcb9bc41f586f13556f7cec412d4401b834abb0f6827df89da3a/llm-foundry-0.3.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.3.0 2024-05-08T02:50:43,184 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/cc/87/e0b2af411af8933ff85fdc34b8fdf28cde01d4c050d75dca5959de0aa7a2/llm_foundry-0.3.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-05-08T02:50:43,185 Found link https://files.pythonhosted.org/packages/ec/6c/2f776ccc71541901f2b9b9f776c415c65ed551eab2ddecf7fb89566511f7/llm-foundry-0.4.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.4.0 2024-05-08T02:50:43,185 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/e6/d0/f2c4899b0dc4fab34a0a79f53fddf94c77e8aeb84c6ac0ec785bc498a8c7/llm_foundry-0.4.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-05-08T02:50:43,186 Found link https://files.pythonhosted.org/packages/2a/7d/472c26d98dcb053169a8f8871f13131566b5ced88e363d735cd6ec7365bc/llm-foundry-0.5.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.5.0 2024-05-08T02:50:43,187 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/8a/30/a9986cdde61701f476416793862c057e8e98d6c88503a5c4f41d564f79f4/llm_foundry-0.5.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-05-08T02:50:43,188 Found link https://files.pythonhosted.org/packages/a2/1c/fec082f001ae88ba752e891c6ead49a5c13296a0f3a97fc0aa6dd0a7766e/llm-foundry-0.6.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.6.0 2024-05-08T02:50:43,189 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/3e/91/9ee7fd88d232ab0cd53c75ad3178f582017273bc78d57309624531d85308/llm_foundry-0.6.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-05-08T02:50:43,190 Found link https://files.pythonhosted.org/packages/2c/69/d99b9cc071f68a8fdeaa5c09a7dd2244be4a81fab41ce348d9181228e7a9/llm-foundry-0.7.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.7.0 2024-05-08T02:50:43,190 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/64/9a/d11a1ae311989cb060c5ca23a4e1ee46d3bd277e6be6d64343db0fc0e8ab/llm_foundry-0.7.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-05-08T02:50:43,191 Found link https://files.pythonhosted.org/packages/59/a4/4745453c2a59dc1fda0bf8a59e4f509e218f039d7fbbbccba6c6a3b55bc1/llm-foundry-0.8.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.8.0 2024-05-08T02:50:43,192 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/88/d0/36334b427373c17497d6eea2d90525ee7263df5ad48ade631cfeda68a8d7/llm_foundry-0.8.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-05-08T02:50:43,193 Found link https://files.pythonhosted.org/packages/5a/3d/43e53ba12e75d272285672399088e7ff2216360a86906560b1b2aa4eab70/llm-foundry-0.9.0.dev0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.9.0.dev0 2024-05-08T02:50:43,193 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/c1/6c/be754bb239d61d4c26eff1d953bd310ced72eb23fd3363ad4836570217bd/llm_foundry-0.9.0.dev0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-05-08T02:50:43,194 Fetching project page and analyzing links: https://www.piwheels.org/simple/llm-foundry/ 2024-05-08T02:50:43,195 Getting page https://www.piwheels.org/simple/llm-foundry/ 2024-05-08T02:50:43,196 Found index url https://www.piwheels.org/simple/ 2024-05-08T02:50:43,474 Fetched page https://www.piwheels.org/simple/llm-foundry/ as text/html 2024-05-08T02:50:43,478 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.9.0.dev0-py3-none-any.whl#sha256=7e76d2a6ef5e65f6ee1c14e9a9b9ab869ea62213d178953ce3a432ef4bc88390 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-05-08T02:50:43,478 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.7.0-py3-none-any.whl#sha256=687bed7df809793c64462ca30c62c8a9c8d66a5b5ce61196b7938a6bdeeb6f68 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-05-08T02:50:43,479 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.6.0-py3-none-any.whl#sha256=d67a6434eddb476f231fd84ac520f1ed5b76cdf1f0a7bb859412cf2108c6aae9 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-05-08T02:50:43,479 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.5.0-py3-none-any.whl#sha256=37244e95dfa42508065d585a3183615c53553c518e8e719dcf76d1513aef5fdc (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-05-08T02:50:43,480 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.4.0-py3-none-any.whl#sha256=5cf2e21930468450f4f78cab10cac25e368036d3a0dcaa6048f1a2ced06cf42c (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-05-08T02:50:43,481 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.3.0-py3-none-any.whl#sha256=4e22006806faee0afc389aea07fdcb9c522cdaf230c87693e24fe113b26af7e3 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-05-08T02:50:43,481 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.2.0-py3-none-any.whl#sha256=d04a1d00b014fa919b4e35d6d0910ba7e796c754b7451c846391e890cb108566 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-05-08T02:50:43,482 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.1.0-py3-none-any.whl#sha256=49868c9a1fd20882f6038ead8e4a4abcf5c795b75bb0686011ce460f237eae18 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-05-08T02:50:43,482 Skipping link: not a file: https://www.piwheels.org/simple/llm-foundry/ 2024-05-08T02:50:43,483 Skipping link: not a file: https://pypi.org/simple/llm-foundry/ 2024-05-08T02:50:43,502 Given no hashes to check 1 links for project 'llm-foundry': discarding no candidates 2024-05-08T02:50:43,520 Collecting llm-foundry==0.8.0 2024-05-08T02:50:43,522 Created temporary directory: /tmp/pip-unpack-kmscj1gx 2024-05-08T02:50:43,828 Downloading llm-foundry-0.8.0.tar.gz (197 kB) 2024-05-08T02:50:44,161 Added llm-foundry==0.8.0 from https://files.pythonhosted.org/packages/59/a4/4745453c2a59dc1fda0bf8a59e4f509e218f039d7fbbbccba6c6a3b55bc1/llm-foundry-0.8.0.tar.gz to build tracker '/tmp/pip-build-tracker-86_xw2rx' 2024-05-08T02:50:44,173 Created temporary directory: /tmp/pip-build-env-apr639i5 2024-05-08T02:50:44,178 Installing build dependencies: started 2024-05-08T02:50:44,180 Running command pip subprocess to install build dependencies 2024-05-08T02:50:45,308 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-05-08T02:50:45,803 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-05-08T02:50:47,396 Collecting setuptools<68.0.0 2024-05-08T02:50:47,409 Downloading https://www.piwheels.org/simple/setuptools/setuptools-67.8.0-py3-none-any.whl (1.1 MB) 2024-05-08T02:50:47,937 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 2.1 MB/s eta 0:00:00 2024-05-08T02:50:50,564 Installing collected packages: setuptools 2024-05-08T02:50:52,869 Successfully installed setuptools-67.8.0 2024-05-08T02:50:53,367 Installing build dependencies: finished with status 'done' 2024-05-08T02:50:53,370 Getting requirements to build wheel: started 2024-05-08T02:50:53,372 Running command Getting requirements to build wheel 2024-05-08T02:50:54,005 running egg_info 2024-05-08T02:50:54,008 writing llm_foundry.egg-info/PKG-INFO 2024-05-08T02:50:54,012 writing dependency_links to llm_foundry.egg-info/dependency_links.txt 2024-05-08T02:50:54,013 writing entry points to llm_foundry.egg-info/entry_points.txt 2024-05-08T02:50:54,015 writing requirements to llm_foundry.egg-info/requires.txt 2024-05-08T02:50:54,017 writing top-level names to llm_foundry.egg-info/top_level.txt 2024-05-08T02:50:54,048 reading manifest file 'llm_foundry.egg-info/SOURCES.txt' 2024-05-08T02:50:54,051 adding license file 'LICENSE' 2024-05-08T02:50:54,057 writing manifest file 'llm_foundry.egg-info/SOURCES.txt' 2024-05-08T02:50:54,135 Getting requirements to build wheel: finished with status 'done' 2024-05-08T02:50:54,142 Installing backend dependencies: started 2024-05-08T02:50:54,144 Running command pip subprocess to install backend dependencies 2024-05-08T02:50:55,287 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-05-08T02:50:55,793 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-05-08T02:50:56,389 Collecting wheel 2024-05-08T02:50:56,403 Using cached https://www.piwheels.org/simple/wheel/wheel-0.43.0-py3-none-any.whl (65 kB) 2024-05-08T02:50:58,662 Installing collected packages: wheel 2024-05-08T02:50:58,890 Creating /tmp/pip-build-env-apr639i5/normal/local/bin 2024-05-08T02:50:58,892 changing mode of /tmp/pip-build-env-apr639i5/normal/local/bin/wheel to 755 2024-05-08T02:50:58,908 Successfully installed wheel-0.43.0 2024-05-08T02:50:59,395 Installing backend dependencies: finished with status 'done' 2024-05-08T02:50:59,397 Created temporary directory: /tmp/pip-modern-metadata-xy1qmgfn 2024-05-08T02:50:59,399 Preparing metadata (pyproject.toml): started 2024-05-08T02:50:59,401 Running command Preparing metadata (pyproject.toml) 2024-05-08T02:51:00,050 running dist_info 2024-05-08T02:51:00,073 creating /tmp/pip-modern-metadata-xy1qmgfn/llm_foundry.egg-info 2024-05-08T02:51:00,077 writing /tmp/pip-modern-metadata-xy1qmgfn/llm_foundry.egg-info/PKG-INFO 2024-05-08T02:51:00,081 writing dependency_links to /tmp/pip-modern-metadata-xy1qmgfn/llm_foundry.egg-info/dependency_links.txt 2024-05-08T02:51:00,082 writing entry points to /tmp/pip-modern-metadata-xy1qmgfn/llm_foundry.egg-info/entry_points.txt 2024-05-08T02:51:00,084 writing requirements to /tmp/pip-modern-metadata-xy1qmgfn/llm_foundry.egg-info/requires.txt 2024-05-08T02:51:00,085 writing top-level names to /tmp/pip-modern-metadata-xy1qmgfn/llm_foundry.egg-info/top_level.txt 2024-05-08T02:51:00,087 writing manifest file '/tmp/pip-modern-metadata-xy1qmgfn/llm_foundry.egg-info/SOURCES.txt' 2024-05-08T02:51:00,123 reading manifest file '/tmp/pip-modern-metadata-xy1qmgfn/llm_foundry.egg-info/SOURCES.txt' 2024-05-08T02:51:00,125 adding license file 'LICENSE' 2024-05-08T02:51:00,129 writing manifest file '/tmp/pip-modern-metadata-xy1qmgfn/llm_foundry.egg-info/SOURCES.txt' 2024-05-08T02:51:00,130 creating '/tmp/pip-modern-metadata-xy1qmgfn/llm_foundry-0.8.0.dist-info' 2024-05-08T02:51:00,356 Preparing metadata (pyproject.toml): finished with status 'done' 2024-05-08T02:51:00,363 Source in /tmp/pip-wheel-1l6zplzh/llm-foundry_b85f7799914546d19d199efa78e702d8 has version 0.8.0, which satisfies requirement llm-foundry==0.8.0 from https://files.pythonhosted.org/packages/59/a4/4745453c2a59dc1fda0bf8a59e4f509e218f039d7fbbbccba6c6a3b55bc1/llm-foundry-0.8.0.tar.gz 2024-05-08T02:51:00,364 Removed llm-foundry==0.8.0 from https://files.pythonhosted.org/packages/59/a4/4745453c2a59dc1fda0bf8a59e4f509e218f039d7fbbbccba6c6a3b55bc1/llm-foundry-0.8.0.tar.gz from build tracker '/tmp/pip-build-tracker-86_xw2rx' 2024-05-08T02:51:00,373 Created temporary directory: /tmp/pip-unpack-sqthywyu 2024-05-08T02:51:00,374 Created temporary directory: /tmp/pip-unpack-eews5ifz 2024-05-08T02:51:00,662 Building wheels for collected packages: llm-foundry 2024-05-08T02:51:00,667 Created temporary directory: /tmp/pip-wheel-m5z6klq2 2024-05-08T02:51:00,667 Destination directory: /tmp/pip-wheel-m5z6klq2 2024-05-08T02:51:00,670 Building wheel for llm-foundry (pyproject.toml): started 2024-05-08T02:51:00,671 Running command Building wheel for llm-foundry (pyproject.toml) 2024-05-08T02:51:01,353 running bdist_wheel 2024-05-08T02:51:01,394 running build 2024-05-08T02:51:01,394 running build_py 2024-05-08T02:51:01,401 creating build 2024-05-08T02:51:01,402 creating build/lib 2024-05-08T02:51:01,402 creating build/lib/llmfoundry 2024-05-08T02:51:01,403 copying llmfoundry/__init__.py -> build/lib/llmfoundry 2024-05-08T02:51:01,405 copying llmfoundry/layers_registry.py -> build/lib/llmfoundry 2024-05-08T02:51:01,407 copying llmfoundry/registry.py -> build/lib/llmfoundry 2024-05-08T02:51:01,410 creating build/lib/llmfoundry/utils 2024-05-08T02:51:01,411 copying llmfoundry/utils/builders.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,414 copying llmfoundry/utils/checkpoint_conversion_helpers.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,416 copying llmfoundry/utils/data_prep_utils.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,418 copying llmfoundry/utils/exceptions.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,421 copying llmfoundry/utils/prompt_files.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,422 copying llmfoundry/utils/logging_utils.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,424 copying llmfoundry/utils/mosaicml_logger_utils.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,426 copying llmfoundry/utils/registry_utils.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,429 copying llmfoundry/utils/config_utils.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,431 copying llmfoundry/utils/warnings.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,433 copying llmfoundry/utils/huggingface_hub_utils.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,435 copying llmfoundry/utils/__init__.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,438 copying llmfoundry/utils/model_download_utils.py -> build/lib/llmfoundry/utils 2024-05-08T02:51:01,441 creating build/lib/llmfoundry/eval 2024-05-08T02:51:01,442 copying llmfoundry/eval/__init__.py -> build/lib/llmfoundry/eval 2024-05-08T02:51:01,444 creating build/lib/llmfoundry/optim 2024-05-08T02:51:01,445 copying llmfoundry/optim/outlier_detection.py -> build/lib/llmfoundry/optim 2024-05-08T02:51:01,447 copying llmfoundry/optim/lion.py -> build/lib/llmfoundry/optim 2024-05-08T02:51:01,449 copying llmfoundry/optim/scheduler.py -> build/lib/llmfoundry/optim 2024-05-08T02:51:01,451 copying llmfoundry/optim/adaptive_lion.py -> build/lib/llmfoundry/optim 2024-05-08T02:51:01,453 copying llmfoundry/optim/__init__.py -> build/lib/llmfoundry/optim 2024-05-08T02:51:01,455 creating build/lib/llmfoundry/models 2024-05-08T02:51:01,456 copying llmfoundry/models/__init__.py -> build/lib/llmfoundry/models 2024-05-08T02:51:01,458 creating build/lib/llmfoundry/interfaces 2024-05-08T02:51:01,459 copying llmfoundry/interfaces/__init__.py -> build/lib/llmfoundry/interfaces 2024-05-08T02:51:01,461 copying llmfoundry/interfaces/callback_with_config.py -> build/lib/llmfoundry/interfaces 2024-05-08T02:51:01,463 creating build/lib/llmfoundry/callbacks 2024-05-08T02:51:01,464 copying llmfoundry/callbacks/hf_checkpointer.py -> build/lib/llmfoundry/callbacks 2024-05-08T02:51:01,467 copying llmfoundry/callbacks/resumption_callbacks.py -> build/lib/llmfoundry/callbacks 2024-05-08T02:51:01,469 copying llmfoundry/callbacks/async_eval_callback.py -> build/lib/llmfoundry/callbacks 2024-05-08T02:51:01,471 copying llmfoundry/callbacks/eval_gauntlet_callback.py -> build/lib/llmfoundry/callbacks 2024-05-08T02:51:01,473 copying llmfoundry/callbacks/curriculum_learning_callback.py -> build/lib/llmfoundry/callbacks 2024-05-08T02:51:01,476 copying llmfoundry/callbacks/__init__.py -> build/lib/llmfoundry/callbacks 2024-05-08T02:51:01,477 copying llmfoundry/callbacks/monolithic_ckpt_callback.py -> build/lib/llmfoundry/callbacks 2024-05-08T02:51:01,479 copying llmfoundry/callbacks/fdiff_callback.py -> build/lib/llmfoundry/callbacks 2024-05-08T02:51:01,481 copying llmfoundry/callbacks/scheduled_gc_callback.py -> build/lib/llmfoundry/callbacks 2024-05-08T02:51:01,483 copying llmfoundry/callbacks/log_mbmoe_tok_per_expert_callback.py -> build/lib/llmfoundry/callbacks 2024-05-08T02:51:01,485 copying llmfoundry/callbacks/eval_output_logging_callback.py -> build/lib/llmfoundry/callbacks 2024-05-08T02:51:01,488 creating build/lib/llmfoundry/data 2024-05-08T02:51:01,489 copying llmfoundry/data/dataloader.py -> build/lib/llmfoundry/data 2024-05-08T02:51:01,491 copying llmfoundry/data/packing.py -> build/lib/llmfoundry/data 2024-05-08T02:51:01,493 copying llmfoundry/data/utils.py -> build/lib/llmfoundry/data 2024-05-08T02:51:01,495 copying llmfoundry/data/__init__.py -> build/lib/llmfoundry/data 2024-05-08T02:51:01,497 copying llmfoundry/data/text_data.py -> build/lib/llmfoundry/data 2024-05-08T02:51:01,500 copying llmfoundry/data/data.py -> build/lib/llmfoundry/data 2024-05-08T02:51:01,502 creating build/lib/llmfoundry/algorithms 2024-05-08T02:51:01,503 copying llmfoundry/algorithms/__init__.py -> build/lib/llmfoundry/algorithms 2024-05-08T02:51:01,506 creating build/lib/llmfoundry/loggers 2024-05-08T02:51:01,507 copying llmfoundry/loggers/__init__.py -> build/lib/llmfoundry/loggers 2024-05-08T02:51:01,509 creating build/lib/llmfoundry/metrics 2024-05-08T02:51:01,510 copying llmfoundry/metrics/token_acc.py -> build/lib/llmfoundry/metrics 2024-05-08T02:51:01,512 copying llmfoundry/metrics/__init__.py -> build/lib/llmfoundry/metrics 2024-05-08T02:51:01,514 creating build/lib/llmfoundry/cli 2024-05-08T02:51:01,515 copying llmfoundry/cli/__init__.py -> build/lib/llmfoundry/cli 2024-05-08T02:51:01,517 copying llmfoundry/cli/cli.py -> build/lib/llmfoundry/cli 2024-05-08T02:51:01,519 copying llmfoundry/cli/registry_cli.py -> build/lib/llmfoundry/cli 2024-05-08T02:51:01,521 creating build/lib/llmfoundry/tokenizers 2024-05-08T02:51:01,522 copying llmfoundry/tokenizers/tiktoken.py -> build/lib/llmfoundry/tokenizers 2024-05-08T02:51:01,524 copying llmfoundry/tokenizers/__init__.py -> build/lib/llmfoundry/tokenizers 2024-05-08T02:51:01,526 creating build/lib/llmfoundry/eval/metrics 2024-05-08T02:51:01,527 copying llmfoundry/eval/metrics/__init__.py -> build/lib/llmfoundry/eval/metrics 2024-05-08T02:51:01,529 copying llmfoundry/eval/metrics/nlp.py -> build/lib/llmfoundry/eval/metrics 2024-05-08T02:51:01,532 creating build/lib/llmfoundry/eval/datasets 2024-05-08T02:51:01,533 copying llmfoundry/eval/datasets/in_context_learning_evaluation.py -> build/lib/llmfoundry/eval/datasets 2024-05-08T02:51:01,537 copying llmfoundry/eval/datasets/utils.py -> build/lib/llmfoundry/eval/datasets 2024-05-08T02:51:01,539 copying llmfoundry/eval/datasets/__init__.py -> build/lib/llmfoundry/eval/datasets 2024-05-08T02:51:01,541 creating build/lib/llmfoundry/models/utils 2024-05-08T02:51:01,542 copying llmfoundry/models/utils/act_ckpt.py -> build/lib/llmfoundry/models/utils 2024-05-08T02:51:01,544 copying llmfoundry/models/utils/config_moe_args.py -> build/lib/llmfoundry/models/utils 2024-05-08T02:51:01,547 copying llmfoundry/models/utils/param_init_fns.py -> build/lib/llmfoundry/models/utils 2024-05-08T02:51:01,550 copying llmfoundry/models/utils/meta_init_context.py -> build/lib/llmfoundry/models/utils 2024-05-08T02:51:01,552 copying llmfoundry/models/utils/__init__.py -> build/lib/llmfoundry/models/utils 2024-05-08T02:51:01,554 copying llmfoundry/models/utils/mpt_param_count.py -> build/lib/llmfoundry/models/utils 2024-05-08T02:51:01,556 creating build/lib/llmfoundry/models/mpt 2024-05-08T02:51:01,557 copying llmfoundry/models/mpt/configuration_mpt.py -> build/lib/llmfoundry/models/mpt 2024-05-08T02:51:01,560 copying llmfoundry/models/mpt/modeling_mpt.py -> build/lib/llmfoundry/models/mpt 2024-05-08T02:51:01,563 copying llmfoundry/models/mpt/__init__.py -> build/lib/llmfoundry/models/mpt 2024-05-08T02:51:01,565 creating build/lib/llmfoundry/models/hf 2024-05-08T02:51:01,566 copying llmfoundry/models/hf/hf_fsdp.py -> build/lib/llmfoundry/models/hf 2024-05-08T02:51:01,568 copying llmfoundry/models/hf/hf_causal_lm.py -> build/lib/llmfoundry/models/hf 2024-05-08T02:51:01,571 copying llmfoundry/models/hf/model_wrapper.py -> build/lib/llmfoundry/models/hf 2024-05-08T02:51:01,573 copying llmfoundry/models/hf/__init__.py -> build/lib/llmfoundry/models/hf 2024-05-08T02:51:01,574 copying llmfoundry/models/hf/hf_t5.py -> build/lib/llmfoundry/models/hf 2024-05-08T02:51:01,578 creating build/lib/llmfoundry/models/layers 2024-05-08T02:51:01,579 copying llmfoundry/models/layers/layer_builders.py -> build/lib/llmfoundry/models/layers 2024-05-08T02:51:01,581 copying llmfoundry/models/layers/blocks.py -> build/lib/llmfoundry/models/layers 2024-05-08T02:51:01,583 copying llmfoundry/models/layers/dmoe.py -> build/lib/llmfoundry/models/layers 2024-05-08T02:51:01,586 copying llmfoundry/models/layers/ffn.py -> build/lib/llmfoundry/models/layers 2024-05-08T02:51:01,588 copying llmfoundry/models/layers/fc.py -> build/lib/llmfoundry/models/layers 2024-05-08T02:51:01,590 copying llmfoundry/models/layers/__init__.py -> build/lib/llmfoundry/models/layers 2024-05-08T02:51:01,592 copying llmfoundry/models/layers/custom_embedding.py -> build/lib/llmfoundry/models/layers 2024-05-08T02:51:01,593 copying llmfoundry/models/layers/norm.py -> build/lib/llmfoundry/models/layers 2024-05-08T02:51:01,596 copying llmfoundry/models/layers/attention.py -> build/lib/llmfoundry/models/layers 2024-05-08T02:51:01,599 creating build/lib/llmfoundry/models/inference_api_wrapper 2024-05-08T02:51:01,600 copying llmfoundry/models/inference_api_wrapper/interface.py -> build/lib/llmfoundry/models/inference_api_wrapper 2024-05-08T02:51:01,602 copying llmfoundry/models/inference_api_wrapper/openai_causal_lm.py -> build/lib/llmfoundry/models/inference_api_wrapper 2024-05-08T02:51:01,604 copying llmfoundry/models/inference_api_wrapper/fmapi.py -> build/lib/llmfoundry/models/inference_api_wrapper 2024-05-08T02:51:01,606 copying llmfoundry/models/inference_api_wrapper/__init__.py -> build/lib/llmfoundry/models/inference_api_wrapper 2024-05-08T02:51:01,608 creating build/lib/llmfoundry/data/finetuning 2024-05-08T02:51:01,609 copying llmfoundry/data/finetuning/dataloader.py -> build/lib/llmfoundry/data/finetuning 2024-05-08T02:51:01,612 copying llmfoundry/data/finetuning/tasks.py -> build/lib/llmfoundry/data/finetuning 2024-05-08T02:51:01,615 copying llmfoundry/data/finetuning/__init__.py -> build/lib/llmfoundry/data/finetuning 2024-05-08T02:51:01,617 copying llmfoundry/data/finetuning/collator.py -> build/lib/llmfoundry/data/finetuning 2024-05-08T02:51:01,639 installing to build/bdist.linux-armv7l/wheel 2024-05-08T02:51:01,639 running install 2024-05-08T02:51:01,663 running install_lib 2024-05-08T02:51:01,669 creating build/bdist.linux-armv7l 2024-05-08T02:51:01,670 creating build/bdist.linux-armv7l/wheel 2024-05-08T02:51:01,671 creating build/bdist.linux-armv7l/wheel/llmfoundry 2024-05-08T02:51:01,673 creating build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,674 copying build/lib/llmfoundry/utils/builders.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,677 copying build/lib/llmfoundry/utils/checkpoint_conversion_helpers.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,679 copying build/lib/llmfoundry/utils/data_prep_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,681 copying build/lib/llmfoundry/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,683 copying build/lib/llmfoundry/utils/prompt_files.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,685 copying build/lib/llmfoundry/utils/logging_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,687 copying build/lib/llmfoundry/utils/mosaicml_logger_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,689 copying build/lib/llmfoundry/utils/registry_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,691 copying build/lib/llmfoundry/utils/config_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,694 copying build/lib/llmfoundry/utils/warnings.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,696 copying build/lib/llmfoundry/utils/huggingface_hub_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,698 copying build/lib/llmfoundry/utils/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,700 copying build/lib/llmfoundry/utils/model_download_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-05-08T02:51:01,703 creating build/bdist.linux-armv7l/wheel/llmfoundry/eval 2024-05-08T02:51:01,704 copying build/lib/llmfoundry/eval/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/eval 2024-05-08T02:51:01,706 creating build/bdist.linux-armv7l/wheel/llmfoundry/eval/metrics 2024-05-08T02:51:01,707 copying build/lib/llmfoundry/eval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/eval/metrics 2024-05-08T02:51:01,709 copying build/lib/llmfoundry/eval/metrics/nlp.py -> build/bdist.linux-armv7l/wheel/llmfoundry/eval/metrics 2024-05-08T02:51:01,713 creating build/bdist.linux-armv7l/wheel/llmfoundry/eval/datasets 2024-05-08T02:51:01,714 copying build/lib/llmfoundry/eval/datasets/in_context_learning_evaluation.py -> build/bdist.linux-armv7l/wheel/llmfoundry/eval/datasets 2024-05-08T02:51:01,718 copying build/lib/llmfoundry/eval/datasets/utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/eval/datasets 2024-05-08T02:51:01,721 copying build/lib/llmfoundry/eval/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/eval/datasets 2024-05-08T02:51:01,723 creating build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-05-08T02:51:01,724 copying build/lib/llmfoundry/optim/outlier_detection.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-05-08T02:51:01,726 copying build/lib/llmfoundry/optim/lion.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-05-08T02:51:01,728 copying build/lib/llmfoundry/optim/scheduler.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-05-08T02:51:01,731 copying build/lib/llmfoundry/optim/adaptive_lion.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-05-08T02:51:01,733 copying build/lib/llmfoundry/optim/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-05-08T02:51:01,735 creating build/bdist.linux-armv7l/wheel/llmfoundry/models 2024-05-08T02:51:01,737 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-05-08T02:51:01,738 copying build/lib/llmfoundry/models/utils/act_ckpt.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-05-08T02:51:01,740 copying build/lib/llmfoundry/models/utils/config_moe_args.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-05-08T02:51:01,742 copying build/lib/llmfoundry/models/utils/param_init_fns.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-05-08T02:51:01,745 copying build/lib/llmfoundry/models/utils/meta_init_context.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-05-08T02:51:01,747 copying build/lib/llmfoundry/models/utils/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-05-08T02:51:01,749 copying build/lib/llmfoundry/models/utils/mpt_param_count.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-05-08T02:51:01,752 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2024-05-08T02:51:01,753 copying build/lib/llmfoundry/models/mpt/configuration_mpt.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2024-05-08T02:51:01,756 copying build/lib/llmfoundry/models/mpt/modeling_mpt.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2024-05-08T02:51:01,764 copying build/lib/llmfoundry/models/mpt/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2024-05-08T02:51:01,766 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-05-08T02:51:01,767 copying build/lib/llmfoundry/models/hf/hf_fsdp.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-05-08T02:51:01,770 copying build/lib/llmfoundry/models/hf/hf_causal_lm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-05-08T02:51:01,772 copying build/lib/llmfoundry/models/hf/model_wrapper.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-05-08T02:51:01,775 copying build/lib/llmfoundry/models/hf/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-05-08T02:51:01,776 copying build/lib/llmfoundry/models/hf/hf_t5.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-05-08T02:51:01,779 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-05-08T02:51:01,780 copying build/lib/llmfoundry/models/layers/layer_builders.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-05-08T02:51:01,782 copying build/lib/llmfoundry/models/layers/blocks.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-05-08T02:51:01,785 copying build/lib/llmfoundry/models/layers/dmoe.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-05-08T02:51:01,787 copying build/lib/llmfoundry/models/layers/ffn.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-05-08T02:51:01,789 copying build/lib/llmfoundry/models/layers/fc.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-05-08T02:51:01,791 copying build/lib/llmfoundry/models/layers/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-05-08T02:51:01,794 copying build/lib/llmfoundry/models/layers/custom_embedding.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-05-08T02:51:01,795 copying build/lib/llmfoundry/models/layers/norm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-05-08T02:51:01,798 copying build/lib/llmfoundry/models/layers/attention.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-05-08T02:51:01,800 copying build/lib/llmfoundry/models/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models 2024-05-08T02:51:01,802 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-05-08T02:51:01,803 copying build/lib/llmfoundry/models/inference_api_wrapper/interface.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-05-08T02:51:01,806 copying build/lib/llmfoundry/models/inference_api_wrapper/openai_causal_lm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-05-08T02:51:01,808 copying build/lib/llmfoundry/models/inference_api_wrapper/fmapi.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-05-08T02:51:01,810 copying build/lib/llmfoundry/models/inference_api_wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-05-08T02:51:01,812 creating build/bdist.linux-armv7l/wheel/llmfoundry/interfaces 2024-05-08T02:51:01,813 copying build/lib/llmfoundry/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/interfaces 2024-05-08T02:51:01,815 copying build/lib/llmfoundry/interfaces/callback_with_config.py -> build/bdist.linux-armv7l/wheel/llmfoundry/interfaces 2024-05-08T02:51:01,817 creating build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-05-08T02:51:01,818 copying build/lib/llmfoundry/callbacks/hf_checkpointer.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-05-08T02:51:01,822 copying build/lib/llmfoundry/callbacks/resumption_callbacks.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-05-08T02:51:01,824 copying build/lib/llmfoundry/callbacks/async_eval_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-05-08T02:51:01,826 copying build/lib/llmfoundry/callbacks/eval_gauntlet_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-05-08T02:51:01,829 copying build/lib/llmfoundry/callbacks/curriculum_learning_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-05-08T02:51:01,831 copying build/lib/llmfoundry/callbacks/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-05-08T02:51:01,833 copying build/lib/llmfoundry/callbacks/monolithic_ckpt_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-05-08T02:51:01,836 copying build/lib/llmfoundry/callbacks/fdiff_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-05-08T02:51:01,838 copying build/lib/llmfoundry/callbacks/scheduled_gc_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-05-08T02:51:01,840 copying build/lib/llmfoundry/callbacks/log_mbmoe_tok_per_expert_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-05-08T02:51:01,842 copying build/lib/llmfoundry/callbacks/eval_output_logging_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-05-08T02:51:01,844 creating build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-05-08T02:51:01,845 copying build/lib/llmfoundry/data/dataloader.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-05-08T02:51:01,847 copying build/lib/llmfoundry/data/packing.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-05-08T02:51:01,850 copying build/lib/llmfoundry/data/utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-05-08T02:51:01,852 copying build/lib/llmfoundry/data/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-05-08T02:51:01,854 copying build/lib/llmfoundry/data/text_data.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-05-08T02:51:01,857 creating build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-05-08T02:51:01,858 copying build/lib/llmfoundry/data/finetuning/dataloader.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-05-08T02:51:01,861 copying build/lib/llmfoundry/data/finetuning/tasks.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-05-08T02:51:01,864 copying build/lib/llmfoundry/data/finetuning/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-05-08T02:51:01,866 copying build/lib/llmfoundry/data/finetuning/collator.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-05-08T02:51:01,868 copying build/lib/llmfoundry/data/data.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-05-08T02:51:01,871 creating build/bdist.linux-armv7l/wheel/llmfoundry/algorithms 2024-05-08T02:51:01,872 copying build/lib/llmfoundry/algorithms/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/algorithms 2024-05-08T02:51:01,874 creating build/bdist.linux-armv7l/wheel/llmfoundry/loggers 2024-05-08T02:51:01,875 copying build/lib/llmfoundry/loggers/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/loggers 2024-05-08T02:51:01,877 copying build/lib/llmfoundry/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry 2024-05-08T02:51:01,880 creating build/bdist.linux-armv7l/wheel/llmfoundry/metrics 2024-05-08T02:51:01,881 copying build/lib/llmfoundry/metrics/token_acc.py -> build/bdist.linux-armv7l/wheel/llmfoundry/metrics 2024-05-08T02:51:01,883 copying build/lib/llmfoundry/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/metrics 2024-05-08T02:51:01,885 copying build/lib/llmfoundry/layers_registry.py -> build/bdist.linux-armv7l/wheel/llmfoundry 2024-05-08T02:51:01,887 creating build/bdist.linux-armv7l/wheel/llmfoundry/cli 2024-05-08T02:51:01,888 copying build/lib/llmfoundry/cli/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/cli 2024-05-08T02:51:01,890 copying build/lib/llmfoundry/cli/cli.py -> build/bdist.linux-armv7l/wheel/llmfoundry/cli 2024-05-08T02:51:01,892 copying build/lib/llmfoundry/cli/registry_cli.py -> build/bdist.linux-armv7l/wheel/llmfoundry/cli 2024-05-08T02:51:01,894 copying build/lib/llmfoundry/registry.py -> build/bdist.linux-armv7l/wheel/llmfoundry 2024-05-08T02:51:01,897 creating build/bdist.linux-armv7l/wheel/llmfoundry/tokenizers 2024-05-08T02:51:01,898 copying build/lib/llmfoundry/tokenizers/tiktoken.py -> build/bdist.linux-armv7l/wheel/llmfoundry/tokenizers 2024-05-08T02:51:01,900 copying build/lib/llmfoundry/tokenizers/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/tokenizers 2024-05-08T02:51:01,902 running install_egg_info 2024-05-08T02:51:01,912 running egg_info 2024-05-08T02:51:01,915 writing llm_foundry.egg-info/PKG-INFO 2024-05-08T02:51:01,918 writing dependency_links to llm_foundry.egg-info/dependency_links.txt 2024-05-08T02:51:01,920 writing entry points to llm_foundry.egg-info/entry_points.txt 2024-05-08T02:51:01,922 writing requirements to llm_foundry.egg-info/requires.txt 2024-05-08T02:51:01,923 writing top-level names to llm_foundry.egg-info/top_level.txt 2024-05-08T02:51:01,940 reading manifest file 'llm_foundry.egg-info/SOURCES.txt' 2024-05-08T02:51:01,944 adding license file 'LICENSE' 2024-05-08T02:51:01,949 writing manifest file 'llm_foundry.egg-info/SOURCES.txt' 2024-05-08T02:51:01,951 Copying llm_foundry.egg-info to build/bdist.linux-armv7l/wheel/llm_foundry-0.8.0-py3.11.egg-info 2024-05-08T02:51:01,963 running install_scripts 2024-05-08T02:51:02,021 creating build/bdist.linux-armv7l/wheel/llm_foundry-0.8.0.dist-info/WHEEL 2024-05-08T02:51:02,023 creating '/tmp/pip-wheel-m5z6klq2/.tmp-jqldre4x/llm_foundry-0.8.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-05-08T02:51:02,027 adding 'llmfoundry/__init__.py' 2024-05-08T02:51:02,029 adding 'llmfoundry/layers_registry.py' 2024-05-08T02:51:02,031 adding 'llmfoundry/registry.py' 2024-05-08T02:51:02,033 adding 'llmfoundry/algorithms/__init__.py' 2024-05-08T02:51:02,035 adding 'llmfoundry/callbacks/__init__.py' 2024-05-08T02:51:02,039 adding 'llmfoundry/callbacks/async_eval_callback.py' 2024-05-08T02:51:02,041 adding 'llmfoundry/callbacks/curriculum_learning_callback.py' 2024-05-08T02:51:02,043 adding 'llmfoundry/callbacks/eval_gauntlet_callback.py' 2024-05-08T02:51:02,045 adding 'llmfoundry/callbacks/eval_output_logging_callback.py' 2024-05-08T02:51:02,047 adding 'llmfoundry/callbacks/fdiff_callback.py' 2024-05-08T02:51:02,051 adding 'llmfoundry/callbacks/hf_checkpointer.py' 2024-05-08T02:51:02,053 adding 'llmfoundry/callbacks/log_mbmoe_tok_per_expert_callback.py' 2024-05-08T02:51:02,055 adding 'llmfoundry/callbacks/monolithic_ckpt_callback.py' 2024-05-08T02:51:02,057 adding 'llmfoundry/callbacks/resumption_callbacks.py' 2024-05-08T02:51:02,058 adding 'llmfoundry/callbacks/scheduled_gc_callback.py' 2024-05-08T02:51:02,061 adding 'llmfoundry/cli/__init__.py' 2024-05-08T02:51:02,062 adding 'llmfoundry/cli/cli.py' 2024-05-08T02:51:02,064 adding 'llmfoundry/cli/registry_cli.py' 2024-05-08T02:51:02,066 adding 'llmfoundry/data/__init__.py' 2024-05-08T02:51:02,068 adding 'llmfoundry/data/data.py' 2024-05-08T02:51:02,070 adding 'llmfoundry/data/dataloader.py' 2024-05-08T02:51:02,072 adding 'llmfoundry/data/packing.py' 2024-05-08T02:51:02,075 adding 'llmfoundry/data/text_data.py' 2024-05-08T02:51:02,077 adding 'llmfoundry/data/utils.py' 2024-05-08T02:51:02,079 adding 'llmfoundry/data/finetuning/__init__.py' 2024-05-08T02:51:02,082 adding 'llmfoundry/data/finetuning/collator.py' 2024-05-08T02:51:02,086 adding 'llmfoundry/data/finetuning/dataloader.py' 2024-05-08T02:51:02,092 adding 'llmfoundry/data/finetuning/tasks.py' 2024-05-08T02:51:02,094 adding 'llmfoundry/eval/__init__.py' 2024-05-08T02:51:02,096 adding 'llmfoundry/eval/datasets/__init__.py' 2024-05-08T02:51:02,105 adding 'llmfoundry/eval/datasets/in_context_learning_evaluation.py' 2024-05-08T02:51:02,108 adding 'llmfoundry/eval/datasets/utils.py' 2024-05-08T02:51:02,110 adding 'llmfoundry/eval/metrics/__init__.py' 2024-05-08T02:51:02,114 adding 'llmfoundry/eval/metrics/nlp.py' 2024-05-08T02:51:02,116 adding 'llmfoundry/interfaces/__init__.py' 2024-05-08T02:51:02,117 adding 'llmfoundry/interfaces/callback_with_config.py' 2024-05-08T02:51:02,119 adding 'llmfoundry/loggers/__init__.py' 2024-05-08T02:51:02,121 adding 'llmfoundry/metrics/__init__.py' 2024-05-08T02:51:02,123 adding 'llmfoundry/metrics/token_acc.py' 2024-05-08T02:51:02,125 adding 'llmfoundry/models/__init__.py' 2024-05-08T02:51:02,127 adding 'llmfoundry/models/hf/__init__.py' 2024-05-08T02:51:02,129 adding 'llmfoundry/models/hf/hf_causal_lm.py' 2024-05-08T02:51:02,132 adding 'llmfoundry/models/hf/hf_fsdp.py' 2024-05-08T02:51:02,134 adding 'llmfoundry/models/hf/hf_t5.py' 2024-05-08T02:51:02,136 adding 'llmfoundry/models/hf/model_wrapper.py' 2024-05-08T02:51:02,138 adding 'llmfoundry/models/inference_api_wrapper/__init__.py' 2024-05-08T02:51:02,140 adding 'llmfoundry/models/inference_api_wrapper/fmapi.py' 2024-05-08T02:51:02,142 adding 'llmfoundry/models/inference_api_wrapper/interface.py' 2024-05-08T02:51:02,144 adding 'llmfoundry/models/inference_api_wrapper/openai_causal_lm.py' 2024-05-08T02:51:02,146 adding 'llmfoundry/models/layers/__init__.py' 2024-05-08T02:51:02,150 adding 'llmfoundry/models/layers/attention.py' 2024-05-08T02:51:02,152 adding 'llmfoundry/models/layers/blocks.py' 2024-05-08T02:51:02,154 adding 'llmfoundry/models/layers/custom_embedding.py' 2024-05-08T02:51:02,156 adding 'llmfoundry/models/layers/dmoe.py' 2024-05-08T02:51:02,158 adding 'llmfoundry/models/layers/fc.py' 2024-05-08T02:51:02,160 adding 'llmfoundry/models/layers/ffn.py' 2024-05-08T02:51:02,162 adding 'llmfoundry/models/layers/layer_builders.py' 2024-05-08T02:51:02,164 adding 'llmfoundry/models/layers/norm.py' 2024-05-08T02:51:02,167 adding 'llmfoundry/models/mpt/__init__.py' 2024-05-08T02:51:02,169 adding 'llmfoundry/models/mpt/configuration_mpt.py' 2024-05-08T02:51:02,175 adding 'llmfoundry/models/mpt/modeling_mpt.py' 2024-05-08T02:51:02,178 adding 'llmfoundry/models/utils/__init__.py' 2024-05-08T02:51:02,180 adding 'llmfoundry/models/utils/act_ckpt.py' 2024-05-08T02:51:02,181 adding 'llmfoundry/models/utils/config_moe_args.py' 2024-05-08T02:51:02,183 adding 'llmfoundry/models/utils/meta_init_context.py' 2024-05-08T02:51:02,184 adding 'llmfoundry/models/utils/mpt_param_count.py' 2024-05-08T02:51:02,187 adding 'llmfoundry/models/utils/param_init_fns.py' 2024-05-08T02:51:02,189 adding 'llmfoundry/optim/__init__.py' 2024-05-08T02:51:02,191 adding 'llmfoundry/optim/adaptive_lion.py' 2024-05-08T02:51:02,192 adding 'llmfoundry/optim/lion.py' 2024-05-08T02:51:02,194 adding 'llmfoundry/optim/outlier_detection.py' 2024-05-08T02:51:02,196 adding 'llmfoundry/optim/scheduler.py' 2024-05-08T02:51:02,198 adding 'llmfoundry/tokenizers/__init__.py' 2024-05-08T02:51:02,200 adding 'llmfoundry/tokenizers/tiktoken.py' 2024-05-08T02:51:02,202 adding 'llmfoundry/utils/__init__.py' 2024-05-08T02:51:02,205 adding 'llmfoundry/utils/builders.py' 2024-05-08T02:51:02,207 adding 'llmfoundry/utils/checkpoint_conversion_helpers.py' 2024-05-08T02:51:02,210 adding 'llmfoundry/utils/config_utils.py' 2024-05-08T02:51:02,211 adding 'llmfoundry/utils/data_prep_utils.py' 2024-05-08T02:51:02,213 adding 'llmfoundry/utils/exceptions.py' 2024-05-08T02:51:02,214 adding 'llmfoundry/utils/huggingface_hub_utils.py' 2024-05-08T02:51:02,216 adding 'llmfoundry/utils/logging_utils.py' 2024-05-08T02:51:02,218 adding 'llmfoundry/utils/model_download_utils.py' 2024-05-08T02:51:02,219 adding 'llmfoundry/utils/mosaicml_logger_utils.py' 2024-05-08T02:51:02,221 adding 'llmfoundry/utils/prompt_files.py' 2024-05-08T02:51:02,222 adding 'llmfoundry/utils/registry_utils.py' 2024-05-08T02:51:02,224 adding 'llmfoundry/utils/warnings.py' 2024-05-08T02:51:02,226 adding 'llm_foundry-0.8.0.dist-info/LICENSE' 2024-05-08T02:51:02,229 adding 'llm_foundry-0.8.0.dist-info/METADATA' 2024-05-08T02:51:02,230 adding 'llm_foundry-0.8.0.dist-info/WHEEL' 2024-05-08T02:51:02,231 adding 'llm_foundry-0.8.0.dist-info/entry_points.txt' 2024-05-08T02:51:02,231 adding 'llm_foundry-0.8.0.dist-info/top_level.txt' 2024-05-08T02:51:02,233 adding 'llm_foundry-0.8.0.dist-info/RECORD' 2024-05-08T02:51:02,238 removing build/bdist.linux-armv7l/wheel 2024-05-08T02:51:02,376 Building wheel for llm-foundry (pyproject.toml): finished with status 'done' 2024-05-08T02:51:02,387 Created wheel for llm-foundry: filename=llm_foundry-0.8.0-py3-none-any.whl size=232536 sha256=52855e62a889379d35a4c4572d2ba5fa81b4818e9484df66597b9ee2ffb981ad 2024-05-08T02:51:02,388 Stored in directory: /tmp/pip-ephem-wheel-cache-d8vuygdb/wheels/93/b1/ab/1dd0342c6b9ef690d35be744f4558c3808f3159392f4faae97 2024-05-08T02:51:02,409 Successfully built llm-foundry 2024-05-08T02:51:02,419 Removed build tracker: '/tmp/pip-build-tracker-86_xw2rx'