2024-06-24T23:57:51,780 Created temporary directory: /tmp/pip-build-tracker-3yg2s_vp 2024-06-24T23:57:51,781 Initialized build tracking at /tmp/pip-build-tracker-3yg2s_vp 2024-06-24T23:57:51,782 Created build tracker: /tmp/pip-build-tracker-3yg2s_vp 2024-06-24T23:57:51,782 Entered build tracker: /tmp/pip-build-tracker-3yg2s_vp 2024-06-24T23:57:51,783 Created temporary directory: /tmp/pip-wheel-xqyja15v 2024-06-24T23:57:51,786 Created temporary directory: /tmp/pip-ephem-wheel-cache-o2s4hyi_ 2024-06-24T23:57:51,810 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-06-24T23:57:51,813 2 location(s) to search for versions of llm-foundry: 2024-06-24T23:57:51,813 * https://pypi.org/simple/llm-foundry/ 2024-06-24T23:57:51,813 * https://www.piwheels.org/simple/llm-foundry/ 2024-06-24T23:57:51,814 Fetching project page and analyzing links: https://pypi.org/simple/llm-foundry/ 2024-06-24T23:57:51,815 Getting page https://pypi.org/simple/llm-foundry/ 2024-06-24T23:57:51,816 Found index url https://pypi.org/simple/ 2024-06-24T23:57:52,038 Fetched page https://pypi.org/simple/llm-foundry/ as application/vnd.pypi.simple.v1+json 2024-06-24T23:57:52,044 Found link https://files.pythonhosted.org/packages/3a/ae/57c3346bd35154ba2f506fc13cb07b38cefc4f5511cb34705c1c34c568f1/llm-foundry-0.1.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.1.0 2024-06-24T23:57:52,045 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/d7/32/b1afffb2d76c0be72fcda3184050bc4ebc32695a645ef95bdb35103007ad/llm_foundry-0.1.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-06-24T23:57:52,046 Found link https://files.pythonhosted.org/packages/61/7d/a152ff61601e702027412187760d34832d34dc2c6c96d8baa4979769b49e/llm-foundry-0.2.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.2.0 2024-06-24T23:57:52,046 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/7c/19/2dfb92b041c0a18b105e98a71009732ac03bc504c22c0a6dd4b62f50c0b7/llm_foundry-0.2.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-06-24T23:57:52,047 Found link https://files.pythonhosted.org/packages/74/dd/f7204d13bcb9bc41f586f13556f7cec412d4401b834abb0f6827df89da3a/llm-foundry-0.3.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.3.0 2024-06-24T23:57:52,048 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/cc/87/e0b2af411af8933ff85fdc34b8fdf28cde01d4c050d75dca5959de0aa7a2/llm_foundry-0.3.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-06-24T23:57:52,049 Found link https://files.pythonhosted.org/packages/ec/6c/2f776ccc71541901f2b9b9f776c415c65ed551eab2ddecf7fb89566511f7/llm-foundry-0.4.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7), version: 0.4.0 2024-06-24T23:57:52,050 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/e6/d0/f2c4899b0dc4fab34a0a79f53fddf94c77e8aeb84c6ac0ec785bc498a8c7/llm_foundry-0.4.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-06-24T23:57:52,051 Found link https://files.pythonhosted.org/packages/2a/7d/472c26d98dcb053169a8f8871f13131566b5ced88e363d735cd6ec7365bc/llm-foundry-0.5.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.5.0 2024-06-24T23:57:52,051 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/8a/30/a9986cdde61701f476416793862c057e8e98d6c88503a5c4f41d564f79f4/llm_foundry-0.5.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,052 Found link https://files.pythonhosted.org/packages/a2/1c/fec082f001ae88ba752e891c6ead49a5c13296a0f3a97fc0aa6dd0a7766e/llm-foundry-0.6.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.6.0 2024-06-24T23:57:52,053 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/3e/91/9ee7fd88d232ab0cd53c75ad3178f582017273bc78d57309624531d85308/llm_foundry-0.6.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,054 Found link https://files.pythonhosted.org/packages/2c/69/d99b9cc071f68a8fdeaa5c09a7dd2244be4a81fab41ce348d9181228e7a9/llm-foundry-0.7.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.7.0 2024-06-24T23:57:52,055 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/64/9a/d11a1ae311989cb060c5ca23a4e1ee46d3bd277e6be6d64343db0fc0e8ab/llm_foundry-0.7.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,056 Found link https://files.pythonhosted.org/packages/59/a4/4745453c2a59dc1fda0bf8a59e4f509e218f039d7fbbbccba6c6a3b55bc1/llm-foundry-0.8.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.8.0 2024-06-24T23:57:52,056 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/88/d0/36334b427373c17497d6eea2d90525ee7263df5ad48ade631cfeda68a8d7/llm_foundry-0.8.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,057 Found link https://files.pythonhosted.org/packages/5a/3d/43e53ba12e75d272285672399088e7ff2216360a86906560b1b2aa4eab70/llm-foundry-0.9.0.dev0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.9.0.dev0 2024-06-24T23:57:52,058 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/c1/6c/be754bb239d61d4c26eff1d953bd310ced72eb23fd3363ad4836570217bd/llm_foundry-0.9.0.dev0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,058 Found link https://files.pythonhosted.org/packages/0e/3f/982053f5b8e7beccbef30503e6f9ec98c92288e00c15d075363c27da0746/llm-foundry-0.9.0.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.9.0 2024-06-24T23:57:52,059 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/86/be/78cb6489023a05040b5403a9767c335a9ddbd0491ed8203d7c2eff585a55/llm_foundry-0.9.0-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,060 Found link https://files.pythonhosted.org/packages/4b/35/dcadb60d79bfb9b37721ac1c5c8c82d98dd3b6b9418ab357e32638f76259/llm-foundry-0.9.1.tar.gz (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9), version: 0.9.1 2024-06-24T23:57:52,061 Skipping link: No binaries permitted for llm-foundry: https://files.pythonhosted.org/packages/21/1b/3456392a9ba585a8c7cdd9994a2599597aa545d4c83fa23a1cfa70f6fcdb/llm_foundry-0.9.1-py3-none-any.whl (from https://pypi.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,062 Fetching project page and analyzing links: https://www.piwheels.org/simple/llm-foundry/ 2024-06-24T23:57:52,063 Getting page https://www.piwheels.org/simple/llm-foundry/ 2024-06-24T23:57:52,064 Found index url https://www.piwheels.org/simple/ 2024-06-24T23:57:52,228 Fetched page https://www.piwheels.org/simple/llm-foundry/ as text/html 2024-06-24T23:57:52,232 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.9.0-py3-none-any.whl#sha256=e18cf6095186599d934ca77c7a115196f9cdcd66fcbb7a4a9980b492aa418518 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,233 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.9.0.dev0-py3-none-any.whl#sha256=7e76d2a6ef5e65f6ee1c14e9a9b9ab869ea62213d178953ce3a432ef4bc88390 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,233 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.8.0-py3-none-any.whl#sha256=52855e62a889379d35a4c4572d2ba5fa81b4818e9484df66597b9ee2ffb981ad (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,234 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.7.0-py3-none-any.whl#sha256=687bed7df809793c64462ca30c62c8a9c8d66a5b5ce61196b7938a6bdeeb6f68 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,235 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.6.0-py3-none-any.whl#sha256=d67a6434eddb476f231fd84ac520f1ed5b76cdf1f0a7bb859412cf2108c6aae9 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,235 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.5.0-py3-none-any.whl#sha256=37244e95dfa42508065d585a3183615c53553c518e8e719dcf76d1513aef5fdc (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.9) 2024-06-24T23:57:52,236 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.4.0-py3-none-any.whl#sha256=5cf2e21930468450f4f78cab10cac25e368036d3a0dcaa6048f1a2ced06cf42c (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-06-24T23:57:52,236 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.3.0-py3-none-any.whl#sha256=4e22006806faee0afc389aea07fdcb9c522cdaf230c87693e24fe113b26af7e3 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-06-24T23:57:52,237 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.2.0-py3-none-any.whl#sha256=d04a1d00b014fa919b4e35d6d0910ba7e796c754b7451c846391e890cb108566 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-06-24T23:57:52,237 Skipping link: No binaries permitted for llm-foundry: https://www.piwheels.org/simple/llm-foundry/llm_foundry-0.1.0-py3-none-any.whl#sha256=49868c9a1fd20882f6038ead8e4a4abcf5c795b75bb0686011ce460f237eae18 (from https://www.piwheels.org/simple/llm-foundry/) (requires-python:>=3.7) 2024-06-24T23:57:52,238 Skipping link: not a file: https://www.piwheels.org/simple/llm-foundry/ 2024-06-24T23:57:52,239 Skipping link: not a file: https://pypi.org/simple/llm-foundry/ 2024-06-24T23:57:52,260 Given no hashes to check 1 links for project 'llm-foundry': discarding no candidates 2024-06-24T23:57:52,279 Collecting llm-foundry==0.9.1 2024-06-24T23:57:52,282 Created temporary directory: /tmp/pip-unpack-b5c9oloy 2024-06-24T23:57:52,501 Downloading llm-foundry-0.9.1.tar.gz (204 kB) 2024-06-24T23:57:52,824 Added llm-foundry==0.9.1 from https://files.pythonhosted.org/packages/4b/35/dcadb60d79bfb9b37721ac1c5c8c82d98dd3b6b9418ab357e32638f76259/llm-foundry-0.9.1.tar.gz to build tracker '/tmp/pip-build-tracker-3yg2s_vp' 2024-06-24T23:57:52,834 Created temporary directory: /tmp/pip-build-env-1snd_nmh 2024-06-24T23:57:52,840 Installing build dependencies: started 2024-06-24T23:57:52,841 Running command pip subprocess to install build dependencies 2024-06-24T23:57:54,042 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-06-24T23:57:54,592 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-06-24T23:57:56,130 Collecting setuptools<68.0.0 2024-06-24T23:57:56,149 Using cached https://www.piwheels.org/simple/setuptools/setuptools-67.8.0-py3-none-any.whl (1.1 MB) 2024-06-24T23:57:58,852 Installing collected packages: setuptools 2024-06-24T23:58:01,482 Successfully installed setuptools-67.8.0 2024-06-24T23:58:01,797 [notice] A new release of pip is available: 24.0 -> 24.1 2024-06-24T23:58:01,798 [notice] To update, run: python3 -m pip install --upgrade pip 2024-06-24T23:58:02,069 Installing build dependencies: finished with status 'done' 2024-06-24T23:58:02,073 Getting requirements to build wheel: started 2024-06-24T23:58:02,074 Running command Getting requirements to build wheel 2024-06-24T23:58:02,722 running egg_info 2024-06-24T23:58:02,726 writing llm_foundry.egg-info/PKG-INFO 2024-06-24T23:58:02,731 writing dependency_links to llm_foundry.egg-info/dependency_links.txt 2024-06-24T23:58:02,734 writing entry points to llm_foundry.egg-info/entry_points.txt 2024-06-24T23:58:02,736 writing requirements to llm_foundry.egg-info/requires.txt 2024-06-24T23:58:02,738 writing top-level names to llm_foundry.egg-info/top_level.txt 2024-06-24T23:58:02,769 reading manifest file 'llm_foundry.egg-info/SOURCES.txt' 2024-06-24T23:58:02,773 adding license file 'LICENSE' 2024-06-24T23:58:02,779 writing manifest file 'llm_foundry.egg-info/SOURCES.txt' 2024-06-24T23:58:02,858 Getting requirements to build wheel: finished with status 'done' 2024-06-24T23:58:02,866 Installing backend dependencies: started 2024-06-24T23:58:02,867 Running command pip subprocess to install backend dependencies 2024-06-24T23:58:04,004 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-06-24T23:58:04,585 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-06-24T23:58:06,303 Collecting wheel 2024-06-24T23:58:06,317 Using cached https://www.piwheels.org/simple/wheel/wheel-0.43.0-py3-none-any.whl (65 kB) 2024-06-24T23:58:08,628 Installing collected packages: wheel 2024-06-24T23:58:08,857 Creating /tmp/pip-build-env-1snd_nmh/normal/local/bin 2024-06-24T23:58:08,860 changing mode of /tmp/pip-build-env-1snd_nmh/normal/local/bin/wheel to 755 2024-06-24T23:58:08,871 Successfully installed wheel-0.43.0 2024-06-24T23:58:09,186 [notice] A new release of pip is available: 24.0 -> 24.1 2024-06-24T23:58:09,187 [notice] To update, run: python3 -m pip install --upgrade pip 2024-06-24T23:58:09,418 Installing backend dependencies: finished with status 'done' 2024-06-24T23:58:09,420 Created temporary directory: /tmp/pip-modern-metadata-936bi_v2 2024-06-24T23:58:09,423 Preparing metadata (pyproject.toml): started 2024-06-24T23:58:09,424 Running command Preparing metadata (pyproject.toml) 2024-06-24T23:58:10,173 running dist_info 2024-06-24T23:58:10,192 creating /tmp/pip-modern-metadata-936bi_v2/llm_foundry.egg-info 2024-06-24T23:58:10,196 writing /tmp/pip-modern-metadata-936bi_v2/llm_foundry.egg-info/PKG-INFO 2024-06-24T23:58:10,199 writing dependency_links to /tmp/pip-modern-metadata-936bi_v2/llm_foundry.egg-info/dependency_links.txt 2024-06-24T23:58:10,201 writing entry points to /tmp/pip-modern-metadata-936bi_v2/llm_foundry.egg-info/entry_points.txt 2024-06-24T23:58:10,203 writing requirements to /tmp/pip-modern-metadata-936bi_v2/llm_foundry.egg-info/requires.txt 2024-06-24T23:58:10,204 writing top-level names to /tmp/pip-modern-metadata-936bi_v2/llm_foundry.egg-info/top_level.txt 2024-06-24T23:58:10,206 writing manifest file '/tmp/pip-modern-metadata-936bi_v2/llm_foundry.egg-info/SOURCES.txt' 2024-06-24T23:58:10,242 reading manifest file '/tmp/pip-modern-metadata-936bi_v2/llm_foundry.egg-info/SOURCES.txt' 2024-06-24T23:58:10,244 adding license file 'LICENSE' 2024-06-24T23:58:10,248 writing manifest file '/tmp/pip-modern-metadata-936bi_v2/llm_foundry.egg-info/SOURCES.txt' 2024-06-24T23:58:10,249 creating '/tmp/pip-modern-metadata-936bi_v2/llm_foundry-0.9.1.dist-info' 2024-06-24T23:58:10,478 Preparing metadata (pyproject.toml): finished with status 'done' 2024-06-24T23:58:10,485 Source in /tmp/pip-wheel-xqyja15v/llm-foundry_5faba8c61ca44a0d9c41e158402b5536 has version 0.9.1, which satisfies requirement llm-foundry==0.9.1 from https://files.pythonhosted.org/packages/4b/35/dcadb60d79bfb9b37721ac1c5c8c82d98dd3b6b9418ab357e32638f76259/llm-foundry-0.9.1.tar.gz 2024-06-24T23:58:10,486 Removed llm-foundry==0.9.1 from https://files.pythonhosted.org/packages/4b/35/dcadb60d79bfb9b37721ac1c5c8c82d98dd3b6b9418ab357e32638f76259/llm-foundry-0.9.1.tar.gz from build tracker '/tmp/pip-build-tracker-3yg2s_vp' 2024-06-24T23:58:10,495 Created temporary directory: /tmp/pip-unpack-b8t8b4hr 2024-06-24T23:58:10,496 Created temporary directory: /tmp/pip-unpack-vy9u2aty 2024-06-24T23:58:10,767 Building wheels for collected packages: llm-foundry 2024-06-24T23:58:10,772 Created temporary directory: /tmp/pip-wheel-j5nu_y9p 2024-06-24T23:58:10,773 Destination directory: /tmp/pip-wheel-j5nu_y9p 2024-06-24T23:58:10,776 Building wheel for llm-foundry (pyproject.toml): started 2024-06-24T23:58:10,777 Running command Building wheel for llm-foundry (pyproject.toml) 2024-06-24T23:58:11,462 running bdist_wheel 2024-06-24T23:58:11,503 running build 2024-06-24T23:58:11,504 running build_py 2024-06-24T23:58:11,510 creating build 2024-06-24T23:58:11,511 creating build/lib 2024-06-24T23:58:11,511 creating build/lib/llmfoundry 2024-06-24T23:58:11,513 copying llmfoundry/layers_registry.py -> build/lib/llmfoundry 2024-06-24T23:58:11,514 copying llmfoundry/__init__.py -> build/lib/llmfoundry 2024-06-24T23:58:11,516 copying llmfoundry/registry.py -> build/lib/llmfoundry 2024-06-24T23:58:11,519 creating build/lib/llmfoundry/metrics 2024-06-24T23:58:11,520 copying llmfoundry/metrics/__init__.py -> build/lib/llmfoundry/metrics 2024-06-24T23:58:11,522 copying llmfoundry/metrics/token_acc.py -> build/lib/llmfoundry/metrics 2024-06-24T23:58:11,524 creating build/lib/llmfoundry/data 2024-06-24T23:58:11,525 copying llmfoundry/data/utils.py -> build/lib/llmfoundry/data 2024-06-24T23:58:11,527 copying llmfoundry/data/dataloader.py -> build/lib/llmfoundry/data 2024-06-24T23:58:11,529 copying llmfoundry/data/__init__.py -> build/lib/llmfoundry/data 2024-06-24T23:58:11,531 copying llmfoundry/data/text_data.py -> build/lib/llmfoundry/data 2024-06-24T23:58:11,533 copying llmfoundry/data/data.py -> build/lib/llmfoundry/data 2024-06-24T23:58:11,535 copying llmfoundry/data/packing.py -> build/lib/llmfoundry/data 2024-06-24T23:58:11,539 creating build/lib/llmfoundry/cli 2024-06-24T23:58:11,540 copying llmfoundry/cli/registry_cli.py -> build/lib/llmfoundry/cli 2024-06-24T23:58:11,541 copying llmfoundry/cli/__init__.py -> build/lib/llmfoundry/cli 2024-06-24T23:58:11,543 copying llmfoundry/cli/cli.py -> build/lib/llmfoundry/cli 2024-06-24T23:58:11,545 creating build/lib/llmfoundry/interfaces 2024-06-24T23:58:11,546 copying llmfoundry/interfaces/__init__.py -> build/lib/llmfoundry/interfaces 2024-06-24T23:58:11,548 copying llmfoundry/interfaces/callback_with_config.py -> build/lib/llmfoundry/interfaces 2024-06-24T23:58:11,550 creating build/lib/llmfoundry/optim 2024-06-24T23:58:11,551 copying llmfoundry/optim/adaptive_lion.py -> build/lib/llmfoundry/optim 2024-06-24T23:58:11,554 copying llmfoundry/optim/lion.py -> build/lib/llmfoundry/optim 2024-06-24T23:58:11,556 copying llmfoundry/optim/__init__.py -> build/lib/llmfoundry/optim 2024-06-24T23:58:11,558 copying llmfoundry/optim/outlier_detection.py -> build/lib/llmfoundry/optim 2024-06-24T23:58:11,559 copying llmfoundry/optim/scheduler.py -> build/lib/llmfoundry/optim 2024-06-24T23:58:11,562 creating build/lib/llmfoundry/callbacks 2024-06-24T23:58:11,563 copying llmfoundry/callbacks/monolithic_ckpt_callback.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:11,565 copying llmfoundry/callbacks/loss_perp_v_len_callback.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:11,568 copying llmfoundry/callbacks/run_timeout_callback.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:11,570 copying llmfoundry/callbacks/eval_output_logging_callback.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:11,572 copying llmfoundry/callbacks/hf_checkpointer.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:11,574 copying llmfoundry/callbacks/__init__.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:11,576 copying llmfoundry/callbacks/scheduled_gc_callback.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:11,578 copying llmfoundry/callbacks/async_eval_callback.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:11,581 copying llmfoundry/callbacks/resumption_callbacks.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:11,583 copying llmfoundry/callbacks/eval_gauntlet_callback.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:11,590 copying llmfoundry/callbacks/curriculum_learning_callback.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:11,593 copying llmfoundry/callbacks/log_mbmoe_tok_per_expert_callback.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:12,000 copying llmfoundry/callbacks/fdiff_callback.py -> build/lib/llmfoundry/callbacks 2024-06-24T23:58:12,003 creating build/lib/llmfoundry/tokenizers 2024-06-24T23:58:12,004 copying llmfoundry/tokenizers/tiktoken.py -> build/lib/llmfoundry/tokenizers 2024-06-24T23:58:12,008 copying llmfoundry/tokenizers/__init__.py -> build/lib/llmfoundry/tokenizers 2024-06-24T23:58:12,010 creating build/lib/llmfoundry/algorithms 2024-06-24T23:58:12,011 copying llmfoundry/algorithms/__init__.py -> build/lib/llmfoundry/algorithms 2024-06-24T23:58:12,015 creating build/lib/llmfoundry/utils 2024-06-24T23:58:12,016 copying llmfoundry/utils/checkpoint_conversion_helpers.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,020 copying llmfoundry/utils/warnings.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,022 copying llmfoundry/utils/exceptions.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,025 copying llmfoundry/utils/prompt_files.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,028 copying llmfoundry/utils/registry_utils.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,031 copying llmfoundry/utils/huggingface_hub_utils.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,034 copying llmfoundry/utils/mosaicml_logger_utils.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,037 copying llmfoundry/utils/config_utils.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,040 copying llmfoundry/utils/__init__.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,042 copying llmfoundry/utils/builders.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,046 copying llmfoundry/utils/model_download_utils.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,048 copying llmfoundry/utils/logging_utils.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,050 copying llmfoundry/utils/data_prep_utils.py -> build/lib/llmfoundry/utils 2024-06-24T23:58:12,054 creating build/lib/llmfoundry/eval 2024-06-24T23:58:12,055 copying llmfoundry/eval/__init__.py -> build/lib/llmfoundry/eval 2024-06-24T23:58:12,058 creating build/lib/llmfoundry/models 2024-06-24T23:58:12,059 copying llmfoundry/models/__init__.py -> build/lib/llmfoundry/models 2024-06-24T23:58:12,062 creating build/lib/llmfoundry/loggers 2024-06-24T23:58:12,063 copying llmfoundry/loggers/__init__.py -> build/lib/llmfoundry/loggers 2024-06-24T23:58:12,066 creating build/lib/llmfoundry/data/finetuning 2024-06-24T23:58:12,068 copying llmfoundry/data/finetuning/tasks.py -> build/lib/llmfoundry/data/finetuning 2024-06-24T23:58:12,071 copying llmfoundry/data/finetuning/collator.py -> build/lib/llmfoundry/data/finetuning 2024-06-24T23:58:12,075 copying llmfoundry/data/finetuning/dataloader.py -> build/lib/llmfoundry/data/finetuning 2024-06-24T23:58:12,078 copying llmfoundry/data/finetuning/__init__.py -> build/lib/llmfoundry/data/finetuning 2024-06-24T23:58:12,081 creating build/lib/llmfoundry/eval/metrics 2024-06-24T23:58:12,083 copying llmfoundry/eval/metrics/__init__.py -> build/lib/llmfoundry/eval/metrics 2024-06-24T23:58:12,085 copying llmfoundry/eval/metrics/nlp.py -> build/lib/llmfoundry/eval/metrics 2024-06-24T23:58:12,089 creating build/lib/llmfoundry/eval/datasets 2024-06-24T23:58:12,090 copying llmfoundry/eval/datasets/utils.py -> build/lib/llmfoundry/eval/datasets 2024-06-24T23:58:12,094 copying llmfoundry/eval/datasets/in_context_learning_evaluation.py -> build/lib/llmfoundry/eval/datasets 2024-06-24T23:58:12,099 copying llmfoundry/eval/datasets/__init__.py -> build/lib/llmfoundry/eval/datasets 2024-06-24T23:58:12,102 creating build/lib/llmfoundry/models/layers 2024-06-24T23:58:12,103 copying llmfoundry/models/layers/dmoe.py -> build/lib/llmfoundry/models/layers 2024-06-24T23:58:12,106 copying llmfoundry/models/layers/norm.py -> build/lib/llmfoundry/models/layers 2024-06-24T23:58:12,108 copying llmfoundry/models/layers/fc.py -> build/lib/llmfoundry/models/layers 2024-06-24T23:58:12,110 copying llmfoundry/models/layers/__init__.py -> build/lib/llmfoundry/models/layers 2024-06-24T23:58:12,111 copying llmfoundry/models/layers/ffn.py -> build/lib/llmfoundry/models/layers 2024-06-24T23:58:12,114 copying llmfoundry/models/layers/custom_embedding.py -> build/lib/llmfoundry/models/layers 2024-06-24T23:58:12,115 copying llmfoundry/models/layers/attention.py -> build/lib/llmfoundry/models/layers 2024-06-24T23:58:12,118 copying llmfoundry/models/layers/blocks.py -> build/lib/llmfoundry/models/layers 2024-06-24T23:58:12,120 copying llmfoundry/models/layers/layer_builders.py -> build/lib/llmfoundry/models/layers 2024-06-24T23:58:12,123 creating build/lib/llmfoundry/models/mpt 2024-06-24T23:58:12,124 copying llmfoundry/models/mpt/modeling_mpt.py -> build/lib/llmfoundry/models/mpt 2024-06-24T23:58:12,128 copying llmfoundry/models/mpt/__init__.py -> build/lib/llmfoundry/models/mpt 2024-06-24T23:58:12,129 copying llmfoundry/models/mpt/configuration_mpt.py -> build/lib/llmfoundry/models/mpt 2024-06-24T23:58:12,133 creating build/lib/llmfoundry/models/utils 2024-06-24T23:58:12,133 copying llmfoundry/models/utils/config_defaults.py -> build/lib/llmfoundry/models/utils 2024-06-24T23:58:12,135 copying llmfoundry/models/utils/config_moe_args.py -> build/lib/llmfoundry/models/utils 2024-06-24T23:58:12,137 copying llmfoundry/models/utils/param_init_fns.py -> build/lib/llmfoundry/models/utils 2024-06-24T23:58:12,140 copying llmfoundry/models/utils/mpt_param_count.py -> build/lib/llmfoundry/models/utils 2024-06-24T23:58:12,142 copying llmfoundry/models/utils/meta_init_context.py -> build/lib/llmfoundry/models/utils 2024-06-24T23:58:12,144 copying llmfoundry/models/utils/act_ckpt.py -> build/lib/llmfoundry/models/utils 2024-06-24T23:58:12,147 copying llmfoundry/models/utils/__init__.py -> build/lib/llmfoundry/models/utils 2024-06-24T23:58:12,150 creating build/lib/llmfoundry/models/inference_api_wrapper 2024-06-24T23:58:12,151 copying llmfoundry/models/inference_api_wrapper/fmapi.py -> build/lib/llmfoundry/models/inference_api_wrapper 2024-06-24T23:58:12,152 copying llmfoundry/models/inference_api_wrapper/openai_causal_lm.py -> build/lib/llmfoundry/models/inference_api_wrapper 2024-06-24T23:58:12,155 copying llmfoundry/models/inference_api_wrapper/__init__.py -> build/lib/llmfoundry/models/inference_api_wrapper 2024-06-24T23:58:12,156 copying llmfoundry/models/inference_api_wrapper/interface.py -> build/lib/llmfoundry/models/inference_api_wrapper 2024-06-24T23:58:12,159 creating build/lib/llmfoundry/models/hf 2024-06-24T23:58:12,160 copying llmfoundry/models/hf/hf_causal_lm.py -> build/lib/llmfoundry/models/hf 2024-06-24T23:58:12,163 copying llmfoundry/models/hf/hf_fsdp.py -> build/lib/llmfoundry/models/hf 2024-06-24T23:58:12,165 copying llmfoundry/models/hf/__init__.py -> build/lib/llmfoundry/models/hf 2024-06-24T23:58:12,167 copying llmfoundry/models/hf/hf_t5.py -> build/lib/llmfoundry/models/hf 2024-06-24T23:58:12,169 copying llmfoundry/models/hf/model_wrapper.py -> build/lib/llmfoundry/models/hf 2024-06-24T23:58:12,191 installing to build/bdist.linux-armv7l/wheel 2024-06-24T23:58:12,192 running install 2024-06-24T23:58:12,217 running install_lib 2024-06-24T23:58:12,224 creating build/bdist.linux-armv7l 2024-06-24T23:58:12,225 creating build/bdist.linux-armv7l/wheel 2024-06-24T23:58:12,227 creating build/bdist.linux-armv7l/wheel/llmfoundry 2024-06-24T23:58:12,229 creating build/bdist.linux-armv7l/wheel/llmfoundry/metrics 2024-06-24T23:58:12,231 copying build/lib/llmfoundry/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/metrics 2024-06-24T23:58:12,233 copying build/lib/llmfoundry/metrics/token_acc.py -> build/bdist.linux-armv7l/wheel/llmfoundry/metrics 2024-06-24T23:58:12,237 creating build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-06-24T23:58:12,237 copying build/lib/llmfoundry/data/utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-06-24T23:58:12,240 copying build/lib/llmfoundry/data/dataloader.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-06-24T23:58:12,242 copying build/lib/llmfoundry/data/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-06-24T23:58:12,244 copying build/lib/llmfoundry/data/text_data.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-06-24T23:58:12,248 creating build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-06-24T23:58:12,249 copying build/lib/llmfoundry/data/finetuning/tasks.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-06-24T23:58:12,252 copying build/lib/llmfoundry/data/finetuning/collator.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-06-24T23:58:12,255 copying build/lib/llmfoundry/data/finetuning/dataloader.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-06-24T23:58:12,258 copying build/lib/llmfoundry/data/finetuning/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data/finetuning 2024-06-24T23:58:12,260 copying build/lib/llmfoundry/data/data.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-06-24T23:58:12,262 copying build/lib/llmfoundry/data/packing.py -> build/bdist.linux-armv7l/wheel/llmfoundry/data 2024-06-24T23:58:12,265 creating build/bdist.linux-armv7l/wheel/llmfoundry/cli 2024-06-24T23:58:12,266 copying build/lib/llmfoundry/cli/registry_cli.py -> build/bdist.linux-armv7l/wheel/llmfoundry/cli 2024-06-24T23:58:12,268 copying build/lib/llmfoundry/cli/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/cli 2024-06-24T23:58:12,270 copying build/lib/llmfoundry/cli/cli.py -> build/bdist.linux-armv7l/wheel/llmfoundry/cli 2024-06-24T23:58:12,273 creating build/bdist.linux-armv7l/wheel/llmfoundry/interfaces 2024-06-24T23:58:12,280 copying build/lib/llmfoundry/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/interfaces 2024-06-24T23:58:12,283 copying build/lib/llmfoundry/interfaces/callback_with_config.py -> build/bdist.linux-armv7l/wheel/llmfoundry/interfaces 2024-06-24T23:58:12,397 creating build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-06-24T23:58:12,398 copying build/lib/llmfoundry/optim/adaptive_lion.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-06-24T23:58:12,410 copying build/lib/llmfoundry/optim/lion.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-06-24T23:58:12,426 copying build/lib/llmfoundry/optim/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-06-24T23:58:12,429 copying build/lib/llmfoundry/optim/outlier_detection.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-06-24T23:58:12,431 copying build/lib/llmfoundry/optim/scheduler.py -> build/bdist.linux-armv7l/wheel/llmfoundry/optim 2024-06-24T23:58:12,441 copying build/lib/llmfoundry/layers_registry.py -> build/bdist.linux-armv7l/wheel/llmfoundry 2024-06-24T23:58:12,453 copying build/lib/llmfoundry/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry 2024-06-24T23:58:12,458 creating build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,459 copying build/lib/llmfoundry/callbacks/monolithic_ckpt_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,463 copying build/lib/llmfoundry/callbacks/loss_perp_v_len_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,466 copying build/lib/llmfoundry/callbacks/run_timeout_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,477 copying build/lib/llmfoundry/callbacks/eval_output_logging_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,479 copying build/lib/llmfoundry/callbacks/hf_checkpointer.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,490 copying build/lib/llmfoundry/callbacks/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,492 copying build/lib/llmfoundry/callbacks/scheduled_gc_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,495 copying build/lib/llmfoundry/callbacks/async_eval_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,498 copying build/lib/llmfoundry/callbacks/resumption_callbacks.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,501 copying build/lib/llmfoundry/callbacks/eval_gauntlet_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,504 copying build/lib/llmfoundry/callbacks/curriculum_learning_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,507 copying build/lib/llmfoundry/callbacks/log_mbmoe_tok_per_expert_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,510 copying build/lib/llmfoundry/callbacks/fdiff_callback.py -> build/bdist.linux-armv7l/wheel/llmfoundry/callbacks 2024-06-24T23:58:12,513 creating build/bdist.linux-armv7l/wheel/llmfoundry/tokenizers 2024-06-24T23:58:12,514 copying build/lib/llmfoundry/tokenizers/tiktoken.py -> build/bdist.linux-armv7l/wheel/llmfoundry/tokenizers 2024-06-24T23:58:12,517 copying build/lib/llmfoundry/tokenizers/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/tokenizers 2024-06-24T23:58:12,519 copying build/lib/llmfoundry/registry.py -> build/bdist.linux-armv7l/wheel/llmfoundry 2024-06-24T23:58:12,523 creating build/bdist.linux-armv7l/wheel/llmfoundry/algorithms 2024-06-24T23:58:12,524 copying build/lib/llmfoundry/algorithms/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/algorithms 2024-06-24T23:58:12,528 creating build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,529 copying build/lib/llmfoundry/utils/checkpoint_conversion_helpers.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,532 copying build/lib/llmfoundry/utils/warnings.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,535 copying build/lib/llmfoundry/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,538 copying build/lib/llmfoundry/utils/prompt_files.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,541 copying build/lib/llmfoundry/utils/registry_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,544 copying build/lib/llmfoundry/utils/huggingface_hub_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,547 copying build/lib/llmfoundry/utils/mosaicml_logger_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,550 copying build/lib/llmfoundry/utils/config_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,554 copying build/lib/llmfoundry/utils/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,556 copying build/lib/llmfoundry/utils/builders.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,560 copying build/lib/llmfoundry/utils/model_download_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,563 copying build/lib/llmfoundry/utils/logging_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,565 copying build/lib/llmfoundry/utils/data_prep_utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/utils 2024-06-24T23:58:12,569 creating build/bdist.linux-armv7l/wheel/llmfoundry/eval 2024-06-24T23:58:12,570 creating build/bdist.linux-armv7l/wheel/llmfoundry/eval/metrics 2024-06-24T23:58:12,572 copying build/lib/llmfoundry/eval/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/eval/metrics 2024-06-24T23:58:12,575 copying build/lib/llmfoundry/eval/metrics/nlp.py -> build/bdist.linux-armv7l/wheel/llmfoundry/eval/metrics 2024-06-24T23:58:12,579 creating build/bdist.linux-armv7l/wheel/llmfoundry/eval/datasets 2024-06-24T23:58:12,580 copying build/lib/llmfoundry/eval/datasets/utils.py -> build/bdist.linux-armv7l/wheel/llmfoundry/eval/datasets 2024-06-24T23:58:12,584 copying build/lib/llmfoundry/eval/datasets/in_context_learning_evaluation.py -> build/bdist.linux-armv7l/wheel/llmfoundry/eval/datasets 2024-06-24T23:58:12,588 copying build/lib/llmfoundry/eval/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/eval/datasets 2024-06-24T23:58:12,590 copying build/lib/llmfoundry/eval/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/eval 2024-06-24T23:58:12,594 creating build/bdist.linux-armv7l/wheel/llmfoundry/models 2024-06-24T23:58:12,596 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-06-24T23:58:12,597 copying build/lib/llmfoundry/models/layers/dmoe.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-06-24T23:58:12,600 copying build/lib/llmfoundry/models/layers/norm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-06-24T23:58:12,603 copying build/lib/llmfoundry/models/layers/fc.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-06-24T23:58:12,606 copying build/lib/llmfoundry/models/layers/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-06-24T23:58:12,608 copying build/lib/llmfoundry/models/layers/ffn.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-06-24T23:58:12,611 copying build/lib/llmfoundry/models/layers/custom_embedding.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-06-24T23:58:12,613 copying build/lib/llmfoundry/models/layers/attention.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-06-24T23:58:12,617 copying build/lib/llmfoundry/models/layers/blocks.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-06-24T23:58:12,620 copying build/lib/llmfoundry/models/layers/layer_builders.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/layers 2024-06-24T23:58:12,623 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2024-06-24T23:58:12,624 copying build/lib/llmfoundry/models/mpt/modeling_mpt.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2024-06-24T23:58:12,629 copying build/lib/llmfoundry/models/mpt/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2024-06-24T23:58:12,632 copying build/lib/llmfoundry/models/mpt/configuration_mpt.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/mpt 2024-06-24T23:58:12,636 copying build/lib/llmfoundry/models/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models 2024-06-24T23:58:12,639 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-06-24T23:58:12,640 copying build/lib/llmfoundry/models/utils/config_defaults.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-06-24T23:58:12,642 copying build/lib/llmfoundry/models/utils/config_moe_args.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-06-24T23:58:12,646 copying build/lib/llmfoundry/models/utils/param_init_fns.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-06-24T23:58:12,650 copying build/lib/llmfoundry/models/utils/mpt_param_count.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-06-24T23:58:12,653 copying build/lib/llmfoundry/models/utils/meta_init_context.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-06-24T23:58:12,656 copying build/lib/llmfoundry/models/utils/act_ckpt.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-06-24T23:58:12,659 copying build/lib/llmfoundry/models/utils/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/utils 2024-06-24T23:58:12,662 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-06-24T23:58:12,663 copying build/lib/llmfoundry/models/inference_api_wrapper/fmapi.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-06-24T23:58:12,666 copying build/lib/llmfoundry/models/inference_api_wrapper/openai_causal_lm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-06-24T23:58:12,669 copying build/lib/llmfoundry/models/inference_api_wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-06-24T23:58:12,671 copying build/lib/llmfoundry/models/inference_api_wrapper/interface.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/inference_api_wrapper 2024-06-24T23:58:12,675 creating build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-06-24T23:58:12,676 copying build/lib/llmfoundry/models/hf/hf_causal_lm.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-06-24T23:58:12,680 copying build/lib/llmfoundry/models/hf/hf_fsdp.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-06-24T23:58:12,683 copying build/lib/llmfoundry/models/hf/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-06-24T23:58:12,686 copying build/lib/llmfoundry/models/hf/hf_t5.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-06-24T23:58:12,689 copying build/lib/llmfoundry/models/hf/model_wrapper.py -> build/bdist.linux-armv7l/wheel/llmfoundry/models/hf 2024-06-24T23:58:12,692 creating build/bdist.linux-armv7l/wheel/llmfoundry/loggers 2024-06-24T23:58:12,693 copying build/lib/llmfoundry/loggers/__init__.py -> build/bdist.linux-armv7l/wheel/llmfoundry/loggers 2024-06-24T23:58:12,696 running install_egg_info 2024-06-24T23:58:12,708 running egg_info 2024-06-24T23:58:12,712 writing llm_foundry.egg-info/PKG-INFO 2024-06-24T23:58:12,715 writing dependency_links to llm_foundry.egg-info/dependency_links.txt 2024-06-24T23:58:12,716 writing entry points to llm_foundry.egg-info/entry_points.txt 2024-06-24T23:58:12,719 writing requirements to llm_foundry.egg-info/requires.txt 2024-06-24T23:58:12,721 writing top-level names to llm_foundry.egg-info/top_level.txt 2024-06-24T23:58:12,748 reading manifest file 'llm_foundry.egg-info/SOURCES.txt' 2024-06-24T23:58:12,752 adding license file 'LICENSE' 2024-06-24T23:58:12,757 writing manifest file 'llm_foundry.egg-info/SOURCES.txt' 2024-06-24T23:58:12,759 Copying llm_foundry.egg-info to build/bdist.linux-armv7l/wheel/llm_foundry-0.9.1-py3.11.egg-info 2024-06-24T23:58:12,779 running install_scripts 2024-06-24T23:58:12,850 creating build/bdist.linux-armv7l/wheel/llm_foundry-0.9.1.dist-info/WHEEL 2024-06-24T23:58:12,853 creating '/tmp/pip-wheel-j5nu_y9p/.tmp-dvrmytqg/llm_foundry-0.9.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-06-24T23:58:12,859 adding 'llmfoundry/__init__.py' 2024-06-24T23:58:12,861 adding 'llmfoundry/layers_registry.py' 2024-06-24T23:58:12,864 adding 'llmfoundry/registry.py' 2024-06-24T23:58:12,867 adding 'llmfoundry/algorithms/__init__.py' 2024-06-24T23:58:12,871 adding 'llmfoundry/callbacks/__init__.py' 2024-06-24T23:58:12,876 adding 'llmfoundry/callbacks/async_eval_callback.py' 2024-06-24T23:58:12,879 adding 'llmfoundry/callbacks/curriculum_learning_callback.py' 2024-06-24T23:58:12,882 adding 'llmfoundry/callbacks/eval_gauntlet_callback.py' 2024-06-24T23:58:12,884 adding 'llmfoundry/callbacks/eval_output_logging_callback.py' 2024-06-24T23:58:12,887 adding 'llmfoundry/callbacks/fdiff_callback.py' 2024-06-24T23:58:12,892 adding 'llmfoundry/callbacks/hf_checkpointer.py' 2024-06-24T23:58:12,895 adding 'llmfoundry/callbacks/log_mbmoe_tok_per_expert_callback.py' 2024-06-24T23:58:12,898 adding 'llmfoundry/callbacks/loss_perp_v_len_callback.py' 2024-06-24T23:58:12,901 adding 'llmfoundry/callbacks/monolithic_ckpt_callback.py' 2024-06-24T23:58:12,904 adding 'llmfoundry/callbacks/resumption_callbacks.py' 2024-06-24T23:58:12,906 adding 'llmfoundry/callbacks/run_timeout_callback.py' 2024-06-24T23:58:12,908 adding 'llmfoundry/callbacks/scheduled_gc_callback.py' 2024-06-24T23:58:12,910 adding 'llmfoundry/cli/__init__.py' 2024-06-24T23:58:12,912 adding 'llmfoundry/cli/cli.py' 2024-06-24T23:58:12,914 adding 'llmfoundry/cli/registry_cli.py' 2024-06-24T23:58:12,916 adding 'llmfoundry/data/__init__.py' 2024-06-24T23:58:12,918 adding 'llmfoundry/data/data.py' 2024-06-24T23:58:12,920 adding 'llmfoundry/data/dataloader.py' 2024-06-24T23:58:12,923 adding 'llmfoundry/data/packing.py' 2024-06-24T23:58:12,927 adding 'llmfoundry/data/text_data.py' 2024-06-24T23:58:12,929 adding 'llmfoundry/data/utils.py' 2024-06-24T23:58:12,931 adding 'llmfoundry/data/finetuning/__init__.py' 2024-06-24T23:58:12,934 adding 'llmfoundry/data/finetuning/collator.py' 2024-06-24T23:58:12,938 adding 'llmfoundry/data/finetuning/dataloader.py' 2024-06-24T23:58:12,944 adding 'llmfoundry/data/finetuning/tasks.py' 2024-06-24T23:58:12,947 adding 'llmfoundry/eval/__init__.py' 2024-06-24T23:58:12,949 adding 'llmfoundry/eval/datasets/__init__.py' 2024-06-24T23:58:12,958 adding 'llmfoundry/eval/datasets/in_context_learning_evaluation.py' 2024-06-24T23:58:12,960 adding 'llmfoundry/eval/datasets/utils.py' 2024-06-24T23:58:12,963 adding 'llmfoundry/eval/metrics/__init__.py' 2024-06-24T23:58:12,966 adding 'llmfoundry/eval/metrics/nlp.py' 2024-06-24T23:58:12,968 adding 'llmfoundry/interfaces/__init__.py' 2024-06-24T23:58:12,970 adding 'llmfoundry/interfaces/callback_with_config.py' 2024-06-24T23:58:12,972 adding 'llmfoundry/loggers/__init__.py' 2024-06-24T23:58:12,974 adding 'llmfoundry/metrics/__init__.py' 2024-06-24T23:58:12,976 adding 'llmfoundry/metrics/token_acc.py' 2024-06-24T23:58:12,978 adding 'llmfoundry/models/__init__.py' 2024-06-24T23:58:12,980 adding 'llmfoundry/models/hf/__init__.py' 2024-06-24T23:58:12,983 adding 'llmfoundry/models/hf/hf_causal_lm.py' 2024-06-24T23:58:12,986 adding 'llmfoundry/models/hf/hf_fsdp.py' 2024-06-24T23:58:12,988 adding 'llmfoundry/models/hf/hf_t5.py' 2024-06-24T23:58:12,990 adding 'llmfoundry/models/hf/model_wrapper.py' 2024-06-24T23:58:12,993 adding 'llmfoundry/models/inference_api_wrapper/__init__.py' 2024-06-24T23:58:12,994 adding 'llmfoundry/models/inference_api_wrapper/fmapi.py' 2024-06-24T23:58:12,996 adding 'llmfoundry/models/inference_api_wrapper/interface.py' 2024-06-24T23:58:12,998 adding 'llmfoundry/models/inference_api_wrapper/openai_causal_lm.py' 2024-06-24T23:58:13,001 adding 'llmfoundry/models/layers/__init__.py' 2024-06-24T23:58:13,005 adding 'llmfoundry/models/layers/attention.py' 2024-06-24T23:58:13,007 adding 'llmfoundry/models/layers/blocks.py' 2024-06-24T23:58:13,009 adding 'llmfoundry/models/layers/custom_embedding.py' 2024-06-24T23:58:13,011 adding 'llmfoundry/models/layers/dmoe.py' 2024-06-24T23:58:13,013 adding 'llmfoundry/models/layers/fc.py' 2024-06-24T23:58:13,016 adding 'llmfoundry/models/layers/ffn.py' 2024-06-24T23:58:13,018 adding 'llmfoundry/models/layers/layer_builders.py' 2024-06-24T23:58:13,020 adding 'llmfoundry/models/layers/norm.py' 2024-06-24T23:58:13,022 adding 'llmfoundry/models/mpt/__init__.py' 2024-06-24T23:58:13,024 adding 'llmfoundry/models/mpt/configuration_mpt.py' 2024-06-24T23:58:13,031 adding 'llmfoundry/models/mpt/modeling_mpt.py' 2024-06-24T23:58:13,033 adding 'llmfoundry/models/utils/__init__.py' 2024-06-24T23:58:13,035 adding 'llmfoundry/models/utils/act_ckpt.py' 2024-06-24T23:58:13,037 adding 'llmfoundry/models/utils/config_defaults.py' 2024-06-24T23:58:13,039 adding 'llmfoundry/models/utils/config_moe_args.py' 2024-06-24T23:58:13,042 adding 'llmfoundry/models/utils/meta_init_context.py' 2024-06-24T23:58:13,044 adding 'llmfoundry/models/utils/mpt_param_count.py' 2024-06-24T23:58:13,047 adding 'llmfoundry/models/utils/param_init_fns.py' 2024-06-24T23:58:13,050 adding 'llmfoundry/optim/__init__.py' 2024-06-24T23:58:13,052 adding 'llmfoundry/optim/adaptive_lion.py' 2024-06-24T23:58:13,054 adding 'llmfoundry/optim/lion.py' 2024-06-24T23:58:13,056 adding 'llmfoundry/optim/outlier_detection.py' 2024-06-24T23:58:13,058 adding 'llmfoundry/optim/scheduler.py' 2024-06-24T23:58:13,061 adding 'llmfoundry/tokenizers/__init__.py' 2024-06-24T23:58:13,063 adding 'llmfoundry/tokenizers/tiktoken.py' 2024-06-24T23:58:13,067 adding 'llmfoundry/utils/__init__.py' 2024-06-24T23:58:13,070 adding 'llmfoundry/utils/builders.py' 2024-06-24T23:58:13,073 adding 'llmfoundry/utils/checkpoint_conversion_helpers.py' 2024-06-24T23:58:13,077 adding 'llmfoundry/utils/config_utils.py' 2024-06-24T23:58:13,079 adding 'llmfoundry/utils/data_prep_utils.py' 2024-06-24T23:58:13,081 adding 'llmfoundry/utils/exceptions.py' 2024-06-24T23:58:13,083 adding 'llmfoundry/utils/huggingface_hub_utils.py' 2024-06-24T23:58:13,085 adding 'llmfoundry/utils/logging_utils.py' 2024-06-24T23:58:13,087 adding 'llmfoundry/utils/model_download_utils.py' 2024-06-24T23:58:13,089 adding 'llmfoundry/utils/mosaicml_logger_utils.py' 2024-06-24T23:58:13,091 adding 'llmfoundry/utils/prompt_files.py' 2024-06-24T23:58:13,093 adding 'llmfoundry/utils/registry_utils.py' 2024-06-24T23:58:13,095 adding 'llmfoundry/utils/warnings.py' 2024-06-24T23:58:13,097 adding 'llm_foundry-0.9.1.dist-info/LICENSE' 2024-06-24T23:58:13,101 adding 'llm_foundry-0.9.1.dist-info/METADATA' 2024-06-24T23:58:13,103 adding 'llm_foundry-0.9.1.dist-info/WHEEL' 2024-06-24T23:58:13,104 adding 'llm_foundry-0.9.1.dist-info/entry_points.txt' 2024-06-24T23:58:13,105 adding 'llm_foundry-0.9.1.dist-info/top_level.txt' 2024-06-24T23:58:13,107 adding 'llm_foundry-0.9.1.dist-info/RECORD' 2024-06-24T23:58:13,126 removing build/bdist.linux-armv7l/wheel 2024-06-24T23:58:13,275 Building wheel for llm-foundry (pyproject.toml): finished with status 'done' 2024-06-24T23:58:13,288 Created wheel for llm-foundry: filename=llm_foundry-0.9.1-py3-none-any.whl size=241129 sha256=b9325253c3df3f92f6e8e2e18959b6a8ddf383fa887c19abf591ff080e99bdb6 2024-06-24T23:58:13,289 Stored in directory: /tmp/pip-ephem-wheel-cache-o2s4hyi_/wheels/a6/32/db/63c6af1b72e9587b6336cf43e556b5974b56743c032388a10e 2024-06-24T23:58:13,317 Successfully built llm-foundry 2024-06-24T23:58:13,332 Removed build tracker: '/tmp/pip-build-tracker-3yg2s_vp'