2024-04-29T01:24:51,087 Created temporary directory: /tmp/pip-build-tracker-_p1bt0qc 2024-04-29T01:24:51,091 Initialized build tracking at /tmp/pip-build-tracker-_p1bt0qc 2024-04-29T01:24:51,091 Created build tracker: /tmp/pip-build-tracker-_p1bt0qc 2024-04-29T01:24:51,092 Entered build tracker: /tmp/pip-build-tracker-_p1bt0qc 2024-04-29T01:24:51,093 Created temporary directory: /tmp/pip-wheel-44km24rc 2024-04-29T01:24:51,104 Created temporary directory: /tmp/pip-ephem-wheel-cache-2kxgv5bt 2024-04-29T01:24:51,163 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-04-29T01:24:51,178 2 location(s) to search for versions of colossalai: 2024-04-29T01:24:51,178 * https://pypi.org/simple/colossalai/ 2024-04-29T01:24:51,178 * https://www.piwheels.org/simple/colossalai/ 2024-04-29T01:24:51,179 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2024-04-29T01:24:51,180 Getting page https://pypi.org/simple/colossalai/ 2024-04-29T01:24:51,184 Found index url https://pypi.org/simple/ 2024-04-29T01:24:51,309 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2024-04-29T01:24:51,321 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2024-04-29T01:24:51,322 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2024-04-29T01:24:51,324 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2024-04-29T01:24:51,325 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2024-04-29T01:24:51,327 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2024-04-29T01:24:51,329 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2024-04-29T01:24:51,330 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2024-04-29T01:24:51,332 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2024-04-29T01:24:51,333 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2024-04-29T01:24:51,335 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2024-04-29T01:24:51,336 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2024-04-29T01:24:51,338 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2024-04-29T01:24:51,340 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2024-04-29T01:24:51,341 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2024-04-29T01:24:51,343 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2024-04-29T01:24:51,344 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2024-04-29T01:24:51,345 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2024-04-29T01:24:51,346 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2024-04-29T01:24:51,347 Getting page https://www.piwheels.org/simple/colossalai/ 2024-04-29T01:24:51,350 Found index url https://www.piwheels.org/simple/ 2024-04-29T01:24:51,534 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2024-04-29T01:24:51,549 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,550 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,551 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,551 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,552 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,552 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,553 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,553 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,554 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,555 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,555 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,556 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,556 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,557 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,557 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,558 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-04-29T01:24:51,559 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2024-04-29T01:24:51,559 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2024-04-29T01:24:51,605 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2024-04-29T01:24:51,641 Collecting colossalai==0.3.7 2024-04-29T01:24:51,646 Created temporary directory: /tmp/pip-unpack-6my0xmnt 2024-04-29T01:24:51,744 Downloading colossalai-0.3.7.tar.gz (1.1 MB) 2024-04-29T01:24:56,864 Added colossalai==0.3.7 from https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz to build tracker '/tmp/pip-build-tracker-_p1bt0qc' 2024-04-29T01:24:56,868 Running setup.py (path:/tmp/pip-wheel-44km24rc/colossalai_0ab717789de64b4f82ebb347c9318db2/setup.py) egg_info for package colossalai 2024-04-29T01:24:56,869 Created temporary directory: /tmp/pip-pip-egg-info-tz4zrdtu 2024-04-29T01:24:56,870 Preparing metadata (setup.py): started 2024-04-29T01:24:56,872 Running command python setup.py egg_info 2024-04-29T01:25:00,100 running egg_info 2024-04-29T01:25:00,102 creating /tmp/pip-pip-egg-info-tz4zrdtu/colossalai.egg-info 2024-04-29T01:25:00,165 writing /tmp/pip-pip-egg-info-tz4zrdtu/colossalai.egg-info/PKG-INFO 2024-04-29T01:25:00,172 writing dependency_links to /tmp/pip-pip-egg-info-tz4zrdtu/colossalai.egg-info/dependency_links.txt 2024-04-29T01:25:00,175 writing entry points to /tmp/pip-pip-egg-info-tz4zrdtu/colossalai.egg-info/entry_points.txt 2024-04-29T01:25:00,178 writing requirements to /tmp/pip-pip-egg-info-tz4zrdtu/colossalai.egg-info/requires.txt 2024-04-29T01:25:00,181 writing top-level names to /tmp/pip-pip-egg-info-tz4zrdtu/colossalai.egg-info/top_level.txt 2024-04-29T01:25:00,184 writing manifest file '/tmp/pip-pip-egg-info-tz4zrdtu/colossalai.egg-info/SOURCES.txt' 2024-04-29T01:25:00,704 reading manifest file '/tmp/pip-pip-egg-info-tz4zrdtu/colossalai.egg-info/SOURCES.txt' 2024-04-29T01:25:00,708 reading manifest template 'MANIFEST.in' 2024-04-29T01:25:03,847 warning: no files found matching '*.tr' under directory 'colossalai' 2024-04-29T01:25:05,282 warning: no files found matching '*.cc' under directory 'colossalai' 2024-04-29T01:25:06,013 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-04-29T01:25:06,230 warning: no files found matching '*.tr' under directory 'extensions' 2024-04-29T01:25:06,317 warning: no files found matching '*.cc' under directory 'extensions' 2024-04-29T01:25:06,359 warning: no files found matching '*.pyi' under directory 'extensions' 2024-04-29T01:25:06,359 adding license file 'LICENSE' 2024-04-29T01:25:06,461 writing manifest file '/tmp/pip-pip-egg-info-tz4zrdtu/colossalai.egg-info/SOURCES.txt' 2024-04-29T01:25:06,645 Preparing metadata (setup.py): finished with status 'done' 2024-04-29T01:25:06,666 Source in /tmp/pip-wheel-44km24rc/colossalai_0ab717789de64b4f82ebb347c9318db2 has version 0.3.7, which satisfies requirement colossalai==0.3.7 from https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz 2024-04-29T01:25:06,668 Removed colossalai==0.3.7 from https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz from build tracker '/tmp/pip-build-tracker-_p1bt0qc' 2024-04-29T01:25:06,692 Created temporary directory: /tmp/pip-unpack-r414jaf5 2024-04-29T01:25:06,694 Created temporary directory: /tmp/pip-unpack-t7_r2u15 2024-04-29T01:25:06,746 Building wheels for collected packages: colossalai 2024-04-29T01:25:06,755 Created temporary directory: /tmp/pip-wheel-838jxzqo 2024-04-29T01:25:06,756 Building wheel for colossalai (setup.py): started 2024-04-29T01:25:06,758 Destination directory: /tmp/pip-wheel-838jxzqo 2024-04-29T01:25:06,758 Running command python setup.py bdist_wheel 2024-04-29T01:25:09,867 running bdist_wheel 2024-04-29T01:25:10,055 running build 2024-04-29T01:25:10,056 running build_py 2024-04-29T01:25:10,125 creating build 2024-04-29T01:25:10,126 creating build/lib 2024-04-29T01:25:10,127 creating build/lib/colossalai 2024-04-29T01:25:10,130 copying colossalai/__init__.py -> build/lib/colossalai 2024-04-29T01:25:10,133 copying colossalai/version.py -> build/lib/colossalai 2024-04-29T01:25:10,136 copying colossalai/initialize.py -> build/lib/colossalai 2024-04-29T01:25:10,143 creating build/lib/extensions 2024-04-29T01:25:10,143 creating build/lib/extensions/softmax 2024-04-29T01:25:10,146 copying extensions/softmax/__init__.py -> build/lib/extensions/softmax 2024-04-29T01:25:10,149 copying extensions/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/softmax 2024-04-29T01:25:10,153 copying extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/softmax 2024-04-29T01:25:10,157 creating build/lib/extensions/layernorm 2024-04-29T01:25:10,159 copying extensions/layernorm/__init__.py -> build/lib/extensions/layernorm 2024-04-29T01:25:10,162 copying extensions/layernorm/layernorm_cuda.py -> build/lib/extensions/layernorm 2024-04-29T01:25:10,167 creating build/lib/extensions/cpu_adam 2024-04-29T01:25:10,169 copying extensions/cpu_adam/__init__.py -> build/lib/extensions/cpu_adam 2024-04-29T01:25:10,172 copying extensions/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/cpu_adam 2024-04-29T01:25:10,176 copying extensions/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/cpu_adam 2024-04-29T01:25:10,181 creating build/lib/extensions/moe 2024-04-29T01:25:10,183 copying extensions/moe/__init__.py -> build/lib/extensions/moe 2024-04-29T01:25:10,186 copying extensions/moe/moe_cuda.py -> build/lib/extensions/moe 2024-04-29T01:25:10,191 creating build/lib/extensions/csrc 2024-04-29T01:25:10,193 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2024-04-29T01:25:10,196 copying extensions/csrc/scaled_softmax.py -> build/lib/extensions/csrc 2024-04-29T01:25:10,202 creating build/lib/extensions/flash_attention 2024-04-29T01:25:10,204 copying extensions/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/flash_attention 2024-04-29T01:25:10,207 copying extensions/flash_attention/__init__.py -> build/lib/extensions/flash_attention 2024-04-29T01:25:10,211 copying extensions/flash_attention/flash_attention_npu.py -> build/lib/extensions/flash_attention 2024-04-29T01:25:10,214 copying extensions/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/flash_attention 2024-04-29T01:25:10,219 creating build/lib/extensions/optimizer 2024-04-29T01:25:10,221 copying extensions/optimizer/__init__.py -> build/lib/extensions/optimizer 2024-04-29T01:25:10,224 copying extensions/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/optimizer 2024-04-29T01:25:10,229 creating build/lib/colossalai/nn 2024-04-29T01:25:10,231 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2024-04-29T01:25:10,235 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2024-04-29T01:25:10,241 creating build/lib/colossalai/checkpoint_io 2024-04-29T01:25:10,243 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-04-29T01:25:10,247 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2024-04-29T01:25:10,253 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2024-04-29T01:25:10,257 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2024-04-29T01:25:10,262 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-04-29T01:25:10,268 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2024-04-29T01:25:10,273 creating build/lib/colossalai/auto_parallel 2024-04-29T01:25:10,275 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2024-04-29T01:25:10,279 creating build/lib/colossalai/kernel 2024-04-29T01:25:10,281 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2024-04-29T01:25:10,284 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2024-04-29T01:25:10,289 creating build/lib/colossalai/shardformer 2024-04-29T01:25:10,291 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2024-04-29T01:25:10,294 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2024-04-29T01:25:10,300 creating build/lib/colossalai/accelerator 2024-04-29T01:25:10,301 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2024-04-29T01:25:10,306 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2024-04-29T01:25:10,309 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2024-04-29T01:25:10,314 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2024-04-29T01:25:10,317 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2024-04-29T01:25:10,321 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2024-04-29T01:25:10,328 creating build/lib/colossalai/testing 2024-04-29T01:25:10,330 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2024-04-29T01:25:10,334 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2024-04-29T01:25:10,338 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2024-04-29T01:25:10,343 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2024-04-29T01:25:10,347 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2024-04-29T01:25:10,352 creating build/lib/colossalai/pipeline 2024-04-29T01:25:10,354 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2024-04-29T01:25:10,359 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2024-04-29T01:25:10,363 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2024-04-29T01:25:10,369 creating build/lib/colossalai/fx 2024-04-29T01:25:10,370 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2024-04-29T01:25:10,375 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2024-04-29T01:25:10,378 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2024-04-29T01:25:10,382 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2024-04-29T01:25:10,385 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2024-04-29T01:25:10,390 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2024-04-29T01:25:10,395 creating build/lib/colossalai/device 2024-04-29T01:25:10,397 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2024-04-29T01:25:10,401 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2024-04-29T01:25:10,405 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2024-04-29T01:25:10,409 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2024-04-29T01:25:10,416 creating build/lib/colossalai/inference 2024-04-29T01:25:10,417 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2024-04-29T01:25:10,424 creating build/lib/colossalai/tensor 2024-04-29T01:25:10,426 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2024-04-29T01:25:10,430 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2024-04-29T01:25:10,434 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2024-04-29T01:25:10,438 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2024-04-29T01:25:10,443 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2024-04-29T01:25:10,448 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2024-04-29T01:25:10,453 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2024-04-29T01:25:10,458 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2024-04-29T01:25:10,684 creating build/lib/colossalai/moe 2024-04-29T01:25:10,687 copying colossalai/moe/loss.py -> build/lib/colossalai/moe 2024-04-29T01:25:10,691 copying colossalai/moe/manager.py -> build/lib/colossalai/moe 2024-04-29T01:25:10,697 copying colossalai/moe/layers.py -> build/lib/colossalai/moe 2024-04-29T01:25:10,702 copying colossalai/moe/utils.py -> build/lib/colossalai/moe 2024-04-29T01:25:10,707 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2024-04-29T01:25:10,712 copying colossalai/moe/load_balance.py -> build/lib/colossalai/moe 2024-04-29T01:25:10,719 copying colossalai/moe/routers.py -> build/lib/colossalai/moe 2024-04-29T01:25:10,726 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2024-04-29T01:25:10,731 copying colossalai/moe/experts.py -> build/lib/colossalai/moe 2024-04-29T01:25:10,735 copying colossalai/moe/checkpoint.py -> build/lib/colossalai/moe 2024-04-29T01:25:10,745 creating build/lib/colossalai/legacy 2024-04-29T01:25:10,746 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2024-04-29T01:25:10,750 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2024-04-29T01:25:10,754 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2024-04-29T01:25:10,758 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2024-04-29T01:25:10,762 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2024-04-29T01:25:10,770 creating build/lib/colossalai/lazy 2024-04-29T01:25:10,772 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2024-04-29T01:25:10,778 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2024-04-29T01:25:10,782 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2024-04-29T01:25:10,787 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2024-04-29T01:25:10,794 creating build/lib/colossalai/context 2024-04-29T01:25:10,796 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2024-04-29T01:25:10,801 copying colossalai/context/config.py -> build/lib/colossalai/context 2024-04-29T01:25:10,805 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2024-04-29T01:25:10,811 creating build/lib/colossalai/booster 2024-04-29T01:25:10,814 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2024-04-29T01:25:10,818 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2024-04-29T01:25:10,822 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2024-04-29T01:25:10,830 creating build/lib/colossalai/cluster 2024-04-29T01:25:10,833 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2024-04-29T01:25:10,838 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2024-04-29T01:25:10,842 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2024-04-29T01:25:10,847 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2024-04-29T01:25:10,852 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2024-04-29T01:25:10,858 creating build/lib/colossalai/interface 2024-04-29T01:25:10,861 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2024-04-29T01:25:10,865 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2024-04-29T01:25:10,869 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2024-04-29T01:25:10,873 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2024-04-29T01:25:10,880 creating build/lib/colossalai/logging 2024-04-29T01:25:10,883 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2024-04-29T01:25:10,888 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2024-04-29T01:25:10,893 creating build/lib/colossalai/amp 2024-04-29T01:25:10,895 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2024-04-29T01:25:10,900 creating build/lib/colossalai/cli 2024-04-29T01:25:10,903 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2024-04-29T01:25:10,907 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2024-04-29T01:25:10,912 creating build/lib/colossalai/_analyzer 2024-04-29T01:25:10,914 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2024-04-29T01:25:10,918 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2024-04-29T01:25:10,923 creating build/lib/colossalai/_C 2024-04-29T01:25:10,926 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2024-04-29T01:25:10,931 creating build/lib/colossalai/zero 2024-04-29T01:25:10,933 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2024-04-29T01:25:10,937 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2024-04-29T01:25:10,944 creating build/lib/colossalai/utils 2024-04-29T01:25:10,945 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2024-04-29T01:25:10,949 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2024-04-29T01:25:10,954 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2024-04-29T01:25:10,957 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2024-04-29T01:25:10,962 creating build/lib/colossalai/nn/loss 2024-04-29T01:25:10,964 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2024-04-29T01:25:10,969 creating build/lib/colossalai/nn/lr_scheduler 2024-04-29T01:25:10,972 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2024-04-29T01:25:10,978 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2024-04-29T01:25:10,982 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2024-04-29T01:25:10,986 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2024-04-29T01:25:10,991 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2024-04-29T01:25:10,995 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2024-04-29T01:25:10,999 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2024-04-29T01:25:11,005 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2024-04-29T01:25:11,011 creating build/lib/colossalai/nn/layer 2024-04-29T01:25:11,013 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2024-04-29T01:25:11,016 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2024-04-29T01:25:11,020 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2024-04-29T01:25:11,024 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2024-04-29T01:25:11,030 creating build/lib/colossalai/nn/optimizer 2024-04-29T01:25:11,032 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2024-04-29T01:25:11,037 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2024-04-29T01:25:11,042 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2024-04-29T01:25:11,045 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2024-04-29T01:25:11,049 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2024-04-29T01:25:11,053 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2024-04-29T01:25:11,057 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2024-04-29T01:25:11,062 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2024-04-29T01:25:11,066 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2024-04-29T01:25:11,073 creating build/lib/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:11,075 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:11,080 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:11,083 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:11,088 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:11,092 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:11,095 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:11,101 creating build/lib/colossalai/auto_parallel/offload 2024-04-29T01:25:11,103 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2024-04-29T01:25:11,108 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2024-04-29T01:25:11,111 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2024-04-29T01:25:11,117 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2024-04-29T01:25:11,121 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2024-04-29T01:25:11,125 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2024-04-29T01:25:11,129 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2024-04-29T01:25:11,134 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2024-04-29T01:25:11,138 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2024-04-29T01:25:11,142 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2024-04-29T01:25:11,147 creating build/lib/colossalai/auto_parallel/tensor_shard 2024-04-29T01:25:11,149 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-04-29T01:25:11,153 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-04-29T01:25:11,156 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-04-29T01:25:11,160 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-04-29T01:25:11,164 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-04-29T01:25:11,171 creating build/lib/colossalai/auto_parallel/passes 2024-04-29T01:25:11,173 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-04-29T01:25:11,177 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2024-04-29T01:25:11,180 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2024-04-29T01:25:11,183 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2024-04-29T01:25:11,187 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-04-29T01:25:11,192 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-04-29T01:25:11,198 creating build/lib/colossalai/auto_parallel/meta_profiler 2024-04-29T01:25:11,200 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-04-29T01:25:11,204 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-04-29T01:25:11,207 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-04-29T01:25:11,210 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-04-29T01:25:11,215 creating build/lib/colossalai/auto_parallel/pipeline_shard 2024-04-29T01:25:11,217 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2024-04-29T01:25:11,225 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,227 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,231 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,234 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,238 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,242 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,245 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,249 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,253 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,257 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,260 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,264 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,269 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,273 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,277 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,282 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,287 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,291 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,295 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,300 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,304 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,308 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,312 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,318 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,321 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,325 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,328 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,332 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:11,337 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-04-29T01:25:11,339 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-04-29T01:25:11,343 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-04-29T01:25:11,349 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-04-29T01:25:11,353 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-04-29T01:25:11,359 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-04-29T01:25:11,366 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:11,369 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:11,374 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:11,378 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:11,382 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:11,386 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:11,391 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:11,399 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,401 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,406 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,411 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,416 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,420 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,424 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,430 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,434 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,439 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,445 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,450 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,454 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,458 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,462 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,467 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,471 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,476 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,481 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,485 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:11,492 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:11,494 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:11,498 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:11,502 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:11,505 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:11,511 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:11,515 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:11,519 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:11,523 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:11,526 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:11,531 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:11,536 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:11,542 creating build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,544 copying colossalai/kernel/triton/token_attention_kernel.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,549 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,553 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,556 copying colossalai/kernel/triton/fused_layernorm.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,561 copying colossalai/kernel/triton/copy_kv_cache_dest.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,565 copying colossalai/kernel/triton/self_attention_nofusion.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,569 copying colossalai/kernel/triton/context_attention.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,574 copying colossalai/kernel/triton/smooth_attention.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,580 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,584 copying colossalai/kernel/triton/custom_autotune.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,589 copying colossalai/kernel/triton/gptq_triton.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,594 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,598 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,602 copying colossalai/kernel/triton/int8_rotary_embedding_kernel.py -> build/lib/colossalai/kernel/triton 2024-04-29T01:25:11,607 creating build/lib/colossalai/kernel/extensions 2024-04-29T01:25:11,609 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2024-04-29T01:25:11,614 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2024-04-29T01:25:11,618 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2024-04-29T01:25:11,622 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2024-04-29T01:25:11,626 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2024-04-29T01:25:11,630 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2024-04-29T01:25:11,638 creating build/lib/colossalai/kernel/jit 2024-04-29T01:25:11,640 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2024-04-29T01:25:11,645 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2024-04-29T01:25:11,653 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2024-04-29T01:25:11,657 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2024-04-29T01:25:11,663 creating build/lib/colossalai/kernel/extensions/softmax 2024-04-29T01:25:11,664 copying colossalai/kernel/extensions/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/softmax 2024-04-29T01:25:11,668 copying colossalai/kernel/extensions/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/softmax 2024-04-29T01:25:11,672 copying colossalai/kernel/extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/softmax 2024-04-29T01:25:11,677 creating build/lib/colossalai/kernel/extensions/layernorm 2024-04-29T01:25:11,679 copying colossalai/kernel/extensions/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/layernorm 2024-04-29T01:25:11,683 copying colossalai/kernel/extensions/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/layernorm 2024-04-29T01:25:11,688 creating build/lib/colossalai/kernel/extensions/cpu_adam 2024-04-29T01:25:11,690 copying colossalai/kernel/extensions/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/cpu_adam 2024-04-29T01:25:11,694 copying colossalai/kernel/extensions/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/cpu_adam 2024-04-29T01:25:11,697 copying colossalai/kernel/extensions/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/cpu_adam 2024-04-29T01:25:11,702 creating build/lib/colossalai/kernel/extensions/moe 2024-04-29T01:25:11,704 copying colossalai/kernel/extensions/moe/__init__.py -> build/lib/colossalai/kernel/extensions/moe 2024-04-29T01:25:11,708 copying colossalai/kernel/extensions/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/moe 2024-04-29T01:25:11,713 creating build/lib/colossalai/kernel/extensions/csrc 2024-04-29T01:25:11,714 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2024-04-29T01:25:11,719 copying colossalai/kernel/extensions/csrc/scaled_softmax.py -> build/lib/colossalai/kernel/extensions/csrc 2024-04-29T01:25:11,725 creating build/lib/colossalai/kernel/extensions/flash_attention 2024-04-29T01:25:11,727 copying colossalai/kernel/extensions/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/flash_attention 2024-04-29T01:25:11,731 copying colossalai/kernel/extensions/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/flash_attention 2024-04-29T01:25:11,735 copying colossalai/kernel/extensions/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/flash_attention 2024-04-29T01:25:11,738 copying colossalai/kernel/extensions/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/flash_attention 2024-04-29T01:25:11,744 creating build/lib/colossalai/kernel/extensions/optimizer 2024-04-29T01:25:11,745 copying colossalai/kernel/extensions/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/optimizer 2024-04-29T01:25:11,750 copying colossalai/kernel/extensions/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/optimizer 2024-04-29T01:25:11,755 creating build/lib/colossalai/shardformer/shard 2024-04-29T01:25:11,757 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2024-04-29T01:25:11,762 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2024-04-29T01:25:11,766 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2024-04-29T01:25:11,770 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2024-04-29T01:25:11,773 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2024-04-29T01:25:11,777 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2024-04-29T01:25:11,785 creating build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,787 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,792 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,796 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,800 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,804 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,809 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,814 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,820 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,825 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,831 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,836 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,841 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,846 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,851 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,857 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,863 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,868 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2024-04-29T01:25:11,877 creating build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,880 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,886 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,891 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,896 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,903 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,911 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,918 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,926 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,933 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,940 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,946 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,952 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,960 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,967 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,973 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,978 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2024-04-29T01:25:11,984 creating build/lib/colossalai/shardformer/layer 2024-04-29T01:25:11,986 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2024-04-29T01:25:11,991 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2024-04-29T01:25:11,995 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2024-04-29T01:25:11,999 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2024-04-29T01:25:12,005 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2024-04-29T01:25:12,011 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2024-04-29T01:25:12,016 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2024-04-29T01:25:12,022 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2024-04-29T01:25:12,027 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2024-04-29T01:25:12,033 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2024-04-29T01:25:12,037 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2024-04-29T01:25:12,044 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-04-29T01:25:12,046 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-04-29T01:25:12,053 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-04-29T01:25:12,057 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-04-29T01:25:12,062 creating build/lib/colossalai/pipeline/schedule 2024-04-29T01:25:12,064 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2024-04-29T01:25:12,068 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2024-04-29T01:25:12,072 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2024-04-29T01:25:12,077 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2024-04-29T01:25:12,082 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2024-04-29T01:25:12,086 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2024-04-29T01:25:12,093 creating build/lib/colossalai/fx/passes 2024-04-29T01:25:12,095 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2024-04-29T01:25:12,100 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2024-04-29T01:25:12,104 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2024-04-29T01:25:12,108 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2024-04-29T01:25:12,113 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2024-04-29T01:25:12,118 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2024-04-29T01:25:12,122 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2024-04-29T01:25:12,127 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2024-04-29T01:25:12,133 creating build/lib/colossalai/fx/codegen 2024-04-29T01:25:12,134 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2024-04-29T01:25:12,138 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2024-04-29T01:25:12,147 creating build/lib/colossalai/fx/profiler 2024-04-29T01:25:12,149 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2024-04-29T01:25:12,153 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2024-04-29T01:25:12,158 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2024-04-29T01:25:12,162 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2024-04-29T01:25:12,166 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2024-04-29T01:25:12,170 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2024-04-29T01:25:12,175 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2024-04-29T01:25:12,179 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2024-04-29T01:25:12,185 creating build/lib/colossalai/fx/tracer 2024-04-29T01:25:12,186 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2024-04-29T01:25:12,190 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2024-04-29T01:25:12,194 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2024-04-29T01:25:12,198 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2024-04-29T01:25:12,203 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2024-04-29T01:25:12,208 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2024-04-29T01:25:12,212 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2024-04-29T01:25:12,221 creating build/lib/colossalai/fx/profiler/experimental 2024-04-29T01:25:12,222 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2024-04-29T01:25:12,227 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2024-04-29T01:25:12,230 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2024-04-29T01:25:12,234 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2024-04-29T01:25:12,238 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2024-04-29T01:25:12,244 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:12,246 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:12,250 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:12,254 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:12,257 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:12,261 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:12,265 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:12,269 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:12,273 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:12,277 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:12,283 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:12,285 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:12,289 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:12,293 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:12,296 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:12,300 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:12,304 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:12,307 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:12,313 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:12,316 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:12,320 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:12,323 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:12,328 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2024-04-29T01:25:12,330 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2024-04-29T01:25:12,335 creating build/lib/colossalai/fx/tracer/meta_patch 2024-04-29T01:25:12,336 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2024-04-29T01:25:12,342 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-04-29T01:25:12,344 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-04-29T01:25:12,348 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-04-29T01:25:12,352 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-04-29T01:25:12,357 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-04-29T01:25:12,360 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-04-29T01:25:12,365 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-04-29T01:25:12,367 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-04-29T01:25:12,372 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-04-29T01:25:12,376 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-04-29T01:25:12,379 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-04-29T01:25:12,385 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:12,387 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:12,391 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:12,394 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:12,398 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:12,402 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:12,406 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:12,410 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:12,414 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:12,421 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:12,422 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:12,426 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:12,430 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:12,434 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:12,438 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:12,441 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:12,446 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:12,449 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:12,455 creating build/lib/colossalai/inference/quant 2024-04-29T01:25:12,457 copying colossalai/inference/quant/__init__.py -> build/lib/colossalai/inference/quant 2024-04-29T01:25:12,462 creating build/lib/colossalai/inference/kv_cache 2024-04-29T01:25:12,464 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2024-04-29T01:25:12,467 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2024-04-29T01:25:12,472 copying colossalai/inference/kv_cache/batch_infer_state.py -> build/lib/colossalai/inference/kv_cache 2024-04-29T01:25:12,477 creating build/lib/colossalai/inference/engine 2024-04-29T01:25:12,479 copying colossalai/inference/engine/__init__.py -> build/lib/colossalai/inference/engine 2024-04-29T01:25:12,483 copying colossalai/inference/engine/engine.py -> build/lib/colossalai/inference/engine 2024-04-29T01:25:12,487 copying colossalai/inference/engine/microbatch_manager.py -> build/lib/colossalai/inference/engine 2024-04-29T01:25:12,493 creating build/lib/colossalai/inference/quant/gptq 2024-04-29T01:25:12,494 copying colossalai/inference/quant/gptq/__init__.py -> build/lib/colossalai/inference/quant/gptq 2024-04-29T01:25:12,498 copying colossalai/inference/quant/gptq/gptq_manager.py -> build/lib/colossalai/inference/quant/gptq 2024-04-29T01:25:12,503 creating build/lib/colossalai/inference/quant/smoothquant 2024-04-29T01:25:12,505 copying colossalai/inference/quant/smoothquant/__init__.py -> build/lib/colossalai/inference/quant/smoothquant 2024-04-29T01:25:12,509 creating build/lib/colossalai/inference/quant/gptq/cai_gptq 2024-04-29T01:25:12,511 copying colossalai/inference/quant/gptq/cai_gptq/__init__.py -> build/lib/colossalai/inference/quant/gptq/cai_gptq 2024-04-29T01:25:12,515 copying colossalai/inference/quant/gptq/cai_gptq/gptq_op.py -> build/lib/colossalai/inference/quant/gptq/cai_gptq 2024-04-29T01:25:12,518 copying colossalai/inference/quant/gptq/cai_gptq/cai_quant_linear.py -> build/lib/colossalai/inference/quant/gptq/cai_gptq 2024-04-29T01:25:12,525 creating build/lib/colossalai/inference/quant/smoothquant/models 2024-04-29T01:25:12,527 copying colossalai/inference/quant/smoothquant/models/__init__.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-04-29T01:25:12,531 copying colossalai/inference/quant/smoothquant/models/base_model.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-04-29T01:25:12,536 copying colossalai/inference/quant/smoothquant/models/parallel_linear.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-04-29T01:25:12,541 copying colossalai/inference/quant/smoothquant/models/llama.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-04-29T01:25:12,547 copying colossalai/inference/quant/smoothquant/models/linear.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-04-29T01:25:12,553 creating build/lib/colossalai/inference/engine/policies 2024-04-29T01:25:12,554 copying colossalai/inference/engine/policies/__init__.py -> build/lib/colossalai/inference/engine/policies 2024-04-29T01:25:12,558 copying colossalai/inference/engine/policies/bloom.py -> build/lib/colossalai/inference/engine/policies 2024-04-29T01:25:12,563 copying colossalai/inference/engine/policies/llama.py -> build/lib/colossalai/inference/engine/policies 2024-04-29T01:25:12,567 copying colossalai/inference/engine/policies/chatglm2.py -> build/lib/colossalai/inference/engine/policies 2024-04-29T01:25:12,572 creating build/lib/colossalai/inference/engine/modeling 2024-04-29T01:25:12,574 copying colossalai/inference/engine/modeling/_utils.py -> build/lib/colossalai/inference/engine/modeling 2024-04-29T01:25:12,578 copying colossalai/inference/engine/modeling/__init__.py -> build/lib/colossalai/inference/engine/modeling 2024-04-29T01:25:12,582 copying colossalai/inference/engine/modeling/bloom.py -> build/lib/colossalai/inference/engine/modeling 2024-04-29T01:25:12,587 copying colossalai/inference/engine/modeling/llama.py -> build/lib/colossalai/inference/engine/modeling 2024-04-29T01:25:12,592 copying colossalai/inference/engine/modeling/chatglm2.py -> build/lib/colossalai/inference/engine/modeling 2024-04-29T01:25:12,599 creating build/lib/colossalai/tensor/d_tensor 2024-04-29T01:25:12,601 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2024-04-29T01:25:12,605 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2024-04-29T01:25:12,609 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2024-04-29T01:25:12,612 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-04-29T01:25:12,617 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2024-04-29T01:25:12,621 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2024-04-29T01:25:12,626 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2024-04-29T01:25:12,631 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-04-29T01:25:12,637 creating build/lib/colossalai/tensor/padded_tensor 2024-04-29T01:25:12,638 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2024-04-29T01:25:12,642 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2024-04-29T01:25:12,647 creating build/lib/colossalai/tensor/moe_tensor 2024-04-29T01:25:12,649 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2024-04-29T01:25:12,652 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2024-04-29T01:25:12,656 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2024-04-29T01:25:12,661 creating build/lib/colossalai/legacy/nn 2024-04-29T01:25:12,662 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2024-04-29T01:25:12,667 creating build/lib/colossalai/legacy/registry 2024-04-29T01:25:12,669 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2024-04-29T01:25:12,673 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2024-04-29T01:25:12,678 creating build/lib/colossalai/legacy/builder 2024-04-29T01:25:12,680 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2024-04-29T01:25:12,684 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2024-04-29T01:25:12,689 creating build/lib/colossalai/legacy/pipeline 2024-04-29T01:25:12,691 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2024-04-29T01:25:12,695 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2024-04-29T01:25:12,700 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2024-04-29T01:25:12,704 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2024-04-29T01:25:12,707 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2024-04-29T01:25:12,712 creating build/lib/colossalai/legacy/inference 2024-04-29T01:25:12,714 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2024-04-29T01:25:12,719 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2024-04-29T01:25:12,723 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2024-04-29T01:25:12,727 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2024-04-29T01:25:12,733 creating build/lib/colossalai/legacy/tensor 2024-04-29T01:25:12,735 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2024-04-29T01:25:12,740 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2024-04-29T01:25:12,744 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2024-04-29T01:25:12,747 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2024-04-29T01:25:12,751 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2024-04-29T01:25:12,755 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2024-04-29T01:25:12,759 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2024-04-29T01:25:12,762 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2024-04-29T01:25:12,767 creating build/lib/colossalai/legacy/context 2024-04-29T01:25:12,769 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2024-04-29T01:25:12,773 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2024-04-29T01:25:12,778 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2024-04-29T01:25:12,783 creating build/lib/colossalai/legacy/engine 2024-04-29T01:25:12,785 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2024-04-29T01:25:12,788 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2024-04-29T01:25:12,794 creating build/lib/colossalai/legacy/amp 2024-04-29T01:25:12,796 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2024-04-29T01:25:12,800 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2024-04-29T01:25:12,805 creating build/lib/colossalai/legacy/communication 2024-04-29T01:25:12,807 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2024-04-29T01:25:12,812 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2024-04-29T01:25:12,816 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2024-04-29T01:25:12,819 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2024-04-29T01:25:12,825 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2024-04-29T01:25:12,828 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2024-04-29T01:25:12,834 creating build/lib/colossalai/legacy/trainer 2024-04-29T01:25:12,836 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2024-04-29T01:25:12,839 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2024-04-29T01:25:12,845 creating build/lib/colossalai/legacy/zero 2024-04-29T01:25:12,847 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2024-04-29T01:25:12,852 creating build/lib/colossalai/legacy/utils 2024-04-29T01:25:12,854 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2024-04-29T01:25:12,859 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2024-04-29T01:25:12,862 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2024-04-29T01:25:12,867 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2024-04-29T01:25:12,871 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2024-04-29T01:25:12,878 creating build/lib/colossalai/legacy/nn/loss 2024-04-29T01:25:12,879 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2024-04-29T01:25:12,883 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2024-04-29T01:25:12,889 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2024-04-29T01:25:12,894 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2024-04-29T01:25:12,898 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2024-04-29T01:25:12,904 creating build/lib/colossalai/legacy/nn/_ops 2024-04-29T01:25:12,906 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2024-04-29T01:25:12,910 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2024-04-29T01:25:12,915 creating build/lib/colossalai/legacy/nn/metric 2024-04-29T01:25:12,917 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2024-04-29T01:25:12,921 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2024-04-29T01:25:12,924 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2024-04-29T01:25:12,928 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2024-04-29T01:25:12,932 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2024-04-29T01:25:12,937 creating build/lib/colossalai/legacy/nn/parallel 2024-04-29T01:25:12,939 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2024-04-29T01:25:12,943 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2024-04-29T01:25:12,946 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2024-04-29T01:25:12,952 creating build/lib/colossalai/legacy/nn/layer 2024-04-29T01:25:12,953 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2024-04-29T01:25:12,957 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2024-04-29T01:25:12,963 creating build/lib/colossalai/legacy/nn/parallel/layers 2024-04-29T01:25:12,964 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-04-29T01:25:12,968 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-04-29T01:25:12,973 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-04-29T01:25:12,976 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-04-29T01:25:12,980 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-04-29T01:25:12,986 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:12,988 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:12,993 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:12,996 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:13,000 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:13,004 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:13,008 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:13,013 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:13,018 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:13,023 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:13,028 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-04-29T01:25:13,031 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-04-29T01:25:13,038 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-04-29T01:25:13,041 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-04-29T01:25:13,045 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-04-29T01:25:13,052 creating build/lib/colossalai/legacy/nn/layer/wrapper 2024-04-29T01:25:13,053 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-04-29T01:25:13,057 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-04-29T01:25:13,063 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:13,065 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:13,069 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:13,073 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:13,077 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:13,081 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:13,085 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:13,090 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-04-29T01:25:13,092 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-04-29T01:25:13,099 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-04-29T01:25:13,103 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-04-29T01:25:13,106 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-04-29T01:25:13,112 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-04-29T01:25:13,114 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-04-29T01:25:13,121 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-04-29T01:25:13,124 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-04-29T01:25:13,128 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-04-29T01:25:13,134 creating build/lib/colossalai/legacy/nn/layer/vanilla 2024-04-29T01:25:13,136 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-04-29T01:25:13,141 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-04-29T01:25:13,146 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-04-29T01:25:13,148 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-04-29T01:25:13,155 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-04-29T01:25:13,158 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-04-29T01:25:13,162 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-04-29T01:25:13,170 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-04-29T01:25:13,172 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-04-29T01:25:13,178 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-04-29T01:25:13,181 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-04-29T01:25:13,185 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-04-29T01:25:13,190 creating build/lib/colossalai/legacy/nn/layer/utils 2024-04-29T01:25:13,240 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-04-29T01:25:13,244 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-04-29T01:25:13,250 creating build/lib/colossalai/legacy/pipeline/middleware 2024-04-29T01:25:13,252 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-04-29T01:25:13,256 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-04-29T01:25:13,263 creating build/lib/colossalai/legacy/pipeline/rpc 2024-04-29T01:25:13,265 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-04-29T01:25:13,270 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-04-29T01:25:13,315 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-04-29T01:25:13,321 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-04-29T01:25:13,330 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-04-29T01:25:13,332 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-04-29T01:25:13,336 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-04-29T01:25:13,344 creating build/lib/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:13,346 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:13,350 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:13,354 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:13,360 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:13,365 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:13,370 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:13,375 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:13,379 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:13,383 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:13,390 creating build/lib/colossalai/legacy/inference/tensor_parallel 2024-04-29T01:25:13,392 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-04-29T01:25:13,397 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-04-29T01:25:13,402 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-04-29T01:25:13,409 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-04-29T01:25:13,463 creating build/lib/colossalai/legacy/inference/pipeline 2024-04-29T01:25:13,464 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2024-04-29T01:25:13,468 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2024-04-29T01:25:13,474 creating build/lib/colossalai/legacy/inference/hybridengine 2024-04-29T01:25:13,476 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-04-29T01:25:13,480 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-04-29T01:25:13,485 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-04-29T01:25:13,487 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-04-29T01:25:13,491 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-04-29T01:25:13,495 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-04-29T01:25:13,500 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-04-29T01:25:13,505 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-04-29T01:25:13,507 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-04-29T01:25:13,511 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-04-29T01:25:13,514 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-04-29T01:25:13,558 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-04-29T01:25:13,563 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-04-29T01:25:13,570 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-04-29T01:25:13,571 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-04-29T01:25:13,575 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-04-29T01:25:13,579 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-04-29T01:25:13,586 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2024-04-29T01:25:13,587 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-04-29T01:25:13,591 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-04-29T01:25:13,599 creating build/lib/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:13,601 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:13,605 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:13,609 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:13,612 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:13,617 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:13,621 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:13,626 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:13,631 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:13,636 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:13,640 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:13,646 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:13,651 creating build/lib/colossalai/legacy/context/random 2024-04-29T01:25:13,653 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2024-04-29T01:25:13,657 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2024-04-29T01:25:13,661 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2024-04-29T01:25:13,667 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2024-04-29T01:25:13,669 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-04-29T01:25:13,674 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-04-29T01:25:13,682 creating build/lib/colossalai/legacy/engine/schedule 2024-04-29T01:25:13,684 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2024-04-29T01:25:13,689 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2024-04-29T01:25:13,694 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-04-29T01:25:13,700 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-04-29T01:25:13,705 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-04-29T01:25:13,711 creating build/lib/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:13,713 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:13,717 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:13,721 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:13,724 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:13,728 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:13,732 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:13,735 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:13,739 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:13,744 creating build/lib/colossalai/legacy/amp/torch_amp 2024-04-29T01:25:13,746 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-04-29T01:25:13,750 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-04-29T01:25:13,756 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-04-29T01:25:13,765 creating build/lib/colossalai/legacy/amp/naive_amp 2024-04-29T01:25:13,767 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-04-29T01:25:13,771 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-04-29T01:25:13,775 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-04-29T01:25:13,780 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-04-29T01:25:13,787 creating build/lib/colossalai/legacy/amp/apex_amp 2024-04-29T01:25:13,793 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-04-29T01:25:13,797 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-04-29T01:25:13,803 creating build/lib/colossalai/legacy/trainer/hooks 2024-04-29T01:25:13,805 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-04-29T01:25:13,808 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2024-04-29T01:25:13,812 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-04-29T01:25:13,816 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2024-04-29T01:25:13,819 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-04-29T01:25:13,827 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-04-29T01:25:13,831 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-04-29T01:25:13,837 creating build/lib/colossalai/legacy/zero/gemini 2024-04-29T01:25:13,839 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2024-04-29T01:25:13,843 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2024-04-29T01:25:13,847 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-04-29T01:25:13,852 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2024-04-29T01:25:13,856 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2024-04-29T01:25:13,861 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-04-29T01:25:13,865 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2024-04-29T01:25:13,870 creating build/lib/colossalai/legacy/zero/shard_utils 2024-04-29T01:25:13,872 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-04-29T01:25:13,876 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-04-29T01:25:13,880 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-04-29T01:25:13,883 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-04-29T01:25:13,887 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-04-29T01:25:13,892 creating build/lib/colossalai/legacy/zero/sharded_param 2024-04-29T01:25:13,894 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-04-29T01:25:13,898 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-04-29T01:25:13,902 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-04-29T01:25:13,907 creating build/lib/colossalai/legacy/zero/sharded_optim 2024-04-29T01:25:13,909 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-04-29T01:25:13,913 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-04-29T01:25:13,919 creating build/lib/colossalai/legacy/zero/init_ctx 2024-04-29T01:25:13,921 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-04-29T01:25:13,925 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-04-29T01:25:13,931 creating build/lib/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:13,933 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:13,938 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:13,942 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:13,945 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:13,949 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:13,954 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:13,961 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-04-29T01:25:13,963 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-04-29T01:25:13,967 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-04-29T01:25:13,972 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2024-04-29T01:25:13,974 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-04-29T01:25:13,978 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-04-29T01:25:13,982 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-04-29T01:25:13,986 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-04-29T01:25:13,990 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-04-29T01:25:13,995 creating build/lib/colossalai/legacy/utils/checkpoint 2024-04-29T01:25:13,997 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-04-29T01:25:14,001 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-04-29T01:25:14,005 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-04-29T01:25:14,011 creating build/lib/colossalai/legacy/utils/data_sampler 2024-04-29T01:25:14,013 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-04-29T01:25:14,017 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-04-29T01:25:14,020 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-04-29T01:25:14,026 creating build/lib/colossalai/legacy/utils/profiler 2024-04-29T01:25:14,028 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2024-04-29T01:25:14,032 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-04-29T01:25:14,035 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-04-29T01:25:14,039 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2024-04-29T01:25:14,045 creating build/lib/colossalai/legacy/utils/profiler/legacy 2024-04-29T01:25:14,047 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-04-29T01:25:14,051 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-04-29T01:25:14,055 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-04-29T01:25:14,059 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-04-29T01:25:14,066 creating build/lib/colossalai/booster/plugin 2024-04-29T01:25:14,068 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-04-29T01:25:14,074 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-04-29T01:25:14,082 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-04-29T01:25:14,085 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2024-04-29T01:25:14,089 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-04-29T01:25:14,092 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2024-04-29T01:25:14,097 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2024-04-29T01:25:14,102 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2024-04-29T01:25:14,107 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2024-04-29T01:25:14,111 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2024-04-29T01:25:14,119 creating build/lib/colossalai/booster/mixed_precision 2024-04-29T01:25:14,121 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2024-04-29T01:25:14,125 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2024-04-29T01:25:14,129 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2024-04-29T01:25:14,132 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2024-04-29T01:25:14,136 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2024-04-29T01:25:14,140 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2024-04-29T01:25:14,143 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2024-04-29T01:25:14,148 creating build/lib/colossalai/amp/naive_amp 2024-04-29T01:25:14,150 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2024-04-29T01:25:14,153 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2024-04-29T01:25:14,159 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2024-04-29T01:25:14,161 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-04-29T01:25:14,164 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-04-29T01:25:14,168 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-04-29T01:25:14,172 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-04-29T01:25:14,178 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-04-29T01:25:14,179 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-04-29T01:25:14,183 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-04-29T01:25:14,187 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-04-29T01:25:14,191 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-04-29T01:25:14,196 creating build/lib/colossalai/cli/check 2024-04-29T01:25:14,197 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2024-04-29T01:25:14,201 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2024-04-29T01:25:14,207 creating build/lib/colossalai/cli/launcher 2024-04-29T01:25:14,209 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2024-04-29T01:25:14,213 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2024-04-29T01:25:14,217 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2024-04-29T01:25:14,222 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2024-04-29T01:25:14,228 creating build/lib/colossalai/_analyzer/fx 2024-04-29T01:25:14,231 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2024-04-29T01:25:14,235 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2024-04-29T01:25:14,239 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2024-04-29T01:25:14,244 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2024-04-29T01:25:14,249 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2024-04-29T01:25:14,254 creating build/lib/colossalai/_analyzer/_subclasses 2024-04-29T01:25:14,256 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2024-04-29T01:25:14,259 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2024-04-29T01:25:14,263 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2024-04-29T01:25:14,269 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-04-29T01:25:14,274 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-04-29T01:25:14,280 creating build/lib/colossalai/_analyzer/fx/passes 2024-04-29T01:25:14,282 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2024-04-29T01:25:14,285 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2024-04-29T01:25:14,290 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2024-04-29T01:25:14,297 creating build/lib/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:14,299 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:14,303 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:14,307 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:14,310 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:14,315 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:14,319 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:14,325 creating build/lib/colossalai/zero/gemini 2024-04-29T01:25:14,327 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2024-04-29T01:25:14,331 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2024-04-29T01:25:14,335 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2024-04-29T01:25:14,338 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2024-04-29T01:25:14,343 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2024-04-29T01:25:14,347 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2024-04-29T01:25:14,354 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2024-04-29T01:25:14,361 creating build/lib/colossalai/zero/low_level 2024-04-29T01:25:14,363 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2024-04-29T01:25:14,368 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2024-04-29T01:25:14,372 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2024-04-29T01:25:14,380 creating build/lib/colossalai/zero/gemini/chunk 2024-04-29T01:25:14,382 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2024-04-29T01:25:14,387 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-04-29T01:25:14,390 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2024-04-29T01:25:14,394 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-04-29T01:25:14,398 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2024-04-29T01:25:14,406 creating build/lib/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:14,408 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:14,412 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:14,415 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:14,419 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:14,423 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:14,427 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:14,431 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:14,435 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:14,438 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:14,444 creating build/lib/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:14,446 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:14,450 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:14,454 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:14,458 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:14,463 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:14,466 copying colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:14,471 creating build/lib/colossalai/utils/model 2024-04-29T01:25:14,473 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2024-04-29T01:25:14,477 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2024-04-29T01:25:14,482 creating build/lib/colossalai/utils/rank_recorder 2024-04-29T01:25:14,484 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2024-04-29T01:25:14,488 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2024-04-29T01:25:14,493 creating build/lib/colossalai/utils/multi_tensor_apply 2024-04-29T01:25:14,495 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-04-29T01:25:14,499 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-04-29T01:25:14,504 creating build/lib/colossalai/utils/tensor_detector 2024-04-29T01:25:14,506 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2024-04-29T01:25:14,509 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2024-04-29T01:25:14,559 creating build/lib/colossalai/kernel/extensions/csrc/arm 2024-04-29T01:25:14,561 copying colossalai/kernel/extensions/csrc/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/arm 2024-04-29T01:25:14,566 copying colossalai/kernel/extensions/csrc/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/arm 2024-04-29T01:25:14,571 creating build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,573 copying colossalai/kernel/extensions/csrc/cuda/layer_norm_cuda.cpp -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,578 copying colossalai/kernel/extensions/csrc/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,583 copying colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,587 copying colossalai/kernel/extensions/csrc/cuda/multi_tensor_adam.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,592 copying colossalai/kernel/extensions/csrc/cuda/moe_cuda_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,598 copying colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax.h -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,604 copying colossalai/kernel/extensions/csrc/cuda/multi_tensor_lamb.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,609 copying colossalai/kernel/extensions/csrc/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,614 copying colossalai/kernel/extensions/csrc/cuda/compat.h -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,618 copying colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax.h -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,623 copying colossalai/kernel/extensions/csrc/cuda/colossal_C_frontend.cpp -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,628 copying colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,632 copying colossalai/kernel/extensions/csrc/cuda/type_shim.h -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,637 copying colossalai/kernel/extensions/csrc/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,641 copying colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,645 copying colossalai/kernel/extensions/csrc/cuda/moe_cuda.cpp -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,650 copying colossalai/kernel/extensions/csrc/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,655 copying colossalai/kernel/extensions/csrc/cuda/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,660 copying colossalai/kernel/extensions/csrc/cuda/layer_norm_cuda_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,666 copying colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,670 copying colossalai/kernel/extensions/csrc/cuda/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:14,675 creating build/lib/colossalai/kernel/extensions/csrc/cuda/include 2024-04-29T01:25:14,676 copying colossalai/kernel/extensions/csrc/cuda/include/block_reduce.h -> build/lib/colossalai/kernel/extensions/csrc/cuda/include 2024-04-29T01:25:14,999 /usr/local/lib/python3.7/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-04-29T01:25:15,000 !! 2024-04-29T01:25:15,000 ******************************************************************************** 2024-04-29T01:25:15,001 Please avoid running ``setup.py`` directly. 2024-04-29T01:25:15,001 Instead, use pypa/build, pypa/installer or other 2024-04-29T01:25:15,002 standards-based tools. 2024-04-29T01:25:15,002 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-04-29T01:25:15,003 ******************************************************************************** 2024-04-29T01:25:15,003 !! 2024-04-29T01:25:15,004 self.initialize_options() 2024-04-29T01:25:15,059 installing to build/bdist.linux-armv7l/wheel 2024-04-29T01:25:15,060 running install 2024-04-29T01:25:15,139 running install_lib 2024-04-29T01:25:15,200 creating build/bdist.linux-armv7l 2024-04-29T01:25:15,201 creating build/bdist.linux-armv7l/wheel 2024-04-29T01:25:15,205 creating build/bdist.linux-armv7l/wheel/extensions 2024-04-29T01:25:15,208 creating build/bdist.linux-armv7l/wheel/extensions/softmax 2024-04-29T01:25:15,210 copying build/lib/extensions/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/softmax 2024-04-29T01:25:15,214 copying build/lib/extensions/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/softmax 2024-04-29T01:25:15,217 copying build/lib/extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/softmax 2024-04-29T01:25:15,222 creating build/bdist.linux-armv7l/wheel/extensions/layernorm 2024-04-29T01:25:15,224 copying build/lib/extensions/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/layernorm 2024-04-29T01:25:15,227 copying build/lib/extensions/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/layernorm 2024-04-29T01:25:15,232 creating build/bdist.linux-armv7l/wheel/extensions/cpu_adam 2024-04-29T01:25:15,233 copying build/lib/extensions/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/cpu_adam 2024-04-29T01:25:15,237 copying build/lib/extensions/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/extensions/cpu_adam 2024-04-29T01:25:15,241 copying build/lib/extensions/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/extensions/cpu_adam 2024-04-29T01:25:15,245 creating build/bdist.linux-armv7l/wheel/extensions/moe 2024-04-29T01:25:15,247 copying build/lib/extensions/moe/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/moe 2024-04-29T01:25:15,250 copying build/lib/extensions/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/moe 2024-04-29T01:25:15,255 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2024-04-29T01:25:15,256 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/csrc 2024-04-29T01:25:15,260 copying build/lib/extensions/csrc/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/extensions/csrc 2024-04-29T01:25:15,265 creating build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-04-29T01:25:15,267 copying build/lib/extensions/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-04-29T01:25:15,271 copying build/lib/extensions/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-04-29T01:25:15,274 copying build/lib/extensions/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-04-29T01:25:15,278 copying build/lib/extensions/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-04-29T01:25:15,282 creating build/bdist.linux-armv7l/wheel/extensions/optimizer 2024-04-29T01:25:15,284 copying build/lib/extensions/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/optimizer 2024-04-29T01:25:15,288 copying build/lib/extensions/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/optimizer 2024-04-29T01:25:15,293 creating build/bdist.linux-armv7l/wheel/colossalai 2024-04-29T01:25:15,296 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2024-04-29T01:25:15,298 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-04-29T01:25:15,303 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-04-29T01:25:15,304 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-04-29T01:25:15,309 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-04-29T01:25:15,311 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-04-29T01:25:15,314 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-04-29T01:25:15,318 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-04-29T01:25:15,322 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-04-29T01:25:15,326 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-04-29T01:25:15,330 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-04-29T01:25:15,334 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-04-29T01:25:15,338 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-04-29T01:25:15,342 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-04-29T01:25:15,347 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-04-29T01:25:15,349 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-04-29T01:25:15,353 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-04-29T01:25:15,356 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-04-29T01:25:15,360 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-04-29T01:25:15,365 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-04-29T01:25:15,367 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-04-29T01:25:15,371 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-04-29T01:25:15,376 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-04-29T01:25:15,380 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-04-29T01:25:15,383 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-04-29T01:25:15,387 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-04-29T01:25:15,391 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-04-29T01:25:15,395 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-04-29T01:25:15,399 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-04-29T01:25:15,405 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-04-29T01:25:15,406 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-04-29T01:25:15,411 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-04-29T01:25:15,417 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-04-29T01:25:15,420 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-04-29T01:25:15,425 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-04-29T01:25:15,432 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-04-29T01:25:15,437 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-04-29T01:25:15,440 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:15,442 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:15,446 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:15,450 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:15,454 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:15,459 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:15,463 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-04-29T01:25:15,467 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-04-29T01:25:15,469 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-04-29T01:25:15,474 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-04-29T01:25:15,477 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-04-29T01:25:15,483 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-04-29T01:25:15,487 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-04-29T01:25:15,491 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-04-29T01:25:15,495 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-04-29T01:25:15,500 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-04-29T01:25:15,504 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-04-29T01:25:15,508 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-04-29T01:25:15,513 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-04-29T01:25:15,515 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-04-29T01:25:15,518 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-04-29T01:25:15,522 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-04-29T01:25:15,528 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,529 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,533 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,537 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,541 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,544 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,548 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,551 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,556 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,559 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,563 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,567 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,573 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,576 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,581 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,585 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,590 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,593 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,597 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,600 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,604 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,607 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,612 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,614 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,619 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,624 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,630 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,633 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,637 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,642 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,646 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,651 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,657 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,661 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,665 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,669 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,672 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,676 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,681 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,685 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,689 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,693 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-04-29T01:25:15,697 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,701 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,705 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,708 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,713 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,716 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-04-29T01:25:15,720 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-04-29T01:25:15,725 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-04-29T01:25:15,727 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-04-29T01:25:15,731 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-04-29T01:25:15,736 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-04-29T01:25:15,741 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-04-29T01:25:15,746 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-04-29T01:25:15,750 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-04-29T01:25:15,756 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:15,758 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:15,762 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:15,766 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:15,769 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:15,773 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:15,777 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-04-29T01:25:15,782 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-04-29T01:25:15,786 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-04-29T01:25:15,788 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-04-29T01:25:15,792 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-04-29T01:25:15,795 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-04-29T01:25:15,799 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-04-29T01:25:15,803 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-04-29T01:25:15,808 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-04-29T01:25:15,816 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-04-29T01:25:15,817 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-04-29T01:25:15,821 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-04-29T01:25:15,825 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-04-29T01:25:15,829 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-04-29T01:25:15,834 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:15,836 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:15,840 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:15,844 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:15,848 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:15,853 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:15,857 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:15,861 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:15,864 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:15,868 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:15,872 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:15,876 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-04-29T01:25:15,882 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-04-29T01:25:15,883 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-04-29T01:25:15,886 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-04-29T01:25:15,890 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-04-29T01:25:15,895 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-04-29T01:25:15,898 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,900 copying build/lib/colossalai/kernel/triton/token_attention_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,904 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,908 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,911 copying build/lib/colossalai/kernel/triton/fused_layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,915 copying build/lib/colossalai/kernel/triton/copy_kv_cache_dest.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,918 copying build/lib/colossalai/kernel/triton/self_attention_nofusion.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,923 copying build/lib/colossalai/kernel/triton/context_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,927 copying build/lib/colossalai/kernel/triton/smooth_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,932 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,936 copying build/lib/colossalai/kernel/triton/custom_autotune.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,940 copying build/lib/colossalai/kernel/triton/gptq_triton.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,945 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,948 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,952 copying build/lib/colossalai/kernel/triton/int8_rotary_embedding_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-04-29T01:25:15,956 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-04-29T01:25:15,960 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-04-29T01:25:15,963 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/softmax 2024-04-29T01:25:15,965 copying build/lib/colossalai/kernel/extensions/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/softmax 2024-04-29T01:25:15,969 copying build/lib/colossalai/kernel/extensions/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/softmax 2024-04-29T01:25:15,972 copying build/lib/colossalai/kernel/extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/softmax 2024-04-29T01:25:15,976 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-04-29T01:25:15,980 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-04-29T01:25:15,984 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-04-29T01:25:15,987 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-04-29T01:25:15,992 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/layernorm 2024-04-29T01:25:15,994 copying build/lib/colossalai/kernel/extensions/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/layernorm 2024-04-29T01:25:15,998 copying build/lib/colossalai/kernel/extensions/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/layernorm 2024-04-29T01:25:16,001 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-04-29T01:25:16,005 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-04-29T01:25:16,010 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/cpu_adam 2024-04-29T01:25:16,011 copying build/lib/colossalai/kernel/extensions/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/cpu_adam 2024-04-29T01:25:16,015 copying build/lib/colossalai/kernel/extensions/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/cpu_adam 2024-04-29T01:25:16,019 copying build/lib/colossalai/kernel/extensions/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/cpu_adam 2024-04-29T01:25:16,023 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/moe 2024-04-29T01:25:16,025 copying build/lib/colossalai/kernel/extensions/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/moe 2024-04-29T01:25:16,029 copying build/lib/colossalai/kernel/extensions/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/moe 2024-04-29T01:25:16,033 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-04-29T01:25:16,035 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-04-29T01:25:16,040 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/arm 2024-04-29T01:25:16,042 copying build/lib/colossalai/kernel/extensions/csrc/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/arm 2024-04-29T01:25:16,047 copying build/lib/colossalai/kernel/extensions/csrc/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/arm 2024-04-29T01:25:16,051 copying build/lib/colossalai/kernel/extensions/csrc/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-04-29T01:25:16,057 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,059 copying build/lib/colossalai/kernel/extensions/csrc/cuda/layer_norm_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,063 copying build/lib/colossalai/kernel/extensions/csrc/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,068 copying build/lib/colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,072 copying build/lib/colossalai/kernel/extensions/csrc/cuda/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,076 copying build/lib/colossalai/kernel/extensions/csrc/cuda/moe_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,083 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda/include 2024-04-29T01:25:16,084 copying build/lib/colossalai/kernel/extensions/csrc/cuda/include/block_reduce.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda/include 2024-04-29T01:25:16,089 copying build/lib/colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,094 copying build/lib/colossalai/kernel/extensions/csrc/cuda/multi_tensor_lamb.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,099 copying build/lib/colossalai/kernel/extensions/csrc/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,103 copying build/lib/colossalai/kernel/extensions/csrc/cuda/compat.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,107 copying build/lib/colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,112 copying build/lib/colossalai/kernel/extensions/csrc/cuda/colossal_C_frontend.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,115 copying build/lib/colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,119 copying build/lib/colossalai/kernel/extensions/csrc/cuda/type_shim.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,124 copying build/lib/colossalai/kernel/extensions/csrc/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,128 copying build/lib/colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,132 copying build/lib/colossalai/kernel/extensions/csrc/cuda/moe_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,135 copying build/lib/colossalai/kernel/extensions/csrc/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,140 copying build/lib/colossalai/kernel/extensions/csrc/cuda/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,144 copying build/lib/colossalai/kernel/extensions/csrc/cuda/layer_norm_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,150 copying build/lib/colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,153 copying build/lib/colossalai/kernel/extensions/csrc/cuda/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-04-29T01:25:16,159 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-04-29T01:25:16,161 copying build/lib/colossalai/kernel/extensions/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-04-29T01:25:16,165 copying build/lib/colossalai/kernel/extensions/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-04-29T01:25:16,168 copying build/lib/colossalai/kernel/extensions/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-04-29T01:25:16,172 copying build/lib/colossalai/kernel/extensions/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-04-29T01:25:16,177 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/optimizer 2024-04-29T01:25:16,179 copying build/lib/colossalai/kernel/extensions/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/optimizer 2024-04-29T01:25:16,182 copying build/lib/colossalai/kernel/extensions/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/optimizer 2024-04-29T01:25:16,187 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-04-29T01:25:16,189 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-04-29T01:25:16,193 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-04-29T01:25:16,196 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-04-29T01:25:16,200 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-04-29T01:25:16,204 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-04-29T01:25:16,208 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-04-29T01:25:16,210 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-04-29T01:25:16,214 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-04-29T01:25:16,218 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-04-29T01:25:16,220 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-04-29T01:25:16,225 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-04-29T01:25:16,228 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-04-29T01:25:16,233 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-04-29T01:25:16,236 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-04-29T01:25:16,240 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-04-29T01:25:16,246 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,247 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,253 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,257 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,260 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,265 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,269 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,274 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,279 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,285 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,289 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,294 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,298 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,303 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,308 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,313 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,319 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,323 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-04-29T01:25:16,330 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,331 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,337 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,340 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,345 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,351 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,359 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,366 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,373 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,377 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,385 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,392 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,397 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,405 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,412 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-04-29T01:25:16,414 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-04-29T01:25:16,421 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-04-29T01:25:16,424 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-04-29T01:25:16,427 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,434 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,438 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-04-29T01:25:16,443 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-04-29T01:25:16,445 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-04-29T01:25:16,449 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-04-29T01:25:16,454 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-04-29T01:25:16,457 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-04-29T01:25:16,462 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-04-29T01:25:16,466 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-04-29T01:25:16,472 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-04-29T01:25:16,476 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-04-29T01:25:16,489 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-04-29T01:25:16,495 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-04-29T01:25:16,499 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-04-29T01:25:16,505 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-04-29T01:25:16,507 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-04-29T01:25:16,511 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-04-29T01:25:16,515 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-04-29T01:25:16,519 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-04-29T01:25:16,523 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-04-29T01:25:16,527 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-04-29T01:25:16,533 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2024-04-29T01:25:16,535 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-04-29T01:25:16,539 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-04-29T01:25:16,543 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-04-29T01:25:16,547 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-04-29T01:25:16,550 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-04-29T01:25:16,555 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-04-29T01:25:16,557 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-04-29T01:25:16,562 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-04-29T01:25:16,566 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-04-29T01:25:16,571 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-04-29T01:25:16,573 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-04-29T01:25:16,577 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-04-29T01:25:16,581 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-04-29T01:25:16,586 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-04-29T01:25:16,593 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-04-29T01:25:16,597 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-04-29T01:25:16,604 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2024-04-29T01:25:16,606 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-04-29T01:25:16,611 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-04-29T01:25:16,614 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-04-29T01:25:16,618 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-04-29T01:25:16,622 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-04-29T01:25:16,628 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-04-29T01:25:16,630 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-04-29T01:25:16,635 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-04-29T01:25:16,640 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-04-29T01:25:16,644 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-04-29T01:25:16,649 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-04-29T01:25:16,654 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-04-29T01:25:16,658 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-04-29T01:25:16,663 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-04-29T01:25:16,668 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-04-29T01:25:16,673 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-04-29T01:25:16,675 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-04-29T01:25:16,679 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-04-29T01:25:16,689 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-04-29T01:25:16,691 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-04-29T01:25:16,696 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-04-29T01:25:16,699 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-04-29T01:25:16,703 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-04-29T01:25:16,709 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-04-29T01:25:16,711 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-04-29T01:25:16,715 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-04-29T01:25:16,718 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-04-29T01:25:16,724 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:16,726 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:16,730 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:16,734 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:16,738 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:16,741 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:16,745 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:16,748 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:16,752 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:16,756 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-04-29T01:25:16,761 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:16,762 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:16,766 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:16,770 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:16,773 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:16,776 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:16,781 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:16,784 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:16,788 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:16,792 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:16,795 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:16,799 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-04-29T01:25:16,802 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-04-29T01:25:16,806 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-04-29T01:25:16,810 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-04-29T01:25:16,814 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-04-29T01:25:16,819 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-04-29T01:25:16,824 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-04-29T01:25:16,828 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-04-29T01:25:16,830 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-04-29T01:25:16,834 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-04-29T01:25:16,838 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-04-29T01:25:16,841 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-04-29T01:25:16,845 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-04-29T01:25:16,847 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-04-29T01:25:16,851 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-04-29T01:25:16,855 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-04-29T01:25:16,859 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-04-29T01:25:16,863 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-04-29T01:25:16,867 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-04-29T01:25:16,869 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-04-29T01:25:16,873 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-04-29T01:25:16,877 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-04-29T01:25:16,881 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-04-29T01:25:16,885 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-04-29T01:25:16,888 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:16,890 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:16,894 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:16,897 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:16,901 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:16,905 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:16,909 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:16,913 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:16,917 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-04-29T01:25:16,921 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-04-29T01:25:16,926 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:16,928 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:16,932 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:16,935 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:16,939 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:16,942 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:16,946 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:16,951 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:16,955 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-04-29T01:25:16,959 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-04-29T01:25:16,963 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-04-29T01:25:16,969 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-04-29T01:25:16,973 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-04-29T01:25:16,977 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-04-29T01:25:16,986 creating build/bdist.linux-armv7l/wheel/colossalai/device 2024-04-29T01:25:16,987 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-04-29T01:25:16,992 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-04-29T01:25:16,996 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-04-29T01:25:17,001 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-04-29T01:25:17,008 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2024-04-29T01:25:17,010 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-04-29T01:25:17,016 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant 2024-04-29T01:25:17,018 copying build/lib/colossalai/inference/quant/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant 2024-04-29T01:25:17,024 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq 2024-04-29T01:25:17,026 copying build/lib/colossalai/inference/quant/gptq/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq 2024-04-29T01:25:17,032 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq/cai_gptq 2024-04-29T01:25:17,034 copying build/lib/colossalai/inference/quant/gptq/cai_gptq/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq/cai_gptq 2024-04-29T01:25:17,038 copying build/lib/colossalai/inference/quant/gptq/cai_gptq/gptq_op.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq/cai_gptq 2024-04-29T01:25:17,043 copying build/lib/colossalai/inference/quant/gptq/cai_gptq/cai_quant_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq/cai_gptq 2024-04-29T01:25:17,048 copying build/lib/colossalai/inference/quant/gptq/gptq_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq 2024-04-29T01:25:17,052 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant 2024-04-29T01:25:17,054 copying build/lib/colossalai/inference/quant/smoothquant/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant 2024-04-29T01:25:17,058 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-04-29T01:25:17,060 copying build/lib/colossalai/inference/quant/smoothquant/models/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-04-29T01:25:17,064 copying build/lib/colossalai/inference/quant/smoothquant/models/base_model.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-04-29T01:25:17,069 copying build/lib/colossalai/inference/quant/smoothquant/models/parallel_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-04-29T01:25:17,073 copying build/lib/colossalai/inference/quant/smoothquant/models/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-04-29T01:25:17,080 copying build/lib/colossalai/inference/quant/smoothquant/models/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-04-29T01:25:17,085 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-04-29T01:25:17,087 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-04-29T01:25:17,090 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-04-29T01:25:17,095 copying build/lib/colossalai/inference/kv_cache/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-04-29T01:25:17,100 creating build/bdist.linux-armv7l/wheel/colossalai/inference/engine 2024-04-29T01:25:17,101 copying build/lib/colossalai/inference/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine 2024-04-29T01:25:17,105 copying build/lib/colossalai/inference/engine/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine 2024-04-29T01:25:17,111 creating build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-04-29T01:25:17,112 copying build/lib/colossalai/inference/engine/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-04-29T01:25:17,116 copying build/lib/colossalai/inference/engine/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-04-29T01:25:17,120 copying build/lib/colossalai/inference/engine/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-04-29T01:25:17,125 copying build/lib/colossalai/inference/engine/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-04-29T01:25:17,130 creating build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-04-29T01:25:17,132 copying build/lib/colossalai/inference/engine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-04-29T01:25:17,136 copying build/lib/colossalai/inference/engine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-04-29T01:25:17,139 copying build/lib/colossalai/inference/engine/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-04-29T01:25:17,145 copying build/lib/colossalai/inference/engine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-04-29T01:25:17,150 copying build/lib/colossalai/inference/engine/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-04-29T01:25:17,156 copying build/lib/colossalai/inference/engine/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine 2024-04-29T01:25:17,161 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-04-29T01:25:17,163 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-04-29T01:25:17,167 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-04-29T01:25:17,171 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-04-29T01:25:17,176 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-04-29T01:25:17,178 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-04-29T01:25:17,182 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-04-29T01:25:17,185 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-04-29T01:25:17,189 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-04-29T01:25:17,193 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-04-29T01:25:17,197 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-04-29T01:25:17,202 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-04-29T01:25:17,209 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-04-29T01:25:17,213 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-04-29T01:25:17,220 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-04-29T01:25:17,222 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-04-29T01:25:17,226 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-04-29T01:25:17,230 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-04-29T01:25:17,235 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-04-29T01:25:17,237 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-04-29T01:25:17,241 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-04-29T01:25:17,244 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-04-29T01:25:17,248 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-04-29T01:25:17,251 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-04-29T01:25:17,256 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-04-29T01:25:17,264 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2024-04-29T01:25:17,266 copying build/lib/colossalai/moe/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-04-29T01:25:17,270 copying build/lib/colossalai/moe/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-04-29T01:25:17,274 copying build/lib/colossalai/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-04-29T01:25:17,279 copying build/lib/colossalai/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-04-29T01:25:17,284 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-04-29T01:25:17,287 copying build/lib/colossalai/moe/load_balance.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-04-29T01:25:17,293 copying build/lib/colossalai/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-04-29T01:25:17,298 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-04-29T01:25:17,303 copying build/lib/colossalai/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-04-29T01:25:17,307 copying build/lib/colossalai/moe/checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-04-29T01:25:17,316 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-04-29T01:25:17,319 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-04-29T01:25:17,321 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-04-29T01:25:17,326 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-04-29T01:25:17,328 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-04-29T01:25:17,332 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-04-29T01:25:17,336 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-04-29T01:25:17,340 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-04-29T01:25:17,345 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-04-29T01:25:17,351 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-04-29T01:25:17,353 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-04-29T01:25:17,357 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-04-29T01:25:17,362 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-04-29T01:25:17,364 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-04-29T01:25:17,368 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-04-29T01:25:17,371 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-04-29T01:25:17,376 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-04-29T01:25:17,379 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-04-29T01:25:17,384 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-04-29T01:25:17,386 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-04-29T01:25:17,390 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-04-29T01:25:17,395 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-04-29T01:25:17,397 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-04-29T01:25:17,401 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-04-29T01:25:17,406 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:17,408 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:17,413 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:17,417 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:17,421 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:17,424 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:17,429 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:17,433 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:17,440 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:17,444 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-04-29T01:25:17,448 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-04-29T01:25:17,452 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-04-29T01:25:17,455 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-04-29T01:25:17,459 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-04-29T01:25:17,465 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-04-29T01:25:17,466 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-04-29T01:25:17,472 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-04-29T01:25:17,473 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-04-29T01:25:17,482 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-04-29T01:25:17,485 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-04-29T01:25:17,489 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-04-29T01:25:17,498 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-04-29T01:25:17,500 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-04-29T01:25:17,504 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-04-29T01:25:17,509 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:17,511 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:17,515 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:17,518 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:17,523 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:17,527 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:17,531 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-04-29T01:25:17,535 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-04-29T01:25:17,537 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-04-29T01:25:17,544 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-04-29T01:25:17,548 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-04-29T01:25:17,552 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-04-29T01:25:17,556 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-04-29T01:25:17,558 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-04-29T01:25:17,565 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-04-29T01:25:17,569 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-04-29T01:25:17,572 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-04-29T01:25:17,578 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-04-29T01:25:17,580 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-04-29T01:25:17,585 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-04-29T01:25:17,590 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-04-29T01:25:17,592 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-04-29T01:25:17,598 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-04-29T01:25:17,602 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-04-29T01:25:17,605 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-04-29T01:25:17,611 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-04-29T01:25:17,616 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-04-29T01:25:17,617 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-04-29T01:25:17,622 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-04-29T01:25:17,626 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-04-29T01:25:17,630 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-04-29T01:25:17,635 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-04-29T01:25:17,637 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-04-29T01:25:17,641 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-04-29T01:25:17,646 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-04-29T01:25:17,647 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-04-29T01:25:17,651 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-04-29T01:25:17,655 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-04-29T01:25:17,658 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-04-29T01:25:17,663 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-04-29T01:25:17,665 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-04-29T01:25:17,669 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-04-29T01:25:17,674 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-04-29T01:25:17,676 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-04-29T01:25:17,681 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-04-29T01:25:17,686 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-04-29T01:25:17,689 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-04-29T01:25:17,691 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-04-29T01:25:17,695 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-04-29T01:25:17,699 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-04-29T01:25:17,703 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-04-29T01:25:17,707 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-04-29T01:25:17,711 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-04-29T01:25:17,714 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-04-29T01:25:17,719 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-04-29T01:25:17,721 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-04-29T01:25:17,725 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-04-29T01:25:17,729 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-04-29T01:25:17,733 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-04-29T01:25:17,742 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-04-29T01:25:17,745 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:17,747 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:17,751 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:17,754 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:17,758 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:17,762 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:17,766 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:17,770 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:17,774 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:17,777 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-04-29T01:25:17,781 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-04-29T01:25:17,785 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-04-29T01:25:17,794 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-04-29T01:25:17,796 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-04-29T01:25:17,800 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-04-29T01:25:17,804 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-04-29T01:25:17,811 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-04-29T01:25:17,813 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-04-29T01:25:17,816 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-04-29T01:25:17,821 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-04-29T01:25:17,826 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-04-29T01:25:17,831 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-04-29T01:25:17,836 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-04-29T01:25:17,838 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-04-29T01:25:17,842 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-04-29T01:25:17,845 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-04-29T01:25:17,850 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-04-29T01:25:17,855 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-04-29T01:25:17,861 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-04-29T01:25:17,864 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-04-29T01:25:17,868 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-04-29T01:25:17,873 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-04-29T01:25:17,879 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-04-29T01:25:17,880 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-04-29T01:25:17,884 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-04-29T01:25:17,889 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-04-29T01:25:17,891 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-04-29T01:25:17,895 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-04-29T01:25:17,899 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-04-29T01:25:17,905 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-04-29T01:25:17,907 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-04-29T01:25:17,911 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-04-29T01:25:17,915 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-04-29T01:25:17,920 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-04-29T01:25:17,925 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-04-29T01:25:17,926 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-04-29T01:25:17,931 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-04-29T01:25:17,935 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-04-29T01:25:17,938 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-04-29T01:25:17,943 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-04-29T01:25:17,946 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-04-29T01:25:17,950 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-04-29T01:25:17,953 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-04-29T01:25:17,958 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-04-29T01:25:17,960 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-04-29T01:25:17,963 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-04-29T01:25:17,969 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-04-29T01:25:17,974 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:17,976 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:17,980 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:17,983 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:17,987 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:17,992 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:17,996 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:18,000 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:18,004 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:18,008 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:18,011 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:18,017 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-04-29T01:25:18,022 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-04-29T01:25:18,024 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-04-29T01:25:18,028 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-04-29T01:25:18,033 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-04-29T01:25:18,037 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-04-29T01:25:18,039 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-04-29T01:25:18,044 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-04-29T01:25:18,046 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-04-29T01:25:18,050 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-04-29T01:25:18,056 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-04-29T01:25:18,057 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-04-29T01:25:18,062 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-04-29T01:25:18,066 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-04-29T01:25:18,073 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-04-29T01:25:18,077 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-04-29T01:25:18,081 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-04-29T01:25:18,086 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:18,088 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:18,092 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:18,095 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:18,099 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:18,102 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:18,106 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:18,110 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:18,113 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-04-29T01:25:18,118 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-04-29T01:25:18,119 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-04-29T01:25:18,124 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-04-29T01:25:18,126 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-04-29T01:25:18,130 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-04-29T01:25:18,135 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-04-29T01:25:18,139 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-04-29T01:25:18,144 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-04-29T01:25:18,145 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-04-29T01:25:18,149 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-04-29T01:25:18,153 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-04-29T01:25:18,157 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-04-29T01:25:18,163 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-04-29T01:25:18,165 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-04-29T01:25:18,169 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-04-29T01:25:18,173 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-04-29T01:25:18,175 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-04-29T01:25:18,180 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-04-29T01:25:18,185 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-04-29T01:25:18,188 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-04-29T01:25:18,193 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-04-29T01:25:18,196 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-04-29T01:25:18,202 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-04-29T01:25:18,204 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-04-29T01:25:18,209 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-04-29T01:25:18,211 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-04-29T01:25:18,215 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-04-29T01:25:18,218 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-04-29T01:25:18,222 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-04-29T01:25:18,226 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-04-29T01:25:18,231 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-04-29T01:25:18,235 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-04-29T01:25:18,239 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-04-29T01:25:18,244 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-04-29T01:25:18,248 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-04-29T01:25:18,254 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-04-29T01:25:18,257 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-04-29T01:25:18,260 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-04-29T01:25:18,262 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-04-29T01:25:18,266 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-04-29T01:25:18,269 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-04-29T01:25:18,273 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-04-29T01:25:18,278 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-04-29T01:25:18,279 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-04-29T01:25:18,283 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-04-29T01:25:18,287 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-04-29T01:25:18,291 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-04-29T01:25:18,294 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-04-29T01:25:18,299 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-04-29T01:25:18,303 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-04-29T01:25:18,308 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-04-29T01:25:18,312 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-04-29T01:25:18,316 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-04-29T01:25:18,320 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-04-29T01:25:18,324 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-04-29T01:25:18,326 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-04-29T01:25:18,330 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-04-29T01:25:18,334 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-04-29T01:25:18,337 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-04-29T01:25:18,341 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-04-29T01:25:18,346 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-04-29T01:25:18,347 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-04-29T01:25:18,351 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-04-29T01:25:18,355 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-04-29T01:25:18,359 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-04-29T01:25:18,361 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-04-29T01:25:18,365 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-04-29T01:25:18,371 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-04-29T01:25:18,373 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-04-29T01:25:18,377 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-04-29T01:25:18,383 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:18,384 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:18,389 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:18,393 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:18,396 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:18,400 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:18,405 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-04-29T01:25:18,411 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-04-29T01:25:18,414 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-04-29T01:25:18,416 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-04-29T01:25:18,420 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-04-29T01:25:18,423 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-04-29T01:25:18,428 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-04-29T01:25:18,433 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-04-29T01:25:18,437 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-04-29T01:25:18,439 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-04-29T01:25:18,443 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-04-29T01:25:18,446 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-04-29T01:25:18,451 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-04-29T01:25:18,457 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-04-29T01:25:18,458 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-04-29T01:25:18,462 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-04-29T01:25:18,466 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-04-29T01:25:18,471 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-04-29T01:25:18,473 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-04-29T01:25:18,477 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-04-29T01:25:18,482 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-04-29T01:25:18,485 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-04-29T01:25:18,490 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-04-29T01:25:18,494 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-04-29T01:25:18,498 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-04-29T01:25:18,504 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-04-29T01:25:18,506 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-04-29T01:25:18,511 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-04-29T01:25:18,514 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-04-29T01:25:18,517 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-04-29T01:25:18,524 creating build/bdist.linux-armv7l/wheel/colossalai/context 2024-04-29T01:25:18,526 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-04-29T01:25:18,530 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-04-29T01:25:18,533 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-04-29T01:25:18,538 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2024-04-29T01:25:18,541 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-04-29T01:25:18,543 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-04-29T01:25:18,549 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-04-29T01:25:18,556 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-04-29T01:25:18,560 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-04-29T01:25:18,563 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-04-29T01:25:18,567 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-04-29T01:25:18,571 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-04-29T01:25:18,576 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-04-29T01:25:18,581 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-04-29T01:25:18,584 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-04-29T01:25:18,590 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-04-29T01:25:18,595 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-04-29T01:25:18,596 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-04-29T01:25:18,600 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-04-29T01:25:18,603 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-04-29T01:25:18,607 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-04-29T01:25:18,611 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-04-29T01:25:18,614 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-04-29T01:25:18,618 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-04-29T01:25:18,621 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-04-29T01:25:18,625 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-04-29T01:25:18,631 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-04-29T01:25:18,633 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-04-29T01:25:18,637 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-04-29T01:25:18,641 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-04-29T01:25:18,645 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-04-29T01:25:18,650 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-04-29T01:25:18,654 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2024-04-29T01:25:18,656 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-04-29T01:25:18,660 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-04-29T01:25:18,663 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-04-29T01:25:18,666 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-04-29T01:25:18,671 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2024-04-29T01:25:18,673 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-04-29T01:25:18,677 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-04-29T01:25:18,682 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2024-04-29T01:25:18,684 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2024-04-29T01:25:18,688 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-04-29T01:25:18,691 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-04-29T01:25:18,693 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-04-29T01:25:18,697 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-04-29T01:25:18,700 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-04-29T01:25:18,703 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-04-29T01:25:18,708 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-04-29T01:25:18,712 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-04-29T01:25:18,713 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-04-29T01:25:18,717 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-04-29T01:25:18,721 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-04-29T01:25:18,725 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-04-29T01:25:18,728 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-04-29T01:25:18,734 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2024-04-29T01:25:18,735 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-04-29T01:25:18,740 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-04-29T01:25:18,741 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-04-29T01:25:18,745 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-04-29T01:25:18,750 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-04-29T01:25:18,752 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-04-29T01:25:18,756 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-04-29T01:25:18,760 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-04-29T01:25:18,764 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-04-29T01:25:18,768 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-04-29T01:25:18,772 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-04-29T01:25:18,774 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-04-29T01:25:18,778 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-04-29T01:25:18,781 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-04-29T01:25:18,785 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-04-29T01:25:18,789 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-04-29T01:25:18,794 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-04-29T01:25:18,799 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-04-29T01:25:18,801 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-04-29T01:25:18,804 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-04-29T01:25:18,809 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-04-29T01:25:18,814 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-04-29T01:25:18,818 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:18,820 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:18,825 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:18,828 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:18,832 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:18,836 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:18,840 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-04-29T01:25:18,845 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-04-29T01:25:18,847 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-04-29T01:25:18,851 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-04-29T01:25:18,854 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-04-29T01:25:18,860 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-04-29T01:25:18,865 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-04-29T01:25:18,869 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-04-29T01:25:18,874 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2024-04-29T01:25:18,875 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C 2024-04-29T01:25:18,879 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-04-29T01:25:18,884 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2024-04-29T01:25:18,887 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-04-29T01:25:18,889 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-04-29T01:25:18,893 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-04-29T01:25:18,897 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-04-29T01:25:18,900 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-04-29T01:25:18,906 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-04-29T01:25:18,907 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-04-29T01:25:18,913 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-04-29T01:25:18,916 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-04-29T01:25:18,920 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-04-29T01:25:18,924 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-04-29T01:25:18,931 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:18,933 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:18,937 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:18,940 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:18,944 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:18,948 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:18,951 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:18,955 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:18,959 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:18,963 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-04-29T01:25:18,967 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-04-29T01:25:18,971 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-04-29T01:25:18,977 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-04-29T01:25:18,983 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-04-29T01:25:18,987 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-04-29T01:25:18,992 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-04-29T01:25:18,994 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-04-29T01:25:18,998 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-04-29T01:25:19,003 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:19,004 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:19,008 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:19,011 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:19,016 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:19,020 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:19,024 copying build/lib/colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-04-29T01:25:19,027 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-04-29T01:25:19,035 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2024-04-29T01:25:19,038 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-04-29T01:25:19,040 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-04-29T01:25:19,043 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-04-29T01:25:19,047 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-04-29T01:25:19,051 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-04-29T01:25:19,053 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-04-29T01:25:19,056 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-04-29T01:25:19,061 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-04-29T01:25:19,065 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-04-29T01:25:19,070 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-04-29T01:25:19,071 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-04-29T01:25:19,075 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-04-29T01:25:19,079 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-04-29T01:25:19,083 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-04-29T01:25:19,085 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-04-29T01:25:19,089 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-04-29T01:25:19,093 running install_egg_info 2024-04-29T01:25:19,239 running egg_info 2024-04-29T01:25:19,300 writing colossalai.egg-info/PKG-INFO 2024-04-29T01:25:19,306 writing dependency_links to colossalai.egg-info/dependency_links.txt 2024-04-29T01:25:19,310 writing entry points to colossalai.egg-info/entry_points.txt 2024-04-29T01:25:19,314 writing requirements to colossalai.egg-info/requires.txt 2024-04-29T01:25:19,318 writing top-level names to colossalai.egg-info/top_level.txt 2024-04-29T01:25:19,753 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2024-04-29T01:25:19,871 reading manifest template 'MANIFEST.in' 2024-04-29T01:25:22,711 warning: no files found matching '*.tr' under directory 'colossalai' 2024-04-29T01:25:24,173 warning: no files found matching '*.cc' under directory 'colossalai' 2024-04-29T01:25:24,865 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-04-29T01:25:25,084 warning: no files found matching '*.tr' under directory 'extensions' 2024-04-29T01:25:25,170 warning: no files found matching '*.cc' under directory 'extensions' 2024-04-29T01:25:25,217 warning: no files found matching '*.pyi' under directory 'extensions' 2024-04-29T01:25:25,219 adding license file 'LICENSE' 2024-04-29T01:25:25,376 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2024-04-29T01:25:25,383 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.3.7-py3.7.egg-info 2024-04-29T01:25:25,413 running install_scripts 2024-04-29T01:25:25,481 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2024-04-29T01:25:25,492 creating build/bdist.linux-armv7l/wheel/colossalai-0.3.7.dist-info/WHEEL 2024-04-29T01:25:25,497 creating '/tmp/pip-wheel-838jxzqo/colossalai-0.3.7-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-04-29T01:25:25,503 adding 'colossalai/__init__.py' 2024-04-29T01:25:25,506 adding 'colossalai/initialize.py' 2024-04-29T01:25:25,509 adding 'colossalai/version.py' 2024-04-29T01:25:25,512 adding 'colossalai/_C/__init__.py' 2024-04-29T01:25:25,515 adding 'colossalai/_analyzer/__init__.py' 2024-04-29T01:25:25,518 adding 'colossalai/_analyzer/envs.py' 2024-04-29T01:25:25,522 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2024-04-29T01:25:25,527 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2024-04-29T01:25:25,531 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2024-04-29T01:25:25,537 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2024-04-29T01:25:25,541 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2024-04-29T01:25:25,545 adding 'colossalai/_analyzer/fx/__init__.py' 2024-04-29T01:25:25,551 adding 'colossalai/_analyzer/fx/codegen.py' 2024-04-29T01:25:25,555 adding 'colossalai/_analyzer/fx/graph_module.py' 2024-04-29T01:25:25,560 adding 'colossalai/_analyzer/fx/node_util.py' 2024-04-29T01:25:25,563 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2024-04-29T01:25:25,567 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2024-04-29T01:25:25,571 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2024-04-29T01:25:25,576 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2024-04-29T01:25:25,579 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2024-04-29T01:25:25,582 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2024-04-29T01:25:25,585 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2024-04-29T01:25:25,588 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2024-04-29T01:25:25,592 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2024-04-29T01:25:25,597 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2024-04-29T01:25:25,601 adding 'colossalai/accelerator/__init__.py' 2024-04-29T01:25:25,603 adding 'colossalai/accelerator/api.py' 2024-04-29T01:25:25,607 adding 'colossalai/accelerator/base_accelerator.py' 2024-04-29T01:25:25,611 adding 'colossalai/accelerator/cpu_accelerator.py' 2024-04-29T01:25:25,614 adding 'colossalai/accelerator/cuda_accelerator.py' 2024-04-29T01:25:25,618 adding 'colossalai/accelerator/npu_accelerator.py' 2024-04-29T01:25:25,622 adding 'colossalai/amp/__init__.py' 2024-04-29T01:25:25,625 adding 'colossalai/amp/naive_amp/__init__.py' 2024-04-29T01:25:25,629 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2024-04-29T01:25:25,633 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2024-04-29T01:25:25,636 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2024-04-29T01:25:25,638 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2024-04-29T01:25:25,641 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2024-04-29T01:25:25,645 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2024-04-29T01:25:25,647 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2024-04-29T01:25:25,650 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2024-04-29T01:25:25,653 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2024-04-29T01:25:25,656 adding 'colossalai/auto_parallel/__init__.py' 2024-04-29T01:25:25,660 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2024-04-29T01:25:25,662 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2024-04-29T01:25:25,666 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2024-04-29T01:25:25,670 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2024-04-29T01:25:25,675 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2024-04-29T01:25:25,678 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2024-04-29T01:25:25,682 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2024-04-29T01:25:25,684 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2024-04-29T01:25:25,687 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2024-04-29T01:25:25,690 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2024-04-29T01:25:25,694 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2024-04-29T01:25:25,697 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2024-04-29T01:25:25,700 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2024-04-29T01:25:25,704 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2024-04-29T01:25:25,707 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2024-04-29T01:25:25,712 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2024-04-29T01:25:25,715 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2024-04-29T01:25:25,719 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2024-04-29T01:25:25,722 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2024-04-29T01:25:25,725 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2024-04-29T01:25:25,728 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2024-04-29T01:25:25,732 adding 'colossalai/auto_parallel/offload/__init__.py' 2024-04-29T01:25:25,735 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2024-04-29T01:25:25,739 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2024-04-29T01:25:25,742 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2024-04-29T01:25:25,745 adding 'colossalai/auto_parallel/offload/region.py' 2024-04-29T01:25:25,751 adding 'colossalai/auto_parallel/offload/region_manager.py' 2024-04-29T01:25:25,755 adding 'colossalai/auto_parallel/offload/runtime.py' 2024-04-29T01:25:25,767 adding 'colossalai/auto_parallel/offload/solver.py' 2024-04-29T01:25:25,772 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2024-04-29T01:25:25,775 adding 'colossalai/auto_parallel/offload/util.py' 2024-04-29T01:25:25,779 adding 'colossalai/auto_parallel/passes/__init__.py' 2024-04-29T01:25:25,782 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2024-04-29T01:25:25,785 adding 'colossalai/auto_parallel/passes/constants.py' 2024-04-29T01:25:25,788 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2024-04-29T01:25:25,792 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2024-04-29T01:25:25,799 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2024-04-29T01:25:25,803 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2024-04-29T01:25:25,807 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2024-04-29T01:25:25,810 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2024-04-29T01:25:25,815 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2024-04-29T01:25:25,818 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2024-04-29T01:25:25,822 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2024-04-29T01:25:25,827 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2024-04-29T01:25:25,830 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2024-04-29T01:25:25,833 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2024-04-29T01:25:25,836 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2024-04-29T01:25:25,840 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2024-04-29T01:25:25,843 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2024-04-29T01:25:25,846 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2024-04-29T01:25:25,850 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2024-04-29T01:25:25,853 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2024-04-29T01:25:25,855 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2024-04-29T01:25:25,858 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2024-04-29T01:25:25,862 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2024-04-29T01:25:25,868 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2024-04-29T01:25:25,874 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2024-04-29T01:25:25,877 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2024-04-29T01:25:25,880 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2024-04-29T01:25:25,882 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2024-04-29T01:25:25,885 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2024-04-29T01:25:25,888 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2024-04-29T01:25:25,890 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2024-04-29T01:25:25,893 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2024-04-29T01:25:25,896 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2024-04-29T01:25:25,899 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2024-04-29T01:25:25,902 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2024-04-29T01:25:25,905 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2024-04-29T01:25:25,907 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2024-04-29T01:25:25,910 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2024-04-29T01:25:25,914 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2024-04-29T01:25:25,919 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2024-04-29T01:25:25,922 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2024-04-29T01:25:25,927 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2024-04-29T01:25:25,932 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2024-04-29T01:25:25,935 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2024-04-29T01:25:25,938 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2024-04-29T01:25:25,942 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2024-04-29T01:25:25,950 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2024-04-29T01:25:25,954 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2024-04-29T01:25:25,957 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2024-04-29T01:25:25,960 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2024-04-29T01:25:25,965 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2024-04-29T01:25:25,968 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2024-04-29T01:25:25,973 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2024-04-29T01:25:25,976 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2024-04-29T01:25:25,980 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2024-04-29T01:25:25,983 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2024-04-29T01:25:25,986 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2024-04-29T01:25:25,990 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2024-04-29T01:25:25,994 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2024-04-29T01:25:25,997 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2024-04-29T01:25:26,004 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2024-04-29T01:25:26,008 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2024-04-29T01:25:26,012 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2024-04-29T01:25:26,015 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2024-04-29T01:25:26,019 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2024-04-29T01:25:26,023 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2024-04-29T01:25:26,027 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2024-04-29T01:25:26,030 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2024-04-29T01:25:26,034 adding 'colossalai/booster/__init__.py' 2024-04-29T01:25:26,036 adding 'colossalai/booster/accelerator.py' 2024-04-29T01:25:26,041 adding 'colossalai/booster/booster.py' 2024-04-29T01:25:26,045 adding 'colossalai/booster/mixed_precision/__init__.py' 2024-04-29T01:25:26,048 adding 'colossalai/booster/mixed_precision/bf16.py' 2024-04-29T01:25:26,051 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2024-04-29T01:25:26,054 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2024-04-29T01:25:26,057 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2024-04-29T01:25:26,059 adding 'colossalai/booster/mixed_precision/fp8.py' 2024-04-29T01:25:26,062 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2024-04-29T01:25:26,066 adding 'colossalai/booster/plugin/__init__.py' 2024-04-29T01:25:26,068 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2024-04-29T01:25:26,076 adding 'colossalai/booster/plugin/gemini_plugin.py' 2024-04-29T01:25:26,091 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2024-04-29T01:25:26,098 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2024-04-29T01:25:26,104 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2024-04-29T01:25:26,107 adding 'colossalai/booster/plugin/plugin_base.py' 2024-04-29T01:25:26,110 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2024-04-29T01:25:26,113 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2024-04-29T01:25:26,118 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2024-04-29T01:25:26,122 adding 'colossalai/checkpoint_io/__init__.py' 2024-04-29T01:25:26,126 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2024-04-29T01:25:26,130 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2024-04-29T01:25:26,141 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2024-04-29T01:25:26,145 adding 'colossalai/checkpoint_io/index_file.py' 2024-04-29T01:25:26,154 adding 'colossalai/checkpoint_io/utils.py' 2024-04-29T01:25:26,158 adding 'colossalai/cli/__init__.py' 2024-04-29T01:25:26,160 adding 'colossalai/cli/cli.py' 2024-04-29T01:25:26,164 adding 'colossalai/cli/check/__init__.py' 2024-04-29T01:25:26,168 adding 'colossalai/cli/check/check_installation.py' 2024-04-29T01:25:26,172 adding 'colossalai/cli/launcher/__init__.py' 2024-04-29T01:25:26,175 adding 'colossalai/cli/launcher/hostinfo.py' 2024-04-29T01:25:26,178 adding 'colossalai/cli/launcher/multinode_runner.py' 2024-04-29T01:25:26,183 adding 'colossalai/cli/launcher/run.py' 2024-04-29T01:25:26,187 adding 'colossalai/cluster/__init__.py' 2024-04-29T01:25:26,190 adding 'colossalai/cluster/device_mesh_manager.py' 2024-04-29T01:25:26,194 adding 'colossalai/cluster/dist_coordinator.py' 2024-04-29T01:25:26,196 adding 'colossalai/cluster/process_group_manager.py' 2024-04-29T01:25:26,201 adding 'colossalai/cluster/process_group_mesh.py' 2024-04-29T01:25:26,204 adding 'colossalai/context/__init__.py' 2024-04-29T01:25:26,207 adding 'colossalai/context/config.py' 2024-04-29T01:25:26,210 adding 'colossalai/context/singleton_meta.py' 2024-04-29T01:25:26,214 adding 'colossalai/device/__init__.py' 2024-04-29T01:25:26,219 adding 'colossalai/device/alpha_beta_profiler.py' 2024-04-29T01:25:26,223 adding 'colossalai/device/calc_pipeline_strategy.py' 2024-04-29T01:25:26,231 adding 'colossalai/device/device_mesh.py' 2024-04-29T01:25:26,236 adding 'colossalai/fx/__init__.py' 2024-04-29T01:25:26,238 adding 'colossalai/fx/_compatibility.py' 2024-04-29T01:25:26,244 adding 'colossalai/fx/_meta_regist_12.py' 2024-04-29T01:25:26,247 adding 'colossalai/fx/_meta_regist_13.py' 2024-04-29T01:25:26,251 adding 'colossalai/fx/graph_module.py' 2024-04-29T01:25:26,254 adding 'colossalai/fx/proxy.py' 2024-04-29T01:25:26,258 adding 'colossalai/fx/codegen/__init__.py' 2024-04-29T01:25:26,269 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2024-04-29T01:25:26,275 adding 'colossalai/fx/passes/__init__.py' 2024-04-29T01:25:26,280 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2024-04-29T01:25:26,284 adding 'colossalai/fx/passes/concrete_info_prop.py' 2024-04-29T01:25:26,289 adding 'colossalai/fx/passes/meta_info_prop.py' 2024-04-29T01:25:26,295 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2024-04-29T01:25:26,299 adding 'colossalai/fx/passes/shard_1d_pass.py' 2024-04-29T01:25:26,304 adding 'colossalai/fx/passes/split_module.py' 2024-04-29T01:25:26,308 adding 'colossalai/fx/passes/utils.py' 2024-04-29T01:25:26,312 adding 'colossalai/fx/profiler/__init__.py' 2024-04-29T01:25:26,315 adding 'colossalai/fx/profiler/constants.py' 2024-04-29T01:25:26,320 adding 'colossalai/fx/profiler/dataflow.py' 2024-04-29T01:25:26,323 adding 'colossalai/fx/profiler/memory_utils.py' 2024-04-29T01:25:26,327 adding 'colossalai/fx/profiler/opcount.py' 2024-04-29T01:25:26,333 adding 'colossalai/fx/profiler/profiler.py' 2024-04-29T01:25:26,336 adding 'colossalai/fx/profiler/shard_utils.py' 2024-04-29T01:25:26,339 adding 'colossalai/fx/profiler/tensor.py' 2024-04-29T01:25:26,343 adding 'colossalai/fx/profiler/experimental/__init__.py' 2024-04-29T01:25:26,346 adding 'colossalai/fx/profiler/experimental/constants.py' 2024-04-29T01:25:26,349 adding 'colossalai/fx/profiler/experimental/profiler.py' 2024-04-29T01:25:26,352 adding 'colossalai/fx/profiler/experimental/registry.py' 2024-04-29T01:25:26,354 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2024-04-29T01:25:26,358 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2024-04-29T01:25:26,361 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2024-04-29T01:25:26,364 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2024-04-29T01:25:26,366 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2024-04-29T01:25:26,369 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2024-04-29T01:25:26,371 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2024-04-29T01:25:26,374 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2024-04-29T01:25:26,376 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2024-04-29T01:25:26,379 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2024-04-29T01:25:26,383 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2024-04-29T01:25:26,386 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2024-04-29T01:25:26,388 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2024-04-29T01:25:26,392 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2024-04-29T01:25:26,394 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2024-04-29T01:25:26,397 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2024-04-29T01:25:26,400 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2024-04-29T01:25:26,403 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2024-04-29T01:25:26,406 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2024-04-29T01:25:26,408 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2024-04-29T01:25:26,411 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2024-04-29T01:25:26,415 adding 'colossalai/fx/tracer/__init__.py' 2024-04-29T01:25:26,418 adding 'colossalai/fx/tracer/_meta_trace.py' 2024-04-29T01:25:26,421 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2024-04-29T01:25:26,424 adding 'colossalai/fx/tracer/_tracer_utils.py' 2024-04-29T01:25:26,431 adding 'colossalai/fx/tracer/experimental.py' 2024-04-29T01:25:26,434 adding 'colossalai/fx/tracer/registry.py' 2024-04-29T01:25:26,442 adding 'colossalai/fx/tracer/tracer.py' 2024-04-29T01:25:26,445 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2024-04-29T01:25:26,449 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2024-04-29T01:25:26,452 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2024-04-29T01:25:26,455 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2024-04-29T01:25:26,458 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2024-04-29T01:25:26,460 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2024-04-29T01:25:26,464 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2024-04-29T01:25:26,467 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2024-04-29T01:25:26,470 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2024-04-29T01:25:26,473 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2024-04-29T01:25:26,476 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2024-04-29T01:25:26,480 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2024-04-29T01:25:26,482 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2024-04-29T01:25:26,485 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2024-04-29T01:25:26,488 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2024-04-29T01:25:26,491 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2024-04-29T01:25:26,493 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2024-04-29T01:25:26,496 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2024-04-29T01:25:26,499 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2024-04-29T01:25:26,503 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2024-04-29T01:25:26,506 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2024-04-29T01:25:26,508 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2024-04-29T01:25:26,511 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2024-04-29T01:25:26,514 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2024-04-29T01:25:26,516 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2024-04-29T01:25:26,519 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2024-04-29T01:25:26,522 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2024-04-29T01:25:26,526 adding 'colossalai/inference/__init__.py' 2024-04-29T01:25:26,529 adding 'colossalai/inference/engine/__init__.py' 2024-04-29T01:25:26,533 adding 'colossalai/inference/engine/engine.py' 2024-04-29T01:25:26,537 adding 'colossalai/inference/engine/microbatch_manager.py' 2024-04-29T01:25:26,541 adding 'colossalai/inference/engine/modeling/__init__.py' 2024-04-29T01:25:26,544 adding 'colossalai/inference/engine/modeling/_utils.py' 2024-04-29T01:25:26,549 adding 'colossalai/inference/engine/modeling/bloom.py' 2024-04-29T01:25:26,555 adding 'colossalai/inference/engine/modeling/chatglm2.py' 2024-04-29T01:25:26,563 adding 'colossalai/inference/engine/modeling/llama.py' 2024-04-29T01:25:26,567 adding 'colossalai/inference/engine/policies/__init__.py' 2024-04-29T01:25:26,570 adding 'colossalai/inference/engine/policies/bloom.py' 2024-04-29T01:25:26,573 adding 'colossalai/inference/engine/policies/chatglm2.py' 2024-04-29T01:25:26,576 adding 'colossalai/inference/engine/policies/llama.py' 2024-04-29T01:25:26,580 adding 'colossalai/inference/kv_cache/__init__.py' 2024-04-29T01:25:26,583 adding 'colossalai/inference/kv_cache/batch_infer_state.py' 2024-04-29T01:25:26,586 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2024-04-29T01:25:26,590 adding 'colossalai/inference/quant/__init__.py' 2024-04-29T01:25:26,593 adding 'colossalai/inference/quant/gptq/__init__.py' 2024-04-29T01:25:26,596 adding 'colossalai/inference/quant/gptq/gptq_manager.py' 2024-04-29T01:25:26,600 adding 'colossalai/inference/quant/gptq/cai_gptq/__init__.py' 2024-04-29T01:25:26,604 adding 'colossalai/inference/quant/gptq/cai_gptq/cai_quant_linear.py' 2024-04-29T01:25:26,607 adding 'colossalai/inference/quant/gptq/cai_gptq/gptq_op.py' 2024-04-29T01:25:26,611 adding 'colossalai/inference/quant/smoothquant/__init__.py' 2024-04-29T01:25:26,614 adding 'colossalai/inference/quant/smoothquant/models/__init__.py' 2024-04-29T01:25:26,620 adding 'colossalai/inference/quant/smoothquant/models/base_model.py' 2024-04-29T01:25:26,623 adding 'colossalai/inference/quant/smoothquant/models/linear.py' 2024-04-29T01:25:26,633 adding 'colossalai/inference/quant/smoothquant/models/llama.py' 2024-04-29T01:25:26,637 adding 'colossalai/inference/quant/smoothquant/models/parallel_linear.py' 2024-04-29T01:25:26,641 adding 'colossalai/interface/__init__.py' 2024-04-29T01:25:26,643 adding 'colossalai/interface/model.py' 2024-04-29T01:25:26,646 adding 'colossalai/interface/optimizer.py' 2024-04-29T01:25:26,649 adding 'colossalai/interface/pretrained.py' 2024-04-29T01:25:26,652 adding 'colossalai/kernel/__init__.py' 2024-04-29T01:25:26,655 adding 'colossalai/kernel/kernel_loader.py' 2024-04-29T01:25:26,659 adding 'colossalai/kernel/extensions/__init__.py' 2024-04-29T01:25:26,662 adding 'colossalai/kernel/extensions/base_extension.py' 2024-04-29T01:25:26,665 adding 'colossalai/kernel/extensions/cpp_extension.py' 2024-04-29T01:25:26,668 adding 'colossalai/kernel/extensions/cuda_extension.py' 2024-04-29T01:25:26,671 adding 'colossalai/kernel/extensions/triton_extension.py' 2024-04-29T01:25:26,675 adding 'colossalai/kernel/extensions/utils.py' 2024-04-29T01:25:26,678 adding 'colossalai/kernel/extensions/cpu_adam/__init__.py' 2024-04-29T01:25:26,681 adding 'colossalai/kernel/extensions/cpu_adam/cpu_adam_arm.py' 2024-04-29T01:25:26,683 adding 'colossalai/kernel/extensions/cpu_adam/cpu_adam_x86.py' 2024-04-29T01:25:26,687 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2024-04-29T01:25:26,691 adding 'colossalai/kernel/extensions/csrc/scaled_softmax.py' 2024-04-29T01:25:26,695 adding 'colossalai/kernel/extensions/csrc/arm/cpu_adam_arm.cpp' 2024-04-29T01:25:26,699 adding 'colossalai/kernel/extensions/csrc/arm/cpu_adam_arm.h' 2024-04-29T01:25:26,704 adding 'colossalai/kernel/extensions/csrc/cuda/colossal_C_frontend.cpp' 2024-04-29T01:25:26,707 adding 'colossalai/kernel/extensions/csrc/cuda/compat.h' 2024-04-29T01:25:26,711 adding 'colossalai/kernel/extensions/csrc/cuda/cpu_adam.cpp' 2024-04-29T01:25:26,715 adding 'colossalai/kernel/extensions/csrc/cuda/cpu_adam.h' 2024-04-29T01:25:26,718 adding 'colossalai/kernel/extensions/csrc/cuda/layer_norm_cuda.cpp' 2024-04-29T01:25:26,725 adding 'colossalai/kernel/extensions/csrc/cuda/layer_norm_cuda_kernel.cu' 2024-04-29T01:25:26,728 adding 'colossalai/kernel/extensions/csrc/cuda/moe_cuda.cpp' 2024-04-29T01:25:26,734 adding 'colossalai/kernel/extensions/csrc/cuda/moe_cuda_kernel.cu' 2024-04-29T01:25:26,738 adding 'colossalai/kernel/extensions/csrc/cuda/multi_tensor_adam.cu' 2024-04-29T01:25:26,742 adding 'colossalai/kernel/extensions/csrc/cuda/multi_tensor_apply.cuh' 2024-04-29T01:25:26,746 adding 'colossalai/kernel/extensions/csrc/cuda/multi_tensor_l2norm_kernel.cu' 2024-04-29T01:25:26,756 adding 'colossalai/kernel/extensions/csrc/cuda/multi_tensor_lamb.cu' 2024-04-29T01:25:26,760 adding 'colossalai/kernel/extensions/csrc/cuda/multi_tensor_scale_kernel.cu' 2024-04-29T01:25:26,763 adding 'colossalai/kernel/extensions/csrc/cuda/multi_tensor_sgd_kernel.cu' 2024-04-29T01:25:26,770 adding 'colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax.cpp' 2024-04-29T01:25:26,775 adding 'colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax.h' 2024-04-29T01:25:26,778 adding 'colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax_cuda.cu' 2024-04-29T01:25:26,781 adding 'colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax.cpp' 2024-04-29T01:25:26,786 adding 'colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax.h' 2024-04-29T01:25:26,789 adding 'colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax_cuda.cu' 2024-04-29T01:25:26,793 adding 'colossalai/kernel/extensions/csrc/cuda/type_shim.h' 2024-04-29T01:25:26,797 adding 'colossalai/kernel/extensions/csrc/cuda/include/block_reduce.h' 2024-04-29T01:25:26,801 adding 'colossalai/kernel/extensions/flash_attention/__init__.py' 2024-04-29T01:25:26,805 adding 'colossalai/kernel/extensions/flash_attention/flash_attention_dao_cuda.py' 2024-04-29T01:25:26,807 adding 'colossalai/kernel/extensions/flash_attention/flash_attention_npu.py' 2024-04-29T01:25:26,810 adding 'colossalai/kernel/extensions/flash_attention/flash_attention_sdpa_cuda.py' 2024-04-29T01:25:26,825 adding 'colossalai/kernel/extensions/layernorm/__init__.py' 2024-04-29T01:25:26,828 adding 'colossalai/kernel/extensions/layernorm/layernorm_cuda.py' 2024-04-29T01:25:26,831 adding 'colossalai/kernel/extensions/moe/__init__.py' 2024-04-29T01:25:26,834 adding 'colossalai/kernel/extensions/moe/moe_cuda.py' 2024-04-29T01:25:26,839 adding 'colossalai/kernel/extensions/optimizer/__init__.py' 2024-04-29T01:25:26,842 adding 'colossalai/kernel/extensions/optimizer/fused_optimizer_cuda.py' 2024-04-29T01:25:26,845 adding 'colossalai/kernel/extensions/softmax/__init__.py' 2024-04-29T01:25:26,848 adding 'colossalai/kernel/extensions/softmax/scaled_masked_softmax_cuda.py' 2024-04-29T01:25:26,851 adding 'colossalai/kernel/extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-04-29T01:25:26,854 adding 'colossalai/kernel/jit/__init__.py' 2024-04-29T01:25:26,856 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2024-04-29T01:25:26,860 adding 'colossalai/kernel/jit/bias_gelu.py' 2024-04-29T01:25:26,863 adding 'colossalai/kernel/jit/option.py' 2024-04-29T01:25:26,867 adding 'colossalai/kernel/triton/__init__.py' 2024-04-29T01:25:26,872 adding 'colossalai/kernel/triton/context_attention.py' 2024-04-29T01:25:26,875 adding 'colossalai/kernel/triton/copy_kv_cache_dest.py' 2024-04-29T01:25:26,878 adding 'colossalai/kernel/triton/custom_autotune.py' 2024-04-29T01:25:26,881 adding 'colossalai/kernel/triton/flash_decoding.py' 2024-04-29T01:25:26,884 adding 'colossalai/kernel/triton/fused_layernorm.py' 2024-04-29T01:25:26,889 adding 'colossalai/kernel/triton/gptq_triton.py' 2024-04-29T01:25:26,892 adding 'colossalai/kernel/triton/int8_rotary_embedding_kernel.py' 2024-04-29T01:25:26,896 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2024-04-29T01:25:26,899 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2024-04-29T01:25:26,903 adding 'colossalai/kernel/triton/self_attention_nofusion.py' 2024-04-29T01:25:26,908 adding 'colossalai/kernel/triton/smooth_attention.py' 2024-04-29T01:25:26,911 adding 'colossalai/kernel/triton/softmax.py' 2024-04-29T01:25:26,915 adding 'colossalai/kernel/triton/token_attention_kernel.py' 2024-04-29T01:25:26,919 adding 'colossalai/lazy/__init__.py' 2024-04-29T01:25:26,922 adding 'colossalai/lazy/construction.py' 2024-04-29T01:25:26,929 adding 'colossalai/lazy/lazy_init.py' 2024-04-29T01:25:26,934 adding 'colossalai/lazy/pretrained.py' 2024-04-29T01:25:26,938 adding 'colossalai/legacy/__init__.py' 2024-04-29T01:25:26,941 adding 'colossalai/legacy/constants.py' 2024-04-29T01:25:26,944 adding 'colossalai/legacy/core.py' 2024-04-29T01:25:26,946 adding 'colossalai/legacy/global_variables.py' 2024-04-29T01:25:26,952 adding 'colossalai/legacy/initialize.py' 2024-04-29T01:25:26,956 adding 'colossalai/legacy/amp/__init__.py' 2024-04-29T01:25:26,959 adding 'colossalai/legacy/amp/amp_type.py' 2024-04-29T01:25:26,962 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2024-04-29T01:25:26,965 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2024-04-29T01:25:26,969 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2024-04-29T01:25:26,974 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2024-04-29T01:25:26,977 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2024-04-29T01:25:26,980 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2024-04-29T01:25:26,984 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2024-04-29T01:25:26,992 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2024-04-29T01:25:26,996 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2024-04-29T01:25:26,999 adding 'colossalai/legacy/builder/__init__.py' 2024-04-29T01:25:27,002 adding 'colossalai/legacy/builder/builder.py' 2024-04-29T01:25:27,006 adding 'colossalai/legacy/communication/__init__.py' 2024-04-29T01:25:27,010 adding 'colossalai/legacy/communication/collective.py' 2024-04-29T01:25:27,015 adding 'colossalai/legacy/communication/p2p.py' 2024-04-29T01:25:27,019 adding 'colossalai/legacy/communication/p2p_v2.py' 2024-04-29T01:25:27,022 adding 'colossalai/legacy/communication/ring.py' 2024-04-29T01:25:27,025 adding 'colossalai/legacy/communication/utils.py' 2024-04-29T01:25:27,029 adding 'colossalai/legacy/context/__init__.py' 2024-04-29T01:25:27,035 adding 'colossalai/legacy/context/parallel_context.py' 2024-04-29T01:25:27,038 adding 'colossalai/legacy/context/parallel_mode.py' 2024-04-29T01:25:27,042 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2024-04-29T01:25:27,045 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2024-04-29T01:25:27,048 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2024-04-29T01:25:27,052 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2024-04-29T01:25:27,056 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2024-04-29T01:25:27,059 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2024-04-29T01:25:27,062 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2024-04-29T01:25:27,064 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2024-04-29T01:25:27,067 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2024-04-29T01:25:27,071 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2024-04-29T01:25:27,073 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2024-04-29T01:25:27,077 adding 'colossalai/legacy/context/random/__init__.py' 2024-04-29T01:25:27,080 adding 'colossalai/legacy/context/random/_helper.py' 2024-04-29T01:25:27,083 adding 'colossalai/legacy/context/random/seed_manager.py' 2024-04-29T01:25:27,087 adding 'colossalai/legacy/engine/__init__.py' 2024-04-29T01:25:27,090 adding 'colossalai/legacy/engine/_base_engine.py' 2024-04-29T01:25:27,094 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2024-04-29T01:25:27,098 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2024-04-29T01:25:27,102 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2024-04-29T01:25:27,105 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2024-04-29T01:25:27,107 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2024-04-29T01:25:27,110 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2024-04-29T01:25:27,113 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2024-04-29T01:25:27,116 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2024-04-29T01:25:27,118 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2024-04-29T01:25:27,121 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2024-04-29T01:25:27,125 adding 'colossalai/legacy/engine/schedule/__init__.py' 2024-04-29T01:25:27,128 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2024-04-29T01:25:27,131 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2024-04-29T01:25:27,141 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2024-04-29T01:25:27,145 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2024-04-29T01:25:27,149 adding 'colossalai/legacy/inference/__init__.py' 2024-04-29T01:25:27,152 adding 'colossalai/legacy/inference/async_engine.py' 2024-04-29T01:25:27,155 adding 'colossalai/legacy/inference/async_manager.py' 2024-04-29T01:25:27,160 adding 'colossalai/legacy/inference/manager.py' 2024-04-29T01:25:27,164 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2024-04-29T01:25:27,166 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2024-04-29T01:25:27,171 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2024-04-29T01:25:27,174 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2024-04-29T01:25:27,178 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2024-04-29T01:25:27,181 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2024-04-29T01:25:27,184 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2024-04-29T01:25:27,187 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2024-04-29T01:25:27,190 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2024-04-29T01:25:27,193 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2024-04-29T01:25:27,197 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2024-04-29T01:25:27,200 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2024-04-29T01:25:27,203 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2024-04-29T01:25:27,209 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2024-04-29T01:25:27,213 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2024-04-29T01:25:27,216 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2024-04-29T01:25:27,220 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2024-04-29T01:25:27,223 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2024-04-29T01:25:27,227 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2024-04-29T01:25:27,231 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2024-04-29T01:25:27,237 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2024-04-29T01:25:27,241 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2024-04-29T01:25:27,244 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2024-04-29T01:25:27,247 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2024-04-29T01:25:27,255 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2024-04-29T01:25:27,261 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2024-04-29T01:25:27,267 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2024-04-29T01:25:27,271 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2024-04-29T01:25:27,274 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2024-04-29T01:25:27,277 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2024-04-29T01:25:27,280 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2024-04-29T01:25:27,284 adding 'colossalai/legacy/nn/__init__.py' 2024-04-29T01:25:27,287 adding 'colossalai/legacy/nn/_ops/__init__.py' 2024-04-29T01:25:27,291 adding 'colossalai/legacy/nn/_ops/_utils.py' 2024-04-29T01:25:27,295 adding 'colossalai/legacy/nn/layer/__init__.py' 2024-04-29T01:25:27,298 adding 'colossalai/legacy/nn/layer/base_layer.py' 2024-04-29T01:25:27,302 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2024-04-29T01:25:27,304 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2024-04-29T01:25:27,307 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2024-04-29T01:25:27,310 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2024-04-29T01:25:27,314 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2024-04-29T01:25:27,316 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2024-04-29T01:25:27,320 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2024-04-29T01:25:27,323 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2024-04-29T01:25:27,326 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2024-04-29T01:25:27,335 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2024-04-29T01:25:27,339 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2024-04-29T01:25:27,346 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2024-04-29T01:25:27,350 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2024-04-29T01:25:27,358 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2024-04-29T01:25:27,363 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2024-04-29T01:25:27,370 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2024-04-29T01:25:27,374 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2024-04-29T01:25:27,383 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2024-04-29T01:25:27,387 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2024-04-29T01:25:27,393 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2024-04-29T01:25:27,396 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2024-04-29T01:25:27,405 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2024-04-29T01:25:27,409 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2024-04-29T01:25:27,413 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2024-04-29T01:25:27,416 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2024-04-29T01:25:27,420 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2024-04-29T01:25:27,424 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2024-04-29T01:25:27,428 adding 'colossalai/legacy/nn/layer/utils/common.py' 2024-04-29T01:25:27,432 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2024-04-29T01:25:27,437 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2024-04-29T01:25:27,441 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2024-04-29T01:25:27,444 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2024-04-29T01:25:27,447 adding 'colossalai/legacy/nn/loss/__init__.py' 2024-04-29T01:25:27,451 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2024-04-29T01:25:27,455 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2024-04-29T01:25:27,458 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2024-04-29T01:25:27,462 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2024-04-29T01:25:27,466 adding 'colossalai/legacy/nn/metric/__init__.py' 2024-04-29T01:25:27,469 adding 'colossalai/legacy/nn/metric/_utils.py' 2024-04-29T01:25:27,472 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2024-04-29T01:25:27,476 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2024-04-29T01:25:27,478 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2024-04-29T01:25:27,482 adding 'colossalai/legacy/nn/parallel/__init__.py' 2024-04-29T01:25:27,486 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2024-04-29T01:25:27,489 adding 'colossalai/legacy/nn/parallel/reducer.py' 2024-04-29T01:25:27,493 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2024-04-29T01:25:27,496 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2024-04-29T01:25:27,498 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2024-04-29T01:25:27,501 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2024-04-29T01:25:27,504 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2024-04-29T01:25:27,508 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2024-04-29T01:25:27,511 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2024-04-29T01:25:27,520 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2024-04-29T01:25:27,525 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2024-04-29T01:25:27,528 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2024-04-29T01:25:27,531 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2024-04-29T01:25:27,534 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2024-04-29T01:25:27,538 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2024-04-29T01:25:27,542 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2024-04-29T01:25:27,545 adding 'colossalai/legacy/pipeline/__init__.py' 2024-04-29T01:25:27,548 adding 'colossalai/legacy/pipeline/layer_spec.py' 2024-04-29T01:25:27,552 adding 'colossalai/legacy/pipeline/pipelinable.py' 2024-04-29T01:25:27,556 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2024-04-29T01:25:27,560 adding 'colossalai/legacy/pipeline/utils.py' 2024-04-29T01:25:27,564 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2024-04-29T01:25:27,567 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2024-04-29T01:25:27,571 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2024-04-29T01:25:27,574 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2024-04-29T01:25:27,578 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2024-04-29T01:25:27,592 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2024-04-29T01:25:27,598 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2024-04-29T01:25:27,601 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2024-04-29T01:25:27,605 adding 'colossalai/legacy/registry/__init__.py' 2024-04-29T01:25:27,608 adding 'colossalai/legacy/registry/registry.py' 2024-04-29T01:25:27,612 adding 'colossalai/legacy/tensor/__init__.py' 2024-04-29T01:25:27,614 adding 'colossalai/legacy/tensor/compute_spec.py' 2024-04-29T01:25:27,617 adding 'colossalai/legacy/tensor/const.py' 2024-04-29T01:25:27,620 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2024-04-29T01:25:27,623 adding 'colossalai/legacy/tensor/distspec.py' 2024-04-29T01:25:27,626 adding 'colossalai/legacy/tensor/op_wrapper.py' 2024-04-29T01:25:27,630 adding 'colossalai/legacy/tensor/process_group.py' 2024-04-29T01:25:27,633 adding 'colossalai/legacy/tensor/tensor_spec.py' 2024-04-29T01:25:27,636 adding 'colossalai/legacy/trainer/__init__.py' 2024-04-29T01:25:27,641 adding 'colossalai/legacy/trainer/_trainer.py' 2024-04-29T01:25:27,645 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2024-04-29T01:25:27,648 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2024-04-29T01:25:27,651 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2024-04-29T01:25:27,654 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2024-04-29T01:25:27,658 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2024-04-29T01:25:27,661 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2024-04-29T01:25:27,665 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2024-04-29T01:25:27,670 adding 'colossalai/legacy/utils/__init__.py' 2024-04-29T01:25:27,674 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2024-04-29T01:25:27,678 adding 'colossalai/legacy/utils/checkpointing.py' 2024-04-29T01:25:27,683 adding 'colossalai/legacy/utils/common.py' 2024-04-29T01:25:27,687 adding 'colossalai/legacy/utils/memory.py' 2024-04-29T01:25:27,691 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2024-04-29T01:25:27,694 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2024-04-29T01:25:27,697 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2024-04-29T01:25:27,701 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2024-04-29T01:25:27,703 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2024-04-29T01:25:27,707 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2024-04-29T01:25:27,710 adding 'colossalai/legacy/utils/profiler/__init__.py' 2024-04-29T01:25:27,713 adding 'colossalai/legacy/utils/profiler/extention.py' 2024-04-29T01:25:27,717 adding 'colossalai/legacy/utils/profiler/profiler.py' 2024-04-29T01:25:27,721 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2024-04-29T01:25:27,724 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2024-04-29T01:25:27,728 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2024-04-29T01:25:27,732 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2024-04-29T01:25:27,735 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2024-04-29T01:25:27,739 adding 'colossalai/legacy/zero/__init__.py' 2024-04-29T01:25:27,743 adding 'colossalai/legacy/zero/gemini/__init__.py' 2024-04-29T01:25:27,747 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2024-04-29T01:25:27,750 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2024-04-29T01:25:27,753 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2024-04-29T01:25:27,757 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2024-04-29T01:25:27,760 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2024-04-29T01:25:27,763 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2024-04-29T01:25:27,767 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2024-04-29T01:25:27,770 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2024-04-29T01:25:27,772 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2024-04-29T01:25:27,779 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2024-04-29T01:25:27,782 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2024-04-29T01:25:27,786 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2024-04-29T01:25:27,788 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2024-04-29T01:25:27,792 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2024-04-29T01:25:27,796 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2024-04-29T01:25:27,800 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2024-04-29T01:25:27,803 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2024-04-29T01:25:27,806 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2024-04-29T01:25:27,808 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2024-04-29T01:25:27,811 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2024-04-29T01:25:27,815 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2024-04-29T01:25:27,818 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2024-04-29T01:25:27,822 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2024-04-29T01:25:27,830 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2024-04-29T01:25:27,833 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2024-04-29T01:25:27,836 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2024-04-29T01:25:27,840 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2024-04-29T01:25:27,846 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2024-04-29T01:25:27,850 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2024-04-29T01:25:27,853 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2024-04-29T01:25:27,856 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2024-04-29T01:25:27,859 adding 'colossalai/logging/__init__.py' 2024-04-29T01:25:27,863 adding 'colossalai/logging/logger.py' 2024-04-29T01:25:27,867 adding 'colossalai/moe/__init__.py' 2024-04-29T01:25:27,871 adding 'colossalai/moe/_operation.py' 2024-04-29T01:25:27,880 adding 'colossalai/moe/checkpoint.py' 2024-04-29T01:25:27,884 adding 'colossalai/moe/experts.py' 2024-04-29T01:25:27,889 adding 'colossalai/moe/layers.py' 2024-04-29T01:25:27,895 adding 'colossalai/moe/load_balance.py' 2024-04-29T01:25:27,898 adding 'colossalai/moe/loss.py' 2024-04-29T01:25:27,902 adding 'colossalai/moe/manager.py' 2024-04-29T01:25:27,908 adding 'colossalai/moe/routers.py' 2024-04-29T01:25:27,912 adding 'colossalai/moe/utils.py' 2024-04-29T01:25:27,915 adding 'colossalai/nn/__init__.py' 2024-04-29T01:25:27,919 adding 'colossalai/nn/init.py' 2024-04-29T01:25:27,922 adding 'colossalai/nn/layer/__init__.py' 2024-04-29T01:25:27,925 adding 'colossalai/nn/layer/layernorm.py' 2024-04-29T01:25:27,929 adding 'colossalai/nn/layer/scaled_softmax.py' 2024-04-29T01:25:27,931 adding 'colossalai/nn/layer/utils.py' 2024-04-29T01:25:27,935 adding 'colossalai/nn/loss/__init__.py' 2024-04-29T01:25:27,938 adding 'colossalai/nn/lr_scheduler/__init__.py' 2024-04-29T01:25:27,942 adding 'colossalai/nn/lr_scheduler/cosine.py' 2024-04-29T01:25:27,945 adding 'colossalai/nn/lr_scheduler/delayed.py' 2024-04-29T01:25:27,948 adding 'colossalai/nn/lr_scheduler/linear.py' 2024-04-29T01:25:27,951 adding 'colossalai/nn/lr_scheduler/multistep.py' 2024-04-29T01:25:27,954 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2024-04-29T01:25:27,957 adding 'colossalai/nn/lr_scheduler/poly.py' 2024-04-29T01:25:27,960 adding 'colossalai/nn/lr_scheduler/torch.py' 2024-04-29T01:25:27,964 adding 'colossalai/nn/optimizer/__init__.py' 2024-04-29T01:25:27,967 adding 'colossalai/nn/optimizer/cpu_adam.py' 2024-04-29T01:25:27,971 adding 'colossalai/nn/optimizer/fused_adam.py' 2024-04-29T01:25:27,975 adding 'colossalai/nn/optimizer/fused_lamb.py' 2024-04-29T01:25:27,979 adding 'colossalai/nn/optimizer/fused_sgd.py' 2024-04-29T01:25:27,983 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2024-04-29T01:25:27,986 adding 'colossalai/nn/optimizer/lamb.py' 2024-04-29T01:25:27,989 adding 'colossalai/nn/optimizer/lars.py' 2024-04-29T01:25:27,993 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2024-04-29T01:25:27,996 adding 'colossalai/pipeline/__init__.py' 2024-04-29T01:25:28,003 adding 'colossalai/pipeline/p2p.py' 2024-04-29T01:25:28,008 adding 'colossalai/pipeline/stage_manager.py' 2024-04-29T01:25:28,012 adding 'colossalai/pipeline/schedule/__init__.py' 2024-04-29T01:25:28,015 adding 'colossalai/pipeline/schedule/_utils.py' 2024-04-29T01:25:28,018 adding 'colossalai/pipeline/schedule/base.py' 2024-04-29T01:25:28,023 adding 'colossalai/pipeline/schedule/generate.py' 2024-04-29T01:25:28,030 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2024-04-29T01:25:28,036 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2024-04-29T01:25:28,040 adding 'colossalai/shardformer/__init__.py' 2024-04-29T01:25:28,042 adding 'colossalai/shardformer/_utils.py' 2024-04-29T01:25:28,046 adding 'colossalai/shardformer/layer/__init__.py' 2024-04-29T01:25:28,055 adding 'colossalai/shardformer/layer/_operation.py' 2024-04-29T01:25:28,060 adding 'colossalai/shardformer/layer/attn.py' 2024-04-29T01:25:28,063 adding 'colossalai/shardformer/layer/dropout.py' 2024-04-29T01:25:28,068 adding 'colossalai/shardformer/layer/embedding.py' 2024-04-29T01:25:28,074 adding 'colossalai/shardformer/layer/linear.py' 2024-04-29T01:25:28,077 adding 'colossalai/shardformer/layer/loss.py' 2024-04-29T01:25:28,081 adding 'colossalai/shardformer/layer/normalization.py' 2024-04-29T01:25:28,086 adding 'colossalai/shardformer/layer/parallel_module.py' 2024-04-29T01:25:28,093 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2024-04-29T01:25:28,098 adding 'colossalai/shardformer/layer/utils.py' 2024-04-29T01:25:28,102 adding 'colossalai/shardformer/modeling/__init__.py' 2024-04-29T01:25:28,114 adding 'colossalai/shardformer/modeling/bert.py' 2024-04-29T01:25:28,118 adding 'colossalai/shardformer/modeling/blip2.py' 2024-04-29T01:25:28,130 adding 'colossalai/shardformer/modeling/bloom.py' 2024-04-29T01:25:28,135 adding 'colossalai/shardformer/modeling/chatglm2.py' 2024-04-29T01:25:28,143 adding 'colossalai/shardformer/modeling/falcon.py' 2024-04-29T01:25:28,155 adding 'colossalai/shardformer/modeling/gpt2.py' 2024-04-29T01:25:28,165 adding 'colossalai/shardformer/modeling/gptj.py' 2024-04-29T01:25:28,168 adding 'colossalai/shardformer/modeling/jit.py' 2024-04-29T01:25:28,178 adding 'colossalai/shardformer/modeling/llama.py' 2024-04-29T01:25:28,185 adding 'colossalai/shardformer/modeling/mistral.py' 2024-04-29T01:25:28,194 adding 'colossalai/shardformer/modeling/opt.py' 2024-04-29T01:25:28,198 adding 'colossalai/shardformer/modeling/sam.py' 2024-04-29T01:25:28,206 adding 'colossalai/shardformer/modeling/t5.py' 2024-04-29T01:25:28,212 adding 'colossalai/shardformer/modeling/vit.py' 2024-04-29T01:25:28,224 adding 'colossalai/shardformer/modeling/whisper.py' 2024-04-29T01:25:28,229 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2024-04-29T01:25:28,231 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2024-04-29T01:25:28,246 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2024-04-29T01:25:28,251 adding 'colossalai/shardformer/policies/__init__.py' 2024-04-29T01:25:28,255 adding 'colossalai/shardformer/policies/auto_policy.py' 2024-04-29T01:25:28,259 adding 'colossalai/shardformer/policies/base_policy.py' 2024-04-29T01:25:28,264 adding 'colossalai/shardformer/policies/bert.py' 2024-04-29T01:25:28,268 adding 'colossalai/shardformer/policies/blip2.py' 2024-04-29T01:25:28,273 adding 'colossalai/shardformer/policies/bloom.py' 2024-04-29T01:25:28,277 adding 'colossalai/shardformer/policies/chatglm2.py' 2024-04-29T01:25:28,282 adding 'colossalai/shardformer/policies/falcon.py' 2024-04-29T01:25:28,287 adding 'colossalai/shardformer/policies/gpt2.py' 2024-04-29T01:25:28,291 adding 'colossalai/shardformer/policies/gptj.py' 2024-04-29T01:25:28,296 adding 'colossalai/shardformer/policies/llama.py' 2024-04-29T01:25:28,301 adding 'colossalai/shardformer/policies/mistral.py' 2024-04-29T01:25:28,305 adding 'colossalai/shardformer/policies/opt.py' 2024-04-29T01:25:28,308 adding 'colossalai/shardformer/policies/sam.py' 2024-04-29T01:25:28,314 adding 'colossalai/shardformer/policies/t5.py' 2024-04-29T01:25:28,318 adding 'colossalai/shardformer/policies/vit.py' 2024-04-29T01:25:28,323 adding 'colossalai/shardformer/policies/whisper.py' 2024-04-29T01:25:28,327 adding 'colossalai/shardformer/shard/__init__.py' 2024-04-29T01:25:28,330 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2024-04-29T01:25:28,334 adding 'colossalai/shardformer/shard/shard_config.py' 2024-04-29T01:25:28,338 adding 'colossalai/shardformer/shard/sharder.py' 2024-04-29T01:25:28,341 adding 'colossalai/shardformer/shard/shardformer.py' 2024-04-29T01:25:28,343 adding 'colossalai/shardformer/shard/utils.py' 2024-04-29T01:25:28,347 adding 'colossalai/tensor/__init__.py' 2024-04-29T01:25:28,350 adding 'colossalai/tensor/colo_parameter.py' 2024-04-29T01:25:28,353 adding 'colossalai/tensor/colo_tensor.py' 2024-04-29T01:25:28,359 adding 'colossalai/tensor/comm_spec.py' 2024-04-29T01:25:28,363 adding 'colossalai/tensor/param_op_hook.py' 2024-04-29T01:25:28,371 adding 'colossalai/tensor/shape_consistency.py' 2024-04-29T01:25:28,376 adding 'colossalai/tensor/sharding_spec.py' 2024-04-29T01:25:28,381 adding 'colossalai/tensor/utils.py' 2024-04-29T01:25:28,385 adding 'colossalai/tensor/d_tensor/__init__.py' 2024-04-29T01:25:28,390 adding 'colossalai/tensor/d_tensor/api.py' 2024-04-29T01:25:28,394 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2024-04-29T01:25:28,397 adding 'colossalai/tensor/d_tensor/layout.py' 2024-04-29T01:25:28,404 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2024-04-29T01:25:28,407 adding 'colossalai/tensor/d_tensor/misc.py' 2024-04-29T01:25:28,411 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2024-04-29T01:25:28,414 adding 'colossalai/tensor/d_tensor/utils.py' 2024-04-29T01:25:28,417 adding 'colossalai/tensor/moe_tensor/__init__.py' 2024-04-29T01:25:28,420 adding 'colossalai/tensor/moe_tensor/api.py' 2024-04-29T01:25:28,423 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2024-04-29T01:25:28,426 adding 'colossalai/tensor/padded_tensor/__init__.py' 2024-04-29T01:25:28,429 adding 'colossalai/tensor/padded_tensor/api.py' 2024-04-29T01:25:28,433 adding 'colossalai/testing/__init__.py' 2024-04-29T01:25:28,436 adding 'colossalai/testing/comparison.py' 2024-04-29T01:25:28,439 adding 'colossalai/testing/pytest_wrapper.py' 2024-04-29T01:25:28,441 adding 'colossalai/testing/random.py' 2024-04-29T01:25:28,445 adding 'colossalai/testing/utils.py' 2024-04-29T01:25:28,450 adding 'colossalai/utils/__init__.py' 2024-04-29T01:25:28,452 adding 'colossalai/utils/common.py' 2024-04-29T01:25:28,455 adding 'colossalai/utils/memory.py' 2024-04-29T01:25:28,458 adding 'colossalai/utils/timer.py' 2024-04-29T01:25:28,462 adding 'colossalai/utils/model/__init__.py' 2024-04-29T01:25:28,465 adding 'colossalai/utils/model/utils.py' 2024-04-29T01:25:28,468 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2024-04-29T01:25:28,471 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2024-04-29T01:25:28,474 adding 'colossalai/utils/rank_recorder/__init__.py' 2024-04-29T01:25:28,478 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2024-04-29T01:25:28,481 adding 'colossalai/utils/tensor_detector/__init__.py' 2024-04-29T01:25:28,485 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2024-04-29T01:25:28,489 adding 'colossalai/zero/__init__.py' 2024-04-29T01:25:28,492 adding 'colossalai/zero/wrapper.py' 2024-04-29T01:25:28,496 adding 'colossalai/zero/gemini/__init__.py' 2024-04-29T01:25:28,507 adding 'colossalai/zero/gemini/gemini_ddp.py' 2024-04-29T01:25:28,511 adding 'colossalai/zero/gemini/gemini_hook.py' 2024-04-29T01:25:28,515 adding 'colossalai/zero/gemini/gemini_mgr.py' 2024-04-29T01:25:28,525 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2024-04-29T01:25:28,530 adding 'colossalai/zero/gemini/placement_policy.py' 2024-04-29T01:25:28,533 adding 'colossalai/zero/gemini/utils.py' 2024-04-29T01:25:28,537 adding 'colossalai/zero/gemini/chunk/__init__.py' 2024-04-29T01:25:28,544 adding 'colossalai/zero/gemini/chunk/chunk.py' 2024-04-29T01:25:28,549 adding 'colossalai/zero/gemini/chunk/manager.py' 2024-04-29T01:25:28,553 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2024-04-29T01:25:28,556 adding 'colossalai/zero/gemini/chunk/utils.py' 2024-04-29T01:25:28,560 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2024-04-29T01:25:28,562 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2024-04-29T01:25:28,565 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2024-04-29T01:25:28,568 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2024-04-29T01:25:28,572 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2024-04-29T01:25:28,574 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2024-04-29T01:25:28,577 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2024-04-29T01:25:28,580 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2024-04-29T01:25:28,583 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2024-04-29T01:25:28,587 adding 'colossalai/zero/low_level/__init__.py' 2024-04-29T01:25:28,591 adding 'colossalai/zero/low_level/_utils.py' 2024-04-29T01:25:28,603 adding 'colossalai/zero/low_level/low_level_optim.py' 2024-04-29T01:25:28,607 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2024-04-29T01:25:28,610 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2024-04-29T01:25:28,613 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2024-04-29T01:25:28,616 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2024-04-29T01:25:28,619 adding 'colossalai/zero/low_level/bookkeeping/parameter_store.py' 2024-04-29T01:25:28,622 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2024-04-29T01:25:28,631 adding 'extensions/cpu_adam/__init__.py' 2024-04-29T01:25:28,634 adding 'extensions/cpu_adam/cpu_adam_arm.py' 2024-04-29T01:25:28,637 adding 'extensions/cpu_adam/cpu_adam_x86.py' 2024-04-29T01:25:28,640 adding 'extensions/csrc/__init__.py' 2024-04-29T01:25:28,644 adding 'extensions/csrc/scaled_softmax.py' 2024-04-29T01:25:28,647 adding 'extensions/flash_attention/__init__.py' 2024-04-29T01:25:28,651 adding 'extensions/flash_attention/flash_attention_dao_cuda.py' 2024-04-29T01:25:28,653 adding 'extensions/flash_attention/flash_attention_npu.py' 2024-04-29T01:25:28,656 adding 'extensions/flash_attention/flash_attention_sdpa_cuda.py' 2024-04-29T01:25:28,660 adding 'extensions/layernorm/__init__.py' 2024-04-29T01:25:28,663 adding 'extensions/layernorm/layernorm_cuda.py' 2024-04-29T01:25:28,666 adding 'extensions/moe/__init__.py' 2024-04-29T01:25:28,669 adding 'extensions/moe/moe_cuda.py' 2024-04-29T01:25:28,674 adding 'extensions/optimizer/__init__.py' 2024-04-29T01:25:28,677 adding 'extensions/optimizer/fused_optimizer_cuda.py' 2024-04-29T01:25:28,680 adding 'extensions/softmax/__init__.py' 2024-04-29T01:25:28,683 adding 'extensions/softmax/scaled_masked_softmax_cuda.py' 2024-04-29T01:25:28,686 adding 'extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-04-29T01:25:28,692 adding 'colossalai-0.3.7.dist-info/LICENSE' 2024-04-29T01:25:28,702 adding 'colossalai-0.3.7.dist-info/METADATA' 2024-04-29T01:25:28,704 adding 'colossalai-0.3.7.dist-info/WHEEL' 2024-04-29T01:25:28,706 adding 'colossalai-0.3.7.dist-info/entry_points.txt' 2024-04-29T01:25:28,709 adding 'colossalai-0.3.7.dist-info/top_level.txt' 2024-04-29T01:25:28,738 adding 'colossalai-0.3.7.dist-info/RECORD' 2024-04-29T01:25:28,828 removing build/bdist.linux-armv7l/wheel 2024-04-29T01:25:29,962 Building wheel for colossalai (setup.py): finished with status 'done' 2024-04-29T01:25:30,011 Created wheel for colossalai: filename=colossalai-0.3.7-py3-none-any.whl size=1408431 sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba 2024-04-29T01:25:30,013 Stored in directory: /tmp/pip-ephem-wheel-cache-2kxgv5bt/wheels/f4/f5/27/ccd94bddf8ac387196d471865d26da2aa1de4f61ea85069aff 2024-04-29T01:25:30,134 Successfully built colossalai 2024-04-29T01:25:30,239 Removed build tracker: '/tmp/pip-build-tracker-_p1bt0qc'