2024-06-20T05:56:05,689 Created temporary directory: /tmp/pip-build-tracker-gegxfasx 2024-06-20T05:56:05,690 Initialized build tracking at /tmp/pip-build-tracker-gegxfasx 2024-06-20T05:56:05,691 Created build tracker: /tmp/pip-build-tracker-gegxfasx 2024-06-20T05:56:05,691 Entered build tracker: /tmp/pip-build-tracker-gegxfasx 2024-06-20T05:56:05,692 Created temporary directory: /tmp/pip-wheel-tau2zce4 2024-06-20T05:56:05,695 Created temporary directory: /tmp/pip-ephem-wheel-cache-wrxxvrrw 2024-06-20T05:56:05,719 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-06-20T05:56:05,723 2 location(s) to search for versions of colossalai: 2024-06-20T05:56:05,723 * https://pypi.org/simple/colossalai/ 2024-06-20T05:56:05,723 * https://www.piwheels.org/simple/colossalai/ 2024-06-20T05:56:05,723 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2024-06-20T05:56:05,724 Getting page https://pypi.org/simple/colossalai/ 2024-06-20T05:56:05,726 Found index url https://pypi.org/simple/ 2024-06-20T05:56:05,948 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2024-06-20T05:56:05,959 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2024-06-20T05:56:05,960 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2024-06-20T05:56:05,961 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2024-06-20T05:56:05,961 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2024-06-20T05:56:05,962 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2024-06-20T05:56:05,963 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2024-06-20T05:56:05,964 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2024-06-20T05:56:05,965 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2024-06-20T05:56:05,966 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2024-06-20T05:56:05,967 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2024-06-20T05:56:05,968 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2024-06-20T05:56:05,969 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2024-06-20T05:56:05,970 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2024-06-20T05:56:05,971 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2024-06-20T05:56:05,972 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2024-06-20T05:56:05,973 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2024-06-20T05:56:05,974 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2024-06-20T05:56:05,975 Found link https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.8 2024-06-20T05:56:05,976 Found link https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.9 2024-06-20T05:56:05,976 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2024-06-20T05:56:05,977 Getting page https://www.piwheels.org/simple/colossalai/ 2024-06-20T05:56:05,978 Found index url https://www.piwheels.org/simple/ 2024-06-20T05:56:06,148 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2024-06-20T05:56:06,154 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.8-py3-none-any.whl#sha256=73a2dba29be661597422944d917c709df77c91843d30ab323f6c740173686dab (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,154 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.7-py3-none-any.whl#sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,155 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,156 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,156 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,157 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,157 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,158 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,159 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,160 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,160 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,161 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,161 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,162 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,162 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,163 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,164 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,164 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-20T05:56:06,165 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2024-06-20T05:56:06,166 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2024-06-20T05:56:06,186 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2024-06-20T05:56:06,204 Collecting colossalai==0.3.9 2024-06-20T05:56:06,207 Created temporary directory: /tmp/pip-unpack-0bpjhgr1 2024-06-20T05:56:06,586 Downloading colossalai-0.3.9.tar.gz (1.3 MB) 2024-06-20T05:56:09,174 Added colossalai==0.3.9 from https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz to build tracker '/tmp/pip-build-tracker-gegxfasx' 2024-06-20T05:56:09,177 Running setup.py (path:/tmp/pip-wheel-tau2zce4/colossalai_4548520112fa48edaa57d6e2d290ae20/setup.py) egg_info for package colossalai 2024-06-20T05:56:09,178 Created temporary directory: /tmp/pip-pip-egg-info-0emo9uyl 2024-06-20T05:56:09,178 Preparing metadata (setup.py): started 2024-06-20T05:56:09,180 Running command python setup.py egg_info 2024-06-20T05:56:10,379 running egg_info 2024-06-20T05:56:10,380 creating /tmp/pip-pip-egg-info-0emo9uyl/colossalai.egg-info 2024-06-20T05:56:10,405 writing /tmp/pip-pip-egg-info-0emo9uyl/colossalai.egg-info/PKG-INFO 2024-06-20T05:56:10,409 writing dependency_links to /tmp/pip-pip-egg-info-0emo9uyl/colossalai.egg-info/dependency_links.txt 2024-06-20T05:56:10,410 writing entry points to /tmp/pip-pip-egg-info-0emo9uyl/colossalai.egg-info/entry_points.txt 2024-06-20T05:56:10,412 writing requirements to /tmp/pip-pip-egg-info-0emo9uyl/colossalai.egg-info/requires.txt 2024-06-20T05:56:10,413 writing top-level names to /tmp/pip-pip-egg-info-0emo9uyl/colossalai.egg-info/top_level.txt 2024-06-20T05:56:10,415 writing manifest file '/tmp/pip-pip-egg-info-0emo9uyl/colossalai.egg-info/SOURCES.txt' 2024-06-20T05:56:10,677 reading manifest file '/tmp/pip-pip-egg-info-0emo9uyl/colossalai.egg-info/SOURCES.txt' 2024-06-20T05:56:10,678 reading manifest template 'MANIFEST.in' 2024-06-20T05:56:11,951 warning: no files found matching '*.tr' under directory 'colossalai' 2024-06-20T05:56:12,584 warning: no files found matching '*.cc' under directory 'colossalai' 2024-06-20T05:56:12,886 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-06-20T05:56:13,038 warning: no files found matching '*.tr' under directory 'extensions' 2024-06-20T05:56:13,096 warning: no files found matching '*.cc' under directory 'extensions' 2024-06-20T05:56:13,122 warning: no files found matching '*.pyi' under directory 'extensions' 2024-06-20T05:56:13,123 adding license file 'LICENSE' 2024-06-20T05:56:13,153 writing manifest file '/tmp/pip-pip-egg-info-0emo9uyl/colossalai.egg-info/SOURCES.txt' 2024-06-20T05:56:13,272 Preparing metadata (setup.py): finished with status 'done' 2024-06-20T05:56:13,277 Source in /tmp/pip-wheel-tau2zce4/colossalai_4548520112fa48edaa57d6e2d290ae20 has version 0.3.9, which satisfies requirement colossalai==0.3.9 from https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz 2024-06-20T05:56:13,278 Removed colossalai==0.3.9 from https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz from build tracker '/tmp/pip-build-tracker-gegxfasx' 2024-06-20T05:56:13,288 Created temporary directory: /tmp/pip-unpack-fv_nqr48 2024-06-20T05:56:13,289 Created temporary directory: /tmp/pip-unpack-ikhfzdf9 2024-06-20T05:56:13,317 Building wheels for collected packages: colossalai 2024-06-20T05:56:13,321 Created temporary directory: /tmp/pip-wheel-idlgq4yc 2024-06-20T05:56:13,321 Building wheel for colossalai (setup.py): started 2024-06-20T05:56:13,322 Destination directory: /tmp/pip-wheel-idlgq4yc 2024-06-20T05:56:13,323 Running command python setup.py bdist_wheel 2024-06-20T05:56:14,455 running bdist_wheel 2024-06-20T05:56:14,553 running build 2024-06-20T05:56:14,553 running build_py 2024-06-20T05:56:14,581 creating build 2024-06-20T05:56:14,582 creating build/lib 2024-06-20T05:56:14,582 creating build/lib/colossalai 2024-06-20T05:56:14,584 copying colossalai/__init__.py -> build/lib/colossalai 2024-06-20T05:56:14,586 copying colossalai/initialize.py -> build/lib/colossalai 2024-06-20T05:56:14,588 copying colossalai/version.py -> build/lib/colossalai 2024-06-20T05:56:14,590 creating build/lib/extensions 2024-06-20T05:56:14,590 creating build/lib/extensions/csrc 2024-06-20T05:56:14,591 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2024-06-20T05:56:14,594 creating build/lib/extensions/pybind 2024-06-20T05:56:14,595 copying extensions/pybind/__init__.py -> build/lib/extensions/pybind 2024-06-20T05:56:14,597 creating build/lib/extensions/pybind/flash_attention 2024-06-20T05:56:14,598 copying extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-06-20T05:56:14,599 copying extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/extensions/pybind/flash_attention 2024-06-20T05:56:14,602 copying extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-06-20T05:56:14,604 copying extensions/pybind/flash_attention/__init__.py -> build/lib/extensions/pybind/flash_attention 2024-06-20T05:56:14,606 creating build/lib/extensions/pybind/layernorm 2024-06-20T05:56:14,607 copying extensions/pybind/layernorm/__init__.py -> build/lib/extensions/pybind/layernorm 2024-06-20T05:56:14,608 copying extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/extensions/pybind/layernorm 2024-06-20T05:56:14,611 creating build/lib/extensions/pybind/inference 2024-06-20T05:56:14,611 copying extensions/pybind/inference/inference_ops_cuda.py -> build/lib/extensions/pybind/inference 2024-06-20T05:56:14,613 copying extensions/pybind/inference/__init__.py -> build/lib/extensions/pybind/inference 2024-06-20T05:56:14,615 creating build/lib/extensions/pybind/moe 2024-06-20T05:56:14,616 copying extensions/pybind/moe/__init__.py -> build/lib/extensions/pybind/moe 2024-06-20T05:56:14,618 copying extensions/pybind/moe/moe_cuda.py -> build/lib/extensions/pybind/moe 2024-06-20T05:56:14,620 creating build/lib/extensions/pybind/cpu_adam 2024-06-20T05:56:14,621 copying extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/pybind/cpu_adam 2024-06-20T05:56:14,623 copying extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/pybind/cpu_adam 2024-06-20T05:56:14,624 copying extensions/pybind/cpu_adam/__init__.py -> build/lib/extensions/pybind/cpu_adam 2024-06-20T05:56:14,627 creating build/lib/extensions/pybind/softmax 2024-06-20T05:56:14,627 copying extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-06-20T05:56:14,630 copying extensions/pybind/softmax/__init__.py -> build/lib/extensions/pybind/softmax 2024-06-20T05:56:14,631 copying extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-06-20T05:56:14,634 creating build/lib/extensions/pybind/optimizer 2024-06-20T05:56:14,634 copying extensions/pybind/optimizer/__init__.py -> build/lib/extensions/pybind/optimizer 2024-06-20T05:56:14,637 copying extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/pybind/optimizer 2024-06-20T05:56:14,639 creating build/lib/colossalai/context 2024-06-20T05:56:14,645 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2024-06-20T05:56:14,647 copying colossalai/context/config.py -> build/lib/colossalai/context 2024-06-20T05:56:14,649 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2024-06-20T05:56:14,652 creating build/lib/colossalai/checkpoint_io 2024-06-20T05:56:14,653 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2024-06-20T05:56:14,656 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-06-20T05:56:14,658 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2024-06-20T05:56:14,660 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2024-06-20T05:56:14,663 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2024-06-20T05:56:14,665 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-06-20T05:56:14,668 creating build/lib/colossalai/fx 2024-06-20T05:56:14,669 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2024-06-20T05:56:14,672 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2024-06-20T05:56:14,674 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2024-06-20T05:56:14,675 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2024-06-20T05:56:14,677 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2024-06-20T05:56:14,679 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2024-06-20T05:56:14,681 creating build/lib/colossalai/zero 2024-06-20T05:56:14,682 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2024-06-20T05:56:14,683 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2024-06-20T05:56:14,686 creating build/lib/colossalai/testing 2024-06-20T05:56:14,687 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2024-06-20T05:56:14,690 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2024-06-20T05:56:14,692 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2024-06-20T05:56:14,693 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2024-06-20T05:56:14,695 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2024-06-20T05:56:14,698 creating build/lib/colossalai/tensor 2024-06-20T05:56:14,699 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2024-06-20T05:56:14,701 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2024-06-20T05:56:14,703 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2024-06-20T05:56:14,705 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2024-06-20T05:56:14,707 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2024-06-20T05:56:14,709 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2024-06-20T05:56:14,711 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2024-06-20T05:56:14,713 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2024-06-20T05:56:14,715 creating build/lib/colossalai/pipeline 2024-06-20T05:56:14,716 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2024-06-20T05:56:14,719 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2024-06-20T05:56:14,720 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2024-06-20T05:56:14,723 creating build/lib/colossalai/cluster 2024-06-20T05:56:14,724 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2024-06-20T05:56:14,726 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2024-06-20T05:56:14,728 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2024-06-20T05:56:14,730 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2024-06-20T05:56:14,732 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2024-06-20T05:56:14,734 creating build/lib/colossalai/cli 2024-06-20T05:56:14,735 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2024-06-20T05:56:14,737 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2024-06-20T05:56:14,739 creating build/lib/colossalai/_C 2024-06-20T05:56:14,740 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2024-06-20T05:56:14,742 creating build/lib/colossalai/legacy 2024-06-20T05:56:14,743 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2024-06-20T05:56:14,745 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2024-06-20T05:56:14,747 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2024-06-20T05:56:14,749 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2024-06-20T05:56:14,751 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2024-06-20T05:56:14,753 creating build/lib/colossalai/_analyzer 2024-06-20T05:56:14,754 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2024-06-20T05:56:14,756 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2024-06-20T05:56:14,758 creating build/lib/colossalai/logging 2024-06-20T05:56:14,758 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2024-06-20T05:56:14,760 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2024-06-20T05:56:14,763 creating build/lib/colossalai/auto_parallel 2024-06-20T05:56:14,763 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2024-06-20T05:56:14,765 creating build/lib/colossalai/quantization 2024-06-20T05:56:14,766 copying colossalai/quantization/bnb.py -> build/lib/colossalai/quantization 2024-06-20T05:56:14,768 copying colossalai/quantization/bnb_config.py -> build/lib/colossalai/quantization 2024-06-20T05:56:14,770 copying colossalai/quantization/__init__.py -> build/lib/colossalai/quantization 2024-06-20T05:56:14,772 creating build/lib/colossalai/accelerator 2024-06-20T05:56:14,773 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2024-06-20T05:56:14,775 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2024-06-20T05:56:14,777 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2024-06-20T05:56:14,778 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2024-06-20T05:56:14,781 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2024-06-20T05:56:14,783 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2024-06-20T05:56:14,786 creating build/lib/colossalai/device 2024-06-20T05:56:14,787 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2024-06-20T05:56:14,789 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2024-06-20T05:56:14,791 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2024-06-20T05:56:14,793 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2024-06-20T05:56:14,796 creating build/lib/colossalai/interface 2024-06-20T05:56:14,796 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2024-06-20T05:56:14,798 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2024-06-20T05:56:14,800 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2024-06-20T05:56:14,802 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2024-06-20T05:56:14,804 creating build/lib/colossalai/inference 2024-06-20T05:56:14,805 copying colossalai/inference/flash_decoding_utils.py -> build/lib/colossalai/inference 2024-06-20T05:56:14,807 copying colossalai/inference/utils.py -> build/lib/colossalai/inference 2024-06-20T05:56:14,809 copying colossalai/inference/config.py -> build/lib/colossalai/inference 2024-06-20T05:56:14,811 copying colossalai/inference/logit_processors.py -> build/lib/colossalai/inference 2024-06-20T05:56:14,814 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2024-06-20T05:56:14,815 copying colossalai/inference/sampler.py -> build/lib/colossalai/inference 2024-06-20T05:56:14,818 copying colossalai/inference/batch_bucket.py -> build/lib/colossalai/inference 2024-06-20T05:56:14,820 copying colossalai/inference/graph_runner.py -> build/lib/colossalai/inference 2024-06-20T05:56:14,822 copying colossalai/inference/struct.py -> build/lib/colossalai/inference 2024-06-20T05:56:14,824 creating build/lib/colossalai/nn 2024-06-20T05:56:14,825 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2024-06-20T05:56:14,827 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2024-06-20T05:56:14,830 creating build/lib/colossalai/moe 2024-06-20T05:56:14,831 copying colossalai/moe/loss.py -> build/lib/colossalai/moe 2024-06-20T05:56:14,833 copying colossalai/moe/utils.py -> build/lib/colossalai/moe 2024-06-20T05:56:14,835 copying colossalai/moe/checkpoint.py -> build/lib/colossalai/moe 2024-06-20T05:56:14,838 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2024-06-20T05:56:14,839 copying colossalai/moe/load_balance.py -> build/lib/colossalai/moe 2024-06-20T05:56:14,841 copying colossalai/moe/experts.py -> build/lib/colossalai/moe 2024-06-20T05:56:14,843 copying colossalai/moe/layers.py -> build/lib/colossalai/moe 2024-06-20T05:56:14,846 copying colossalai/moe/manager.py -> build/lib/colossalai/moe 2024-06-20T05:56:14,848 copying colossalai/moe/routers.py -> build/lib/colossalai/moe 2024-06-20T05:56:14,850 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2024-06-20T05:56:14,853 creating build/lib/colossalai/amp 2024-06-20T05:56:14,854 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2024-06-20T05:56:14,856 creating build/lib/colossalai/booster 2024-06-20T05:56:14,857 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2024-06-20T05:56:14,859 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2024-06-20T05:56:14,861 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2024-06-20T05:56:14,863 creating build/lib/colossalai/kernel 2024-06-20T05:56:14,864 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2024-06-20T05:56:14,865 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2024-06-20T05:56:14,867 creating build/lib/colossalai/utils 2024-06-20T05:56:14,868 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2024-06-20T05:56:14,870 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2024-06-20T05:56:14,872 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2024-06-20T05:56:14,874 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2024-06-20T05:56:14,876 creating build/lib/colossalai/shardformer 2024-06-20T05:56:14,877 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2024-06-20T05:56:14,878 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2024-06-20T05:56:14,881 creating build/lib/colossalai/lazy 2024-06-20T05:56:14,882 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2024-06-20T05:56:14,884 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2024-06-20T05:56:14,887 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2024-06-20T05:56:14,888 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2024-06-20T05:56:14,891 creating build/lib/colossalai/fx/profiler 2024-06-20T05:56:14,891 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2024-06-20T05:56:14,894 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2024-06-20T05:56:14,896 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2024-06-20T05:56:14,898 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2024-06-20T05:56:14,900 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2024-06-20T05:56:14,902 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2024-06-20T05:56:14,904 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2024-06-20T05:56:14,905 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2024-06-20T05:56:14,907 creating build/lib/colossalai/fx/tracer 2024-06-20T05:56:14,908 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2024-06-20T05:56:14,911 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2024-06-20T05:56:14,912 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2024-06-20T05:56:14,914 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2024-06-20T05:56:14,916 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2024-06-20T05:56:14,918 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2024-06-20T05:56:14,920 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2024-06-20T05:56:14,923 creating build/lib/colossalai/fx/codegen 2024-06-20T05:56:14,924 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2024-06-20T05:56:14,926 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2024-06-20T05:56:14,928 creating build/lib/colossalai/fx/passes 2024-06-20T05:56:14,929 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2024-06-20T05:56:14,932 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2024-06-20T05:56:14,934 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2024-06-20T05:56:14,936 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2024-06-20T05:56:14,938 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2024-06-20T05:56:14,940 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2024-06-20T05:56:14,942 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2024-06-20T05:56:14,944 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2024-06-20T05:56:14,947 creating build/lib/colossalai/fx/profiler/experimental 2024-06-20T05:56:14,948 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2024-06-20T05:56:14,950 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2024-06-20T05:56:14,952 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2024-06-20T05:56:14,954 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2024-06-20T05:56:14,955 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2024-06-20T05:56:14,958 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:14,959 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:14,960 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:14,962 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:14,964 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:14,966 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:14,967 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:14,969 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:14,971 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:14,973 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:14,975 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:14,976 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:14,979 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:14,981 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:14,982 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:14,984 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:14,986 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:14,987 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:14,989 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:14,991 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:14,992 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:14,994 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:14,996 creating build/lib/colossalai/fx/tracer/meta_patch 2024-06-20T05:56:14,997 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2024-06-20T05:56:14,999 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2024-06-20T05:56:15,000 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2024-06-20T05:56:15,003 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:15,003 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:15,005 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:15,007 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:15,009 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:15,011 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:15,013 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:15,015 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:15,017 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:15,019 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:15,020 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:15,022 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:15,024 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:15,026 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:15,030 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:15,032 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:15,034 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:15,035 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:15,039 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-20T05:56:15,040 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-20T05:56:15,042 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-20T05:56:15,044 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-20T05:56:15,046 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-20T05:56:15,048 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-20T05:56:15,049 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-20T05:56:15,051 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-20T05:56:15,053 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-20T05:56:15,054 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-20T05:56:15,056 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-20T05:56:15,058 creating build/lib/colossalai/zero/low_level 2024-06-20T05:56:15,059 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2024-06-20T05:56:15,061 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2024-06-20T05:56:15,064 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2024-06-20T05:56:15,067 creating build/lib/colossalai/zero/gemini 2024-06-20T05:56:15,067 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2024-06-20T05:56:15,070 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2024-06-20T05:56:15,072 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2024-06-20T05:56:15,074 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2024-06-20T05:56:15,077 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2024-06-20T05:56:15,079 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2024-06-20T05:56:15,081 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2024-06-20T05:56:15,084 creating build/lib/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:15,085 copying colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:15,087 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:15,089 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:15,090 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:15,092 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:15,093 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:15,096 creating build/lib/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:15,097 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:15,099 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:15,100 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:15,102 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:15,104 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:15,106 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:15,107 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:15,109 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:15,111 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:15,113 creating build/lib/colossalai/zero/gemini/chunk 2024-06-20T05:56:15,114 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-06-20T05:56:15,116 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2024-06-20T05:56:15,118 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-06-20T05:56:15,120 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2024-06-20T05:56:15,122 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2024-06-20T05:56:15,125 creating build/lib/colossalai/tensor/padded_tensor 2024-06-20T05:56:15,126 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2024-06-20T05:56:15,128 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2024-06-20T05:56:15,130 creating build/lib/colossalai/tensor/d_tensor 2024-06-20T05:56:15,131 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2024-06-20T05:56:15,134 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2024-06-20T05:56:15,135 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2024-06-20T05:56:15,137 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2024-06-20T05:56:15,140 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2024-06-20T05:56:15,142 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-06-20T05:56:15,144 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-06-20T05:56:15,147 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2024-06-20T05:56:15,150 creating build/lib/colossalai/tensor/moe_tensor 2024-06-20T05:56:15,152 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2024-06-20T05:56:15,154 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2024-06-20T05:56:15,156 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2024-06-20T05:56:15,158 creating build/lib/colossalai/pipeline/schedule 2024-06-20T05:56:15,160 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2024-06-20T05:56:15,163 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2024-06-20T05:56:15,165 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2024-06-20T05:56:15,167 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2024-06-20T05:56:15,169 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2024-06-20T05:56:15,171 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2024-06-20T05:56:15,175 creating build/lib/colossalai/cli/launcher 2024-06-20T05:56:15,176 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2024-06-20T05:56:15,178 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2024-06-20T05:56:15,180 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2024-06-20T05:56:15,182 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2024-06-20T05:56:15,186 creating build/lib/colossalai/cli/check 2024-06-20T05:56:15,187 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2024-06-20T05:56:15,189 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2024-06-20T05:56:15,192 creating build/lib/colossalai/legacy/context 2024-06-20T05:56:15,193 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2024-06-20T05:56:15,196 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2024-06-20T05:56:15,198 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2024-06-20T05:56:15,201 creating build/lib/colossalai/legacy/zero 2024-06-20T05:56:15,202 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2024-06-20T05:56:15,204 creating build/lib/colossalai/legacy/tensor 2024-06-20T05:56:15,206 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2024-06-20T05:56:15,208 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2024-06-20T05:56:15,210 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2024-06-20T05:56:15,212 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2024-06-20T05:56:15,214 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2024-06-20T05:56:15,216 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2024-06-20T05:56:15,218 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2024-06-20T05:56:15,221 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2024-06-20T05:56:15,224 creating build/lib/colossalai/legacy/pipeline 2024-06-20T05:56:15,225 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2024-06-20T05:56:15,228 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2024-06-20T05:56:15,230 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2024-06-20T05:56:15,233 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2024-06-20T05:56:15,235 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2024-06-20T05:56:15,237 creating build/lib/colossalai/legacy/engine 2024-06-20T05:56:15,238 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2024-06-20T05:56:15,240 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2024-06-20T05:56:15,242 creating build/lib/colossalai/legacy/builder 2024-06-20T05:56:15,243 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2024-06-20T05:56:15,244 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2024-06-20T05:56:15,246 creating build/lib/colossalai/legacy/registry 2024-06-20T05:56:15,247 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2024-06-20T05:56:15,249 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2024-06-20T05:56:15,251 creating build/lib/colossalai/legacy/communication 2024-06-20T05:56:15,252 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2024-06-20T05:56:15,254 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2024-06-20T05:56:15,256 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2024-06-20T05:56:15,258 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2024-06-20T05:56:15,260 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2024-06-20T05:56:15,262 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2024-06-20T05:56:15,265 creating build/lib/colossalai/legacy/inference 2024-06-20T05:56:15,266 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2024-06-20T05:56:15,267 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2024-06-20T05:56:15,269 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2024-06-20T05:56:15,271 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2024-06-20T05:56:15,274 creating build/lib/colossalai/legacy/nn 2024-06-20T05:56:15,275 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2024-06-20T05:56:15,277 creating build/lib/colossalai/legacy/amp 2024-06-20T05:56:15,278 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2024-06-20T05:56:15,280 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2024-06-20T05:56:15,282 creating build/lib/colossalai/legacy/utils 2024-06-20T05:56:15,283 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2024-06-20T05:56:15,285 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2024-06-20T05:56:15,287 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2024-06-20T05:56:15,289 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2024-06-20T05:56:15,291 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2024-06-20T05:56:15,294 creating build/lib/colossalai/legacy/trainer 2024-06-20T05:56:15,295 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2024-06-20T05:56:15,298 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2024-06-20T05:56:15,300 creating build/lib/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:15,301 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:15,303 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:15,305 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:15,307 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:15,308 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:15,310 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:15,312 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:15,314 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:15,316 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:15,318 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:15,319 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:15,322 creating build/lib/colossalai/legacy/context/random 2024-06-20T05:56:15,323 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2024-06-20T05:56:15,325 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2024-06-20T05:56:15,326 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2024-06-20T05:56:15,329 creating build/lib/colossalai/legacy/zero/gemini 2024-06-20T05:56:15,330 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-20T05:56:15,332 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-20T05:56:15,334 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-20T05:56:15,336 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-20T05:56:15,338 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-20T05:56:15,340 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-20T05:56:15,342 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-20T05:56:15,344 creating build/lib/colossalai/legacy/zero/shard_utils 2024-06-20T05:56:15,345 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-06-20T05:56:15,347 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-06-20T05:56:15,348 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-06-20T05:56:15,350 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-06-20T05:56:15,352 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-06-20T05:56:15,354 creating build/lib/colossalai/legacy/zero/init_ctx 2024-06-20T05:56:15,355 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-06-20T05:56:15,358 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-06-20T05:56:15,360 creating build/lib/colossalai/legacy/zero/sharded_param 2024-06-20T05:56:15,361 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-06-20T05:56:15,363 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-06-20T05:56:15,364 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-06-20T05:56:15,366 creating build/lib/colossalai/legacy/zero/sharded_optim 2024-06-20T05:56:15,367 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-06-20T05:56:15,370 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-06-20T05:56:15,372 creating build/lib/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:15,373 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:15,375 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:15,376 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:15,379 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:15,380 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:15,382 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:15,385 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-06-20T05:56:15,386 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-06-20T05:56:15,388 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-06-20T05:56:15,390 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2024-06-20T05:56:15,391 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-06-20T05:56:15,393 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-06-20T05:56:15,394 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-06-20T05:56:15,397 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-06-20T05:56:15,398 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-06-20T05:56:15,401 creating build/lib/colossalai/legacy/pipeline/rpc 2024-06-20T05:56:15,402 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-06-20T05:56:15,404 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-06-20T05:56:15,407 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-06-20T05:56:15,409 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-06-20T05:56:15,411 creating build/lib/colossalai/legacy/pipeline/middleware 2024-06-20T05:56:15,412 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-06-20T05:56:15,415 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-06-20T05:56:15,417 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-06-20T05:56:15,418 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-06-20T05:56:15,420 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-06-20T05:56:15,422 creating build/lib/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:15,423 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:15,425 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:15,427 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:15,428 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:15,430 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:15,432 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:15,433 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:15,435 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:15,437 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2024-06-20T05:56:15,438 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-06-20T05:56:15,440 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-06-20T05:56:15,443 creating build/lib/colossalai/legacy/engine/schedule 2024-06-20T05:56:15,444 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-06-20T05:56:15,447 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-06-20T05:56:15,448 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2024-06-20T05:56:15,450 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-06-20T05:56:15,452 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2024-06-20T05:56:15,454 creating build/lib/colossalai/legacy/inference/pipeline 2024-06-20T05:56:15,455 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2024-06-20T05:56:15,458 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2024-06-20T05:56:15,460 creating build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:15,461 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:15,463 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:15,465 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:15,466 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:15,468 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:15,470 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:15,472 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:15,474 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:15,476 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:15,478 creating build/lib/colossalai/legacy/inference/tensor_parallel 2024-06-20T05:56:15,479 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-06-20T05:56:15,481 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-06-20T05:56:15,483 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-06-20T05:56:15,485 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-06-20T05:56:15,487 creating build/lib/colossalai/legacy/inference/hybridengine 2024-06-20T05:56:15,488 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-06-20T05:56:15,490 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-06-20T05:56:15,492 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-06-20T05:56:15,493 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-06-20T05:56:15,495 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-06-20T05:56:15,497 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-06-20T05:56:15,499 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-06-20T05:56:15,501 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-20T05:56:15,502 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-20T05:56:15,505 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-20T05:56:15,507 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-20T05:56:15,509 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-20T05:56:15,511 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-20T05:56:15,514 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-06-20T05:56:15,515 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-06-20T05:56:15,517 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-06-20T05:56:15,518 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-06-20T05:56:15,521 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2024-06-20T05:56:15,522 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-06-20T05:56:15,524 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-06-20T05:56:15,526 creating build/lib/colossalai/legacy/nn/_ops 2024-06-20T05:56:15,527 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2024-06-20T05:56:15,529 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2024-06-20T05:56:15,532 creating build/lib/colossalai/legacy/nn/layer 2024-06-20T05:56:15,533 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2024-06-20T05:56:15,535 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2024-06-20T05:56:15,537 creating build/lib/colossalai/legacy/nn/parallel 2024-06-20T05:56:15,538 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2024-06-20T05:56:15,539 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2024-06-20T05:56:15,541 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2024-06-20T05:56:15,544 creating build/lib/colossalai/legacy/nn/loss 2024-06-20T05:56:15,545 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2024-06-20T05:56:15,547 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2024-06-20T05:56:15,549 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2024-06-20T05:56:15,550 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2024-06-20T05:56:15,552 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2024-06-20T05:56:15,555 creating build/lib/colossalai/legacy/nn/metric 2024-06-20T05:56:15,556 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2024-06-20T05:56:15,558 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2024-06-20T05:56:15,560 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2024-06-20T05:56:15,562 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2024-06-20T05:56:15,563 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2024-06-20T05:56:15,565 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-06-20T05:56:15,566 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-06-20T05:56:15,568 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-06-20T05:56:15,570 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-06-20T05:56:15,572 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-06-20T05:56:15,576 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-06-20T05:56:15,577 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-06-20T05:56:15,578 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-06-20T05:56:15,580 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-06-20T05:56:15,582 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-06-20T05:56:15,585 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-06-20T05:56:15,586 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-06-20T05:56:15,588 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-06-20T05:56:15,590 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-06-20T05:56:15,593 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-06-20T05:56:15,595 creating build/lib/colossalai/legacy/nn/layer/wrapper 2024-06-20T05:56:15,596 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-06-20T05:56:15,598 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-06-20T05:56:15,600 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:15,601 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:15,603 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:15,604 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:15,606 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:15,607 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:15,609 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:15,611 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-20T05:56:15,612 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-20T05:56:15,614 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-20T05:56:15,616 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-20T05:56:15,619 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-20T05:56:15,622 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-06-20T05:56:15,623 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-06-20T05:56:15,625 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-06-20T05:56:15,627 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-06-20T05:56:15,630 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-06-20T05:56:15,633 creating build/lib/colossalai/legacy/nn/layer/utils 2024-06-20T05:56:15,634 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-06-20T05:56:15,636 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-06-20T05:56:15,638 creating build/lib/colossalai/legacy/nn/layer/vanilla 2024-06-20T05:56:15,639 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-06-20T05:56:15,641 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-06-20T05:56:15,644 creating build/lib/colossalai/legacy/nn/parallel/layers 2024-06-20T05:56:15,645 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-06-20T05:56:15,647 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-06-20T05:56:15,649 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-06-20T05:56:15,650 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-06-20T05:56:15,652 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-06-20T05:56:15,655 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:15,656 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:15,658 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:15,659 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:15,661 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:15,663 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:15,665 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:15,667 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:15,669 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:15,671 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:15,673 creating build/lib/colossalai/legacy/amp/torch_amp 2024-06-20T05:56:15,674 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-06-20T05:56:15,676 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-06-20T05:56:15,678 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-06-20T05:56:15,681 creating build/lib/colossalai/legacy/amp/apex_amp 2024-06-20T05:56:15,682 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-06-20T05:56:15,683 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-06-20T05:56:15,686 creating build/lib/colossalai/legacy/amp/naive_amp 2024-06-20T05:56:15,686 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-06-20T05:56:15,689 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-06-20T05:56:15,690 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-06-20T05:56:15,693 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-06-20T05:56:15,695 creating build/lib/colossalai/legacy/utils/checkpoint 2024-06-20T05:56:15,696 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-06-20T05:56:15,698 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-06-20T05:56:15,699 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-06-20T05:56:15,702 creating build/lib/colossalai/legacy/utils/profiler 2024-06-20T05:56:15,703 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2024-06-20T05:56:15,705 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2024-06-20T05:56:15,707 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-06-20T05:56:15,709 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-06-20T05:56:15,711 creating build/lib/colossalai/legacy/utils/data_sampler 2024-06-20T05:56:15,712 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-06-20T05:56:15,714 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-06-20T05:56:15,716 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-06-20T05:56:15,718 creating build/lib/colossalai/legacy/utils/profiler/legacy 2024-06-20T05:56:15,718 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-06-20T05:56:15,720 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-06-20T05:56:15,722 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-06-20T05:56:15,724 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-06-20T05:56:15,727 creating build/lib/colossalai/legacy/trainer/hooks 2024-06-20T05:56:15,727 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-20T05:56:15,729 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-20T05:56:15,731 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-20T05:56:15,733 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-20T05:56:15,735 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-20T05:56:15,737 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-20T05:56:15,739 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-20T05:56:15,742 creating build/lib/colossalai/_analyzer/fx 2024-06-20T05:56:15,743 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2024-06-20T05:56:15,745 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2024-06-20T05:56:15,747 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2024-06-20T05:56:15,748 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2024-06-20T05:56:15,751 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2024-06-20T05:56:15,753 creating build/lib/colossalai/_analyzer/_subclasses 2024-06-20T05:56:15,754 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2024-06-20T05:56:15,757 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2024-06-20T05:56:15,759 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-06-20T05:56:15,761 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-06-20T05:56:15,763 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2024-06-20T05:56:15,766 creating build/lib/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:15,767 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:15,770 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:15,772 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:15,778 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:15,780 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:15,782 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:15,785 creating build/lib/colossalai/_analyzer/fx/passes 2024-06-20T05:56:15,786 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2024-06-20T05:56:15,788 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2024-06-20T05:56:15,790 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2024-06-20T05:56:15,793 creating build/lib/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:15,794 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:15,796 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:15,799 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:15,800 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:15,803 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:15,805 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:15,807 creating build/lib/colossalai/auto_parallel/meta_profiler 2024-06-20T05:56:15,808 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-06-20T05:56:15,810 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-06-20T05:56:15,812 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-06-20T05:56:15,814 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-06-20T05:56:15,817 creating build/lib/colossalai/auto_parallel/tensor_shard 2024-06-20T05:56:15,818 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-06-20T05:56:15,820 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-06-20T05:56:15,822 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-06-20T05:56:15,824 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-06-20T05:56:15,826 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-06-20T05:56:15,829 creating build/lib/colossalai/auto_parallel/passes 2024-06-20T05:56:15,830 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2024-06-20T05:56:15,832 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-06-20T05:56:15,835 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2024-06-20T05:56:15,837 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-06-20T05:56:15,839 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-06-20T05:56:15,842 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2024-06-20T05:56:15,844 creating build/lib/colossalai/auto_parallel/pipeline_shard 2024-06-20T05:56:15,846 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2024-06-20T05:56:15,848 creating build/lib/colossalai/auto_parallel/offload 2024-06-20T05:56:15,849 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2024-06-20T05:56:15,852 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2024-06-20T05:56:15,854 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2024-06-20T05:56:15,856 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2024-06-20T05:56:15,859 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2024-06-20T05:56:15,861 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2024-06-20T05:56:15,863 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2024-06-20T05:56:15,864 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2024-06-20T05:56:15,867 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2024-06-20T05:56:15,869 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2024-06-20T05:56:15,871 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:15,873 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:15,875 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:15,877 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:15,879 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:15,882 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:15,884 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:15,887 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:15,890 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:15,893 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:15,895 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:15,898 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:15,903 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,904 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,907 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,909 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,912 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,915 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,918 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,920 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,923 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,925 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,927 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,930 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,933 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,935 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,938 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,940 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,943 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,946 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,948 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,951 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,954 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,956 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,960 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,963 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,968 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,971 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,973 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,976 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:15,980 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:15,981 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:15,984 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:15,987 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:15,990 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:15,993 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:15,996 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:16,000 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-06-20T05:56:16,001 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-06-20T05:56:16,005 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-06-20T05:56:16,008 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-06-20T05:56:16,011 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-06-20T05:56:16,014 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-06-20T05:56:16,018 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,020 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,023 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,026 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,030 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,033 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,035 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,039 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,042 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,045 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,049 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,051 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,054 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,057 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,059 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,061 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,064 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,067 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,069 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,072 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:16,076 creating build/lib/colossalai/inference/server 2024-06-20T05:56:16,077 copying colossalai/inference/server/utils.py -> build/lib/colossalai/inference/server 2024-06-20T05:56:16,079 copying colossalai/inference/server/completion_service.py -> build/lib/colossalai/inference/server 2024-06-20T05:56:16,081 copying colossalai/inference/server/__init__.py -> build/lib/colossalai/inference/server 2024-06-20T05:56:16,083 copying colossalai/inference/server/chat_service.py -> build/lib/colossalai/inference/server 2024-06-20T05:56:16,085 copying colossalai/inference/server/api_server.py -> build/lib/colossalai/inference/server 2024-06-20T05:56:16,088 creating build/lib/colossalai/inference/core 2024-06-20T05:56:16,089 copying colossalai/inference/core/plugin.py -> build/lib/colossalai/inference/core 2024-06-20T05:56:16,091 copying colossalai/inference/core/request_handler.py -> build/lib/colossalai/inference/core 2024-06-20T05:56:16,094 copying colossalai/inference/core/engine.py -> build/lib/colossalai/inference/core 2024-06-20T05:56:16,096 copying colossalai/inference/core/__init__.py -> build/lib/colossalai/inference/core 2024-06-20T05:56:16,098 copying colossalai/inference/core/async_engine.py -> build/lib/colossalai/inference/core 2024-06-20T05:56:16,101 copying colossalai/inference/core/rpc_engine.py -> build/lib/colossalai/inference/core 2024-06-20T05:56:16,103 creating build/lib/colossalai/inference/executor 2024-06-20T05:56:16,104 copying colossalai/inference/executor/rpc_worker.py -> build/lib/colossalai/inference/executor 2024-06-20T05:56:16,106 copying colossalai/inference/executor/__init__.py -> build/lib/colossalai/inference/executor 2024-06-20T05:56:16,108 creating build/lib/colossalai/inference/modeling 2024-06-20T05:56:16,109 copying colossalai/inference/modeling/__init__.py -> build/lib/colossalai/inference/modeling 2024-06-20T05:56:16,111 creating build/lib/colossalai/inference/spec 2024-06-20T05:56:16,112 copying colossalai/inference/spec/drafter.py -> build/lib/colossalai/inference/spec 2024-06-20T05:56:16,114 copying colossalai/inference/spec/__init__.py -> build/lib/colossalai/inference/spec 2024-06-20T05:56:16,116 copying colossalai/inference/spec/struct.py -> build/lib/colossalai/inference/spec 2024-06-20T05:56:16,118 creating build/lib/colossalai/inference/kv_cache 2024-06-20T05:56:16,119 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2024-06-20T05:56:16,122 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2024-06-20T05:56:16,123 copying colossalai/inference/kv_cache/block_cache.py -> build/lib/colossalai/inference/kv_cache 2024-06-20T05:56:16,126 creating build/lib/colossalai/inference/modeling/layers 2024-06-20T05:56:16,127 copying colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/lib/colossalai/inference/modeling/layers 2024-06-20T05:56:16,128 copying colossalai/inference/modeling/layers/__init__.py -> build/lib/colossalai/inference/modeling/layers 2024-06-20T05:56:16,130 copying colossalai/inference/modeling/layers/attention.py -> build/lib/colossalai/inference/modeling/layers 2024-06-20T05:56:16,133 creating build/lib/colossalai/inference/modeling/policy 2024-06-20T05:56:16,134 copying colossalai/inference/modeling/policy/glide_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-06-20T05:56:16,136 copying colossalai/inference/modeling/policy/__init__.py -> build/lib/colossalai/inference/modeling/policy 2024-06-20T05:56:16,137 copying colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/policy 2024-06-20T05:56:16,139 copying colossalai/inference/modeling/policy/nopadding_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-06-20T05:56:16,142 creating build/lib/colossalai/inference/modeling/models 2024-06-20T05:56:16,143 copying colossalai/inference/modeling/models/glide_llama.py -> build/lib/colossalai/inference/modeling/models 2024-06-20T05:56:16,145 copying colossalai/inference/modeling/models/__init__.py -> build/lib/colossalai/inference/modeling/models 2024-06-20T05:56:16,147 copying colossalai/inference/modeling/models/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/models 2024-06-20T05:56:16,149 copying colossalai/inference/modeling/models/nopadding_llama.py -> build/lib/colossalai/inference/modeling/models 2024-06-20T05:56:16,152 creating build/lib/colossalai/inference/modeling/backends 2024-06-20T05:56:16,153 copying colossalai/inference/modeling/backends/pre_attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-06-20T05:56:16,155 copying colossalai/inference/modeling/backends/__init__.py -> build/lib/colossalai/inference/modeling/backends 2024-06-20T05:56:16,157 copying colossalai/inference/modeling/backends/attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-06-20T05:56:16,160 creating build/lib/colossalai/nn/lr_scheduler 2024-06-20T05:56:16,161 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-20T05:56:16,163 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-20T05:56:16,165 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-20T05:56:16,167 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-20T05:56:16,169 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-20T05:56:16,171 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-20T05:56:16,173 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-20T05:56:16,175 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-20T05:56:16,177 creating build/lib/colossalai/nn/layer 2024-06-20T05:56:16,178 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2024-06-20T05:56:16,180 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2024-06-20T05:56:16,182 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2024-06-20T05:56:16,184 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2024-06-20T05:56:16,186 creating build/lib/colossalai/nn/loss 2024-06-20T05:56:16,187 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2024-06-20T05:56:16,190 creating build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,191 copying colossalai/nn/optimizer/distributed_came.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,194 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,196 copying colossalai/nn/optimizer/distributed_lamb.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,198 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,200 copying colossalai/nn/optimizer/galore.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,202 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,204 copying colossalai/nn/optimizer/came.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,206 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,208 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,210 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,212 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,214 copying colossalai/nn/optimizer/distributed_adafactor.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,216 copying colossalai/nn/optimizer/distributed_galore.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,219 copying colossalai/nn/optimizer/adafactor.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,221 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,223 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2024-06-20T05:56:16,225 creating build/lib/colossalai/amp/naive_amp 2024-06-20T05:56:16,226 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2024-06-20T05:56:16,227 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2024-06-20T05:56:16,230 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-20T05:56:16,231 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-20T05:56:16,233 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-20T05:56:16,235 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-20T05:56:16,236 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-20T05:56:16,239 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2024-06-20T05:56:16,240 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-06-20T05:56:16,242 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-06-20T05:56:16,243 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-06-20T05:56:16,245 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-06-20T05:56:16,248 creating build/lib/colossalai/booster/mixed_precision 2024-06-20T05:56:16,249 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2024-06-20T05:56:16,251 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2024-06-20T05:56:16,253 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2024-06-20T05:56:16,255 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2024-06-20T05:56:16,257 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2024-06-20T05:56:16,258 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2024-06-20T05:56:16,260 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2024-06-20T05:56:16,263 creating build/lib/colossalai/booster/plugin 2024-06-20T05:56:16,264 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-06-20T05:56:16,267 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-06-20T05:56:16,270 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2024-06-20T05:56:16,272 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-06-20T05:56:16,274 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2024-06-20T05:56:16,277 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2024-06-20T05:56:16,279 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2024-06-20T05:56:16,281 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2024-06-20T05:56:16,283 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2024-06-20T05:56:16,284 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-06-20T05:56:16,286 creating build/lib/colossalai/kernel/extensions 2024-06-20T05:56:16,287 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2024-06-20T05:56:16,290 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2024-06-20T05:56:16,291 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2024-06-20T05:56:16,293 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2024-06-20T05:56:16,296 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2024-06-20T05:56:16,297 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2024-06-20T05:56:16,300 creating build/lib/colossalai/kernel/triton 2024-06-20T05:56:16,301 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2024-06-20T05:56:16,303 copying colossalai/kernel/triton/context_attn_unpad.py -> build/lib/colossalai/kernel/triton 2024-06-20T05:56:16,306 copying colossalai/kernel/triton/rms_layernorm.py -> build/lib/colossalai/kernel/triton 2024-06-20T05:56:16,308 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2024-06-20T05:56:16,310 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2024-06-20T05:56:16,312 copying colossalai/kernel/triton/rotary_cache_copy.py -> build/lib/colossalai/kernel/triton 2024-06-20T05:56:16,314 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2024-06-20T05:56:16,316 copying colossalai/kernel/triton/kvcache_copy.py -> build/lib/colossalai/kernel/triton 2024-06-20T05:56:16,319 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2024-06-20T05:56:16,321 copying colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-06-20T05:56:16,323 copying colossalai/kernel/triton/fused_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-06-20T05:56:16,326 creating build/lib/colossalai/kernel/jit 2024-06-20T05:56:16,327 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2024-06-20T05:56:16,328 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2024-06-20T05:56:16,330 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2024-06-20T05:56:16,332 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2024-06-20T05:56:16,334 creating build/lib/colossalai/kernel/extensions/csrc 2024-06-20T05:56:16,335 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2024-06-20T05:56:16,337 creating build/lib/colossalai/kernel/extensions/pybind 2024-06-20T05:56:16,338 copying colossalai/kernel/extensions/pybind/__init__.py -> build/lib/colossalai/kernel/extensions/pybind 2024-06-20T05:56:16,340 creating build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-06-20T05:56:16,341 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-06-20T05:56:16,343 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-06-20T05:56:16,345 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-06-20T05:56:16,347 copying colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-06-20T05:56:16,349 creating build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-06-20T05:56:16,350 copying colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-06-20T05:56:16,351 copying colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-06-20T05:56:16,353 creating build/lib/colossalai/kernel/extensions/pybind/inference 2024-06-20T05:56:16,354 copying colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-06-20T05:56:16,356 copying colossalai/kernel/extensions/pybind/inference/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-06-20T05:56:16,358 creating build/lib/colossalai/kernel/extensions/pybind/moe 2024-06-20T05:56:16,359 copying colossalai/kernel/extensions/pybind/moe/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-06-20T05:56:16,361 copying colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-06-20T05:56:16,363 creating build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-20T05:56:16,364 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-20T05:56:16,366 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-20T05:56:16,368 copying colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-20T05:56:16,370 creating build/lib/colossalai/kernel/extensions/pybind/softmax 2024-06-20T05:56:16,371 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-06-20T05:56:16,373 copying colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-06-20T05:56:16,374 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-06-20T05:56:16,376 creating build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-06-20T05:56:16,377 copying colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-06-20T05:56:16,379 copying colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-06-20T05:56:16,381 creating build/lib/colossalai/utils/rank_recorder 2024-06-20T05:56:16,382 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2024-06-20T05:56:16,384 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2024-06-20T05:56:16,387 creating build/lib/colossalai/utils/multi_tensor_apply 2024-06-20T05:56:16,388 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-06-20T05:56:16,390 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-06-20T05:56:16,392 creating build/lib/colossalai/utils/model 2024-06-20T05:56:16,393 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2024-06-20T05:56:16,394 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2024-06-20T05:56:16,396 creating build/lib/colossalai/utils/tensor_detector 2024-06-20T05:56:16,397 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2024-06-20T05:56:16,399 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2024-06-20T05:56:16,402 creating build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,403 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,405 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,407 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,410 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,412 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,414 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,416 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,419 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,421 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,424 copying colossalai/shardformer/policies/qwen2.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,426 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,428 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,430 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,432 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,434 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,437 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,439 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,442 copying colossalai/shardformer/policies/command.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,444 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2024-06-20T05:56:16,447 creating build/lib/colossalai/shardformer/shard 2024-06-20T05:56:16,449 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2024-06-20T05:56:16,451 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2024-06-20T05:56:16,453 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2024-06-20T05:56:16,455 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2024-06-20T05:56:16,457 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2024-06-20T05:56:16,459 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2024-06-20T05:56:16,462 creating build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,463 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,465 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,469 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,471 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,474 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,477 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,480 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,483 copying colossalai/shardformer/modeling/qwen2.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,486 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,488 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,491 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,492 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,494 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,497 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,500 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,503 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,506 copying colossalai/shardformer/modeling/command.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,509 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2024-06-20T05:56:16,513 creating build/lib/colossalai/shardformer/layer 2024-06-20T05:56:16,514 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2024-06-20T05:56:16,517 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2024-06-20T05:56:16,519 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2024-06-20T05:56:16,522 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2024-06-20T05:56:16,524 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2024-06-20T05:56:16,526 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2024-06-20T05:56:16,529 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2024-06-20T05:56:16,531 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2024-06-20T05:56:16,533 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2024-06-20T05:56:16,535 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2024-06-20T05:56:16,538 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2024-06-20T05:56:16,541 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-06-20T05:56:16,542 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-06-20T05:56:16,544 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-06-20T05:56:16,546 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-06-20T05:56:16,623 creating build/lib/colossalai/kernel/extensions/csrc/funcs 2024-06-20T05:56:16,624 copying colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-06-20T05:56:16,627 copying colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-06-20T05:56:16,630 copying colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-06-20T05:56:16,632 copying colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-06-20T05:56:16,634 copying colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-06-20T05:56:16,636 creating build/lib/colossalai/kernel/extensions/csrc/common 2024-06-20T05:56:16,637 copying colossalai/kernel/extensions/csrc/common/target.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-06-20T05:56:16,639 copying colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-06-20T05:56:16,641 copying colossalai/kernel/extensions/csrc/common/data_type.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-06-20T05:56:16,643 copying colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-06-20T05:56:16,645 copying colossalai/kernel/extensions/csrc/common/micros.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-06-20T05:56:16,647 creating build/lib/colossalai/kernel/extensions/csrc/kernel 2024-06-20T05:56:16,648 creating build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-06-20T05:56:16,649 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-06-20T05:56:16,651 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-06-20T05:56:16,654 creating build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-06-20T05:56:16,655 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-06-20T05:56:16,658 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-06-20T05:56:16,660 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,661 copying colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,663 copying colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,665 copying colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,668 copying colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,671 copying colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,674 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,676 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,679 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,682 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,684 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,686 copying colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,689 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,692 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,694 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,697 copying colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,699 copying colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,701 copying colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,704 copying colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:16,706 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-06-20T05:56:16,707 copying colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-06-20T05:56:16,710 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-20T05:56:16,710 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-20T05:56:16,712 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-20T05:56:16,715 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-20T05:56:16,717 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-20T05:56:16,721 copying colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-06-20T05:56:16,724 copying colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-06-20T05:56:16,726 copying colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-06-20T05:56:16,730 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-06-20T05:56:16,733 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-06-20T05:56:16,735 copying colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-06-20T05:56:16,841 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-06-20T05:56:16,842 !! 2024-06-20T05:56:16,843 ******************************************************************************** 2024-06-20T05:56:16,843 Please avoid running ``setup.py`` directly. 2024-06-20T05:56:16,844 Instead, use pypa/build, pypa/installer or other 2024-06-20T05:56:16,845 standards-based tools. 2024-06-20T05:56:16,846 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-06-20T05:56:16,846 ******************************************************************************** 2024-06-20T05:56:16,848 !! 2024-06-20T05:56:16,848 self.initialize_options() 2024-06-20T05:56:16,867 installing to build/bdist.linux-armv7l/wheel 2024-06-20T05:56:16,867 running install 2024-06-20T05:56:16,891 running install_lib 2024-06-20T05:56:16,916 creating build/bdist.linux-armv7l 2024-06-20T05:56:16,916 creating build/bdist.linux-armv7l/wheel 2024-06-20T05:56:16,918 creating build/bdist.linux-armv7l/wheel/extensions 2024-06-20T05:56:16,919 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2024-06-20T05:56:16,920 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/csrc 2024-06-20T05:56:16,922 creating build/bdist.linux-armv7l/wheel/extensions/pybind 2024-06-20T05:56:16,923 creating build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-06-20T05:56:16,924 copying build/lib/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-06-20T05:56:16,926 copying build/lib/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-06-20T05:56:16,928 copying build/lib/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-06-20T05:56:16,929 copying build/lib/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-06-20T05:56:16,931 creating build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-06-20T05:56:16,932 copying build/lib/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-06-20T05:56:16,934 copying build/lib/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-06-20T05:56:16,936 copying build/lib/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind 2024-06-20T05:56:16,938 creating build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-06-20T05:56:16,939 copying build/lib/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-06-20T05:56:16,941 copying build/lib/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-06-20T05:56:16,943 creating build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-06-20T05:56:16,943 copying build/lib/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-06-20T05:56:16,945 copying build/lib/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-06-20T05:56:16,947 creating build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-06-20T05:56:16,948 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-06-20T05:56:16,950 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-06-20T05:56:16,952 copying build/lib/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-06-20T05:56:16,954 creating build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-06-20T05:56:16,955 copying build/lib/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-06-20T05:56:16,957 copying build/lib/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-06-20T05:56:16,959 copying build/lib/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-06-20T05:56:16,961 creating build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-06-20T05:56:16,962 copying build/lib/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-06-20T05:56:16,964 copying build/lib/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-06-20T05:56:16,967 creating build/bdist.linux-armv7l/wheel/colossalai 2024-06-20T05:56:16,968 creating build/bdist.linux-armv7l/wheel/colossalai/context 2024-06-20T05:56:16,969 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-06-20T05:56:16,971 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-06-20T05:56:16,972 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-06-20T05:56:16,974 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-20T05:56:16,975 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-20T05:56:16,978 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-20T05:56:16,980 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-20T05:56:16,981 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-20T05:56:16,984 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-20T05:56:16,986 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-20T05:56:16,989 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-20T05:56:16,990 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-20T05:56:16,991 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-20T05:56:16,994 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-20T05:56:16,996 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-20T05:56:16,999 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-20T05:56:17,001 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-20T05:56:17,004 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-20T05:56:17,006 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-20T05:56:17,008 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-06-20T05:56:17,009 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-06-20T05:56:17,012 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:17,013 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:17,015 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:17,016 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:17,018 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:17,020 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:17,022 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:17,023 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:17,025 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:17,027 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-20T05:56:17,029 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-06-20T05:56:17,030 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-06-20T05:56:17,032 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-06-20T05:56:17,034 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-06-20T05:56:17,036 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:17,037 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:17,039 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:17,041 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:17,043 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:17,045 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:17,047 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:17,049 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:17,051 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:17,052 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:17,054 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:17,056 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-20T05:56:17,058 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-20T05:56:17,060 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-20T05:56:17,061 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-20T05:56:17,063 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-20T05:56:17,065 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-20T05:56:17,067 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-06-20T05:56:17,068 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:17,069 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:17,071 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:17,073 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:17,075 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:17,077 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:17,079 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:17,081 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:17,083 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-20T05:56:17,084 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-06-20T05:56:17,087 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:17,087 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:17,090 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:17,092 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:17,094 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:17,096 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:17,098 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:17,100 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:17,101 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-20T05:56:17,103 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-20T05:56:17,105 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-20T05:56:17,107 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-06-20T05:56:17,108 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-06-20T05:56:17,110 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-20T05:56:17,111 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-20T05:56:17,113 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-20T05:56:17,115 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-20T05:56:17,117 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-20T05:56:17,119 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-20T05:56:17,120 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-20T05:56:17,122 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-20T05:56:17,124 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-20T05:56:17,126 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-20T05:56:17,128 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-20T05:56:17,129 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-20T05:56:17,132 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-20T05:56:17,134 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-20T05:56:17,137 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-20T05:56:17,139 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-06-20T05:56:17,140 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-06-20T05:56:17,143 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-06-20T05:56:17,145 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-20T05:56:17,147 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-20T05:56:17,149 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-20T05:56:17,151 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-20T05:56:17,152 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-20T05:56:17,154 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-20T05:56:17,157 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-20T05:56:17,159 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-20T05:56:17,160 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-20T05:56:17,162 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-20T05:56:17,165 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-20T05:56:17,167 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-20T05:56:17,169 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-20T05:56:17,171 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2024-06-20T05:56:17,173 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-06-20T05:56:17,174 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:17,175 copying build/lib/colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:17,177 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:17,179 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:17,181 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:17,183 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:17,184 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-20T05:56:17,186 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-06-20T05:56:17,188 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-06-20T05:56:17,191 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-06-20T05:56:17,194 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-20T05:56:17,195 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-20T05:56:17,197 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-20T05:56:17,200 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-20T05:56:17,202 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-20T05:56:17,205 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-20T05:56:17,207 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-20T05:56:17,209 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:17,210 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:17,212 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:17,214 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:17,216 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:17,218 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:17,220 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:17,222 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:17,223 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:17,226 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-20T05:56:17,228 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-20T05:56:17,230 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-06-20T05:56:17,231 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-06-20T05:56:17,233 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-06-20T05:56:17,234 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-06-20T05:56:17,236 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-06-20T05:56:17,239 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-06-20T05:56:17,243 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-06-20T05:56:17,244 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-06-20T05:56:17,247 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2024-06-20T05:56:17,248 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-06-20T05:56:17,251 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-06-20T05:56:17,252 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-06-20T05:56:17,254 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-06-20T05:56:17,256 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-06-20T05:56:17,258 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-20T05:56:17,260 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-06-20T05:56:17,261 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-06-20T05:56:17,263 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-06-20T05:56:17,265 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-20T05:56:17,267 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-20T05:56:17,270 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-20T05:56:17,271 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-20T05:56:17,274 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-20T05:56:17,275 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-20T05:56:17,278 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-20T05:56:17,279 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-20T05:56:17,281 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-20T05:56:17,282 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-20T05:56:17,284 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-20T05:56:17,287 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-20T05:56:17,288 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-20T05:56:17,290 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-20T05:56:17,292 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-20T05:56:17,295 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-06-20T05:56:17,296 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-06-20T05:56:17,298 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-06-20T05:56:17,300 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-06-20T05:56:17,301 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-20T05:56:17,303 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-20T05:56:17,306 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-06-20T05:56:17,307 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-20T05:56:17,308 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-20T05:56:17,310 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-20T05:56:17,313 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-20T05:56:17,315 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-20T05:56:17,316 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-20T05:56:17,319 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-20T05:56:17,321 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-06-20T05:56:17,323 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-06-20T05:56:17,325 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-06-20T05:56:17,328 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-06-20T05:56:17,329 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-06-20T05:56:17,331 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-06-20T05:56:17,333 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-06-20T05:56:17,335 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-06-20T05:56:17,337 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-06-20T05:56:17,339 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2024-06-20T05:56:17,340 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-06-20T05:56:17,341 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-06-20T05:56:17,343 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-06-20T05:56:17,345 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-06-20T05:56:17,347 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-06-20T05:56:17,350 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-06-20T05:56:17,350 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-06-20T05:56:17,352 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-06-20T05:56:17,354 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-06-20T05:56:17,356 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-06-20T05:56:17,358 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2024-06-20T05:56:17,359 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C 2024-06-20T05:56:17,361 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-06-20T05:56:17,362 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-06-20T05:56:17,363 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-06-20T05:56:17,366 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-06-20T05:56:17,368 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:17,369 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:17,371 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:17,373 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:17,375 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:17,377 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:17,379 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:17,380 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:17,382 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:17,385 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:17,387 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:17,388 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-20T05:56:17,391 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-06-20T05:56:17,392 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-06-20T05:56:17,394 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-06-20T05:56:17,396 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-06-20T05:56:17,398 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-06-20T05:56:17,400 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-06-20T05:56:17,402 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-20T05:56:17,403 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-20T05:56:17,405 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-20T05:56:17,407 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-20T05:56:17,410 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-06-20T05:56:17,411 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-06-20T05:56:17,413 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-06-20T05:56:17,414 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-20T05:56:17,416 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-20T05:56:17,419 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-06-20T05:56:17,420 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-06-20T05:56:17,422 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-06-20T05:56:17,424 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-06-20T05:56:17,427 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-06-20T05:56:17,428 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-06-20T05:56:17,430 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-20T05:56:17,432 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-20T05:56:17,435 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-06-20T05:56:17,435 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-06-20T05:56:17,438 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-06-20T05:56:17,440 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-06-20T05:56:17,441 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-06-20T05:56:17,443 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-06-20T05:56:17,446 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-06-20T05:56:17,446 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-06-20T05:56:17,449 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-06-20T05:56:17,451 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-06-20T05:56:17,452 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-06-20T05:56:17,454 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-06-20T05:56:17,457 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-06-20T05:56:17,459 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-06-20T05:56:17,460 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-06-20T05:56:17,462 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-06-20T05:56:17,464 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-06-20T05:56:17,466 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:17,467 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:17,470 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:17,472 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:17,475 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:17,478 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:17,479 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-20T05:56:17,482 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-20T05:56:17,483 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-20T05:56:17,486 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-20T05:56:17,488 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-20T05:56:17,490 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-20T05:56:17,492 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-20T05:56:17,493 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-20T05:56:17,495 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-20T05:56:17,498 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-20T05:56:17,501 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-06-20T05:56:17,502 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-06-20T05:56:17,504 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-06-20T05:56:17,508 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-06-20T05:56:17,509 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-06-20T05:56:17,512 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-06-20T05:56:17,516 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-06-20T05:56:17,519 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-06-20T05:56:17,522 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-06-20T05:56:17,524 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-06-20T05:56:17,527 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-06-20T05:56:17,529 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-06-20T05:56:17,530 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-06-20T05:56:17,533 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-06-20T05:56:17,535 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-06-20T05:56:17,537 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-06-20T05:56:17,540 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-06-20T05:56:17,543 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-06-20T05:56:17,544 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-06-20T05:56:17,547 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:17,548 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:17,551 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:17,553 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:17,556 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:17,558 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:17,560 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:17,562 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:17,564 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-20T05:56:17,566 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-06-20T05:56:17,567 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-06-20T05:56:17,570 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-06-20T05:56:17,573 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-06-20T05:56:17,575 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-06-20T05:56:17,578 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-06-20T05:56:17,581 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-06-20T05:56:17,583 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-06-20T05:56:17,586 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-06-20T05:56:17,588 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-06-20T05:56:17,591 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-06-20T05:56:17,592 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-06-20T05:56:17,594 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-06-20T05:56:17,597 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-06-20T05:56:17,598 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-06-20T05:56:17,599 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-06-20T05:56:17,602 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-20T05:56:17,602 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-20T05:56:17,605 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-20T05:56:17,607 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-20T05:56:17,609 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-20T05:56:17,612 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-20T05:56:17,614 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-20T05:56:17,615 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-06-20T05:56:17,618 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-06-20T05:56:17,619 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-06-20T05:56:17,620 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-06-20T05:56:17,622 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-06-20T05:56:17,624 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:17,625 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:17,627 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:17,629 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:17,631 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:17,632 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:17,635 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:17,637 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:17,639 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:17,640 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-20T05:56:17,643 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-06-20T05:56:17,644 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-06-20T05:56:17,647 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-06-20T05:56:17,648 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-06-20T05:56:17,650 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-06-20T05:56:17,652 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-06-20T05:56:17,654 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-06-20T05:56:17,656 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-06-20T05:56:17,659 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-06-20T05:56:17,662 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-20T05:56:17,662 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-20T05:56:17,665 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-20T05:56:17,668 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-20T05:56:17,669 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-20T05:56:17,671 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-20T05:56:17,673 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-06-20T05:56:17,675 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-06-20T05:56:17,677 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-06-20T05:56:17,679 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-06-20T05:56:17,680 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-06-20T05:56:17,683 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-06-20T05:56:17,684 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-06-20T05:56:17,686 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-06-20T05:56:17,688 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-06-20T05:56:17,690 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-06-20T05:56:17,692 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-06-20T05:56:17,693 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-06-20T05:56:17,695 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-06-20T05:56:17,698 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-06-20T05:56:17,700 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-06-20T05:56:17,703 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-06-20T05:56:17,704 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-06-20T05:56:17,705 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-06-20T05:56:17,707 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-06-20T05:56:17,710 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-06-20T05:56:17,711 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-06-20T05:56:17,712 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-06-20T05:56:17,714 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-06-20T05:56:17,715 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-06-20T05:56:17,719 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-06-20T05:56:17,722 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-06-20T05:56:17,723 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-06-20T05:56:17,725 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-06-20T05:56:17,727 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-06-20T05:56:17,729 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-06-20T05:56:17,732 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-06-20T05:56:17,733 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-06-20T05:56:17,735 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-06-20T05:56:17,737 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-06-20T05:56:17,740 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-06-20T05:56:17,742 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-06-20T05:56:17,744 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-06-20T05:56:17,746 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-06-20T05:56:17,747 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-06-20T05:56:17,749 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-06-20T05:56:17,752 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:17,753 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:17,755 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:17,757 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:17,758 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:17,760 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:17,762 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-20T05:56:17,765 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-20T05:56:17,766 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-20T05:56:17,768 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-20T05:56:17,769 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-20T05:56:17,772 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-20T05:56:17,776 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-06-20T05:56:17,776 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-06-20T05:56:17,778 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-06-20T05:56:17,780 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-06-20T05:56:17,783 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-06-20T05:56:17,786 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-06-20T05:56:17,787 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-06-20T05:56:17,789 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-06-20T05:56:17,791 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-06-20T05:56:17,792 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-06-20T05:56:17,794 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-06-20T05:56:17,796 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-06-20T05:56:17,798 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-06-20T05:56:17,800 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-06-20T05:56:17,800 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-06-20T05:56:17,803 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-06-20T05:56:17,805 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:17,806 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:17,809 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:17,811 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:17,813 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:17,815 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:17,817 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:17,819 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:17,820 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:17,823 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-20T05:56:17,825 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-06-20T05:56:17,827 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-06-20T05:56:17,829 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-06-20T05:56:17,831 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-06-20T05:56:17,832 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-06-20T05:56:17,834 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-06-20T05:56:17,837 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-06-20T05:56:17,838 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-06-20T05:56:17,840 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-06-20T05:56:17,843 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-06-20T05:56:17,844 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-06-20T05:56:17,847 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-06-20T05:56:17,849 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-06-20T05:56:17,850 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-06-20T05:56:17,852 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-06-20T05:56:17,854 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-06-20T05:56:17,855 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-06-20T05:56:17,858 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-06-20T05:56:17,859 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-06-20T05:56:17,864 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-06-20T05:56:17,865 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-06-20T05:56:17,866 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-06-20T05:56:17,868 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-06-20T05:56:17,870 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-06-20T05:56:17,872 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-06-20T05:56:17,875 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-06-20T05:56:17,876 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-06-20T05:56:17,878 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-06-20T05:56:17,880 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-06-20T05:56:17,881 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-06-20T05:56:17,883 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-06-20T05:56:17,885 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-06-20T05:56:17,887 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-06-20T05:56:17,889 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-06-20T05:56:17,891 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-06-20T05:56:17,892 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-06-20T05:56:17,893 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-06-20T05:56:17,895 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-06-20T05:56:17,897 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-06-20T05:56:17,899 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-06-20T05:56:17,900 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-06-20T05:56:17,903 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-06-20T05:56:17,904 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-06-20T05:56:17,906 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-06-20T05:56:17,909 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-06-20T05:56:17,910 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-06-20T05:56:17,913 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-06-20T05:56:17,914 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-06-20T05:56:17,916 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-06-20T05:56:17,918 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-06-20T05:56:17,920 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-06-20T05:56:17,922 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-06-20T05:56:17,923 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-06-20T05:56:17,925 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-06-20T05:56:17,927 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-06-20T05:56:17,928 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-06-20T05:56:17,931 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-06-20T05:56:17,933 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-06-20T05:56:17,935 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-06-20T05:56:17,937 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-06-20T05:56:17,939 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-06-20T05:56:17,940 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-06-20T05:56:17,943 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-06-20T05:56:17,945 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-20T05:56:17,946 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-20T05:56:17,948 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-20T05:56:17,950 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-20T05:56:17,953 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-20T05:56:17,955 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-20T05:56:17,956 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-20T05:56:17,959 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-20T05:56:17,960 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-06-20T05:56:17,963 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-06-20T05:56:17,964 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-06-20T05:56:17,965 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-06-20T05:56:17,968 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:17,969 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:17,972 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:17,973 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:17,975 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:17,977 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:17,979 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-20T05:56:17,981 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-06-20T05:56:17,983 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-06-20T05:56:17,985 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-06-20T05:56:17,987 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-06-20T05:56:17,988 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-06-20T05:56:17,990 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-06-20T05:56:17,992 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-06-20T05:56:17,994 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-06-20T05:56:17,996 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-06-20T05:56:17,998 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-06-20T05:56:18,000 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-06-20T05:56:18,001 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-06-20T05:56:18,004 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-06-20T05:56:18,005 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-06-20T05:56:18,008 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-06-20T05:56:18,010 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-06-20T05:56:18,012 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2024-06-20T05:56:18,013 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-06-20T05:56:18,015 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-06-20T05:56:18,018 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-06-20T05:56:18,019 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:18,020 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:18,022 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:18,025 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:18,027 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:18,029 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:18,031 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-20T05:56:18,033 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-06-20T05:56:18,034 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-06-20T05:56:18,036 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:18,037 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:18,039 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:18,041 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:18,043 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:18,045 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:18,047 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:18,048 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:18,051 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:18,052 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:18,054 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:18,056 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-20T05:56:18,059 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-06-20T05:56:18,060 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-06-20T05:56:18,063 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-06-20T05:56:18,065 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-06-20T05:56:18,066 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-06-20T05:56:18,068 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-06-20T05:56:18,071 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,072 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,074 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,076 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,078 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,080 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,083 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,083 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,086 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,088 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,091 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,093 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,095 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,097 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,099 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,102 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,104 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,106 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,108 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,111 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,112 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,114 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,117 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,119 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,121 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,123 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-20T05:56:18,125 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,127 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,129 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,131 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,133 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,135 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,137 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,139 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,140 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,142 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,144 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,146 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,148 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,150 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,152 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,154 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,156 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,158 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,161 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,163 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,164 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,166 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-20T05:56:18,168 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-06-20T05:56:18,169 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-06-20T05:56:18,172 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:18,173 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:18,175 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:18,177 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:18,179 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:18,182 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:18,184 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-20T05:56:18,186 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-06-20T05:56:18,188 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-06-20T05:56:18,189 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-06-20T05:56:18,192 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-06-20T05:56:18,194 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-06-20T05:56:18,196 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-06-20T05:56:18,199 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-06-20T05:56:18,201 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-06-20T05:56:18,203 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-20T05:56:18,204 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-20T05:56:18,207 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-20T05:56:18,209 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-20T05:56:18,210 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-20T05:56:18,212 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-20T05:56:18,215 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-20T05:56:18,217 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-06-20T05:56:18,218 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-06-20T05:56:18,220 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-20T05:56:18,221 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-20T05:56:18,224 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-20T05:56:18,227 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-20T05:56:18,229 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-20T05:56:18,231 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-20T05:56:18,233 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-20T05:56:18,236 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-20T05:56:18,237 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-20T05:56:18,240 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-20T05:56:18,242 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-20T05:56:18,244 creating build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-06-20T05:56:18,245 copying build/lib/colossalai/quantization/bnb.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-06-20T05:56:18,248 copying build/lib/colossalai/quantization/bnb_config.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-06-20T05:56:18,250 copying build/lib/colossalai/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-06-20T05:56:18,252 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-20T05:56:18,253 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-20T05:56:18,255 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-20T05:56:18,257 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-20T05:56:18,259 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-20T05:56:18,261 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-20T05:56:18,263 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-20T05:56:18,266 creating build/bdist.linux-armv7l/wheel/colossalai/device 2024-06-20T05:56:18,267 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-06-20T05:56:18,269 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-06-20T05:56:18,272 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-06-20T05:56:18,274 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-06-20T05:56:18,275 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-06-20T05:56:18,277 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2024-06-20T05:56:18,278 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-06-20T05:56:18,280 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-06-20T05:56:18,282 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-06-20T05:56:18,284 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-06-20T05:56:18,287 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-20T05:56:18,288 copying build/lib/colossalai/inference/flash_decoding_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-20T05:56:18,291 creating build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-06-20T05:56:18,292 copying build/lib/colossalai/inference/server/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-06-20T05:56:18,293 copying build/lib/colossalai/inference/server/completion_service.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-06-20T05:56:18,295 copying build/lib/colossalai/inference/server/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-06-20T05:56:18,297 copying build/lib/colossalai/inference/server/chat_service.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-06-20T05:56:18,299 copying build/lib/colossalai/inference/server/api_server.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-06-20T05:56:18,302 creating build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-20T05:56:18,304 copying build/lib/colossalai/inference/core/plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-20T05:56:18,307 copying build/lib/colossalai/inference/core/request_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-20T05:56:18,310 copying build/lib/colossalai/inference/core/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-20T05:56:18,313 copying build/lib/colossalai/inference/core/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-20T05:56:18,315 copying build/lib/colossalai/inference/core/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-20T05:56:18,318 copying build/lib/colossalai/inference/core/rpc_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-20T05:56:18,322 copying build/lib/colossalai/inference/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-20T05:56:18,325 creating build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-06-20T05:56:18,326 copying build/lib/colossalai/inference/executor/rpc_worker.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-06-20T05:56:18,329 copying build/lib/colossalai/inference/executor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-06-20T05:56:18,331 copying build/lib/colossalai/inference/config.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-20T05:56:18,333 copying build/lib/colossalai/inference/logit_processors.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-20T05:56:18,336 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-06-20T05:56:18,338 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-06-20T05:56:18,339 copying build/lib/colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-06-20T05:56:18,341 copying build/lib/colossalai/inference/modeling/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-06-20T05:56:18,343 copying build/lib/colossalai/inference/modeling/layers/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-06-20T05:56:18,346 copying build/lib/colossalai/inference/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-06-20T05:56:18,348 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-06-20T05:56:18,349 copying build/lib/colossalai/inference/modeling/policy/glide_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-06-20T05:56:18,352 copying build/lib/colossalai/inference/modeling/policy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-06-20T05:56:18,354 copying build/lib/colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-06-20T05:56:18,357 copying build/lib/colossalai/inference/modeling/policy/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-06-20T05:56:18,360 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-06-20T05:56:18,361 copying build/lib/colossalai/inference/modeling/models/glide_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-06-20T05:56:18,364 copying build/lib/colossalai/inference/modeling/models/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-06-20T05:56:18,366 copying build/lib/colossalai/inference/modeling/models/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-06-20T05:56:18,370 copying build/lib/colossalai/inference/modeling/models/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-06-20T05:56:18,373 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-06-20T05:56:18,375 copying build/lib/colossalai/inference/modeling/backends/pre_attention_backend.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-06-20T05:56:18,377 copying build/lib/colossalai/inference/modeling/backends/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-06-20T05:56:18,379 copying build/lib/colossalai/inference/modeling/backends/attention_backend.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-06-20T05:56:18,382 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-20T05:56:18,384 copying build/lib/colossalai/inference/sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-20T05:56:18,387 copying build/lib/colossalai/inference/batch_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-20T05:56:18,390 copying build/lib/colossalai/inference/graph_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-20T05:56:18,393 creating build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-06-20T05:56:18,394 copying build/lib/colossalai/inference/spec/drafter.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-06-20T05:56:18,396 copying build/lib/colossalai/inference/spec/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-06-20T05:56:18,399 copying build/lib/colossalai/inference/spec/struct.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-06-20T05:56:18,401 copying build/lib/colossalai/inference/struct.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-20T05:56:18,403 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-06-20T05:56:18,404 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-06-20T05:56:18,406 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-06-20T05:56:18,408 copying build/lib/colossalai/inference/kv_cache/block_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-06-20T05:56:18,410 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2024-06-20T05:56:18,411 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-20T05:56:18,412 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-20T05:56:18,415 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-20T05:56:18,417 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-20T05:56:18,419 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-20T05:56:18,420 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-20T05:56:18,422 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-20T05:56:18,424 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-20T05:56:18,426 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-20T05:56:18,428 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-06-20T05:56:18,431 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-06-20T05:56:18,431 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-06-20T05:56:18,433 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-06-20T05:56:18,435 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-06-20T05:56:18,437 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-06-20T05:56:18,439 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-06-20T05:56:18,441 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-06-20T05:56:18,442 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-06-20T05:56:18,444 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,445 copying build/lib/colossalai/nn/optimizer/distributed_came.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,448 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,450 copying build/lib/colossalai/nn/optimizer/distributed_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,452 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,455 copying build/lib/colossalai/nn/optimizer/galore.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,457 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,459 copying build/lib/colossalai/nn/optimizer/came.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,461 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,463 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,465 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,467 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,469 copying build/lib/colossalai/nn/optimizer/distributed_adafactor.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,471 copying build/lib/colossalai/nn/optimizer/distributed_galore.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,474 copying build/lib/colossalai/nn/optimizer/adafactor.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,476 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,478 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-20T05:56:18,480 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-06-20T05:56:18,482 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-20T05:56:18,483 copying build/lib/colossalai/moe/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-20T05:56:18,485 copying build/lib/colossalai/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-20T05:56:18,487 copying build/lib/colossalai/moe/checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-20T05:56:18,490 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-20T05:56:18,492 copying build/lib/colossalai/moe/load_balance.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-20T05:56:18,494 copying build/lib/colossalai/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-20T05:56:18,497 copying build/lib/colossalai/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-20T05:56:18,500 copying build/lib/colossalai/moe/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-20T05:56:18,502 copying build/lib/colossalai/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-20T05:56:18,505 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-20T05:56:18,508 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2024-06-20T05:56:18,509 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2024-06-20T05:56:18,511 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-06-20T05:56:18,512 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-20T05:56:18,513 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-20T05:56:18,515 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-20T05:56:18,517 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-20T05:56:18,519 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-20T05:56:18,521 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-06-20T05:56:18,522 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-06-20T05:56:18,525 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-06-20T05:56:18,526 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-06-20T05:56:18,528 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-06-20T05:56:18,530 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-06-20T05:56:18,531 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-06-20T05:56:18,534 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2024-06-20T05:56:18,535 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-06-20T05:56:18,538 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-20T05:56:18,538 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-20T05:56:18,541 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-20T05:56:18,543 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-20T05:56:18,544 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-20T05:56:18,546 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-20T05:56:18,548 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-20T05:56:18,550 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-20T05:56:18,552 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-06-20T05:56:18,554 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-20T05:56:18,555 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-20T05:56:18,558 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-20T05:56:18,561 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-20T05:56:18,564 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-20T05:56:18,566 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-20T05:56:18,568 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-20T05:56:18,571 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-20T05:56:18,573 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-20T05:56:18,575 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-20T05:56:18,577 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-20T05:56:18,579 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-06-20T05:56:18,581 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-06-20T05:56:18,582 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-20T05:56:18,584 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-06-20T05:56:18,585 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-06-20T05:56:18,586 copying build/lib/colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-06-20T05:56:18,589 copying build/lib/colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-06-20T05:56:18,591 copying build/lib/colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-06-20T05:56:18,593 copying build/lib/colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-06-20T05:56:18,595 copying build/lib/colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-06-20T05:56:18,598 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-06-20T05:56:18,599 copying build/lib/colossalai/kernel/extensions/csrc/common/target.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-06-20T05:56:18,601 copying build/lib/colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-06-20T05:56:18,603 copying build/lib/colossalai/kernel/extensions/csrc/common/data_type.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-06-20T05:56:18,605 copying build/lib/colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-06-20T05:56:18,607 copying build/lib/colossalai/kernel/extensions/csrc/common/micros.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-06-20T05:56:18,609 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-06-20T05:56:18,611 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel 2024-06-20T05:56:18,612 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-06-20T05:56:18,613 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-06-20T05:56:18,616 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-06-20T05:56:18,619 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-06-20T05:56:18,620 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-06-20T05:56:18,623 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-06-20T05:56:18,625 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,626 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,628 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,630 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,633 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,636 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,638 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,640 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-06-20T05:56:18,641 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-06-20T05:56:18,643 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,646 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,648 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,651 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,653 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,656 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,658 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,661 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,663 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,665 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,668 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-20T05:56:18,669 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-20T05:56:18,671 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-20T05:56:18,672 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-20T05:56:18,674 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-20T05:56:18,676 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,678 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-20T05:56:18,681 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-20T05:56:18,683 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-20T05:56:18,685 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-20T05:56:18,687 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-06-20T05:56:18,689 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-06-20T05:56:18,689 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-06-20T05:56:18,692 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-06-20T05:56:18,693 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-06-20T05:56:18,695 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-06-20T05:56:18,698 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-06-20T05:56:18,698 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-06-20T05:56:18,700 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-06-20T05:56:18,702 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-06-20T05:56:18,704 copying build/lib/colossalai/kernel/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-06-20T05:56:18,706 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-06-20T05:56:18,707 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-06-20T05:56:18,709 copying build/lib/colossalai/kernel/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-06-20T05:56:18,711 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-06-20T05:56:18,714 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-06-20T05:56:18,715 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-06-20T05:56:18,716 copying build/lib/colossalai/kernel/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-06-20T05:56:18,718 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-06-20T05:56:18,720 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-20T05:56:18,721 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-20T05:56:18,723 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-20T05:56:18,725 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-20T05:56:18,727 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-06-20T05:56:18,728 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-06-20T05:56:18,730 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-06-20T05:56:18,732 copying build/lib/colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-06-20T05:56:18,733 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-06-20T05:56:18,735 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-06-20T05:56:18,738 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-06-20T05:56:18,739 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-06-20T05:56:18,740 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-06-20T05:56:18,742 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-06-20T05:56:18,744 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-20T05:56:18,746 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-20T05:56:18,748 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-20T05:56:18,750 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-06-20T05:56:18,752 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-20T05:56:18,753 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-20T05:56:18,756 copying build/lib/colossalai/kernel/triton/context_attn_unpad.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-20T05:56:18,759 copying build/lib/colossalai/kernel/triton/rms_layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-20T05:56:18,761 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-20T05:56:18,763 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-20T05:56:18,766 copying build/lib/colossalai/kernel/triton/rotary_cache_copy.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-20T05:56:18,768 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-20T05:56:18,770 copying build/lib/colossalai/kernel/triton/kvcache_copy.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-20T05:56:18,772 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-20T05:56:18,774 copying build/lib/colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-20T05:56:18,777 copying build/lib/colossalai/kernel/triton/fused_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-20T05:56:18,779 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-06-20T05:56:18,781 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-06-20T05:56:18,782 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-06-20T05:56:18,784 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-06-20T05:56:18,786 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-06-20T05:56:18,788 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-06-20T05:56:18,790 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2024-06-20T05:56:18,791 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-06-20T05:56:18,792 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-06-20T05:56:18,794 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-06-20T05:56:18,796 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-06-20T05:56:18,797 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-06-20T05:56:18,800 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-06-20T05:56:18,802 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-06-20T05:56:18,803 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-06-20T05:56:18,804 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-06-20T05:56:18,806 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-06-20T05:56:18,808 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-06-20T05:56:18,809 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-06-20T05:56:18,812 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-06-20T05:56:18,818 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-06-20T05:56:18,820 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-06-20T05:56:18,822 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-06-20T05:56:18,825 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-06-20T05:56:18,826 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,827 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,830 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,832 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,835 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,837 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,840 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,842 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,844 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,847 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,850 copying build/lib/colossalai/shardformer/policies/qwen2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,852 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,855 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,857 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,859 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,861 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,864 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,866 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,868 copying build/lib/colossalai/shardformer/policies/command.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,871 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-20T05:56:18,874 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-20T05:56:18,875 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-20T05:56:18,877 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-20T05:56:18,879 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-20T05:56:18,881 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-20T05:56:18,884 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-20T05:56:18,886 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-20T05:56:18,888 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,889 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,892 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,895 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,897 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,900 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,903 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,906 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,909 copying build/lib/colossalai/shardformer/modeling/qwen2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,912 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,913 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,916 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,918 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,920 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-06-20T05:56:18,921 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-06-20T05:56:18,923 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-06-20T05:56:18,925 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-06-20T05:56:18,929 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,931 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,934 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,936 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,939 copying build/lib/colossalai/shardformer/modeling/command.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,942 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-20T05:56:18,946 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-20T05:56:18,947 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-20T05:56:18,949 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-20T05:56:18,952 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-20T05:56:18,954 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-20T05:56:18,956 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-20T05:56:18,958 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-20T05:56:18,961 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-20T05:56:18,964 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-20T05:56:18,966 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-20T05:56:18,967 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-20T05:56:18,970 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-20T05:56:18,973 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-06-20T05:56:18,975 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-06-20T05:56:18,976 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-06-20T05:56:18,978 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-06-20T05:56:18,979 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-06-20T05:56:18,982 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-06-20T05:56:18,984 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-06-20T05:56:18,986 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-06-20T05:56:18,988 running install_egg_info 2024-06-20T05:56:19,052 running egg_info 2024-06-20T05:56:19,076 writing colossalai.egg-info/PKG-INFO 2024-06-20T05:56:19,080 writing dependency_links to colossalai.egg-info/dependency_links.txt 2024-06-20T05:56:19,082 writing entry points to colossalai.egg-info/entry_points.txt 2024-06-20T05:56:19,083 writing requirements to colossalai.egg-info/requires.txt 2024-06-20T05:56:19,085 writing top-level names to colossalai.egg-info/top_level.txt 2024-06-20T05:56:19,321 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2024-06-20T05:56:19,369 reading manifest template 'MANIFEST.in' 2024-06-20T05:56:20,652 warning: no files found matching '*.tr' under directory 'colossalai' 2024-06-20T05:56:21,263 warning: no files found matching '*.cc' under directory 'colossalai' 2024-06-20T05:56:21,594 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-06-20T05:56:21,726 warning: no files found matching '*.tr' under directory 'extensions' 2024-06-20T05:56:21,780 warning: no files found matching '*.cc' under directory 'extensions' 2024-06-20T05:56:21,808 warning: no files found matching '*.pyi' under directory 'extensions' 2024-06-20T05:56:21,809 adding license file 'LICENSE' 2024-06-20T05:56:21,855 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2024-06-20T05:56:21,858 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.3.9-py3.11.egg-info 2024-06-20T05:56:21,871 running install_scripts 2024-06-20T05:56:21,897 creating build/bdist.linux-armv7l/wheel/colossalai-0.3.9.dist-info/WHEEL 2024-06-20T05:56:21,900 creating '/tmp/pip-wheel-idlgq4yc/colossalai-0.3.9-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-06-20T05:56:21,902 adding 'colossalai/__init__.py' 2024-06-20T05:56:21,904 adding 'colossalai/initialize.py' 2024-06-20T05:56:21,905 adding 'colossalai/version.py' 2024-06-20T05:56:21,907 adding 'colossalai/_C/__init__.py' 2024-06-20T05:56:21,909 adding 'colossalai/_analyzer/__init__.py' 2024-06-20T05:56:21,910 adding 'colossalai/_analyzer/envs.py' 2024-06-20T05:56:21,912 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2024-06-20T05:56:21,915 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2024-06-20T05:56:21,916 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2024-06-20T05:56:21,919 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2024-06-20T05:56:21,920 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2024-06-20T05:56:21,922 adding 'colossalai/_analyzer/fx/__init__.py' 2024-06-20T05:56:21,924 adding 'colossalai/_analyzer/fx/codegen.py' 2024-06-20T05:56:21,926 adding 'colossalai/_analyzer/fx/graph_module.py' 2024-06-20T05:56:21,928 adding 'colossalai/_analyzer/fx/node_util.py' 2024-06-20T05:56:21,929 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2024-06-20T05:56:21,931 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2024-06-20T05:56:21,933 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2024-06-20T05:56:21,935 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2024-06-20T05:56:21,936 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2024-06-20T05:56:21,938 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2024-06-20T05:56:21,939 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2024-06-20T05:56:21,940 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2024-06-20T05:56:21,942 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2024-06-20T05:56:21,944 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2024-06-20T05:56:21,946 adding 'colossalai/accelerator/__init__.py' 2024-06-20T05:56:21,947 adding 'colossalai/accelerator/api.py' 2024-06-20T05:56:21,949 adding 'colossalai/accelerator/base_accelerator.py' 2024-06-20T05:56:21,951 adding 'colossalai/accelerator/cpu_accelerator.py' 2024-06-20T05:56:21,952 adding 'colossalai/accelerator/cuda_accelerator.py' 2024-06-20T05:56:21,954 adding 'colossalai/accelerator/npu_accelerator.py' 2024-06-20T05:56:21,956 adding 'colossalai/amp/__init__.py' 2024-06-20T05:56:21,957 adding 'colossalai/amp/naive_amp/__init__.py' 2024-06-20T05:56:21,959 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2024-06-20T05:56:21,961 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2024-06-20T05:56:21,962 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2024-06-20T05:56:21,963 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2024-06-20T05:56:21,965 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2024-06-20T05:56:21,966 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2024-06-20T05:56:21,968 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2024-06-20T05:56:21,969 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2024-06-20T05:56:21,970 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2024-06-20T05:56:21,972 adding 'colossalai/auto_parallel/__init__.py' 2024-06-20T05:56:21,974 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2024-06-20T05:56:21,975 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2024-06-20T05:56:21,977 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2024-06-20T05:56:21,978 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2024-06-20T05:56:21,981 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2024-06-20T05:56:21,982 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2024-06-20T05:56:21,984 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2024-06-20T05:56:21,985 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2024-06-20T05:56:21,986 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2024-06-20T05:56:21,988 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2024-06-20T05:56:21,990 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2024-06-20T05:56:21,991 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2024-06-20T05:56:21,993 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2024-06-20T05:56:21,994 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2024-06-20T05:56:21,996 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2024-06-20T05:56:21,998 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2024-06-20T05:56:22,000 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2024-06-20T05:56:22,001 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2024-06-20T05:56:22,002 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2024-06-20T05:56:22,004 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2024-06-20T05:56:22,005 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2024-06-20T05:56:22,007 adding 'colossalai/auto_parallel/offload/__init__.py' 2024-06-20T05:56:22,009 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2024-06-20T05:56:22,010 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2024-06-20T05:56:22,011 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2024-06-20T05:56:22,013 adding 'colossalai/auto_parallel/offload/region.py' 2024-06-20T05:56:22,015 adding 'colossalai/auto_parallel/offload/region_manager.py' 2024-06-20T05:56:22,017 adding 'colossalai/auto_parallel/offload/runtime.py' 2024-06-20T05:56:22,019 adding 'colossalai/auto_parallel/offload/solver.py' 2024-06-20T05:56:22,022 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2024-06-20T05:56:22,023 adding 'colossalai/auto_parallel/offload/util.py' 2024-06-20T05:56:22,025 adding 'colossalai/auto_parallel/passes/__init__.py' 2024-06-20T05:56:22,026 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2024-06-20T05:56:22,027 adding 'colossalai/auto_parallel/passes/constants.py' 2024-06-20T05:56:22,029 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2024-06-20T05:56:22,031 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2024-06-20T05:56:22,034 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2024-06-20T05:56:22,035 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2024-06-20T05:56:22,037 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2024-06-20T05:56:22,038 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2024-06-20T05:56:22,040 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2024-06-20T05:56:22,042 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2024-06-20T05:56:22,044 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2024-06-20T05:56:22,046 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2024-06-20T05:56:22,047 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2024-06-20T05:56:22,049 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2024-06-20T05:56:22,050 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2024-06-20T05:56:22,052 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2024-06-20T05:56:22,053 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2024-06-20T05:56:22,055 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2024-06-20T05:56:22,057 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2024-06-20T05:56:22,058 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2024-06-20T05:56:22,060 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2024-06-20T05:56:22,061 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2024-06-20T05:56:22,063 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2024-06-20T05:56:22,066 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2024-06-20T05:56:22,068 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2024-06-20T05:56:22,070 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2024-06-20T05:56:22,071 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2024-06-20T05:56:22,072 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2024-06-20T05:56:22,073 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2024-06-20T05:56:22,074 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2024-06-20T05:56:22,076 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2024-06-20T05:56:22,077 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2024-06-20T05:56:22,079 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2024-06-20T05:56:22,080 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2024-06-20T05:56:22,081 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2024-06-20T05:56:22,082 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2024-06-20T05:56:22,084 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2024-06-20T05:56:22,085 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2024-06-20T05:56:22,087 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2024-06-20T05:56:22,089 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2024-06-20T05:56:22,090 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2024-06-20T05:56:22,092 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2024-06-20T05:56:22,094 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2024-06-20T05:56:22,095 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2024-06-20T05:56:22,097 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2024-06-20T05:56:22,098 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2024-06-20T05:56:22,101 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2024-06-20T05:56:22,103 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2024-06-20T05:56:22,105 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2024-06-20T05:56:22,106 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2024-06-20T05:56:22,108 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2024-06-20T05:56:22,110 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2024-06-20T05:56:22,112 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2024-06-20T05:56:22,113 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2024-06-20T05:56:22,115 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2024-06-20T05:56:22,116 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2024-06-20T05:56:22,118 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2024-06-20T05:56:22,120 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2024-06-20T05:56:22,121 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2024-06-20T05:56:22,123 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2024-06-20T05:56:22,126 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2024-06-20T05:56:22,127 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2024-06-20T05:56:22,129 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2024-06-20T05:56:22,131 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2024-06-20T05:56:22,133 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2024-06-20T05:56:22,134 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2024-06-20T05:56:22,136 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2024-06-20T05:56:22,137 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2024-06-20T05:56:22,139 adding 'colossalai/booster/__init__.py' 2024-06-20T05:56:22,140 adding 'colossalai/booster/accelerator.py' 2024-06-20T05:56:22,143 adding 'colossalai/booster/booster.py' 2024-06-20T05:56:22,144 adding 'colossalai/booster/mixed_precision/__init__.py' 2024-06-20T05:56:22,146 adding 'colossalai/booster/mixed_precision/bf16.py' 2024-06-20T05:56:22,147 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2024-06-20T05:56:22,148 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2024-06-20T05:56:22,150 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2024-06-20T05:56:22,151 adding 'colossalai/booster/mixed_precision/fp8.py' 2024-06-20T05:56:22,152 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2024-06-20T05:56:22,154 adding 'colossalai/booster/plugin/__init__.py' 2024-06-20T05:56:22,155 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2024-06-20T05:56:22,158 adding 'colossalai/booster/plugin/gemini_plugin.py' 2024-06-20T05:56:22,165 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2024-06-20T05:56:22,168 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2024-06-20T05:56:22,171 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2024-06-20T05:56:22,172 adding 'colossalai/booster/plugin/plugin_base.py' 2024-06-20T05:56:22,173 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2024-06-20T05:56:22,175 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2024-06-20T05:56:22,177 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2024-06-20T05:56:22,179 adding 'colossalai/checkpoint_io/__init__.py' 2024-06-20T05:56:22,181 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2024-06-20T05:56:22,183 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2024-06-20T05:56:22,187 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2024-06-20T05:56:22,189 adding 'colossalai/checkpoint_io/index_file.py' 2024-06-20T05:56:22,193 adding 'colossalai/checkpoint_io/utils.py' 2024-06-20T05:56:22,194 adding 'colossalai/cli/__init__.py' 2024-06-20T05:56:22,196 adding 'colossalai/cli/cli.py' 2024-06-20T05:56:22,197 adding 'colossalai/cli/check/__init__.py' 2024-06-20T05:56:22,199 adding 'colossalai/cli/check/check_installation.py' 2024-06-20T05:56:22,201 adding 'colossalai/cli/launcher/__init__.py' 2024-06-20T05:56:22,202 adding 'colossalai/cli/launcher/hostinfo.py' 2024-06-20T05:56:22,204 adding 'colossalai/cli/launcher/multinode_runner.py' 2024-06-20T05:56:22,206 adding 'colossalai/cli/launcher/run.py' 2024-06-20T05:56:22,208 adding 'colossalai/cluster/__init__.py' 2024-06-20T05:56:22,209 adding 'colossalai/cluster/device_mesh_manager.py' 2024-06-20T05:56:22,211 adding 'colossalai/cluster/dist_coordinator.py' 2024-06-20T05:56:22,212 adding 'colossalai/cluster/process_group_manager.py' 2024-06-20T05:56:22,214 adding 'colossalai/cluster/process_group_mesh.py' 2024-06-20T05:56:22,215 adding 'colossalai/context/__init__.py' 2024-06-20T05:56:22,217 adding 'colossalai/context/config.py' 2024-06-20T05:56:22,218 adding 'colossalai/context/singleton_meta.py' 2024-06-20T05:56:22,220 adding 'colossalai/device/__init__.py' 2024-06-20T05:56:22,222 adding 'colossalai/device/alpha_beta_profiler.py' 2024-06-20T05:56:22,224 adding 'colossalai/device/calc_pipeline_strategy.py' 2024-06-20T05:56:22,227 adding 'colossalai/device/device_mesh.py' 2024-06-20T05:56:22,229 adding 'colossalai/fx/__init__.py' 2024-06-20T05:56:22,230 adding 'colossalai/fx/_compatibility.py' 2024-06-20T05:56:22,232 adding 'colossalai/fx/_meta_regist_12.py' 2024-06-20T05:56:22,234 adding 'colossalai/fx/_meta_regist_13.py' 2024-06-20T05:56:22,235 adding 'colossalai/fx/graph_module.py' 2024-06-20T05:56:22,236 adding 'colossalai/fx/proxy.py' 2024-06-20T05:56:22,238 adding 'colossalai/fx/codegen/__init__.py' 2024-06-20T05:56:22,242 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2024-06-20T05:56:22,244 adding 'colossalai/fx/passes/__init__.py' 2024-06-20T05:56:22,246 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2024-06-20T05:56:22,248 adding 'colossalai/fx/passes/concrete_info_prop.py' 2024-06-20T05:56:22,250 adding 'colossalai/fx/passes/meta_info_prop.py' 2024-06-20T05:56:22,253 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2024-06-20T05:56:22,254 adding 'colossalai/fx/passes/shard_1d_pass.py' 2024-06-20T05:56:22,257 adding 'colossalai/fx/passes/split_module.py' 2024-06-20T05:56:22,258 adding 'colossalai/fx/passes/utils.py' 2024-06-20T05:56:22,260 adding 'colossalai/fx/profiler/__init__.py' 2024-06-20T05:56:22,261 adding 'colossalai/fx/profiler/constants.py' 2024-06-20T05:56:22,263 adding 'colossalai/fx/profiler/dataflow.py' 2024-06-20T05:56:22,264 adding 'colossalai/fx/profiler/memory_utils.py' 2024-06-20T05:56:22,266 adding 'colossalai/fx/profiler/opcount.py' 2024-06-20T05:56:22,269 adding 'colossalai/fx/profiler/profiler.py' 2024-06-20T05:56:22,270 adding 'colossalai/fx/profiler/shard_utils.py' 2024-06-20T05:56:22,272 adding 'colossalai/fx/profiler/tensor.py' 2024-06-20T05:56:22,273 adding 'colossalai/fx/profiler/experimental/__init__.py' 2024-06-20T05:56:22,274 adding 'colossalai/fx/profiler/experimental/constants.py' 2024-06-20T05:56:22,276 adding 'colossalai/fx/profiler/experimental/profiler.py' 2024-06-20T05:56:22,277 adding 'colossalai/fx/profiler/experimental/registry.py' 2024-06-20T05:56:22,278 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2024-06-20T05:56:22,280 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2024-06-20T05:56:22,282 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2024-06-20T05:56:22,283 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2024-06-20T05:56:22,284 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2024-06-20T05:56:22,285 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2024-06-20T05:56:22,287 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2024-06-20T05:56:22,288 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2024-06-20T05:56:22,289 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2024-06-20T05:56:22,291 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2024-06-20T05:56:22,292 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2024-06-20T05:56:22,294 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2024-06-20T05:56:22,295 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2024-06-20T05:56:22,296 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2024-06-20T05:56:22,298 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2024-06-20T05:56:22,299 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2024-06-20T05:56:22,300 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2024-06-20T05:56:22,301 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2024-06-20T05:56:22,302 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2024-06-20T05:56:22,304 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2024-06-20T05:56:22,305 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2024-06-20T05:56:22,307 adding 'colossalai/fx/tracer/__init__.py' 2024-06-20T05:56:22,308 adding 'colossalai/fx/tracer/_meta_trace.py' 2024-06-20T05:56:22,310 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2024-06-20T05:56:22,311 adding 'colossalai/fx/tracer/_tracer_utils.py' 2024-06-20T05:56:22,314 adding 'colossalai/fx/tracer/experimental.py' 2024-06-20T05:56:22,316 adding 'colossalai/fx/tracer/registry.py' 2024-06-20T05:56:22,319 adding 'colossalai/fx/tracer/tracer.py' 2024-06-20T05:56:22,320 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2024-06-20T05:56:22,322 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2024-06-20T05:56:22,323 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2024-06-20T05:56:22,324 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2024-06-20T05:56:22,326 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2024-06-20T05:56:22,327 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2024-06-20T05:56:22,329 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2024-06-20T05:56:22,330 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2024-06-20T05:56:22,331 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2024-06-20T05:56:22,333 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2024-06-20T05:56:22,334 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2024-06-20T05:56:22,336 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2024-06-20T05:56:22,338 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2024-06-20T05:56:22,339 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2024-06-20T05:56:22,340 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2024-06-20T05:56:22,341 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2024-06-20T05:56:22,343 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2024-06-20T05:56:22,344 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2024-06-20T05:56:22,346 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2024-06-20T05:56:22,347 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2024-06-20T05:56:22,349 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2024-06-20T05:56:22,350 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2024-06-20T05:56:22,351 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2024-06-20T05:56:22,352 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2024-06-20T05:56:22,353 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2024-06-20T05:56:22,355 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2024-06-20T05:56:22,356 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2024-06-20T05:56:22,358 adding 'colossalai/inference/__init__.py' 2024-06-20T05:56:22,361 adding 'colossalai/inference/batch_bucket.py' 2024-06-20T05:56:22,364 adding 'colossalai/inference/config.py' 2024-06-20T05:56:22,365 adding 'colossalai/inference/flash_decoding_utils.py' 2024-06-20T05:56:22,367 adding 'colossalai/inference/graph_runner.py' 2024-06-20T05:56:22,368 adding 'colossalai/inference/logit_processors.py' 2024-06-20T05:56:22,370 adding 'colossalai/inference/sampler.py' 2024-06-20T05:56:22,371 adding 'colossalai/inference/struct.py' 2024-06-20T05:56:22,373 adding 'colossalai/inference/utils.py' 2024-06-20T05:56:22,375 adding 'colossalai/inference/core/__init__.py' 2024-06-20T05:56:22,377 adding 'colossalai/inference/core/async_engine.py' 2024-06-20T05:56:22,381 adding 'colossalai/inference/core/engine.py' 2024-06-20T05:56:22,383 adding 'colossalai/inference/core/plugin.py' 2024-06-20T05:56:22,385 adding 'colossalai/inference/core/request_handler.py' 2024-06-20T05:56:22,387 adding 'colossalai/inference/core/rpc_engine.py' 2024-06-20T05:56:22,389 adding 'colossalai/inference/executor/__init__.py' 2024-06-20T05:56:22,391 adding 'colossalai/inference/executor/rpc_worker.py' 2024-06-20T05:56:22,393 adding 'colossalai/inference/kv_cache/__init__.py' 2024-06-20T05:56:22,394 adding 'colossalai/inference/kv_cache/block_cache.py' 2024-06-20T05:56:22,397 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2024-06-20T05:56:22,399 adding 'colossalai/inference/modeling/__init__.py' 2024-06-20T05:56:22,400 adding 'colossalai/inference/modeling/backends/__init__.py' 2024-06-20T05:56:22,402 adding 'colossalai/inference/modeling/backends/attention_backend.py' 2024-06-20T05:56:22,403 adding 'colossalai/inference/modeling/backends/pre_attention_backend.py' 2024-06-20T05:56:22,405 adding 'colossalai/inference/modeling/layers/__init__.py' 2024-06-20T05:56:22,407 adding 'colossalai/inference/modeling/layers/attention.py' 2024-06-20T05:56:22,408 adding 'colossalai/inference/modeling/layers/baichuan_tp_linear.py' 2024-06-20T05:56:22,410 adding 'colossalai/inference/modeling/models/__init__.py' 2024-06-20T05:56:22,412 adding 'colossalai/inference/modeling/models/glide_llama.py' 2024-06-20T05:56:22,414 adding 'colossalai/inference/modeling/models/nopadding_baichuan.py' 2024-06-20T05:56:22,417 adding 'colossalai/inference/modeling/models/nopadding_llama.py' 2024-06-20T05:56:22,419 adding 'colossalai/inference/modeling/policy/__init__.py' 2024-06-20T05:56:22,420 adding 'colossalai/inference/modeling/policy/glide_llama.py' 2024-06-20T05:56:22,422 adding 'colossalai/inference/modeling/policy/nopadding_baichuan.py' 2024-06-20T05:56:22,423 adding 'colossalai/inference/modeling/policy/nopadding_llama.py' 2024-06-20T05:56:22,424 adding 'colossalai/inference/server/__init__.py' 2024-06-20T05:56:22,426 adding 'colossalai/inference/server/api_server.py' 2024-06-20T05:56:22,428 adding 'colossalai/inference/server/chat_service.py' 2024-06-20T05:56:22,429 adding 'colossalai/inference/server/completion_service.py' 2024-06-20T05:56:22,430 adding 'colossalai/inference/server/utils.py' 2024-06-20T05:56:22,431 adding 'colossalai/inference/spec/__init__.py' 2024-06-20T05:56:22,433 adding 'colossalai/inference/spec/drafter.py' 2024-06-20T05:56:22,434 adding 'colossalai/inference/spec/struct.py' 2024-06-20T05:56:22,436 adding 'colossalai/interface/__init__.py' 2024-06-20T05:56:22,437 adding 'colossalai/interface/model.py' 2024-06-20T05:56:22,439 adding 'colossalai/interface/optimizer.py' 2024-06-20T05:56:22,440 adding 'colossalai/interface/pretrained.py' 2024-06-20T05:56:22,442 adding 'colossalai/kernel/__init__.py' 2024-06-20T05:56:22,443 adding 'colossalai/kernel/kernel_loader.py' 2024-06-20T05:56:22,445 adding 'colossalai/kernel/extensions/__init__.py' 2024-06-20T05:56:22,446 adding 'colossalai/kernel/extensions/base_extension.py' 2024-06-20T05:56:22,448 adding 'colossalai/kernel/extensions/cpp_extension.py' 2024-06-20T05:56:22,449 adding 'colossalai/kernel/extensions/cuda_extension.py' 2024-06-20T05:56:22,450 adding 'colossalai/kernel/extensions/triton_extension.py' 2024-06-20T05:56:22,452 adding 'colossalai/kernel/extensions/utils.py' 2024-06-20T05:56:22,454 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2024-06-20T05:56:22,455 adding 'colossalai/kernel/extensions/csrc/common/data_type.h' 2024-06-20T05:56:22,457 adding 'colossalai/kernel/extensions/csrc/common/micros.h' 2024-06-20T05:56:22,458 adding 'colossalai/kernel/extensions/csrc/common/mp_type_traits.h' 2024-06-20T05:56:22,460 adding 'colossalai/kernel/extensions/csrc/common/target.h' 2024-06-20T05:56:22,461 adding 'colossalai/kernel/extensions/csrc/common/vec_type_traits.h' 2024-06-20T05:56:22,463 adding 'colossalai/kernel/extensions/csrc/funcs/binary_functor.h' 2024-06-20T05:56:22,465 adding 'colossalai/kernel/extensions/csrc/funcs/cast_functor.h' 2024-06-20T05:56:22,467 adding 'colossalai/kernel/extensions/csrc/funcs/reduce_function.h' 2024-06-20T05:56:22,468 adding 'colossalai/kernel/extensions/csrc/funcs/ternary_functor.h' 2024-06-20T05:56:22,469 adding 'colossalai/kernel/extensions/csrc/funcs/unary_functor.h' 2024-06-20T05:56:22,472 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp' 2024-06-20T05:56:22,473 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h' 2024-06-20T05:56:22,475 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu' 2024-06-20T05:56:22,477 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu' 2024-06-20T05:56:22,478 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu' 2024-06-20T05:56:22,480 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu' 2024-06-20T05:56:22,484 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu' 2024-06-20T05:56:22,486 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu' 2024-06-20T05:56:22,488 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu' 2024-06-20T05:56:22,491 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu' 2024-06-20T05:56:22,493 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu' 2024-06-20T05:56:22,495 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu' 2024-06-20T05:56:22,496 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh' 2024-06-20T05:56:22,498 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu' 2024-06-20T05:56:22,500 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu' 2024-06-20T05:56:22,501 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu' 2024-06-20T05:56:22,503 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu' 2024-06-20T05:56:22,505 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu' 2024-06-20T05:56:22,507 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu' 2024-06-20T05:56:22,510 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu' 2024-06-20T05:56:22,512 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h' 2024-06-20T05:56:22,514 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h' 2024-06-20T05:56:22,515 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h' 2024-06-20T05:56:22,516 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h' 2024-06-20T05:56:22,517 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h' 2024-06-20T05:56:22,520 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp' 2024-06-20T05:56:22,521 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h' 2024-06-20T05:56:22,523 adding 'colossalai/kernel/extensions/pybind/__init__.py' 2024-06-20T05:56:22,525 adding 'colossalai/kernel/extensions/pybind/cpu_adam/__init__.py' 2024-06-20T05:56:22,526 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-06-20T05:56:22,527 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-06-20T05:56:22,529 adding 'colossalai/kernel/extensions/pybind/flash_attention/__init__.py' 2024-06-20T05:56:22,531 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-06-20T05:56:22,532 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py' 2024-06-20T05:56:22,533 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-06-20T05:56:22,535 adding 'colossalai/kernel/extensions/pybind/inference/__init__.py' 2024-06-20T05:56:22,536 adding 'colossalai/kernel/extensions/pybind/inference/inference.cpp' 2024-06-20T05:56:22,537 adding 'colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py' 2024-06-20T05:56:22,539 adding 'colossalai/kernel/extensions/pybind/layernorm/__init__.py' 2024-06-20T05:56:22,540 adding 'colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp' 2024-06-20T05:56:22,541 adding 'colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py' 2024-06-20T05:56:22,543 adding 'colossalai/kernel/extensions/pybind/moe/__init__.py' 2024-06-20T05:56:22,544 adding 'colossalai/kernel/extensions/pybind/moe/moe.cpp' 2024-06-20T05:56:22,545 adding 'colossalai/kernel/extensions/pybind/moe/moe_cuda.py' 2024-06-20T05:56:22,547 adding 'colossalai/kernel/extensions/pybind/optimizer/__init__.py' 2024-06-20T05:56:22,548 adding 'colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-06-20T05:56:22,549 adding 'colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp' 2024-06-20T05:56:22,551 adding 'colossalai/kernel/extensions/pybind/softmax/__init__.py' 2024-06-20T05:56:22,552 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp' 2024-06-20T05:56:22,553 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-06-20T05:56:22,555 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp' 2024-06-20T05:56:22,556 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-06-20T05:56:22,557 adding 'colossalai/kernel/jit/__init__.py' 2024-06-20T05:56:22,558 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2024-06-20T05:56:22,560 adding 'colossalai/kernel/jit/bias_gelu.py' 2024-06-20T05:56:22,561 adding 'colossalai/kernel/jit/option.py' 2024-06-20T05:56:22,563 adding 'colossalai/kernel/triton/__init__.py' 2024-06-20T05:56:22,565 adding 'colossalai/kernel/triton/context_attn_unpad.py' 2024-06-20T05:56:22,568 adding 'colossalai/kernel/triton/flash_decoding.py' 2024-06-20T05:56:22,569 adding 'colossalai/kernel/triton/fused_rotary_embedding.py' 2024-06-20T05:56:22,571 adding 'colossalai/kernel/triton/kvcache_copy.py' 2024-06-20T05:56:22,573 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2024-06-20T05:56:22,575 adding 'colossalai/kernel/triton/no_pad_rotary_embedding.py' 2024-06-20T05:56:22,577 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2024-06-20T05:56:22,578 adding 'colossalai/kernel/triton/rms_layernorm.py' 2024-06-20T05:56:22,579 adding 'colossalai/kernel/triton/rotary_cache_copy.py' 2024-06-20T05:56:22,581 adding 'colossalai/kernel/triton/softmax.py' 2024-06-20T05:56:22,582 adding 'colossalai/lazy/__init__.py' 2024-06-20T05:56:22,584 adding 'colossalai/lazy/construction.py' 2024-06-20T05:56:22,587 adding 'colossalai/lazy/lazy_init.py' 2024-06-20T05:56:22,589 adding 'colossalai/lazy/pretrained.py' 2024-06-20T05:56:22,591 adding 'colossalai/legacy/__init__.py' 2024-06-20T05:56:22,592 adding 'colossalai/legacy/constants.py' 2024-06-20T05:56:22,593 adding 'colossalai/legacy/core.py' 2024-06-20T05:56:22,594 adding 'colossalai/legacy/global_variables.py' 2024-06-20T05:56:22,597 adding 'colossalai/legacy/initialize.py' 2024-06-20T05:56:22,599 adding 'colossalai/legacy/amp/__init__.py' 2024-06-20T05:56:22,600 adding 'colossalai/legacy/amp/amp_type.py' 2024-06-20T05:56:22,602 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2024-06-20T05:56:22,603 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2024-06-20T05:56:22,605 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2024-06-20T05:56:22,607 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2024-06-20T05:56:22,608 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2024-06-20T05:56:22,610 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2024-06-20T05:56:22,612 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2024-06-20T05:56:22,615 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2024-06-20T05:56:22,617 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2024-06-20T05:56:22,618 adding 'colossalai/legacy/builder/__init__.py' 2024-06-20T05:56:22,619 adding 'colossalai/legacy/builder/builder.py' 2024-06-20T05:56:22,621 adding 'colossalai/legacy/communication/__init__.py' 2024-06-20T05:56:22,622 adding 'colossalai/legacy/communication/collective.py' 2024-06-20T05:56:22,624 adding 'colossalai/legacy/communication/p2p.py' 2024-06-20T05:56:22,626 adding 'colossalai/legacy/communication/p2p_v2.py' 2024-06-20T05:56:22,627 adding 'colossalai/legacy/communication/ring.py' 2024-06-20T05:56:22,629 adding 'colossalai/legacy/communication/utils.py' 2024-06-20T05:56:22,631 adding 'colossalai/legacy/context/__init__.py' 2024-06-20T05:56:22,633 adding 'colossalai/legacy/context/parallel_context.py' 2024-06-20T05:56:22,634 adding 'colossalai/legacy/context/parallel_mode.py' 2024-06-20T05:56:22,636 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2024-06-20T05:56:22,637 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2024-06-20T05:56:22,639 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2024-06-20T05:56:22,641 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2024-06-20T05:56:22,642 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2024-06-20T05:56:22,643 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2024-06-20T05:56:22,645 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2024-06-20T05:56:22,646 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2024-06-20T05:56:22,647 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2024-06-20T05:56:22,649 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2024-06-20T05:56:22,650 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2024-06-20T05:56:22,651 adding 'colossalai/legacy/context/random/__init__.py' 2024-06-20T05:56:22,653 adding 'colossalai/legacy/context/random/_helper.py' 2024-06-20T05:56:22,654 adding 'colossalai/legacy/context/random/seed_manager.py' 2024-06-20T05:56:22,656 adding 'colossalai/legacy/engine/__init__.py' 2024-06-20T05:56:22,657 adding 'colossalai/legacy/engine/_base_engine.py' 2024-06-20T05:56:22,659 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2024-06-20T05:56:22,661 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2024-06-20T05:56:22,663 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2024-06-20T05:56:22,664 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2024-06-20T05:56:22,665 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2024-06-20T05:56:22,667 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2024-06-20T05:56:22,668 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2024-06-20T05:56:22,669 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2024-06-20T05:56:22,670 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2024-06-20T05:56:22,672 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2024-06-20T05:56:22,673 adding 'colossalai/legacy/engine/schedule/__init__.py' 2024-06-20T05:56:22,675 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2024-06-20T05:56:22,676 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2024-06-20T05:56:22,680 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2024-06-20T05:56:22,682 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2024-06-20T05:56:22,684 adding 'colossalai/legacy/inference/__init__.py' 2024-06-20T05:56:22,685 adding 'colossalai/legacy/inference/async_engine.py' 2024-06-20T05:56:22,687 adding 'colossalai/legacy/inference/async_manager.py' 2024-06-20T05:56:22,688 adding 'colossalai/legacy/inference/manager.py' 2024-06-20T05:56:22,690 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2024-06-20T05:56:22,691 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2024-06-20T05:56:22,693 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2024-06-20T05:56:22,694 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2024-06-20T05:56:22,696 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2024-06-20T05:56:22,697 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2024-06-20T05:56:22,698 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2024-06-20T05:56:22,699 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2024-06-20T05:56:22,700 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2024-06-20T05:56:22,702 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2024-06-20T05:56:22,703 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2024-06-20T05:56:22,705 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2024-06-20T05:56:22,706 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2024-06-20T05:56:22,709 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2024-06-20T05:56:22,710 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2024-06-20T05:56:22,712 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2024-06-20T05:56:22,714 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2024-06-20T05:56:22,715 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2024-06-20T05:56:22,717 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2024-06-20T05:56:22,719 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2024-06-20T05:56:22,721 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2024-06-20T05:56:22,723 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2024-06-20T05:56:22,724 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2024-06-20T05:56:22,726 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2024-06-20T05:56:22,729 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2024-06-20T05:56:22,731 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2024-06-20T05:56:22,734 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2024-06-20T05:56:22,735 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2024-06-20T05:56:22,737 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2024-06-20T05:56:22,738 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2024-06-20T05:56:22,739 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2024-06-20T05:56:22,741 adding 'colossalai/legacy/nn/__init__.py' 2024-06-20T05:56:22,743 adding 'colossalai/legacy/nn/_ops/__init__.py' 2024-06-20T05:56:22,744 adding 'colossalai/legacy/nn/_ops/_utils.py' 2024-06-20T05:56:22,746 adding 'colossalai/legacy/nn/layer/__init__.py' 2024-06-20T05:56:22,747 adding 'colossalai/legacy/nn/layer/base_layer.py' 2024-06-20T05:56:22,749 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2024-06-20T05:56:22,750 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2024-06-20T05:56:22,752 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2024-06-20T05:56:22,753 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2024-06-20T05:56:22,755 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2024-06-20T05:56:22,756 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2024-06-20T05:56:22,758 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2024-06-20T05:56:22,759 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2024-06-20T05:56:22,761 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2024-06-20T05:56:22,764 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2024-06-20T05:56:22,766 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2024-06-20T05:56:22,769 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2024-06-20T05:56:22,770 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2024-06-20T05:56:22,773 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2024-06-20T05:56:22,775 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2024-06-20T05:56:22,778 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2024-06-20T05:56:22,780 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2024-06-20T05:56:22,783 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2024-06-20T05:56:22,785 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2024-06-20T05:56:22,788 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2024-06-20T05:56:22,789 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2024-06-20T05:56:22,792 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2024-06-20T05:56:22,794 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2024-06-20T05:56:22,796 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2024-06-20T05:56:22,797 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2024-06-20T05:56:22,798 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2024-06-20T05:56:22,800 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2024-06-20T05:56:22,801 adding 'colossalai/legacy/nn/layer/utils/common.py' 2024-06-20T05:56:22,803 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2024-06-20T05:56:22,805 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2024-06-20T05:56:22,807 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2024-06-20T05:56:22,808 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2024-06-20T05:56:22,810 adding 'colossalai/legacy/nn/loss/__init__.py' 2024-06-20T05:56:22,811 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2024-06-20T05:56:22,813 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2024-06-20T05:56:22,818 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2024-06-20T05:56:22,820 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2024-06-20T05:56:22,822 adding 'colossalai/legacy/nn/metric/__init__.py' 2024-06-20T05:56:22,823 adding 'colossalai/legacy/nn/metric/_utils.py' 2024-06-20T05:56:22,824 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2024-06-20T05:56:22,825 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2024-06-20T05:56:22,826 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2024-06-20T05:56:22,828 adding 'colossalai/legacy/nn/parallel/__init__.py' 2024-06-20T05:56:22,830 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2024-06-20T05:56:22,831 adding 'colossalai/legacy/nn/parallel/reducer.py' 2024-06-20T05:56:22,833 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2024-06-20T05:56:22,834 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2024-06-20T05:56:22,836 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2024-06-20T05:56:22,837 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2024-06-20T05:56:22,839 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2024-06-20T05:56:22,842 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2024-06-20T05:56:22,843 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2024-06-20T05:56:22,848 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2024-06-20T05:56:22,850 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2024-06-20T05:56:22,852 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2024-06-20T05:56:22,854 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2024-06-20T05:56:22,855 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2024-06-20T05:56:22,857 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2024-06-20T05:56:22,859 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2024-06-20T05:56:22,862 adding 'colossalai/legacy/pipeline/__init__.py' 2024-06-20T05:56:22,863 adding 'colossalai/legacy/pipeline/layer_spec.py' 2024-06-20T05:56:22,865 adding 'colossalai/legacy/pipeline/pipelinable.py' 2024-06-20T05:56:22,867 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2024-06-20T05:56:22,870 adding 'colossalai/legacy/pipeline/utils.py' 2024-06-20T05:56:22,872 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2024-06-20T05:56:22,873 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2024-06-20T05:56:22,875 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2024-06-20T05:56:22,877 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2024-06-20T05:56:22,879 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2024-06-20T05:56:22,888 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2024-06-20T05:56:22,891 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2024-06-20T05:56:22,893 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2024-06-20T05:56:22,895 adding 'colossalai/legacy/registry/__init__.py' 2024-06-20T05:56:22,897 adding 'colossalai/legacy/registry/registry.py' 2024-06-20T05:56:22,899 adding 'colossalai/legacy/tensor/__init__.py' 2024-06-20T05:56:22,900 adding 'colossalai/legacy/tensor/compute_spec.py' 2024-06-20T05:56:22,902 adding 'colossalai/legacy/tensor/const.py' 2024-06-20T05:56:22,904 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2024-06-20T05:56:22,906 adding 'colossalai/legacy/tensor/distspec.py' 2024-06-20T05:56:22,907 adding 'colossalai/legacy/tensor/op_wrapper.py' 2024-06-20T05:56:22,909 adding 'colossalai/legacy/tensor/process_group.py' 2024-06-20T05:56:22,911 adding 'colossalai/legacy/tensor/tensor_spec.py' 2024-06-20T05:56:22,914 adding 'colossalai/legacy/trainer/__init__.py' 2024-06-20T05:56:22,917 adding 'colossalai/legacy/trainer/_trainer.py' 2024-06-20T05:56:22,920 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2024-06-20T05:56:22,922 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2024-06-20T05:56:22,924 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2024-06-20T05:56:22,925 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2024-06-20T05:56:22,928 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2024-06-20T05:56:22,929 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2024-06-20T05:56:22,932 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2024-06-20T05:56:22,934 adding 'colossalai/legacy/utils/__init__.py' 2024-06-20T05:56:22,936 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2024-06-20T05:56:22,938 adding 'colossalai/legacy/utils/checkpointing.py' 2024-06-20T05:56:22,940 adding 'colossalai/legacy/utils/common.py' 2024-06-20T05:56:22,942 adding 'colossalai/legacy/utils/memory.py' 2024-06-20T05:56:22,947 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2024-06-20T05:56:22,948 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2024-06-20T05:56:22,950 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2024-06-20T05:56:22,951 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2024-06-20T05:56:22,953 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2024-06-20T05:56:22,954 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2024-06-20T05:56:22,956 adding 'colossalai/legacy/utils/profiler/__init__.py' 2024-06-20T05:56:22,957 adding 'colossalai/legacy/utils/profiler/extention.py' 2024-06-20T05:56:22,959 adding 'colossalai/legacy/utils/profiler/profiler.py' 2024-06-20T05:56:22,960 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2024-06-20T05:56:22,962 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2024-06-20T05:56:22,964 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2024-06-20T05:56:22,965 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2024-06-20T05:56:22,966 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2024-06-20T05:56:22,968 adding 'colossalai/legacy/zero/__init__.py' 2024-06-20T05:56:22,970 adding 'colossalai/legacy/zero/gemini/__init__.py' 2024-06-20T05:56:22,971 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2024-06-20T05:56:22,973 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2024-06-20T05:56:22,974 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2024-06-20T05:56:22,976 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2024-06-20T05:56:22,977 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2024-06-20T05:56:22,978 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2024-06-20T05:56:22,980 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2024-06-20T05:56:22,981 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2024-06-20T05:56:22,982 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2024-06-20T05:56:22,984 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2024-06-20T05:56:22,985 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2024-06-20T05:56:22,987 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2024-06-20T05:56:22,988 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2024-06-20T05:56:22,990 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2024-06-20T05:56:22,992 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2024-06-20T05:56:22,994 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2024-06-20T05:56:22,995 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2024-06-20T05:56:22,996 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2024-06-20T05:56:22,998 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2024-06-20T05:56:22,999 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2024-06-20T05:56:23,001 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2024-06-20T05:56:23,002 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2024-06-20T05:56:23,004 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2024-06-20T05:56:23,008 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2024-06-20T05:56:23,009 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2024-06-20T05:56:23,010 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2024-06-20T05:56:23,012 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2024-06-20T05:56:23,015 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2024-06-20T05:56:23,016 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2024-06-20T05:56:23,018 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2024-06-20T05:56:23,019 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2024-06-20T05:56:23,021 adding 'colossalai/logging/__init__.py' 2024-06-20T05:56:23,022 adding 'colossalai/logging/logger.py' 2024-06-20T05:56:23,024 adding 'colossalai/moe/__init__.py' 2024-06-20T05:56:23,026 adding 'colossalai/moe/_operation.py' 2024-06-20T05:56:23,030 adding 'colossalai/moe/checkpoint.py' 2024-06-20T05:56:23,031 adding 'colossalai/moe/experts.py' 2024-06-20T05:56:23,034 adding 'colossalai/moe/layers.py' 2024-06-20T05:56:23,036 adding 'colossalai/moe/load_balance.py' 2024-06-20T05:56:23,038 adding 'colossalai/moe/loss.py' 2024-06-20T05:56:23,040 adding 'colossalai/moe/manager.py' 2024-06-20T05:56:23,043 adding 'colossalai/moe/routers.py' 2024-06-20T05:56:23,044 adding 'colossalai/moe/utils.py' 2024-06-20T05:56:23,046 adding 'colossalai/nn/__init__.py' 2024-06-20T05:56:23,047 adding 'colossalai/nn/init.py' 2024-06-20T05:56:23,049 adding 'colossalai/nn/layer/__init__.py' 2024-06-20T05:56:23,050 adding 'colossalai/nn/layer/layernorm.py' 2024-06-20T05:56:23,052 adding 'colossalai/nn/layer/scaled_softmax.py' 2024-06-20T05:56:23,053 adding 'colossalai/nn/layer/utils.py' 2024-06-20T05:56:23,054 adding 'colossalai/nn/loss/__init__.py' 2024-06-20T05:56:23,056 adding 'colossalai/nn/lr_scheduler/__init__.py' 2024-06-20T05:56:23,057 adding 'colossalai/nn/lr_scheduler/cosine.py' 2024-06-20T05:56:23,059 adding 'colossalai/nn/lr_scheduler/delayed.py' 2024-06-20T05:56:23,060 adding 'colossalai/nn/lr_scheduler/linear.py' 2024-06-20T05:56:23,061 adding 'colossalai/nn/lr_scheduler/multistep.py' 2024-06-20T05:56:23,062 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2024-06-20T05:56:23,064 adding 'colossalai/nn/lr_scheduler/poly.py' 2024-06-20T05:56:23,065 adding 'colossalai/nn/lr_scheduler/torch.py' 2024-06-20T05:56:23,067 adding 'colossalai/nn/optimizer/__init__.py' 2024-06-20T05:56:23,068 adding 'colossalai/nn/optimizer/adafactor.py' 2024-06-20T05:56:23,070 adding 'colossalai/nn/optimizer/came.py' 2024-06-20T05:56:23,071 adding 'colossalai/nn/optimizer/cpu_adam.py' 2024-06-20T05:56:23,074 adding 'colossalai/nn/optimizer/distributed_adafactor.py' 2024-06-20T05:56:23,077 adding 'colossalai/nn/optimizer/distributed_came.py' 2024-06-20T05:56:23,079 adding 'colossalai/nn/optimizer/distributed_galore.py' 2024-06-20T05:56:23,081 adding 'colossalai/nn/optimizer/distributed_lamb.py' 2024-06-20T05:56:23,082 adding 'colossalai/nn/optimizer/fused_adam.py' 2024-06-20T05:56:23,084 adding 'colossalai/nn/optimizer/fused_lamb.py' 2024-06-20T05:56:23,086 adding 'colossalai/nn/optimizer/fused_sgd.py' 2024-06-20T05:56:23,088 adding 'colossalai/nn/optimizer/galore.py' 2024-06-20T05:56:23,090 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2024-06-20T05:56:23,091 adding 'colossalai/nn/optimizer/lamb.py' 2024-06-20T05:56:23,092 adding 'colossalai/nn/optimizer/lars.py' 2024-06-20T05:56:23,094 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2024-06-20T05:56:23,096 adding 'colossalai/pipeline/__init__.py' 2024-06-20T05:56:23,099 adding 'colossalai/pipeline/p2p.py' 2024-06-20T05:56:23,101 adding 'colossalai/pipeline/stage_manager.py' 2024-06-20T05:56:23,102 adding 'colossalai/pipeline/schedule/__init__.py' 2024-06-20T05:56:23,104 adding 'colossalai/pipeline/schedule/_utils.py' 2024-06-20T05:56:23,105 adding 'colossalai/pipeline/schedule/base.py' 2024-06-20T05:56:23,107 adding 'colossalai/pipeline/schedule/generate.py' 2024-06-20T05:56:23,110 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2024-06-20T05:56:23,113 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2024-06-20T05:56:23,115 adding 'colossalai/quantization/__init__.py' 2024-06-20T05:56:23,117 adding 'colossalai/quantization/bnb.py' 2024-06-20T05:56:23,118 adding 'colossalai/quantization/bnb_config.py' 2024-06-20T05:56:23,120 adding 'colossalai/shardformer/__init__.py' 2024-06-20T05:56:23,121 adding 'colossalai/shardformer/_utils.py' 2024-06-20T05:56:23,123 adding 'colossalai/shardformer/layer/__init__.py' 2024-06-20T05:56:23,127 adding 'colossalai/shardformer/layer/_operation.py' 2024-06-20T05:56:23,129 adding 'colossalai/shardformer/layer/attn.py' 2024-06-20T05:56:23,130 adding 'colossalai/shardformer/layer/dropout.py' 2024-06-20T05:56:23,132 adding 'colossalai/shardformer/layer/embedding.py' 2024-06-20T05:56:23,135 adding 'colossalai/shardformer/layer/linear.py' 2024-06-20T05:56:23,137 adding 'colossalai/shardformer/layer/loss.py' 2024-06-20T05:56:23,138 adding 'colossalai/shardformer/layer/normalization.py' 2024-06-20T05:56:23,140 adding 'colossalai/shardformer/layer/parallel_module.py' 2024-06-20T05:56:23,143 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2024-06-20T05:56:23,145 adding 'colossalai/shardformer/layer/utils.py' 2024-06-20T05:56:23,147 adding 'colossalai/shardformer/modeling/__init__.py' 2024-06-20T05:56:23,152 adding 'colossalai/shardformer/modeling/bert.py' 2024-06-20T05:56:23,154 adding 'colossalai/shardformer/modeling/blip2.py' 2024-06-20T05:56:23,159 adding 'colossalai/shardformer/modeling/bloom.py' 2024-06-20T05:56:23,161 adding 'colossalai/shardformer/modeling/chatglm2.py' 2024-06-20T05:56:23,164 adding 'colossalai/shardformer/modeling/command.py' 2024-06-20T05:56:23,167 adding 'colossalai/shardformer/modeling/falcon.py' 2024-06-20T05:56:23,172 adding 'colossalai/shardformer/modeling/gpt2.py' 2024-06-20T05:56:23,176 adding 'colossalai/shardformer/modeling/gptj.py' 2024-06-20T05:56:23,177 adding 'colossalai/shardformer/modeling/jit.py' 2024-06-20T05:56:23,181 adding 'colossalai/shardformer/modeling/llama.py' 2024-06-20T05:56:23,184 adding 'colossalai/shardformer/modeling/mistral.py' 2024-06-20T05:56:23,188 adding 'colossalai/shardformer/modeling/opt.py' 2024-06-20T05:56:23,191 adding 'colossalai/shardformer/modeling/qwen2.py' 2024-06-20T05:56:23,193 adding 'colossalai/shardformer/modeling/sam.py' 2024-06-20T05:56:23,196 adding 'colossalai/shardformer/modeling/t5.py' 2024-06-20T05:56:23,198 adding 'colossalai/shardformer/modeling/vit.py' 2024-06-20T05:56:23,203 adding 'colossalai/shardformer/modeling/whisper.py' 2024-06-20T05:56:23,205 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2024-06-20T05:56:23,206 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2024-06-20T05:56:23,212 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2024-06-20T05:56:23,214 adding 'colossalai/shardformer/policies/__init__.py' 2024-06-20T05:56:23,216 adding 'colossalai/shardformer/policies/auto_policy.py' 2024-06-20T05:56:23,218 adding 'colossalai/shardformer/policies/base_policy.py' 2024-06-20T05:56:23,220 adding 'colossalai/shardformer/policies/bert.py' 2024-06-20T05:56:23,222 adding 'colossalai/shardformer/policies/blip2.py' 2024-06-20T05:56:23,224 adding 'colossalai/shardformer/policies/bloom.py' 2024-06-20T05:56:23,226 adding 'colossalai/shardformer/policies/chatglm2.py' 2024-06-20T05:56:23,228 adding 'colossalai/shardformer/policies/command.py' 2024-06-20T05:56:23,229 adding 'colossalai/shardformer/policies/falcon.py' 2024-06-20T05:56:23,232 adding 'colossalai/shardformer/policies/gpt2.py' 2024-06-20T05:56:23,233 adding 'colossalai/shardformer/policies/gptj.py' 2024-06-20T05:56:23,235 adding 'colossalai/shardformer/policies/llama.py' 2024-06-20T05:56:23,237 adding 'colossalai/shardformer/policies/mistral.py' 2024-06-20T05:56:23,239 adding 'colossalai/shardformer/policies/opt.py' 2024-06-20T05:56:23,241 adding 'colossalai/shardformer/policies/qwen2.py' 2024-06-20T05:56:23,243 adding 'colossalai/shardformer/policies/sam.py' 2024-06-20T05:56:23,245 adding 'colossalai/shardformer/policies/t5.py' 2024-06-20T05:56:23,247 adding 'colossalai/shardformer/policies/vit.py' 2024-06-20T05:56:23,249 adding 'colossalai/shardformer/policies/whisper.py' 2024-06-20T05:56:23,251 adding 'colossalai/shardformer/shard/__init__.py' 2024-06-20T05:56:23,252 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2024-06-20T05:56:23,254 adding 'colossalai/shardformer/shard/shard_config.py' 2024-06-20T05:56:23,255 adding 'colossalai/shardformer/shard/sharder.py' 2024-06-20T05:56:23,257 adding 'colossalai/shardformer/shard/shardformer.py' 2024-06-20T05:56:23,258 adding 'colossalai/shardformer/shard/utils.py' 2024-06-20T05:56:23,260 adding 'colossalai/tensor/__init__.py' 2024-06-20T05:56:23,261 adding 'colossalai/tensor/colo_parameter.py' 2024-06-20T05:56:23,263 adding 'colossalai/tensor/colo_tensor.py' 2024-06-20T05:56:23,265 adding 'colossalai/tensor/comm_spec.py' 2024-06-20T05:56:23,267 adding 'colossalai/tensor/param_op_hook.py' 2024-06-20T05:56:23,270 adding 'colossalai/tensor/shape_consistency.py' 2024-06-20T05:56:23,272 adding 'colossalai/tensor/sharding_spec.py' 2024-06-20T05:56:23,274 adding 'colossalai/tensor/utils.py' 2024-06-20T05:56:23,276 adding 'colossalai/tensor/d_tensor/__init__.py' 2024-06-20T05:56:23,278 adding 'colossalai/tensor/d_tensor/api.py' 2024-06-20T05:56:23,280 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2024-06-20T05:56:23,281 adding 'colossalai/tensor/d_tensor/layout.py' 2024-06-20T05:56:23,284 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2024-06-20T05:56:23,285 adding 'colossalai/tensor/d_tensor/misc.py' 2024-06-20T05:56:23,287 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2024-06-20T05:56:23,288 adding 'colossalai/tensor/d_tensor/utils.py' 2024-06-20T05:56:23,290 adding 'colossalai/tensor/moe_tensor/__init__.py' 2024-06-20T05:56:23,291 adding 'colossalai/tensor/moe_tensor/api.py' 2024-06-20T05:56:23,292 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2024-06-20T05:56:23,293 adding 'colossalai/tensor/padded_tensor/__init__.py' 2024-06-20T05:56:23,295 adding 'colossalai/tensor/padded_tensor/api.py' 2024-06-20T05:56:23,296 adding 'colossalai/testing/__init__.py' 2024-06-20T05:56:23,298 adding 'colossalai/testing/comparison.py' 2024-06-20T05:56:23,299 adding 'colossalai/testing/pytest_wrapper.py' 2024-06-20T05:56:23,300 adding 'colossalai/testing/random.py' 2024-06-20T05:56:23,302 adding 'colossalai/testing/utils.py' 2024-06-20T05:56:23,304 adding 'colossalai/utils/__init__.py' 2024-06-20T05:56:23,305 adding 'colossalai/utils/common.py' 2024-06-20T05:56:23,306 adding 'colossalai/utils/memory.py' 2024-06-20T05:56:23,307 adding 'colossalai/utils/timer.py' 2024-06-20T05:56:23,309 adding 'colossalai/utils/model/__init__.py' 2024-06-20T05:56:23,311 adding 'colossalai/utils/model/utils.py' 2024-06-20T05:56:23,312 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2024-06-20T05:56:23,313 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2024-06-20T05:56:23,315 adding 'colossalai/utils/rank_recorder/__init__.py' 2024-06-20T05:56:23,317 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2024-06-20T05:56:23,318 adding 'colossalai/utils/tensor_detector/__init__.py' 2024-06-20T05:56:23,320 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2024-06-20T05:56:23,322 adding 'colossalai/zero/__init__.py' 2024-06-20T05:56:23,323 adding 'colossalai/zero/wrapper.py' 2024-06-20T05:56:23,325 adding 'colossalai/zero/gemini/__init__.py' 2024-06-20T05:56:23,330 adding 'colossalai/zero/gemini/gemini_ddp.py' 2024-06-20T05:56:23,332 adding 'colossalai/zero/gemini/gemini_hook.py' 2024-06-20T05:56:23,334 adding 'colossalai/zero/gemini/gemini_mgr.py' 2024-06-20T05:56:23,338 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2024-06-20T05:56:23,340 adding 'colossalai/zero/gemini/placement_policy.py' 2024-06-20T05:56:23,342 adding 'colossalai/zero/gemini/utils.py' 2024-06-20T05:56:23,343 adding 'colossalai/zero/gemini/chunk/__init__.py' 2024-06-20T05:56:23,346 adding 'colossalai/zero/gemini/chunk/chunk.py' 2024-06-20T05:56:23,349 adding 'colossalai/zero/gemini/chunk/manager.py' 2024-06-20T05:56:23,350 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2024-06-20T05:56:23,352 adding 'colossalai/zero/gemini/chunk/utils.py' 2024-06-20T05:56:23,353 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2024-06-20T05:56:23,355 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2024-06-20T05:56:23,356 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2024-06-20T05:56:23,357 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2024-06-20T05:56:23,359 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2024-06-20T05:56:23,360 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2024-06-20T05:56:23,362 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2024-06-20T05:56:23,363 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2024-06-20T05:56:23,364 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2024-06-20T05:56:23,366 adding 'colossalai/zero/low_level/__init__.py' 2024-06-20T05:56:23,368 adding 'colossalai/zero/low_level/_utils.py' 2024-06-20T05:56:23,372 adding 'colossalai/zero/low_level/low_level_optim.py' 2024-06-20T05:56:23,382 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2024-06-20T05:56:23,383 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2024-06-20T05:56:23,385 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2024-06-20T05:56:23,386 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2024-06-20T05:56:23,387 adding 'colossalai/zero/low_level/bookkeeping/parameter_store.py' 2024-06-20T05:56:23,388 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2024-06-20T05:56:23,391 adding 'extensions/csrc/__init__.py' 2024-06-20T05:56:23,392 adding 'extensions/pybind/__init__.py' 2024-06-20T05:56:23,394 adding 'extensions/pybind/cpu_adam/__init__.py' 2024-06-20T05:56:23,395 adding 'extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-06-20T05:56:23,396 adding 'extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-06-20T05:56:23,398 adding 'extensions/pybind/flash_attention/__init__.py' 2024-06-20T05:56:23,399 adding 'extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-06-20T05:56:23,401 adding 'extensions/pybind/flash_attention/flash_attention_npu.py' 2024-06-20T05:56:23,402 adding 'extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-06-20T05:56:23,403 adding 'extensions/pybind/inference/__init__.py' 2024-06-20T05:56:23,404 adding 'extensions/pybind/inference/inference_ops_cuda.py' 2024-06-20T05:56:23,406 adding 'extensions/pybind/layernorm/__init__.py' 2024-06-20T05:56:23,407 adding 'extensions/pybind/layernorm/layernorm_cuda.py' 2024-06-20T05:56:23,409 adding 'extensions/pybind/moe/__init__.py' 2024-06-20T05:56:23,410 adding 'extensions/pybind/moe/moe_cuda.py' 2024-06-20T05:56:23,412 adding 'extensions/pybind/optimizer/__init__.py' 2024-06-20T05:56:23,413 adding 'extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-06-20T05:56:23,415 adding 'extensions/pybind/softmax/__init__.py' 2024-06-20T05:56:23,416 adding 'extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-06-20T05:56:23,418 adding 'extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-06-20T05:56:23,420 adding 'colossalai-0.3.9.dist-info/LICENSE' 2024-06-20T05:56:23,424 adding 'colossalai-0.3.9.dist-info/METADATA' 2024-06-20T05:56:23,425 adding 'colossalai-0.3.9.dist-info/WHEEL' 2024-06-20T05:56:23,426 adding 'colossalai-0.3.9.dist-info/entry_points.txt' 2024-06-20T05:56:23,427 adding 'colossalai-0.3.9.dist-info/top_level.txt' 2024-06-20T05:56:23,442 adding 'colossalai-0.3.9.dist-info/RECORD' 2024-06-20T05:56:23,468 removing build/bdist.linux-armv7l/wheel 2024-06-20T05:56:23,819 Building wheel for colossalai (setup.py): finished with status 'done' 2024-06-20T05:56:23,836 Created wheel for colossalai: filename=colossalai-0.3.9-py3-none-any.whl size=1535686 sha256=670e4e0d607a0803e8f0a7349996228f4cfa411d817bd631c07b1b2064e7af48 2024-06-20T05:56:23,838 Stored in directory: /tmp/pip-ephem-wheel-cache-wrxxvrrw/wheels/4a/3a/9a/6cffb6f4373b51f4edf69ded6e9219e0462ae61f9fbd74e541 2024-06-20T05:56:23,877 Successfully built colossalai 2024-06-20T05:56:23,923 Removed build tracker: '/tmp/pip-build-tracker-gegxfasx'