2024-03-07T16:37:44,565 Created temporary directory: /tmp/pip-build-tracker-l2qizw93 2024-03-07T16:37:44,566 Initialized build tracking at /tmp/pip-build-tracker-l2qizw93 2024-03-07T16:37:44,566 Created build tracker: /tmp/pip-build-tracker-l2qizw93 2024-03-07T16:37:44,567 Entered build tracker: /tmp/pip-build-tracker-l2qizw93 2024-03-07T16:37:44,568 Created temporary directory: /tmp/pip-wheel-lk1zfur4 2024-03-07T16:37:44,571 Created temporary directory: /tmp/pip-ephem-wheel-cache-pjndjs90 2024-03-07T16:37:44,593 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-07T16:37:44,597 2 location(s) to search for versions of colossalai: 2024-03-07T16:37:44,597 * https://pypi.org/simple/colossalai/ 2024-03-07T16:37:44,597 * https://www.piwheels.org/simple/colossalai/ 2024-03-07T16:37:44,598 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2024-03-07T16:37:44,598 Getting page https://pypi.org/simple/colossalai/ 2024-03-07T16:37:44,600 Found index url https://pypi.org/simple/ 2024-03-07T16:37:44,817 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2024-03-07T16:37:44,821 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2024-03-07T16:37:44,823 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2024-03-07T16:37:44,823 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2024-03-07T16:37:44,824 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2024-03-07T16:37:44,825 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2024-03-07T16:37:44,827 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2024-03-07T16:37:44,828 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2024-03-07T16:37:44,829 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2024-03-07T16:37:44,830 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2024-03-07T16:37:44,831 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2024-03-07T16:37:44,832 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2024-03-07T16:37:44,833 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2024-03-07T16:37:44,834 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2024-03-07T16:37:44,836 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2024-03-07T16:37:44,836 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2024-03-07T16:37:44,837 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2024-03-07T16:37:44,838 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2024-03-07T16:37:44,839 Getting page https://www.piwheels.org/simple/colossalai/ 2024-03-07T16:37:44,840 Found index url https://www.piwheels.org/simple/ 2024-03-07T16:37:45,028 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2024-03-07T16:37:45,033 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,034 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,034 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,035 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,035 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,036 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,037 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,037 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,038 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,038 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,039 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,040 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,040 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,041 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,041 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-03-07T16:37:45,042 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2024-03-07T16:37:45,042 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2024-03-07T16:37:45,062 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2024-03-07T16:37:45,080 Collecting colossalai==0.3.6 2024-03-07T16:37:45,082 Created temporary directory: /tmp/pip-unpack-18l847tv 2024-03-07T16:37:45,393 Downloading colossalai-0.3.6.tar.gz (1.1 MB) 2024-03-07T16:37:47,529 Added colossalai==0.3.6 from https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz to build tracker '/tmp/pip-build-tracker-l2qizw93' 2024-03-07T16:37:47,531 Running setup.py (path:/tmp/pip-wheel-lk1zfur4/colossalai_c2ab54dcce02409b9eedb1f4dbe34f98/setup.py) egg_info for package colossalai 2024-03-07T16:37:47,532 Created temporary directory: /tmp/pip-pip-egg-info-cpu3wrzv 2024-03-07T16:37:47,533 Preparing metadata (setup.py): started 2024-03-07T16:37:47,534 Running command python setup.py egg_info 2024-03-07T16:37:48,597 running egg_info 2024-03-07T16:37:48,599 creating /tmp/pip-pip-egg-info-cpu3wrzv/colossalai.egg-info 2024-03-07T16:37:48,623 writing /tmp/pip-pip-egg-info-cpu3wrzv/colossalai.egg-info/PKG-INFO 2024-03-07T16:37:48,627 writing dependency_links to /tmp/pip-pip-egg-info-cpu3wrzv/colossalai.egg-info/dependency_links.txt 2024-03-07T16:37:48,628 writing entry points to /tmp/pip-pip-egg-info-cpu3wrzv/colossalai.egg-info/entry_points.txt 2024-03-07T16:37:48,630 writing requirements to /tmp/pip-pip-egg-info-cpu3wrzv/colossalai.egg-info/requires.txt 2024-03-07T16:37:48,632 writing top-level names to /tmp/pip-pip-egg-info-cpu3wrzv/colossalai.egg-info/top_level.txt 2024-03-07T16:37:48,634 writing manifest file '/tmp/pip-pip-egg-info-cpu3wrzv/colossalai.egg-info/SOURCES.txt' 2024-03-07T16:37:48,893 reading manifest file '/tmp/pip-pip-egg-info-cpu3wrzv/colossalai.egg-info/SOURCES.txt' 2024-03-07T16:37:48,894 reading manifest template 'MANIFEST.in' 2024-03-07T16:37:50,063 warning: no files found matching '*.tr' under directory 'colossalai' 2024-03-07T16:37:50,663 warning: no files found matching '*.cc' under directory 'colossalai' 2024-03-07T16:37:50,941 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-03-07T16:37:51,026 warning: no files found matching '*.tr' under directory 'extensions' 2024-03-07T16:37:51,059 warning: no files found matching '*.cc' under directory 'extensions' 2024-03-07T16:37:51,077 warning: no files found matching '*.pyi' under directory 'extensions' 2024-03-07T16:37:51,077 adding license file 'LICENSE' 2024-03-07T16:37:51,104 writing manifest file '/tmp/pip-pip-egg-info-cpu3wrzv/colossalai.egg-info/SOURCES.txt' 2024-03-07T16:37:51,214 Preparing metadata (setup.py): finished with status 'done' 2024-03-07T16:37:51,219 Source in /tmp/pip-wheel-lk1zfur4/colossalai_c2ab54dcce02409b9eedb1f4dbe34f98 has version 0.3.6, which satisfies requirement colossalai==0.3.6 from https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz 2024-03-07T16:37:51,220 Removed colossalai==0.3.6 from https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz from build tracker '/tmp/pip-build-tracker-l2qizw93' 2024-03-07T16:37:51,229 Created temporary directory: /tmp/pip-unpack-zwqqso8e 2024-03-07T16:37:51,230 Created temporary directory: /tmp/pip-unpack-xwigr4hi 2024-03-07T16:37:51,251 Building wheels for collected packages: colossalai 2024-03-07T16:37:51,255 Created temporary directory: /tmp/pip-wheel-i8qbqsfx 2024-03-07T16:37:51,256 Building wheel for colossalai (setup.py): started 2024-03-07T16:37:51,257 Destination directory: /tmp/pip-wheel-i8qbqsfx 2024-03-07T16:37:51,258 Running command python setup.py bdist_wheel 2024-03-07T16:37:52,301 running bdist_wheel 2024-03-07T16:37:52,398 running build 2024-03-07T16:37:52,399 running build_py 2024-03-07T16:37:52,426 creating build 2024-03-07T16:37:52,426 creating build/lib 2024-03-07T16:37:52,427 creating build/lib/colossalai 2024-03-07T16:37:52,428 copying colossalai/version.py -> build/lib/colossalai 2024-03-07T16:37:52,430 copying colossalai/__init__.py -> build/lib/colossalai 2024-03-07T16:37:52,432 copying colossalai/initialize.py -> build/lib/colossalai 2024-03-07T16:37:52,435 creating build/lib/extensions 2024-03-07T16:37:52,436 creating build/lib/extensions/cpu_adam 2024-03-07T16:37:52,437 copying extensions/cpu_adam/__init__.py -> build/lib/extensions/cpu_adam 2024-03-07T16:37:52,439 copying extensions/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/cpu_adam 2024-03-07T16:37:52,441 copying extensions/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/cpu_adam 2024-03-07T16:37:52,443 creating build/lib/extensions/csrc 2024-03-07T16:37:52,445 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2024-03-07T16:37:52,447 copying extensions/csrc/scaled_softmax.py -> build/lib/extensions/csrc 2024-03-07T16:37:52,449 creating build/lib/extensions/optimizer 2024-03-07T16:37:52,451 copying extensions/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/optimizer 2024-03-07T16:37:52,453 copying extensions/optimizer/__init__.py -> build/lib/extensions/optimizer 2024-03-07T16:37:52,455 creating build/lib/extensions/moe 2024-03-07T16:37:52,456 copying extensions/moe/moe_cuda.py -> build/lib/extensions/moe 2024-03-07T16:37:52,458 copying extensions/moe/__init__.py -> build/lib/extensions/moe 2024-03-07T16:37:52,461 creating build/lib/extensions/flash_attention 2024-03-07T16:37:52,462 copying extensions/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/flash_attention 2024-03-07T16:37:52,464 copying extensions/flash_attention/flash_attention_xformers_cuda.py -> build/lib/extensions/flash_attention 2024-03-07T16:37:52,466 copying extensions/flash_attention/flash_attention_npu.py -> build/lib/extensions/flash_attention 2024-03-07T16:37:52,468 copying extensions/flash_attention/__init__.py -> build/lib/extensions/flash_attention 2024-03-07T16:37:52,470 creating build/lib/extensions/layernorm 2024-03-07T16:37:52,471 copying extensions/layernorm/layernorm_cuda.py -> build/lib/extensions/layernorm 2024-03-07T16:37:52,473 copying extensions/layernorm/__init__.py -> build/lib/extensions/layernorm 2024-03-07T16:37:52,475 creating build/lib/extensions/softmax 2024-03-07T16:37:52,476 copying extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/softmax 2024-03-07T16:37:52,478 copying extensions/softmax/__init__.py -> build/lib/extensions/softmax 2024-03-07T16:37:52,479 copying extensions/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/softmax 2024-03-07T16:37:52,481 creating build/lib/colossalai/kernel 2024-03-07T16:37:52,482 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2024-03-07T16:37:52,484 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2024-03-07T16:37:52,486 creating build/lib/colossalai/_analyzer 2024-03-07T16:37:52,487 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2024-03-07T16:37:52,488 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2024-03-07T16:37:52,490 creating build/lib/colossalai/logging 2024-03-07T16:37:52,491 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2024-03-07T16:37:52,494 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2024-03-07T16:37:52,496 creating build/lib/colossalai/context 2024-03-07T16:37:52,497 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2024-03-07T16:37:52,499 copying colossalai/context/config.py -> build/lib/colossalai/context 2024-03-07T16:37:52,501 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2024-03-07T16:37:52,503 creating build/lib/colossalai/legacy 2024-03-07T16:37:52,504 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2024-03-07T16:37:52,505 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2024-03-07T16:37:52,507 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2024-03-07T16:37:52,508 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2024-03-07T16:37:52,510 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2024-03-07T16:37:52,513 creating build/lib/colossalai/nn 2024-03-07T16:37:52,514 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2024-03-07T16:37:52,516 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2024-03-07T16:37:52,518 creating build/lib/colossalai/tensor 2024-03-07T16:37:52,519 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2024-03-07T16:37:52,522 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2024-03-07T16:37:52,523 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2024-03-07T16:37:52,525 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2024-03-07T16:37:52,527 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2024-03-07T16:37:52,529 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2024-03-07T16:37:52,531 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2024-03-07T16:37:52,534 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2024-03-07T16:37:52,537 creating build/lib/colossalai/testing 2024-03-07T16:37:52,538 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2024-03-07T16:37:52,540 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2024-03-07T16:37:52,541 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2024-03-07T16:37:52,543 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2024-03-07T16:37:52,545 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2024-03-07T16:37:52,547 creating build/lib/colossalai/lazy 2024-03-07T16:37:52,548 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2024-03-07T16:37:52,551 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2024-03-07T16:37:52,553 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2024-03-07T16:37:52,555 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2024-03-07T16:37:52,557 creating build/lib/colossalai/accelerator 2024-03-07T16:37:52,558 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2024-03-07T16:37:52,560 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2024-03-07T16:37:52,563 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2024-03-07T16:37:52,564 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2024-03-07T16:37:52,566 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2024-03-07T16:37:52,568 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2024-03-07T16:37:52,570 creating build/lib/colossalai/amp 2024-03-07T16:37:52,571 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2024-03-07T16:37:52,573 creating build/lib/colossalai/cluster 2024-03-07T16:37:52,574 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2024-03-07T16:37:52,577 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2024-03-07T16:37:52,580 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2024-03-07T16:37:52,582 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2024-03-07T16:37:52,584 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2024-03-07T16:37:52,586 creating build/lib/colossalai/zero 2024-03-07T16:37:52,587 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2024-03-07T16:37:52,589 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2024-03-07T16:37:52,592 creating build/lib/colossalai/shardformer 2024-03-07T16:37:52,593 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2024-03-07T16:37:52,595 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2024-03-07T16:37:52,597 creating build/lib/colossalai/interface 2024-03-07T16:37:52,598 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2024-03-07T16:37:52,601 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2024-03-07T16:37:52,603 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2024-03-07T16:37:52,604 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2024-03-07T16:37:52,607 creating build/lib/colossalai/inference 2024-03-07T16:37:52,608 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2024-03-07T16:37:52,611 creating build/lib/colossalai/moe 2024-03-07T16:37:52,612 copying colossalai/moe/load_balance.py -> build/lib/colossalai/moe 2024-03-07T16:37:52,615 copying colossalai/moe/routers.py -> build/lib/colossalai/moe 2024-03-07T16:37:52,618 copying colossalai/moe/experts.py -> build/lib/colossalai/moe 2024-03-07T16:37:52,621 copying colossalai/moe/loss.py -> build/lib/colossalai/moe 2024-03-07T16:37:52,623 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2024-03-07T16:37:52,626 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2024-03-07T16:37:52,628 copying colossalai/moe/checkpoint.py -> build/lib/colossalai/moe 2024-03-07T16:37:52,631 copying colossalai/moe/utils.py -> build/lib/colossalai/moe 2024-03-07T16:37:52,633 copying colossalai/moe/layers.py -> build/lib/colossalai/moe 2024-03-07T16:37:52,636 copying colossalai/moe/manager.py -> build/lib/colossalai/moe 2024-03-07T16:37:52,639 creating build/lib/colossalai/cli 2024-03-07T16:37:52,641 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2024-03-07T16:37:52,643 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2024-03-07T16:37:52,646 creating build/lib/colossalai/device 2024-03-07T16:37:52,648 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2024-03-07T16:37:52,651 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2024-03-07T16:37:52,653 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2024-03-07T16:37:52,655 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2024-03-07T16:37:52,658 creating build/lib/colossalai/booster 2024-03-07T16:37:52,659 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2024-03-07T16:37:52,661 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2024-03-07T16:37:52,664 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2024-03-07T16:37:52,666 creating build/lib/colossalai/checkpoint_io 2024-03-07T16:37:52,667 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2024-03-07T16:37:52,670 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-03-07T16:37:52,673 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2024-03-07T16:37:52,675 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-03-07T16:37:52,678 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2024-03-07T16:37:52,681 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2024-03-07T16:37:52,684 creating build/lib/colossalai/_C 2024-03-07T16:37:52,686 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2024-03-07T16:37:52,688 creating build/lib/colossalai/pipeline 2024-03-07T16:37:52,689 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2024-03-07T16:37:52,692 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2024-03-07T16:37:52,694 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2024-03-07T16:37:52,698 creating build/lib/colossalai/auto_parallel 2024-03-07T16:37:52,699 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2024-03-07T16:37:52,702 creating build/lib/colossalai/utils 2024-03-07T16:37:52,704 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2024-03-07T16:37:52,706 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2024-03-07T16:37:52,708 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2024-03-07T16:37:52,709 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2024-03-07T16:37:52,712 creating build/lib/colossalai/fx 2024-03-07T16:37:52,713 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2024-03-07T16:37:52,716 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2024-03-07T16:37:52,718 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2024-03-07T16:37:52,720 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2024-03-07T16:37:52,722 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2024-03-07T16:37:52,724 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2024-03-07T16:37:52,727 creating build/lib/colossalai/kernel/jit 2024-03-07T16:37:52,729 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2024-03-07T16:37:52,731 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2024-03-07T16:37:52,733 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2024-03-07T16:37:52,735 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2024-03-07T16:37:52,737 creating build/lib/colossalai/kernel/extensions 2024-03-07T16:37:52,738 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2024-03-07T16:37:52,741 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2024-03-07T16:37:52,743 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2024-03-07T16:37:52,745 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2024-03-07T16:37:52,747 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2024-03-07T16:37:52,749 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2024-03-07T16:37:52,752 creating build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,753 copying colossalai/kernel/triton/copy_kv_cache_dest.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,756 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,758 copying colossalai/kernel/triton/custom_autotune.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,760 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,763 copying colossalai/kernel/triton/self_attention_nofusion.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,765 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,767 copying colossalai/kernel/triton/context_attention.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,769 copying colossalai/kernel/triton/gptq_triton.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,772 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,774 copying colossalai/kernel/triton/token_attention_kernel.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,776 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,778 copying colossalai/kernel/triton/smooth_attention.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,781 copying colossalai/kernel/triton/int8_rotary_embedding_kernel.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,783 copying colossalai/kernel/triton/fused_layernorm.py -> build/lib/colossalai/kernel/triton 2024-03-07T16:37:52,786 creating build/lib/colossalai/kernel/extensions/cpu_adam 2024-03-07T16:37:52,787 copying colossalai/kernel/extensions/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/cpu_adam 2024-03-07T16:37:52,789 copying colossalai/kernel/extensions/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/cpu_adam 2024-03-07T16:37:52,791 copying colossalai/kernel/extensions/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/cpu_adam 2024-03-07T16:37:52,794 creating build/lib/colossalai/kernel/extensions/csrc 2024-03-07T16:37:52,795 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2024-03-07T16:37:52,797 copying colossalai/kernel/extensions/csrc/scaled_softmax.py -> build/lib/colossalai/kernel/extensions/csrc 2024-03-07T16:37:52,800 creating build/lib/colossalai/kernel/extensions/optimizer 2024-03-07T16:37:52,801 copying colossalai/kernel/extensions/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/optimizer 2024-03-07T16:37:52,803 copying colossalai/kernel/extensions/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/optimizer 2024-03-07T16:37:52,806 creating build/lib/colossalai/kernel/extensions/moe 2024-03-07T16:37:52,807 copying colossalai/kernel/extensions/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/moe 2024-03-07T16:37:52,809 copying colossalai/kernel/extensions/moe/__init__.py -> build/lib/colossalai/kernel/extensions/moe 2024-03-07T16:37:52,811 creating build/lib/colossalai/kernel/extensions/flash_attention 2024-03-07T16:37:52,813 copying colossalai/kernel/extensions/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/flash_attention 2024-03-07T16:37:52,815 copying colossalai/kernel/extensions/flash_attention/flash_attention_xformers_cuda.py -> build/lib/colossalai/kernel/extensions/flash_attention 2024-03-07T16:37:52,817 copying colossalai/kernel/extensions/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/flash_attention 2024-03-07T16:37:52,819 copying colossalai/kernel/extensions/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/flash_attention 2024-03-07T16:37:52,822 creating build/lib/colossalai/kernel/extensions/layernorm 2024-03-07T16:37:52,823 copying colossalai/kernel/extensions/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/layernorm 2024-03-07T16:37:52,825 copying colossalai/kernel/extensions/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/layernorm 2024-03-07T16:37:52,827 creating build/lib/colossalai/kernel/extensions/softmax 2024-03-07T16:37:52,829 copying colossalai/kernel/extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/softmax 2024-03-07T16:37:52,831 copying colossalai/kernel/extensions/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/softmax 2024-03-07T16:37:52,833 copying colossalai/kernel/extensions/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/softmax 2024-03-07T16:37:52,835 creating build/lib/colossalai/_analyzer/_subclasses 2024-03-07T16:37:52,836 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2024-03-07T16:37:52,839 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-03-07T16:37:52,842 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2024-03-07T16:37:52,843 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2024-03-07T16:37:52,845 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-03-07T16:37:52,849 creating build/lib/colossalai/_analyzer/fx 2024-03-07T16:37:52,850 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2024-03-07T16:37:52,852 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2024-03-07T16:37:52,855 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2024-03-07T16:37:52,857 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2024-03-07T16:37:52,859 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2024-03-07T16:37:52,861 creating build/lib/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:52,862 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:52,865 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:52,867 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:52,869 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:52,871 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:52,873 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:52,876 creating build/lib/colossalai/_analyzer/fx/passes 2024-03-07T16:37:52,877 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2024-03-07T16:37:52,879 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2024-03-07T16:37:52,882 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2024-03-07T16:37:52,884 creating build/lib/colossalai/legacy/trainer 2024-03-07T16:37:52,886 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2024-03-07T16:37:52,888 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2024-03-07T16:37:52,891 creating build/lib/colossalai/legacy/context 2024-03-07T16:37:52,892 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2024-03-07T16:37:52,895 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2024-03-07T16:37:52,896 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2024-03-07T16:37:52,898 creating build/lib/colossalai/legacy/nn 2024-03-07T16:37:52,899 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2024-03-07T16:37:52,902 creating build/lib/colossalai/legacy/tensor 2024-03-07T16:37:52,902 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2024-03-07T16:37:52,904 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2024-03-07T16:37:52,906 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2024-03-07T16:37:52,908 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2024-03-07T16:37:52,910 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2024-03-07T16:37:52,912 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2024-03-07T16:37:52,914 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2024-03-07T16:37:52,915 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2024-03-07T16:37:52,917 creating build/lib/colossalai/legacy/amp 2024-03-07T16:37:52,918 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2024-03-07T16:37:52,920 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2024-03-07T16:37:52,922 creating build/lib/colossalai/legacy/zero 2024-03-07T16:37:52,923 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2024-03-07T16:37:52,925 creating build/lib/colossalai/legacy/engine 2024-03-07T16:37:52,926 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2024-03-07T16:37:52,928 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2024-03-07T16:37:52,930 creating build/lib/colossalai/legacy/inference 2024-03-07T16:37:52,931 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2024-03-07T16:37:52,933 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2024-03-07T16:37:52,935 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2024-03-07T16:37:52,937 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2024-03-07T16:37:52,939 creating build/lib/colossalai/legacy/builder 2024-03-07T16:37:52,940 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2024-03-07T16:37:52,942 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2024-03-07T16:37:52,944 creating build/lib/colossalai/legacy/communication 2024-03-07T16:37:52,945 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2024-03-07T16:37:52,947 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2024-03-07T16:37:52,949 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2024-03-07T16:37:52,951 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2024-03-07T16:37:52,953 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2024-03-07T16:37:52,956 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2024-03-07T16:37:52,959 creating build/lib/colossalai/legacy/registry 2024-03-07T16:37:52,959 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2024-03-07T16:37:52,961 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2024-03-07T16:37:52,964 creating build/lib/colossalai/legacy/pipeline 2024-03-07T16:37:52,964 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2024-03-07T16:37:52,967 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2024-03-07T16:37:52,968 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2024-03-07T16:37:52,970 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2024-03-07T16:37:52,972 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2024-03-07T16:37:52,974 creating build/lib/colossalai/legacy/utils 2024-03-07T16:37:52,975 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2024-03-07T16:37:52,977 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2024-03-07T16:37:52,979 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2024-03-07T16:37:52,982 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2024-03-07T16:37:52,983 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2024-03-07T16:37:52,986 creating build/lib/colossalai/legacy/trainer/hooks 2024-03-07T16:37:52,987 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2024-03-07T16:37:52,989 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-03-07T16:37:52,991 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-03-07T16:37:52,993 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-03-07T16:37:52,995 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2024-03-07T16:37:52,996 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-03-07T16:37:52,998 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-03-07T16:37:53,011 creating build/lib/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:53,012 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:53,014 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:53,016 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:53,018 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:53,020 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:53,022 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:53,024 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:53,026 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:53,028 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:53,029 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:53,031 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:53,033 creating build/lib/colossalai/legacy/context/random 2024-03-07T16:37:53,034 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2024-03-07T16:37:53,036 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2024-03-07T16:37:53,038 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2024-03-07T16:37:53,040 creating build/lib/colossalai/legacy/nn/loss 2024-03-07T16:37:53,041 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2024-03-07T16:37:53,043 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2024-03-07T16:37:53,045 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2024-03-07T16:37:53,047 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2024-03-07T16:37:53,049 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2024-03-07T16:37:53,051 creating build/lib/colossalai/legacy/nn/metric 2024-03-07T16:37:53,052 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2024-03-07T16:37:53,054 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2024-03-07T16:37:53,055 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2024-03-07T16:37:53,057 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2024-03-07T16:37:53,059 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2024-03-07T16:37:53,061 creating build/lib/colossalai/legacy/nn/layer 2024-03-07T16:37:53,062 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2024-03-07T16:37:53,063 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2024-03-07T16:37:53,066 creating build/lib/colossalai/legacy/nn/parallel 2024-03-07T16:37:53,067 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2024-03-07T16:37:53,069 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2024-03-07T16:37:53,071 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2024-03-07T16:37:53,073 creating build/lib/colossalai/legacy/nn/_ops 2024-03-07T16:37:53,074 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2024-03-07T16:37:53,076 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2024-03-07T16:37:53,078 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-03-07T16:37:53,079 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-03-07T16:37:53,081 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-03-07T16:37:53,084 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-03-07T16:37:53,086 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-03-07T16:37:53,089 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-03-07T16:37:53,090 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-03-07T16:37:53,092 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-03-07T16:37:53,095 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-03-07T16:37:53,096 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-03-07T16:37:53,102 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-03-07T16:37:53,103 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-03-07T16:37:53,105 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-03-07T16:37:53,107 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-03-07T16:37:53,108 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-03-07T16:37:53,112 creating build/lib/colossalai/legacy/nn/layer/vanilla 2024-03-07T16:37:53,113 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-03-07T16:37:53,115 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-03-07T16:37:53,118 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-03-07T16:37:53,119 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-03-07T16:37:53,121 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-03-07T16:37:53,124 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-03-07T16:37:53,126 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-03-07T16:37:53,129 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:53,130 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:53,132 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:53,134 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:53,136 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:53,138 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:53,140 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:53,142 creating build/lib/colossalai/legacy/nn/layer/wrapper 2024-03-07T16:37:53,143 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-03-07T16:37:53,145 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-03-07T16:37:53,147 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-03-07T16:37:53,148 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-03-07T16:37:53,150 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-03-07T16:37:53,152 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-03-07T16:37:53,153 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-03-07T16:37:53,156 creating build/lib/colossalai/legacy/nn/layer/utils 2024-03-07T16:37:53,157 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-03-07T16:37:53,159 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-03-07T16:37:53,161 creating build/lib/colossalai/legacy/nn/parallel/layers 2024-03-07T16:37:53,162 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-03-07T16:37:53,164 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-03-07T16:37:53,166 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-03-07T16:37:53,168 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-03-07T16:37:53,169 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-03-07T16:37:53,172 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:53,172 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:53,174 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:53,176 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:53,178 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:53,180 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:53,182 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:53,184 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:53,186 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:53,188 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:53,191 creating build/lib/colossalai/legacy/amp/apex_amp 2024-03-07T16:37:53,191 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-03-07T16:37:53,193 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-03-07T16:37:53,195 creating build/lib/colossalai/legacy/amp/torch_amp 2024-03-07T16:37:53,196 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-03-07T16:37:53,198 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-03-07T16:37:53,200 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-03-07T16:37:53,203 creating build/lib/colossalai/legacy/amp/naive_amp 2024-03-07T16:37:53,204 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-03-07T16:37:53,206 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-03-07T16:37:53,209 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-03-07T16:37:53,211 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-03-07T16:37:53,213 creating build/lib/colossalai/legacy/zero/gemini 2024-03-07T16:37:53,214 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2024-03-07T16:37:53,216 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-03-07T16:37:53,219 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2024-03-07T16:37:53,221 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2024-03-07T16:37:53,222 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2024-03-07T16:37:53,224 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-03-07T16:37:53,226 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2024-03-07T16:37:53,228 creating build/lib/colossalai/legacy/zero/sharded_optim 2024-03-07T16:37:53,229 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-03-07T16:37:53,231 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-03-07T16:37:53,233 creating build/lib/colossalai/legacy/zero/sharded_param 2024-03-07T16:37:53,234 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-03-07T16:37:53,236 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-03-07T16:37:53,238 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-03-07T16:37:53,240 creating build/lib/colossalai/legacy/zero/shard_utils 2024-03-07T16:37:53,241 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-03-07T16:37:53,243 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-03-07T16:37:53,245 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-03-07T16:37:53,246 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-03-07T16:37:53,248 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-03-07T16:37:53,250 creating build/lib/colossalai/legacy/zero/init_ctx 2024-03-07T16:37:53,251 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-03-07T16:37:53,254 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-03-07T16:37:53,256 creating build/lib/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:53,257 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:53,259 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:53,262 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:53,263 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:53,266 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:53,268 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:53,271 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2024-03-07T16:37:53,272 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-03-07T16:37:53,274 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-03-07T16:37:53,275 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-03-07T16:37:53,278 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-03-07T16:37:53,279 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-03-07T16:37:53,282 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-03-07T16:37:53,283 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-03-07T16:37:53,284 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-03-07T16:37:53,286 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2024-03-07T16:37:53,287 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-03-07T16:37:53,289 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-03-07T16:37:53,292 creating build/lib/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:53,292 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:53,294 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:53,296 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:53,297 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:53,299 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:53,300 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:53,302 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:53,304 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:53,306 creating build/lib/colossalai/legacy/engine/schedule 2024-03-07T16:37:53,307 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2024-03-07T16:37:53,309 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-03-07T16:37:53,312 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-03-07T16:37:53,314 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2024-03-07T16:37:53,316 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-03-07T16:37:53,319 creating build/lib/colossalai/legacy/inference/hybridengine 2024-03-07T16:37:53,320 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-03-07T16:37:53,323 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-03-07T16:37:53,326 creating build/lib/colossalai/legacy/inference/tensor_parallel 2024-03-07T16:37:53,327 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-03-07T16:37:53,329 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-03-07T16:37:53,332 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-03-07T16:37:53,335 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-03-07T16:37:53,339 creating build/lib/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:53,340 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:53,342 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:53,344 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:53,346 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:53,348 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:53,350 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:53,353 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:53,355 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:53,358 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:53,361 creating build/lib/colossalai/legacy/inference/pipeline 2024-03-07T16:37:53,362 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2024-03-07T16:37:53,364 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2024-03-07T16:37:53,368 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2024-03-07T16:37:53,369 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-03-07T16:37:53,372 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-03-07T16:37:53,374 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-03-07T16:37:53,375 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-03-07T16:37:53,378 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-03-07T16:37:53,381 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-03-07T16:37:53,384 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-03-07T16:37:53,385 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-03-07T16:37:53,387 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-03-07T16:37:53,390 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-03-07T16:37:53,393 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-03-07T16:37:53,396 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-03-07T16:37:53,400 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-03-07T16:37:53,401 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-03-07T16:37:53,403 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-03-07T16:37:53,405 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-03-07T16:37:53,408 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-03-07T16:37:53,411 creating build/lib/colossalai/legacy/pipeline/middleware 2024-03-07T16:37:53,412 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-03-07T16:37:53,414 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-03-07T16:37:53,416 creating build/lib/colossalai/legacy/pipeline/rpc 2024-03-07T16:37:53,417 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-03-07T16:37:53,420 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-03-07T16:37:53,422 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-03-07T16:37:53,424 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-03-07T16:37:53,426 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-03-07T16:37:53,427 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-03-07T16:37:53,429 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-03-07T16:37:53,431 creating build/lib/colossalai/legacy/utils/checkpoint 2024-03-07T16:37:53,432 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-03-07T16:37:53,434 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-03-07T16:37:53,436 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-03-07T16:37:53,439 creating build/lib/colossalai/legacy/utils/data_sampler 2024-03-07T16:37:53,439 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-03-07T16:37:53,441 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-03-07T16:37:53,443 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-03-07T16:37:53,445 creating build/lib/colossalai/legacy/utils/profiler 2024-03-07T16:37:53,446 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2024-03-07T16:37:53,449 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2024-03-07T16:37:53,451 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-03-07T16:37:53,452 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-03-07T16:37:53,455 creating build/lib/colossalai/legacy/utils/profiler/legacy 2024-03-07T16:37:53,456 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-03-07T16:37:53,458 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-03-07T16:37:53,460 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-03-07T16:37:53,463 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-03-07T16:37:53,465 creating build/lib/colossalai/nn/loss 2024-03-07T16:37:53,466 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2024-03-07T16:37:53,468 creating build/lib/colossalai/nn/optimizer 2024-03-07T16:37:53,469 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2024-03-07T16:37:53,471 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2024-03-07T16:37:53,473 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2024-03-07T16:37:53,475 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2024-03-07T16:37:53,477 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2024-03-07T16:37:53,479 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2024-03-07T16:37:53,482 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2024-03-07T16:37:53,484 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2024-03-07T16:37:53,486 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2024-03-07T16:37:53,488 creating build/lib/colossalai/nn/layer 2024-03-07T16:37:53,489 copying colossalai/nn/layer/colo_attention.py -> build/lib/colossalai/nn/layer 2024-03-07T16:37:53,492 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2024-03-07T16:37:53,493 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2024-03-07T16:37:53,495 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2024-03-07T16:37:53,497 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2024-03-07T16:37:53,499 creating build/lib/colossalai/nn/lr_scheduler 2024-03-07T16:37:53,500 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2024-03-07T16:37:53,503 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2024-03-07T16:37:53,504 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2024-03-07T16:37:53,506 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2024-03-07T16:37:53,508 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2024-03-07T16:37:53,510 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2024-03-07T16:37:53,512 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2024-03-07T16:37:53,514 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2024-03-07T16:37:53,516 creating build/lib/colossalai/tensor/d_tensor 2024-03-07T16:37:53,518 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2024-03-07T16:37:53,520 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-03-07T16:37:53,522 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2024-03-07T16:37:53,524 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2024-03-07T16:37:53,526 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2024-03-07T16:37:53,528 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2024-03-07T16:37:53,531 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2024-03-07T16:37:53,533 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-03-07T16:37:53,539 creating build/lib/colossalai/tensor/moe_tensor 2024-03-07T16:37:53,540 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2024-03-07T16:37:53,542 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2024-03-07T16:37:53,543 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2024-03-07T16:37:53,546 creating build/lib/colossalai/amp/naive_amp 2024-03-07T16:37:53,547 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2024-03-07T16:37:53,549 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2024-03-07T16:37:53,551 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2024-03-07T16:37:53,552 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-03-07T16:37:53,554 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-03-07T16:37:53,557 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-03-07T16:37:53,559 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-03-07T16:37:53,561 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-03-07T16:37:53,562 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-03-07T16:37:53,564 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-03-07T16:37:53,565 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-03-07T16:37:53,567 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-03-07T16:37:53,569 creating build/lib/colossalai/zero/gemini 2024-03-07T16:37:53,570 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2024-03-07T16:37:53,573 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2024-03-07T16:37:53,575 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2024-03-07T16:37:53,577 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2024-03-07T16:37:53,579 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2024-03-07T16:37:53,583 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2024-03-07T16:37:53,585 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2024-03-07T16:37:53,588 creating build/lib/colossalai/zero/low_level 2024-03-07T16:37:53,589 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2024-03-07T16:37:53,592 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2024-03-07T16:37:53,594 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2024-03-07T16:37:53,597 creating build/lib/colossalai/zero/gemini/chunk 2024-03-07T16:37:53,598 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2024-03-07T16:37:53,601 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2024-03-07T16:37:53,603 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-03-07T16:37:53,605 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-03-07T16:37:53,607 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2024-03-07T16:37:53,610 creating build/lib/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:53,611 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:53,613 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:53,615 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:53,617 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:53,619 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:53,621 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:53,622 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:53,624 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:53,626 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:53,630 creating build/lib/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:53,632 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:53,634 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:53,636 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:53,639 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:53,642 copying colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:53,644 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:53,646 creating build/lib/colossalai/shardformer/layer 2024-03-07T16:37:53,647 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2024-03-07T16:37:53,650 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2024-03-07T16:37:53,652 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2024-03-07T16:37:53,655 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2024-03-07T16:37:53,657 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2024-03-07T16:37:53,659 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2024-03-07T16:37:53,662 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2024-03-07T16:37:53,664 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2024-03-07T16:37:53,666 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2024-03-07T16:37:53,668 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2024-03-07T16:37:53,672 creating build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,673 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,675 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,677 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,679 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,682 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,684 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,687 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,689 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,692 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,695 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,697 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,699 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,701 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,704 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,706 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,709 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2024-03-07T16:37:53,712 creating build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,713 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,715 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,718 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,720 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,722 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,724 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,726 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,728 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,731 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,734 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,736 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,737 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,740 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,742 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,744 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,746 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,749 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2024-03-07T16:37:53,751 creating build/lib/colossalai/shardformer/shard 2024-03-07T16:37:53,752 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2024-03-07T16:37:53,755 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2024-03-07T16:37:53,756 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2024-03-07T16:37:53,758 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2024-03-07T16:37:53,760 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2024-03-07T16:37:53,762 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-03-07T16:37:53,763 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-03-07T16:37:53,765 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-03-07T16:37:53,766 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-03-07T16:37:53,769 creating build/lib/colossalai/inference/quant 2024-03-07T16:37:53,770 copying colossalai/inference/quant/__init__.py -> build/lib/colossalai/inference/quant 2024-03-07T16:37:53,772 creating build/lib/colossalai/inference/kv_cache 2024-03-07T16:37:53,773 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2024-03-07T16:37:53,775 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2024-03-07T16:37:53,777 copying colossalai/inference/kv_cache/batch_infer_state.py -> build/lib/colossalai/inference/kv_cache 2024-03-07T16:37:53,779 creating build/lib/colossalai/inference/engine 2024-03-07T16:37:53,780 copying colossalai/inference/engine/__init__.py -> build/lib/colossalai/inference/engine 2024-03-07T16:37:53,782 copying colossalai/inference/engine/microbatch_manager.py -> build/lib/colossalai/inference/engine 2024-03-07T16:37:53,784 copying colossalai/inference/engine/engine.py -> build/lib/colossalai/inference/engine 2024-03-07T16:37:53,786 creating build/lib/colossalai/inference/quant/smoothquant 2024-03-07T16:37:53,787 copying colossalai/inference/quant/smoothquant/__init__.py -> build/lib/colossalai/inference/quant/smoothquant 2024-03-07T16:37:53,789 creating build/lib/colossalai/inference/quant/gptq 2024-03-07T16:37:53,790 copying colossalai/inference/quant/gptq/gptq_manager.py -> build/lib/colossalai/inference/quant/gptq 2024-03-07T16:37:53,792 copying colossalai/inference/quant/gptq/__init__.py -> build/lib/colossalai/inference/quant/gptq 2024-03-07T16:37:53,794 creating build/lib/colossalai/inference/quant/smoothquant/models 2024-03-07T16:37:53,795 copying colossalai/inference/quant/smoothquant/models/llama.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-03-07T16:37:53,798 copying colossalai/inference/quant/smoothquant/models/parallel_linear.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-03-07T16:37:53,800 copying colossalai/inference/quant/smoothquant/models/linear.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-03-07T16:37:53,802 copying colossalai/inference/quant/smoothquant/models/__init__.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-03-07T16:37:53,804 copying colossalai/inference/quant/smoothquant/models/base_model.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-03-07T16:37:53,807 creating build/lib/colossalai/inference/quant/gptq/cai_gptq 2024-03-07T16:37:53,808 copying colossalai/inference/quant/gptq/cai_gptq/gptq_op.py -> build/lib/colossalai/inference/quant/gptq/cai_gptq 2024-03-07T16:37:53,810 copying colossalai/inference/quant/gptq/cai_gptq/cai_quant_linear.py -> build/lib/colossalai/inference/quant/gptq/cai_gptq 2024-03-07T16:37:53,812 copying colossalai/inference/quant/gptq/cai_gptq/__init__.py -> build/lib/colossalai/inference/quant/gptq/cai_gptq 2024-03-07T16:37:53,815 creating build/lib/colossalai/inference/engine/modeling 2024-03-07T16:37:53,815 copying colossalai/inference/engine/modeling/_utils.py -> build/lib/colossalai/inference/engine/modeling 2024-03-07T16:37:53,817 copying colossalai/inference/engine/modeling/llama.py -> build/lib/colossalai/inference/engine/modeling 2024-03-07T16:37:53,820 copying colossalai/inference/engine/modeling/__init__.py -> build/lib/colossalai/inference/engine/modeling 2024-03-07T16:37:53,824 copying colossalai/inference/engine/modeling/bloom.py -> build/lib/colossalai/inference/engine/modeling 2024-03-07T16:37:53,827 copying colossalai/inference/engine/modeling/chatglm2.py -> build/lib/colossalai/inference/engine/modeling 2024-03-07T16:37:53,830 creating build/lib/colossalai/inference/engine/policies 2024-03-07T16:37:53,831 copying colossalai/inference/engine/policies/llama.py -> build/lib/colossalai/inference/engine/policies 2024-03-07T16:37:53,833 copying colossalai/inference/engine/policies/__init__.py -> build/lib/colossalai/inference/engine/policies 2024-03-07T16:37:53,835 copying colossalai/inference/engine/policies/bloom.py -> build/lib/colossalai/inference/engine/policies 2024-03-07T16:37:53,837 copying colossalai/inference/engine/policies/chatglm2.py -> build/lib/colossalai/inference/engine/policies 2024-03-07T16:37:53,839 creating build/lib/colossalai/cli/launcher 2024-03-07T16:37:53,840 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2024-03-07T16:37:53,842 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2024-03-07T16:37:53,844 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2024-03-07T16:37:53,846 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2024-03-07T16:37:53,848 creating build/lib/colossalai/cli/check 2024-03-07T16:37:53,849 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2024-03-07T16:37:53,851 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2024-03-07T16:37:53,853 creating build/lib/colossalai/booster/mixed_precision 2024-03-07T16:37:53,854 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2024-03-07T16:37:53,856 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2024-03-07T16:37:53,858 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2024-03-07T16:37:53,859 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2024-03-07T16:37:53,861 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2024-03-07T16:37:53,863 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2024-03-07T16:37:53,865 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2024-03-07T16:37:53,868 creating build/lib/colossalai/booster/plugin 2024-03-07T16:37:53,868 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2024-03-07T16:37:53,871 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2024-03-07T16:37:53,874 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2024-03-07T16:37:53,875 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-03-07T16:37:53,878 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-03-07T16:37:53,880 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2024-03-07T16:37:53,882 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2024-03-07T16:37:53,885 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-03-07T16:37:53,887 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2024-03-07T16:37:53,889 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-03-07T16:37:53,893 creating build/lib/colossalai/pipeline/schedule 2024-03-07T16:37:53,894 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2024-03-07T16:37:53,897 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2024-03-07T16:37:53,899 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2024-03-07T16:37:53,901 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2024-03-07T16:37:53,904 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2024-03-07T16:37:53,906 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2024-03-07T16:37:53,909 creating build/lib/colossalai/auto_parallel/pipeline_shard 2024-03-07T16:37:53,910 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2024-03-07T16:37:53,912 creating build/lib/colossalai/auto_parallel/meta_profiler 2024-03-07T16:37:53,913 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-03-07T16:37:53,915 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-03-07T16:37:53,916 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-03-07T16:37:53,918 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-03-07T16:37:53,921 creating build/lib/colossalai/auto_parallel/offload 2024-03-07T16:37:53,922 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2024-03-07T16:37:53,924 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2024-03-07T16:37:53,926 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2024-03-07T16:37:53,928 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2024-03-07T16:37:53,931 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2024-03-07T16:37:53,932 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2024-03-07T16:37:53,934 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2024-03-07T16:37:53,936 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2024-03-07T16:37:53,939 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2024-03-07T16:37:53,941 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2024-03-07T16:37:53,943 creating build/lib/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:53,944 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:53,946 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:53,948 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:53,950 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:53,952 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:53,954 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:53,957 creating build/lib/colossalai/auto_parallel/tensor_shard 2024-03-07T16:37:53,959 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-03-07T16:37:53,961 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-03-07T16:37:53,963 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-03-07T16:37:53,964 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-03-07T16:37:53,966 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-03-07T16:37:53,969 creating build/lib/colossalai/auto_parallel/passes 2024-03-07T16:37:53,970 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-03-07T16:37:53,973 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2024-03-07T16:37:53,974 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-03-07T16:37:53,976 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2024-03-07T16:37:53,978 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-03-07T16:37:53,980 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2024-03-07T16:37:53,983 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:53,984 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:53,986 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:53,988 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:53,990 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:53,992 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:53,994 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:53,996 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:53,998 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:54,000 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:54,002 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:54,004 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:54,007 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,008 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,010 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,012 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,014 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,016 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,018 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,020 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,022 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,024 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,026 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,028 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,030 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,032 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,034 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,035 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,037 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,038 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,040 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,042 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,044 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,046 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,048 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,050 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,052 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,054 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,055 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,057 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:54,060 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-03-07T16:37:54,061 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-03-07T16:37:54,063 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-03-07T16:37:54,065 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-03-07T16:37:54,067 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-03-07T16:37:54,070 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-03-07T16:37:54,072 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:54,074 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:54,076 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:54,078 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:54,080 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:54,082 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:54,084 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:54,087 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,087 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,090 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,092 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,094 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,096 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,098 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,102 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,104 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,107 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,109 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,113 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,115 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,117 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,120 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,123 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,125 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,128 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,131 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,134 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:54,137 creating build/lib/colossalai/utils/model 2024-03-07T16:37:54,138 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2024-03-07T16:37:54,141 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2024-03-07T16:37:54,143 creating build/lib/colossalai/utils/rank_recorder 2024-03-07T16:37:54,145 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2024-03-07T16:37:54,147 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2024-03-07T16:37:54,151 creating build/lib/colossalai/utils/tensor_detector 2024-03-07T16:37:54,152 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2024-03-07T16:37:54,155 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2024-03-07T16:37:54,157 creating build/lib/colossalai/utils/multi_tensor_apply 2024-03-07T16:37:54,159 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-03-07T16:37:54,161 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-03-07T16:37:54,164 creating build/lib/colossalai/fx/tracer 2024-03-07T16:37:54,165 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2024-03-07T16:37:54,169 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2024-03-07T16:37:54,171 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2024-03-07T16:37:54,175 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2024-03-07T16:37:54,178 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2024-03-07T16:37:54,181 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2024-03-07T16:37:54,184 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2024-03-07T16:37:54,187 creating build/lib/colossalai/fx/codegen 2024-03-07T16:37:54,189 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2024-03-07T16:37:54,192 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2024-03-07T16:37:54,197 creating build/lib/colossalai/fx/passes 2024-03-07T16:37:54,199 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2024-03-07T16:37:54,203 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2024-03-07T16:37:54,206 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2024-03-07T16:37:54,210 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2024-03-07T16:37:54,212 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2024-03-07T16:37:54,216 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2024-03-07T16:37:54,219 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2024-03-07T16:37:54,222 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2024-03-07T16:37:54,225 creating build/lib/colossalai/fx/profiler 2024-03-07T16:37:54,227 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2024-03-07T16:37:54,230 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2024-03-07T16:37:54,232 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2024-03-07T16:37:54,235 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2024-03-07T16:37:54,238 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2024-03-07T16:37:54,240 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2024-03-07T16:37:54,242 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2024-03-07T16:37:54,244 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2024-03-07T16:37:54,247 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2024-03-07T16:37:54,248 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2024-03-07T16:37:54,250 creating build/lib/colossalai/fx/tracer/meta_patch 2024-03-07T16:37:54,251 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2024-03-07T16:37:54,254 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-03-07T16:37:54,255 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-03-07T16:37:54,257 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-03-07T16:37:54,259 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-03-07T16:37:54,261 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-03-07T16:37:54,264 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-03-07T16:37:54,266 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-03-07T16:37:54,268 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-03-07T16:37:54,270 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-03-07T16:37:54,272 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-03-07T16:37:54,274 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-03-07T16:37:54,276 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:54,278 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:54,280 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:54,282 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:54,284 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:54,286 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:54,288 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:54,291 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:54,293 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:54,295 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:54,296 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:54,299 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:54,301 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:54,303 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:54,305 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:54,307 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:54,309 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:54,311 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:54,314 creating build/lib/colossalai/fx/profiler/experimental 2024-03-07T16:37:54,315 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2024-03-07T16:37:54,317 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2024-03-07T16:37:54,319 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2024-03-07T16:37:54,322 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2024-03-07T16:37:54,324 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2024-03-07T16:37:54,326 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:54,328 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:54,330 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:54,332 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:54,334 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:54,336 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:54,338 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:54,340 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:54,342 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:54,344 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:54,347 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:54,348 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:54,350 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:54,352 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:54,354 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:54,356 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:54,358 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:54,360 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:54,362 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:54,364 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:54,366 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:54,368 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:54,429 creating build/lib/colossalai/kernel/extensions/csrc/arm 2024-03-07T16:37:54,431 copying colossalai/kernel/extensions/csrc/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/arm 2024-03-07T16:37:54,433 copying colossalai/kernel/extensions/csrc/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/arm 2024-03-07T16:37:54,436 creating build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,437 copying colossalai/kernel/extensions/csrc/cuda/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,440 copying colossalai/kernel/extensions/csrc/cuda/multi_tensor_lamb.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,443 copying colossalai/kernel/extensions/csrc/cuda/moe_cuda_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,446 copying colossalai/kernel/extensions/csrc/cuda/colossal_C_frontend.cpp -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,448 copying colossalai/kernel/extensions/csrc/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,451 copying colossalai/kernel/extensions/csrc/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,453 copying colossalai/kernel/extensions/csrc/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,456 copying colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax.h -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,459 copying colossalai/kernel/extensions/csrc/cuda/compat.h -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,461 copying colossalai/kernel/extensions/csrc/cuda/moe_cuda.cpp -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,463 copying colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,465 copying colossalai/kernel/extensions/csrc/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,468 copying colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax.h -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,471 copying colossalai/kernel/extensions/csrc/cuda/layer_norm_cuda.cpp -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,474 copying colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,476 copying colossalai/kernel/extensions/csrc/cuda/type_shim.h -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,479 copying colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,481 copying colossalai/kernel/extensions/csrc/cuda/layer_norm_cuda_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,484 copying colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,486 copying colossalai/kernel/extensions/csrc/cuda/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,489 copying colossalai/kernel/extensions/csrc/cuda/multi_tensor_adam.cu -> build/lib/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,492 creating build/lib/colossalai/kernel/extensions/csrc/cuda/include 2024-03-07T16:37:54,493 copying colossalai/kernel/extensions/csrc/cuda/include/block_reduce.h -> build/lib/colossalai/kernel/extensions/csrc/cuda/include 2024-03-07T16:37:54,592 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-03-07T16:37:54,592 !! 2024-03-07T16:37:54,593 ******************************************************************************** 2024-03-07T16:37:54,594 Please avoid running ``setup.py`` directly. 2024-03-07T16:37:54,594 Instead, use pypa/build, pypa/installer or other 2024-03-07T16:37:54,595 standards-based tools. 2024-03-07T16:37:54,596 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-03-07T16:37:54,597 ******************************************************************************** 2024-03-07T16:37:54,598 !! 2024-03-07T16:37:54,598 self.initialize_options() 2024-03-07T16:37:54,619 installing to build/bdist.linux-armv7l/wheel 2024-03-07T16:37:54,620 running install 2024-03-07T16:37:54,644 running install_lib 2024-03-07T16:37:54,669 creating build/bdist.linux-armv7l 2024-03-07T16:37:54,670 creating build/bdist.linux-armv7l/wheel 2024-03-07T16:37:54,672 creating build/bdist.linux-armv7l/wheel/extensions 2024-03-07T16:37:54,673 creating build/bdist.linux-armv7l/wheel/extensions/cpu_adam 2024-03-07T16:37:54,675 copying build/lib/extensions/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/cpu_adam 2024-03-07T16:37:54,677 copying build/lib/extensions/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/extensions/cpu_adam 2024-03-07T16:37:54,679 copying build/lib/extensions/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/extensions/cpu_adam 2024-03-07T16:37:54,681 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2024-03-07T16:37:54,683 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/csrc 2024-03-07T16:37:54,685 copying build/lib/extensions/csrc/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/extensions/csrc 2024-03-07T16:37:54,688 creating build/bdist.linux-armv7l/wheel/extensions/optimizer 2024-03-07T16:37:54,689 copying build/lib/extensions/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/optimizer 2024-03-07T16:37:54,691 copying build/lib/extensions/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/optimizer 2024-03-07T16:37:54,693 creating build/bdist.linux-armv7l/wheel/extensions/moe 2024-03-07T16:37:54,694 copying build/lib/extensions/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/moe 2024-03-07T16:37:54,697 copying build/lib/extensions/moe/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/moe 2024-03-07T16:37:54,699 creating build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-03-07T16:37:54,700 copying build/lib/extensions/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-03-07T16:37:54,702 copying build/lib/extensions/flash_attention/flash_attention_xformers_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-03-07T16:37:54,704 copying build/lib/extensions/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-03-07T16:37:54,706 copying build/lib/extensions/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-03-07T16:37:54,709 creating build/bdist.linux-armv7l/wheel/extensions/layernorm 2024-03-07T16:37:54,710 copying build/lib/extensions/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/layernorm 2024-03-07T16:37:54,712 copying build/lib/extensions/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/layernorm 2024-03-07T16:37:54,714 creating build/bdist.linux-armv7l/wheel/extensions/softmax 2024-03-07T16:37:54,716 copying build/lib/extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/softmax 2024-03-07T16:37:54,718 copying build/lib/extensions/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/softmax 2024-03-07T16:37:54,720 copying build/lib/extensions/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/softmax 2024-03-07T16:37:54,722 creating build/bdist.linux-armv7l/wheel/colossalai 2024-03-07T16:37:54,724 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-03-07T16:37:54,725 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-03-07T16:37:54,728 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-03-07T16:37:54,729 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-03-07T16:37:54,731 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-03-07T16:37:54,733 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-03-07T16:37:54,735 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-03-07T16:37:54,738 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-03-07T16:37:54,739 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-03-07T16:37:54,741 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/cpu_adam 2024-03-07T16:37:54,743 copying build/lib/colossalai/kernel/extensions/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/cpu_adam 2024-03-07T16:37:54,745 copying build/lib/colossalai/kernel/extensions/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/cpu_adam 2024-03-07T16:37:54,747 copying build/lib/colossalai/kernel/extensions/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/cpu_adam 2024-03-07T16:37:54,749 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-03-07T16:37:54,751 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/arm 2024-03-07T16:37:54,752 copying build/lib/colossalai/kernel/extensions/csrc/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/arm 2024-03-07T16:37:54,755 copying build/lib/colossalai/kernel/extensions/csrc/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/arm 2024-03-07T16:37:54,757 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-03-07T16:37:54,759 copying build/lib/colossalai/kernel/extensions/csrc/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-03-07T16:37:54,763 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,764 copying build/lib/colossalai/kernel/extensions/csrc/cuda/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,766 copying build/lib/colossalai/kernel/extensions/csrc/cuda/multi_tensor_lamb.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,769 copying build/lib/colossalai/kernel/extensions/csrc/cuda/moe_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,772 copying build/lib/colossalai/kernel/extensions/csrc/cuda/colossal_C_frontend.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,774 copying build/lib/colossalai/kernel/extensions/csrc/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,777 copying build/lib/colossalai/kernel/extensions/csrc/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,779 copying build/lib/colossalai/kernel/extensions/csrc/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,781 copying build/lib/colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,784 copying build/lib/colossalai/kernel/extensions/csrc/cuda/compat.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,785 copying build/lib/colossalai/kernel/extensions/csrc/cuda/moe_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,787 copying build/lib/colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,789 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda/include 2024-03-07T16:37:54,790 copying build/lib/colossalai/kernel/extensions/csrc/cuda/include/block_reduce.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda/include 2024-03-07T16:37:54,793 copying build/lib/colossalai/kernel/extensions/csrc/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,795 copying build/lib/colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,797 copying build/lib/colossalai/kernel/extensions/csrc/cuda/layer_norm_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,799 copying build/lib/colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,801 copying build/lib/colossalai/kernel/extensions/csrc/cuda/type_shim.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,803 copying build/lib/colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,805 copying build/lib/colossalai/kernel/extensions/csrc/cuda/layer_norm_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,808 copying build/lib/colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,810 copying build/lib/colossalai/kernel/extensions/csrc/cuda/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,812 copying build/lib/colossalai/kernel/extensions/csrc/cuda/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/cuda 2024-03-07T16:37:54,814 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-03-07T16:37:54,816 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/optimizer 2024-03-07T16:37:54,817 copying build/lib/colossalai/kernel/extensions/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/optimizer 2024-03-07T16:37:54,818 copying build/lib/colossalai/kernel/extensions/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/optimizer 2024-03-07T16:37:54,820 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-03-07T16:37:54,822 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-03-07T16:37:54,824 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/moe 2024-03-07T16:37:54,825 copying build/lib/colossalai/kernel/extensions/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/moe 2024-03-07T16:37:54,827 copying build/lib/colossalai/kernel/extensions/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/moe 2024-03-07T16:37:54,828 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-03-07T16:37:54,829 copying build/lib/colossalai/kernel/extensions/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-03-07T16:37:54,831 copying build/lib/colossalai/kernel/extensions/flash_attention/flash_attention_xformers_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-03-07T16:37:54,833 copying build/lib/colossalai/kernel/extensions/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-03-07T16:37:54,835 copying build/lib/colossalai/kernel/extensions/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-03-07T16:37:54,836 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-03-07T16:37:54,839 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-03-07T16:37:54,841 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/layernorm 2024-03-07T16:37:54,842 copying build/lib/colossalai/kernel/extensions/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/layernorm 2024-03-07T16:37:54,843 copying build/lib/colossalai/kernel/extensions/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/layernorm 2024-03-07T16:37:54,846 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/softmax 2024-03-07T16:37:54,846 copying build/lib/colossalai/kernel/extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/softmax 2024-03-07T16:37:54,848 copying build/lib/colossalai/kernel/extensions/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/softmax 2024-03-07T16:37:54,850 copying build/lib/colossalai/kernel/extensions/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/softmax 2024-03-07T16:37:54,852 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-03-07T16:37:54,854 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,855 copying build/lib/colossalai/kernel/triton/copy_kv_cache_dest.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,857 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,859 copying build/lib/colossalai/kernel/triton/custom_autotune.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,861 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,863 copying build/lib/colossalai/kernel/triton/self_attention_nofusion.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,865 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,867 copying build/lib/colossalai/kernel/triton/context_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,869 copying build/lib/colossalai/kernel/triton/gptq_triton.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,872 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,874 copying build/lib/colossalai/kernel/triton/token_attention_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,876 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,878 copying build/lib/colossalai/kernel/triton/smooth_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,881 copying build/lib/colossalai/kernel/triton/int8_rotary_embedding_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,883 copying build/lib/colossalai/kernel/triton/fused_layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-03-07T16:37:54,885 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-03-07T16:37:54,886 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-03-07T16:37:54,887 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-03-07T16:37:54,890 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-03-07T16:37:54,893 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-03-07T16:37:54,894 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-03-07T16:37:54,896 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-03-07T16:37:54,900 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-03-07T16:37:54,903 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-03-07T16:37:54,905 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-03-07T16:37:54,906 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-03-07T16:37:54,909 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:54,910 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:54,913 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:54,915 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:54,917 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:54,919 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:54,922 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-03-07T16:37:54,924 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-03-07T16:37:54,927 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-03-07T16:37:54,928 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-03-07T16:37:54,931 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-03-07T16:37:54,932 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-03-07T16:37:54,935 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-03-07T16:37:54,937 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-03-07T16:37:54,939 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-03-07T16:37:54,941 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2024-03-07T16:37:54,943 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-03-07T16:37:54,945 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-03-07T16:37:54,947 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-03-07T16:37:54,949 creating build/bdist.linux-armv7l/wheel/colossalai/context 2024-03-07T16:37:54,950 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-03-07T16:37:54,952 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-03-07T16:37:54,954 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-03-07T16:37:54,957 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-03-07T16:37:54,958 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-03-07T16:37:54,960 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-03-07T16:37:54,961 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-03-07T16:37:54,963 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-03-07T16:37:54,965 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-03-07T16:37:54,968 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-03-07T16:37:54,969 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-03-07T16:37:54,971 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-03-07T16:37:54,974 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-03-07T16:37:54,976 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-03-07T16:37:54,978 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-03-07T16:37:54,981 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-03-07T16:37:54,982 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:54,983 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:54,985 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:54,987 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:54,990 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:54,992 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:54,994 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:54,996 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:54,998 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:55,000 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:55,002 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:55,004 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-03-07T16:37:55,007 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-03-07T16:37:55,007 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-03-07T16:37:55,009 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-03-07T16:37:55,011 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-03-07T16:37:55,014 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-03-07T16:37:55,016 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-03-07T16:37:55,018 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-03-07T16:37:55,020 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-03-07T16:37:55,022 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-03-07T16:37:55,024 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-03-07T16:37:55,025 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-03-07T16:37:55,027 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-03-07T16:37:55,030 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-03-07T16:37:55,032 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-03-07T16:37:55,034 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-03-07T16:37:55,036 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-03-07T16:37:55,037 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-03-07T16:37:55,039 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-03-07T16:37:55,041 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-03-07T16:37:55,042 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-03-07T16:37:55,044 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-03-07T16:37:55,046 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-03-07T16:37:55,048 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-03-07T16:37:55,048 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-03-07T16:37:55,050 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-03-07T16:37:55,053 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-03-07T16:37:55,055 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-03-07T16:37:55,059 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-03-07T16:37:55,060 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-03-07T16:37:55,062 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-03-07T16:37:55,065 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-03-07T16:37:55,067 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-03-07T16:37:55,071 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-03-07T16:37:55,072 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-03-07T16:37:55,075 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-03-07T16:37:55,078 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-03-07T16:37:55,081 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-03-07T16:37:55,088 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-03-07T16:37:55,089 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-03-07T16:37:55,095 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-03-07T16:37:55,098 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-03-07T16:37:55,100 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-03-07T16:37:55,102 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-03-07T16:37:55,103 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-03-07T16:37:55,105 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-03-07T16:37:55,108 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-03-07T16:37:55,110 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-03-07T16:37:55,114 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:55,115 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:55,117 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:55,119 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:55,121 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:55,123 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:55,125 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-03-07T16:37:55,128 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-03-07T16:37:55,129 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-03-07T16:37:55,131 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-03-07T16:37:55,134 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-03-07T16:37:55,134 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-03-07T16:37:55,136 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-03-07T16:37:55,139 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-03-07T16:37:55,141 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-03-07T16:37:55,143 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-03-07T16:37:55,144 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-03-07T16:37:55,146 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-03-07T16:37:55,148 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-03-07T16:37:55,151 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-03-07T16:37:55,152 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-03-07T16:37:55,154 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-03-07T16:37:55,155 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-03-07T16:37:55,157 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-03-07T16:37:55,159 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-03-07T16:37:55,161 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-03-07T16:37:55,163 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-03-07T16:37:55,165 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:55,166 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:55,168 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:55,170 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:55,173 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:55,175 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:55,177 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:55,179 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:55,181 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:55,184 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-03-07T16:37:55,186 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-03-07T16:37:55,188 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-03-07T16:37:55,190 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-03-07T16:37:55,191 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-03-07T16:37:55,193 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-03-07T16:37:55,195 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-03-07T16:37:55,196 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-03-07T16:37:55,199 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-03-07T16:37:55,201 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-03-07T16:37:55,202 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-03-07T16:37:55,204 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-03-07T16:37:55,206 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-03-07T16:37:55,208 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-03-07T16:37:55,210 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-03-07T16:37:55,212 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-03-07T16:37:55,213 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-03-07T16:37:55,214 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-03-07T16:37:55,216 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-03-07T16:37:55,217 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-03-07T16:37:55,219 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-03-07T16:37:55,221 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-03-07T16:37:55,222 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-03-07T16:37:55,224 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-03-07T16:37:55,226 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-03-07T16:37:55,229 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-03-07T16:37:55,230 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-03-07T16:37:55,232 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-03-07T16:37:55,234 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-03-07T16:37:55,236 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-03-07T16:37:55,239 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-03-07T16:37:55,240 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-03-07T16:37:55,242 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-03-07T16:37:55,243 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-03-07T16:37:55,245 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-03-07T16:37:55,246 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-03-07T16:37:55,249 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-03-07T16:37:55,250 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-03-07T16:37:55,253 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-03-07T16:37:55,254 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-03-07T16:37:55,257 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-03-07T16:37:55,259 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-03-07T16:37:55,260 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-03-07T16:37:55,262 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-03-07T16:37:55,264 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-03-07T16:37:55,265 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-03-07T16:37:55,267 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-03-07T16:37:55,269 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-03-07T16:37:55,271 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-03-07T16:37:55,272 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-03-07T16:37:55,274 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-03-07T16:37:55,277 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-03-07T16:37:55,278 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-03-07T16:37:55,280 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-03-07T16:37:55,282 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-03-07T16:37:55,284 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-03-07T16:37:55,285 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-03-07T16:37:55,287 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-03-07T16:37:55,289 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-03-07T16:37:55,290 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-03-07T16:37:55,292 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-03-07T16:37:55,294 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-03-07T16:37:55,296 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-03-07T16:37:55,297 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-03-07T16:37:55,300 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-03-07T16:37:55,302 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:55,303 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:55,305 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:55,307 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:55,309 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:55,311 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:55,313 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-03-07T16:37:55,315 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-03-07T16:37:55,317 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-03-07T16:37:55,318 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-03-07T16:37:55,320 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-03-07T16:37:55,322 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:55,323 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:55,325 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:55,327 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:55,328 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:55,330 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:55,332 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:55,334 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:55,335 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-03-07T16:37:55,337 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-03-07T16:37:55,339 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-03-07T16:37:55,341 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-03-07T16:37:55,342 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-03-07T16:37:55,344 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-03-07T16:37:55,347 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-03-07T16:37:55,349 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-03-07T16:37:55,351 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-03-07T16:37:55,353 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-03-07T16:37:55,355 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-03-07T16:37:55,356 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-03-07T16:37:55,358 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-03-07T16:37:55,359 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-03-07T16:37:55,360 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-03-07T16:37:55,362 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-03-07T16:37:55,364 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-03-07T16:37:55,365 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-03-07T16:37:55,367 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-03-07T16:37:55,370 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-03-07T16:37:55,371 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-03-07T16:37:55,373 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-03-07T16:37:55,376 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-03-07T16:37:55,377 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-03-07T16:37:55,378 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-03-07T16:37:55,380 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-03-07T16:37:55,383 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-03-07T16:37:55,384 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-03-07T16:37:55,387 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-03-07T16:37:55,390 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-03-07T16:37:55,392 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-03-07T16:37:55,393 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-03-07T16:37:55,395 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-03-07T16:37:55,397 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-03-07T16:37:55,399 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-03-07T16:37:55,400 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-03-07T16:37:55,403 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-03-07T16:37:55,405 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-03-07T16:37:55,407 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-03-07T16:37:55,409 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-03-07T16:37:55,411 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:55,412 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:55,414 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:55,416 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:55,417 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:55,419 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:55,421 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:55,423 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:55,425 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:55,428 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-03-07T16:37:55,430 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-03-07T16:37:55,431 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-03-07T16:37:55,433 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-03-07T16:37:55,435 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-03-07T16:37:55,438 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-03-07T16:37:55,439 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-03-07T16:37:55,441 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-03-07T16:37:55,443 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-03-07T16:37:55,445 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-03-07T16:37:55,447 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-03-07T16:37:55,448 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-03-07T16:37:55,450 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-03-07T16:37:55,452 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-03-07T16:37:55,455 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-03-07T16:37:55,458 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-03-07T16:37:55,461 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-03-07T16:37:55,463 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-03-07T16:37:55,464 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-03-07T16:37:55,466 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-03-07T16:37:55,469 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-03-07T16:37:55,470 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-03-07T16:37:55,473 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-03-07T16:37:55,475 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-03-07T16:37:55,476 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-03-07T16:37:55,479 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-03-07T16:37:55,482 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-03-07T16:37:55,483 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-03-07T16:37:55,485 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-03-07T16:37:55,487 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-03-07T16:37:55,490 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-03-07T16:37:55,491 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-03-07T16:37:55,495 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-03-07T16:37:55,498 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-03-07T16:37:55,500 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-03-07T16:37:55,502 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-03-07T16:37:55,505 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-03-07T16:37:55,508 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-03-07T16:37:55,509 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-03-07T16:37:55,512 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-03-07T16:37:55,515 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-03-07T16:37:55,518 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-03-07T16:37:55,519 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-03-07T16:37:55,521 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-03-07T16:37:55,523 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-03-07T16:37:55,526 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-03-07T16:37:55,528 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-03-07T16:37:55,529 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-03-07T16:37:55,532 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-03-07T16:37:55,534 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-03-07T16:37:55,536 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-03-07T16:37:55,539 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-03-07T16:37:55,541 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-03-07T16:37:55,543 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-03-07T16:37:55,545 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-03-07T16:37:55,547 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-03-07T16:37:55,550 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-03-07T16:37:55,552 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-03-07T16:37:55,555 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-03-07T16:37:55,557 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-03-07T16:37:55,559 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-03-07T16:37:55,561 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-03-07T16:37:55,564 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2024-03-07T16:37:55,566 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-03-07T16:37:55,567 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-03-07T16:37:55,569 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-03-07T16:37:55,573 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-03-07T16:37:55,574 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-03-07T16:37:55,576 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-03-07T16:37:55,578 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-03-07T16:37:55,581 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-03-07T16:37:55,583 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-03-07T16:37:55,586 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-03-07T16:37:55,588 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-03-07T16:37:55,591 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-03-07T16:37:55,594 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-03-07T16:37:55,597 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-03-07T16:37:55,598 copying build/lib/colossalai/nn/layer/colo_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-03-07T16:37:55,601 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-03-07T16:37:55,603 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-03-07T16:37:55,605 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-03-07T16:37:55,607 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-03-07T16:37:55,609 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-03-07T16:37:55,612 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-03-07T16:37:55,613 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-03-07T16:37:55,615 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-03-07T16:37:55,618 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-03-07T16:37:55,620 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-03-07T16:37:55,622 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-03-07T16:37:55,624 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-03-07T16:37:55,626 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-03-07T16:37:55,628 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-03-07T16:37:55,631 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-03-07T16:37:55,633 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-03-07T16:37:55,636 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-03-07T16:37:55,639 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-03-07T16:37:55,642 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-03-07T16:37:55,644 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-03-07T16:37:55,647 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-03-07T16:37:55,650 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-03-07T16:37:55,653 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-03-07T16:37:55,656 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-03-07T16:37:55,658 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-03-07T16:37:55,661 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-03-07T16:37:55,664 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-03-07T16:37:55,667 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-03-07T16:37:55,670 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-03-07T16:37:55,673 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-03-07T16:37:55,674 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-03-07T16:37:55,677 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-03-07T16:37:55,679 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-03-07T16:37:55,682 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-03-07T16:37:55,685 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-03-07T16:37:55,688 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-03-07T16:37:55,691 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2024-03-07T16:37:55,692 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-03-07T16:37:55,695 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-03-07T16:37:55,697 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-03-07T16:37:55,699 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-03-07T16:37:55,701 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-03-07T16:37:55,704 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-03-07T16:37:55,706 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-03-07T16:37:55,709 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-03-07T16:37:55,711 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-03-07T16:37:55,714 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-03-07T16:37:55,716 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-03-07T16:37:55,717 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-03-07T16:37:55,720 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-03-07T16:37:55,723 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-03-07T16:37:55,725 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-03-07T16:37:55,728 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-03-07T16:37:55,730 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-03-07T16:37:55,732 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2024-03-07T16:37:55,733 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2024-03-07T16:37:55,735 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-03-07T16:37:55,736 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-03-07T16:37:55,737 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-03-07T16:37:55,739 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-03-07T16:37:55,741 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-03-07T16:37:55,743 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-03-07T16:37:55,745 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-03-07T16:37:55,746 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-03-07T16:37:55,747 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-03-07T16:37:55,749 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-03-07T16:37:55,751 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-03-07T16:37:55,753 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-03-07T16:37:55,755 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-03-07T16:37:55,757 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-03-07T16:37:55,758 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-03-07T16:37:55,760 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-03-07T16:37:55,762 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-03-07T16:37:55,764 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-03-07T16:37:55,766 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-03-07T16:37:55,768 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2024-03-07T16:37:55,770 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-03-07T16:37:55,771 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-03-07T16:37:55,773 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-03-07T16:37:55,774 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-03-07T16:37:55,777 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-03-07T16:37:55,779 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-03-07T16:37:55,781 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-03-07T16:37:55,783 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-03-07T16:37:55,785 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-03-07T16:37:55,787 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:55,788 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:55,789 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:55,791 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:55,793 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:55,795 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:55,796 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:55,798 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:55,800 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:55,802 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-03-07T16:37:55,804 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-03-07T16:37:55,805 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-03-07T16:37:55,807 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-03-07T16:37:55,810 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-03-07T16:37:55,813 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-03-07T16:37:55,815 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-03-07T16:37:55,818 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-03-07T16:37:55,819 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-03-07T16:37:55,822 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:55,823 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:55,825 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:55,826 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:55,828 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:55,830 copying build/lib/colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:55,832 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-03-07T16:37:55,834 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-03-07T16:37:55,835 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-03-07T16:37:55,838 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-03-07T16:37:55,841 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-03-07T16:37:55,842 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-03-07T16:37:55,844 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-03-07T16:37:55,844 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-03-07T16:37:55,847 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-03-07T16:37:55,849 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-03-07T16:37:55,851 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-03-07T16:37:55,853 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-03-07T16:37:55,855 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-03-07T16:37:55,858 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-03-07T16:37:55,860 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-03-07T16:37:55,862 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-03-07T16:37:55,864 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-03-07T16:37:55,868 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,868 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,871 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,873 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,876 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,879 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-03-07T16:37:55,879 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-03-07T16:37:55,881 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-03-07T16:37:55,883 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-03-07T16:37:55,886 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,889 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,891 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,893 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,896 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,899 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,901 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,903 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,905 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,908 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,911 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,914 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-03-07T16:37:55,917 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-03-07T16:37:55,919 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,920 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,922 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,925 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,927 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,930 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,932 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,934 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,936 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,939 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,941 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,944 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,945 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,948 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,951 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,953 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,956 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,958 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-03-07T16:37:55,961 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-03-07T16:37:55,962 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-03-07T16:37:55,964 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-03-07T16:37:55,966 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-03-07T16:37:55,967 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-03-07T16:37:55,969 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-03-07T16:37:55,971 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-03-07T16:37:55,973 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2024-03-07T16:37:55,974 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-03-07T16:37:55,976 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-03-07T16:37:55,978 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-03-07T16:37:55,979 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-03-07T16:37:55,982 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2024-03-07T16:37:55,983 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant 2024-03-07T16:37:55,984 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant 2024-03-07T16:37:55,985 copying build/lib/colossalai/inference/quant/smoothquant/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant 2024-03-07T16:37:55,987 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-03-07T16:37:55,988 copying build/lib/colossalai/inference/quant/smoothquant/models/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-03-07T16:37:55,991 copying build/lib/colossalai/inference/quant/smoothquant/models/parallel_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-03-07T16:37:55,993 copying build/lib/colossalai/inference/quant/smoothquant/models/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-03-07T16:37:55,995 copying build/lib/colossalai/inference/quant/smoothquant/models/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-03-07T16:37:55,997 copying build/lib/colossalai/inference/quant/smoothquant/models/base_model.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-03-07T16:37:55,999 copying build/lib/colossalai/inference/quant/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant 2024-03-07T16:37:56,002 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq 2024-03-07T16:37:56,003 copying build/lib/colossalai/inference/quant/gptq/gptq_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq 2024-03-07T16:37:56,005 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq/cai_gptq 2024-03-07T16:37:56,006 copying build/lib/colossalai/inference/quant/gptq/cai_gptq/gptq_op.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq/cai_gptq 2024-03-07T16:37:56,008 copying build/lib/colossalai/inference/quant/gptq/cai_gptq/cai_quant_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq/cai_gptq 2024-03-07T16:37:56,010 copying build/lib/colossalai/inference/quant/gptq/cai_gptq/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq/cai_gptq 2024-03-07T16:37:56,012 copying build/lib/colossalai/inference/quant/gptq/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq 2024-03-07T16:37:56,014 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-03-07T16:37:56,015 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-03-07T16:37:56,016 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-03-07T16:37:56,019 copying build/lib/colossalai/inference/kv_cache/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-03-07T16:37:56,021 creating build/bdist.linux-armv7l/wheel/colossalai/inference/engine 2024-03-07T16:37:56,022 creating build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-03-07T16:37:56,023 copying build/lib/colossalai/inference/engine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-03-07T16:37:56,025 copying build/lib/colossalai/inference/engine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-03-07T16:37:56,027 copying build/lib/colossalai/inference/engine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-03-07T16:37:56,029 copying build/lib/colossalai/inference/engine/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-03-07T16:37:56,031 copying build/lib/colossalai/inference/engine/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-03-07T16:37:56,034 copying build/lib/colossalai/inference/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine 2024-03-07T16:37:56,036 creating build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-03-07T16:37:56,037 copying build/lib/colossalai/inference/engine/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-03-07T16:37:56,039 copying build/lib/colossalai/inference/engine/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-03-07T16:37:56,041 copying build/lib/colossalai/inference/engine/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-03-07T16:37:56,043 copying build/lib/colossalai/inference/engine/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-03-07T16:37:56,045 copying build/lib/colossalai/inference/engine/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine 2024-03-07T16:37:56,047 copying build/lib/colossalai/inference/engine/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine 2024-03-07T16:37:56,049 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-03-07T16:37:56,052 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2024-03-07T16:37:56,053 copying build/lib/colossalai/moe/load_balance.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-03-07T16:37:56,055 copying build/lib/colossalai/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-03-07T16:37:56,058 copying build/lib/colossalai/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-03-07T16:37:56,061 copying build/lib/colossalai/moe/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-03-07T16:37:56,063 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-03-07T16:37:56,065 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-03-07T16:37:56,067 copying build/lib/colossalai/moe/checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-03-07T16:37:56,069 copying build/lib/colossalai/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-03-07T16:37:56,072 copying build/lib/colossalai/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-03-07T16:37:56,074 copying build/lib/colossalai/moe/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-03-07T16:37:56,077 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2024-03-07T16:37:56,078 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-03-07T16:37:56,079 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-03-07T16:37:56,081 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-03-07T16:37:56,083 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-03-07T16:37:56,085 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-03-07T16:37:56,087 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-03-07T16:37:56,089 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-03-07T16:37:56,090 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-03-07T16:37:56,092 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-03-07T16:37:56,094 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-03-07T16:37:56,096 creating build/bdist.linux-armv7l/wheel/colossalai/device 2024-03-07T16:37:56,097 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-03-07T16:37:56,099 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-03-07T16:37:56,102 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-03-07T16:37:56,103 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-03-07T16:37:56,106 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2024-03-07T16:37:56,107 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-03-07T16:37:56,110 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-03-07T16:37:56,111 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-03-07T16:37:56,112 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-03-07T16:37:56,114 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-03-07T16:37:56,116 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-03-07T16:37:56,118 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-03-07T16:37:56,120 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-03-07T16:37:56,122 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-03-07T16:37:56,123 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-03-07T16:37:56,126 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-03-07T16:37:56,128 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-03-07T16:37:56,129 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-03-07T16:37:56,131 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-03-07T16:37:56,134 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-03-07T16:37:56,136 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-03-07T16:37:56,138 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-03-07T16:37:56,140 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-03-07T16:37:56,143 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-03-07T16:37:56,145 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-03-07T16:37:56,147 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-03-07T16:37:56,149 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-03-07T16:37:56,153 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-03-07T16:37:56,154 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-03-07T16:37:56,156 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-03-07T16:37:56,159 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-03-07T16:37:56,161 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-03-07T16:37:56,164 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-03-07T16:37:56,166 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-03-07T16:37:56,169 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2024-03-07T16:37:56,170 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C 2024-03-07T16:37:56,173 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-03-07T16:37:56,174 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-03-07T16:37:56,176 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-03-07T16:37:56,178 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-03-07T16:37:56,179 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-03-07T16:37:56,182 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-03-07T16:37:56,184 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-03-07T16:37:56,186 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-03-07T16:37:56,189 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-03-07T16:37:56,191 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-03-07T16:37:56,194 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-03-07T16:37:56,197 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-03-07T16:37:56,198 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-03-07T16:37:56,199 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-03-07T16:37:56,201 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-03-07T16:37:56,203 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:56,204 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:56,206 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:56,207 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:56,209 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:56,211 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:56,214 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:56,216 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:56,218 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:56,220 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:56,222 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:56,224 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-03-07T16:37:56,226 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-03-07T16:37:56,228 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-03-07T16:37:56,229 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-03-07T16:37:56,231 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-03-07T16:37:56,234 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-03-07T16:37:56,235 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-03-07T16:37:56,238 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-03-07T16:37:56,239 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-03-07T16:37:56,242 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-03-07T16:37:56,244 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-03-07T16:37:56,246 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-03-07T16:37:56,248 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-03-07T16:37:56,250 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-03-07T16:37:56,253 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-03-07T16:37:56,255 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-03-07T16:37:56,258 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:56,259 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:56,260 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:56,263 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:56,264 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:56,266 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:56,268 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-03-07T16:37:56,271 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-03-07T16:37:56,273 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-03-07T16:37:56,273 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-03-07T16:37:56,277 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,277 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,279 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,281 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,284 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,286 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,288 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,290 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,292 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,294 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,295 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,297 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,299 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,301 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,303 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,305 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,306 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,308 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,310 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,312 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,314 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,315 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,317 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,319 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,321 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,323 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,325 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,327 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-03-07T16:37:56,330 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,330 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,333 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,335 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,337 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,339 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,341 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,343 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,345 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,348 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,350 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,352 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,355 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,356 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,358 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,360 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,362 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,365 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,367 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,369 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-03-07T16:37:56,371 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-03-07T16:37:56,373 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-03-07T16:37:56,375 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-03-07T16:37:56,375 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-03-07T16:37:56,378 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-03-07T16:37:56,380 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-03-07T16:37:56,381 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-03-07T16:37:56,384 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-03-07T16:37:56,386 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-03-07T16:37:56,388 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:56,389 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:56,391 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:56,393 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:56,395 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:56,397 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:56,399 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-03-07T16:37:56,401 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-03-07T16:37:56,404 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-03-07T16:37:56,405 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-03-07T16:37:56,408 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-03-07T16:37:56,409 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-03-07T16:37:56,411 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-03-07T16:37:56,413 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-03-07T16:37:56,416 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-03-07T16:37:56,419 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2024-03-07T16:37:56,419 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-03-07T16:37:56,422 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-03-07T16:37:56,424 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-03-07T16:37:56,425 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-03-07T16:37:56,427 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-03-07T16:37:56,429 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-03-07T16:37:56,430 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-03-07T16:37:56,432 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-03-07T16:37:56,434 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-03-07T16:37:56,435 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-03-07T16:37:56,437 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-03-07T16:37:56,439 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-03-07T16:37:56,441 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-03-07T16:37:56,443 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-03-07T16:37:56,444 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-03-07T16:37:56,446 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-03-07T16:37:56,448 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-03-07T16:37:56,450 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2024-03-07T16:37:56,451 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-03-07T16:37:56,454 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-03-07T16:37:56,456 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-03-07T16:37:56,457 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-03-07T16:37:56,460 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-03-07T16:37:56,462 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-03-07T16:37:56,465 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-03-07T16:37:56,466 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-03-07T16:37:56,467 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-03-07T16:37:56,469 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-03-07T16:37:56,471 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-03-07T16:37:56,473 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-03-07T16:37:56,475 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-03-07T16:37:56,476 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-03-07T16:37:56,478 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-03-07T16:37:56,480 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-03-07T16:37:56,482 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-03-07T16:37:56,484 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-03-07T16:37:56,486 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-03-07T16:37:56,487 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-03-07T16:37:56,489 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-03-07T16:37:56,492 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-03-07T16:37:56,494 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-03-07T16:37:56,495 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:56,496 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:56,498 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:56,500 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:56,502 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:56,504 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:56,506 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:56,508 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:56,510 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-03-07T16:37:56,511 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-03-07T16:37:56,514 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:56,514 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:56,516 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:56,519 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:56,520 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:56,523 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:56,524 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:56,526 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:56,528 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-03-07T16:37:56,529 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-03-07T16:37:56,531 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-03-07T16:37:56,533 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-03-07T16:37:56,535 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-03-07T16:37:56,536 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-03-07T16:37:56,539 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-03-07T16:37:56,542 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-03-07T16:37:56,543 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-03-07T16:37:56,546 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-03-07T16:37:56,548 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-03-07T16:37:56,550 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-03-07T16:37:56,552 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-03-07T16:37:56,554 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-03-07T16:37:56,557 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-03-07T16:37:56,559 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-03-07T16:37:56,562 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-03-07T16:37:56,564 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-03-07T16:37:56,565 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-03-07T16:37:56,568 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-03-07T16:37:56,570 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-03-07T16:37:56,573 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-03-07T16:37:56,575 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-03-07T16:37:56,577 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-03-07T16:37:56,579 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-03-07T16:37:56,581 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-03-07T16:37:56,583 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-03-07T16:37:56,584 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:56,586 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:56,588 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:56,589 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:56,591 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:56,593 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:56,595 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:56,596 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:56,598 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:56,600 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-03-07T16:37:56,603 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:56,603 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:56,606 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:56,607 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:56,609 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:56,611 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:56,612 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:56,615 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:56,617 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:56,619 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:56,620 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:56,622 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-03-07T16:37:56,624 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-03-07T16:37:56,626 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-03-07T16:37:56,628 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-03-07T16:37:56,629 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-03-07T16:37:56,631 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-03-07T16:37:56,633 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-03-07T16:37:56,635 running install_egg_info 2024-03-07T16:37:56,697 running egg_info 2024-03-07T16:37:56,724 writing colossalai.egg-info/PKG-INFO 2024-03-07T16:37:56,729 writing dependency_links to colossalai.egg-info/dependency_links.txt 2024-03-07T16:37:56,731 writing entry points to colossalai.egg-info/entry_points.txt 2024-03-07T16:37:56,732 writing requirements to colossalai.egg-info/requires.txt 2024-03-07T16:37:56,734 writing top-level names to colossalai.egg-info/top_level.txt 2024-03-07T16:37:56,959 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2024-03-07T16:37:56,995 reading manifest template 'MANIFEST.in' 2024-03-07T16:37:58,234 warning: no files found matching '*.tr' under directory 'colossalai' 2024-03-07T16:37:58,833 warning: no files found matching '*.cc' under directory 'colossalai' 2024-03-07T16:37:59,119 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-03-07T16:37:59,207 warning: no files found matching '*.tr' under directory 'extensions' 2024-03-07T16:37:59,241 warning: no files found matching '*.cc' under directory 'extensions' 2024-03-07T16:37:59,258 warning: no files found matching '*.pyi' under directory 'extensions' 2024-03-07T16:37:59,258 adding license file 'LICENSE' 2024-03-07T16:37:59,302 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2024-03-07T16:37:59,305 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.3.6-py3.11.egg-info 2024-03-07T16:37:59,318 running install_scripts 2024-03-07T16:37:59,340 creating build/bdist.linux-armv7l/wheel/colossalai-0.3.6.dist-info/WHEEL 2024-03-07T16:37:59,342 creating '/tmp/pip-wheel-i8qbqsfx/colossalai-0.3.6-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-03-07T16:37:59,348 adding 'colossalai/__init__.py' 2024-03-07T16:37:59,351 adding 'colossalai/initialize.py' 2024-03-07T16:37:59,353 adding 'colossalai/version.py' 2024-03-07T16:37:59,354 adding 'colossalai/_C/__init__.py' 2024-03-07T16:37:59,357 adding 'colossalai/_analyzer/__init__.py' 2024-03-07T16:37:59,359 adding 'colossalai/_analyzer/envs.py' 2024-03-07T16:37:59,360 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2024-03-07T16:37:59,362 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2024-03-07T16:37:59,364 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2024-03-07T16:37:59,367 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2024-03-07T16:37:59,369 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2024-03-07T16:37:59,372 adding 'colossalai/_analyzer/fx/__init__.py' 2024-03-07T16:37:59,375 adding 'colossalai/_analyzer/fx/codegen.py' 2024-03-07T16:37:59,377 adding 'colossalai/_analyzer/fx/graph_module.py' 2024-03-07T16:37:59,380 adding 'colossalai/_analyzer/fx/node_util.py' 2024-03-07T16:37:59,381 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2024-03-07T16:37:59,383 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2024-03-07T16:37:59,386 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2024-03-07T16:37:59,388 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2024-03-07T16:37:59,390 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2024-03-07T16:37:59,392 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2024-03-07T16:37:59,393 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2024-03-07T16:37:59,395 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2024-03-07T16:37:59,397 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2024-03-07T16:37:59,400 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2024-03-07T16:37:59,402 adding 'colossalai/accelerator/__init__.py' 2024-03-07T16:37:59,403 adding 'colossalai/accelerator/api.py' 2024-03-07T16:37:59,405 adding 'colossalai/accelerator/base_accelerator.py' 2024-03-07T16:37:59,407 adding 'colossalai/accelerator/cpu_accelerator.py' 2024-03-07T16:37:59,410 adding 'colossalai/accelerator/cuda_accelerator.py' 2024-03-07T16:37:59,412 adding 'colossalai/accelerator/npu_accelerator.py' 2024-03-07T16:37:59,414 adding 'colossalai/amp/__init__.py' 2024-03-07T16:37:59,416 adding 'colossalai/amp/naive_amp/__init__.py' 2024-03-07T16:37:59,418 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2024-03-07T16:37:59,420 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2024-03-07T16:37:59,421 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2024-03-07T16:37:59,423 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2024-03-07T16:37:59,425 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2024-03-07T16:37:59,427 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2024-03-07T16:37:59,428 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2024-03-07T16:37:59,430 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2024-03-07T16:37:59,432 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2024-03-07T16:37:59,434 adding 'colossalai/auto_parallel/__init__.py' 2024-03-07T16:37:59,436 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2024-03-07T16:37:59,437 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2024-03-07T16:37:59,439 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2024-03-07T16:37:59,441 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2024-03-07T16:37:59,444 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2024-03-07T16:37:59,446 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2024-03-07T16:37:59,448 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2024-03-07T16:37:59,450 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2024-03-07T16:37:59,451 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2024-03-07T16:37:59,453 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2024-03-07T16:37:59,455 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2024-03-07T16:37:59,457 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2024-03-07T16:37:59,459 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2024-03-07T16:37:59,460 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2024-03-07T16:37:59,462 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2024-03-07T16:37:59,464 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2024-03-07T16:37:59,465 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2024-03-07T16:37:59,467 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2024-03-07T16:37:59,468 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2024-03-07T16:37:59,470 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2024-03-07T16:37:59,471 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2024-03-07T16:37:59,473 adding 'colossalai/auto_parallel/offload/__init__.py' 2024-03-07T16:37:59,474 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2024-03-07T16:37:59,476 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2024-03-07T16:37:59,477 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2024-03-07T16:37:59,478 adding 'colossalai/auto_parallel/offload/region.py' 2024-03-07T16:37:59,481 adding 'colossalai/auto_parallel/offload/region_manager.py' 2024-03-07T16:37:59,482 adding 'colossalai/auto_parallel/offload/runtime.py' 2024-03-07T16:37:59,485 adding 'colossalai/auto_parallel/offload/solver.py' 2024-03-07T16:37:59,487 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2024-03-07T16:37:59,488 adding 'colossalai/auto_parallel/offload/util.py' 2024-03-07T16:37:59,490 adding 'colossalai/auto_parallel/passes/__init__.py' 2024-03-07T16:37:59,491 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2024-03-07T16:37:59,492 adding 'colossalai/auto_parallel/passes/constants.py' 2024-03-07T16:37:59,494 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2024-03-07T16:37:59,495 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2024-03-07T16:37:59,498 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2024-03-07T16:37:59,500 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2024-03-07T16:37:59,501 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2024-03-07T16:37:59,502 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2024-03-07T16:37:59,505 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2024-03-07T16:37:59,506 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2024-03-07T16:37:59,508 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2024-03-07T16:37:59,510 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2024-03-07T16:37:59,512 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2024-03-07T16:37:59,513 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2024-03-07T16:37:59,514 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2024-03-07T16:37:59,516 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2024-03-07T16:37:59,517 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2024-03-07T16:37:59,519 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2024-03-07T16:37:59,520 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2024-03-07T16:37:59,522 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2024-03-07T16:37:59,523 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2024-03-07T16:37:59,524 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2024-03-07T16:37:59,526 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2024-03-07T16:37:59,529 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2024-03-07T16:37:59,531 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2024-03-07T16:37:59,532 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2024-03-07T16:37:59,533 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2024-03-07T16:37:59,534 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2024-03-07T16:37:59,536 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2024-03-07T16:37:59,537 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2024-03-07T16:37:59,538 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2024-03-07T16:37:59,539 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2024-03-07T16:37:59,540 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2024-03-07T16:37:59,541 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2024-03-07T16:37:59,543 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2024-03-07T16:37:59,544 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2024-03-07T16:37:59,545 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2024-03-07T16:37:59,546 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2024-03-07T16:37:59,548 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2024-03-07T16:37:59,550 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2024-03-07T16:37:59,555 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2024-03-07T16:37:59,557 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2024-03-07T16:37:59,558 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2024-03-07T16:37:59,560 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2024-03-07T16:37:59,561 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2024-03-07T16:37:59,563 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2024-03-07T16:37:59,566 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2024-03-07T16:37:59,567 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2024-03-07T16:37:59,569 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2024-03-07T16:37:59,570 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2024-03-07T16:37:59,572 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2024-03-07T16:37:59,574 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2024-03-07T16:37:59,576 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2024-03-07T16:37:59,577 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2024-03-07T16:37:59,579 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2024-03-07T16:37:59,580 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2024-03-07T16:37:59,581 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2024-03-07T16:37:59,583 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2024-03-07T16:37:59,585 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2024-03-07T16:37:59,586 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2024-03-07T16:37:59,589 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2024-03-07T16:37:59,591 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2024-03-07T16:37:59,592 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2024-03-07T16:37:59,594 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2024-03-07T16:37:59,596 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2024-03-07T16:37:59,597 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2024-03-07T16:37:59,599 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2024-03-07T16:37:59,602 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2024-03-07T16:37:59,603 adding 'colossalai/booster/__init__.py' 2024-03-07T16:37:59,606 adding 'colossalai/booster/accelerator.py' 2024-03-07T16:37:59,609 adding 'colossalai/booster/booster.py' 2024-03-07T16:37:59,610 adding 'colossalai/booster/mixed_precision/__init__.py' 2024-03-07T16:37:59,612 adding 'colossalai/booster/mixed_precision/bf16.py' 2024-03-07T16:37:59,613 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2024-03-07T16:37:59,614 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2024-03-07T16:37:59,615 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2024-03-07T16:37:59,616 adding 'colossalai/booster/mixed_precision/fp8.py' 2024-03-07T16:37:59,618 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2024-03-07T16:37:59,620 adding 'colossalai/booster/plugin/__init__.py' 2024-03-07T16:37:59,621 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2024-03-07T16:37:59,624 adding 'colossalai/booster/plugin/gemini_plugin.py' 2024-03-07T16:37:59,630 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2024-03-07T16:37:59,632 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2024-03-07T16:37:59,635 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2024-03-07T16:37:59,636 adding 'colossalai/booster/plugin/plugin_base.py' 2024-03-07T16:37:59,638 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2024-03-07T16:37:59,639 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2024-03-07T16:37:59,641 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2024-03-07T16:37:59,643 adding 'colossalai/checkpoint_io/__init__.py' 2024-03-07T16:37:59,645 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2024-03-07T16:37:59,646 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2024-03-07T16:37:59,651 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2024-03-07T16:37:59,652 adding 'colossalai/checkpoint_io/index_file.py' 2024-03-07T16:37:59,656 adding 'colossalai/checkpoint_io/utils.py' 2024-03-07T16:37:59,658 adding 'colossalai/cli/__init__.py' 2024-03-07T16:37:59,659 adding 'colossalai/cli/cli.py' 2024-03-07T16:37:59,660 adding 'colossalai/cli/check/__init__.py' 2024-03-07T16:37:59,662 adding 'colossalai/cli/check/check_installation.py' 2024-03-07T16:37:59,664 adding 'colossalai/cli/launcher/__init__.py' 2024-03-07T16:37:59,665 adding 'colossalai/cli/launcher/hostinfo.py' 2024-03-07T16:37:59,667 adding 'colossalai/cli/launcher/multinode_runner.py' 2024-03-07T16:37:59,669 adding 'colossalai/cli/launcher/run.py' 2024-03-07T16:37:59,670 adding 'colossalai/cluster/__init__.py' 2024-03-07T16:37:59,672 adding 'colossalai/cluster/device_mesh_manager.py' 2024-03-07T16:37:59,673 adding 'colossalai/cluster/dist_coordinator.py' 2024-03-07T16:37:59,675 adding 'colossalai/cluster/process_group_manager.py' 2024-03-07T16:37:59,677 adding 'colossalai/cluster/process_group_mesh.py' 2024-03-07T16:37:59,679 adding 'colossalai/context/__init__.py' 2024-03-07T16:37:59,680 adding 'colossalai/context/config.py' 2024-03-07T16:37:59,681 adding 'colossalai/context/singleton_meta.py' 2024-03-07T16:37:59,683 adding 'colossalai/device/__init__.py' 2024-03-07T16:37:59,686 adding 'colossalai/device/alpha_beta_profiler.py' 2024-03-07T16:37:59,688 adding 'colossalai/device/calc_pipeline_strategy.py' 2024-03-07T16:37:59,691 adding 'colossalai/device/device_mesh.py' 2024-03-07T16:37:59,693 adding 'colossalai/fx/__init__.py' 2024-03-07T16:37:59,694 adding 'colossalai/fx/_compatibility.py' 2024-03-07T16:37:59,696 adding 'colossalai/fx/_meta_regist_12.py' 2024-03-07T16:37:59,698 adding 'colossalai/fx/_meta_regist_13.py' 2024-03-07T16:37:59,700 adding 'colossalai/fx/graph_module.py' 2024-03-07T16:37:59,701 adding 'colossalai/fx/proxy.py' 2024-03-07T16:37:59,703 adding 'colossalai/fx/codegen/__init__.py' 2024-03-07T16:37:59,707 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2024-03-07T16:37:59,709 adding 'colossalai/fx/passes/__init__.py' 2024-03-07T16:37:59,711 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2024-03-07T16:37:59,713 adding 'colossalai/fx/passes/concrete_info_prop.py' 2024-03-07T16:37:59,715 adding 'colossalai/fx/passes/meta_info_prop.py' 2024-03-07T16:37:59,717 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2024-03-07T16:37:59,719 adding 'colossalai/fx/passes/shard_1d_pass.py' 2024-03-07T16:37:59,721 adding 'colossalai/fx/passes/split_module.py' 2024-03-07T16:37:59,723 adding 'colossalai/fx/passes/utils.py' 2024-03-07T16:37:59,724 adding 'colossalai/fx/profiler/__init__.py' 2024-03-07T16:37:59,726 adding 'colossalai/fx/profiler/constants.py' 2024-03-07T16:37:59,727 adding 'colossalai/fx/profiler/dataflow.py' 2024-03-07T16:37:59,729 adding 'colossalai/fx/profiler/memory_utils.py' 2024-03-07T16:37:59,731 adding 'colossalai/fx/profiler/opcount.py' 2024-03-07T16:37:59,733 adding 'colossalai/fx/profiler/profiler.py' 2024-03-07T16:37:59,734 adding 'colossalai/fx/profiler/shard_utils.py' 2024-03-07T16:37:59,736 adding 'colossalai/fx/profiler/tensor.py' 2024-03-07T16:37:59,738 adding 'colossalai/fx/profiler/experimental/__init__.py' 2024-03-07T16:37:59,739 adding 'colossalai/fx/profiler/experimental/constants.py' 2024-03-07T16:37:59,740 adding 'colossalai/fx/profiler/experimental/profiler.py' 2024-03-07T16:37:59,742 adding 'colossalai/fx/profiler/experimental/registry.py' 2024-03-07T16:37:59,743 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2024-03-07T16:37:59,745 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2024-03-07T16:37:59,746 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2024-03-07T16:37:59,747 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2024-03-07T16:37:59,748 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2024-03-07T16:37:59,749 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2024-03-07T16:37:59,751 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2024-03-07T16:37:59,752 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2024-03-07T16:37:59,753 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2024-03-07T16:37:59,754 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2024-03-07T16:37:59,756 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2024-03-07T16:37:59,757 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2024-03-07T16:37:59,758 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2024-03-07T16:37:59,760 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2024-03-07T16:37:59,761 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2024-03-07T16:37:59,762 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2024-03-07T16:37:59,763 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2024-03-07T16:37:59,764 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2024-03-07T16:37:59,766 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2024-03-07T16:37:59,767 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2024-03-07T16:37:59,768 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2024-03-07T16:37:59,770 adding 'colossalai/fx/tracer/__init__.py' 2024-03-07T16:37:59,771 adding 'colossalai/fx/tracer/_meta_trace.py' 2024-03-07T16:37:59,772 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2024-03-07T16:37:59,773 adding 'colossalai/fx/tracer/_tracer_utils.py' 2024-03-07T16:37:59,776 adding 'colossalai/fx/tracer/experimental.py' 2024-03-07T16:37:59,778 adding 'colossalai/fx/tracer/registry.py' 2024-03-07T16:37:59,781 adding 'colossalai/fx/tracer/tracer.py' 2024-03-07T16:37:59,782 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2024-03-07T16:37:59,784 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2024-03-07T16:37:59,785 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2024-03-07T16:37:59,786 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2024-03-07T16:37:59,788 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2024-03-07T16:37:59,789 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2024-03-07T16:37:59,790 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2024-03-07T16:37:59,792 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2024-03-07T16:37:59,793 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2024-03-07T16:37:59,794 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2024-03-07T16:37:59,795 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2024-03-07T16:37:59,797 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2024-03-07T16:37:59,798 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2024-03-07T16:37:59,799 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2024-03-07T16:37:59,801 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2024-03-07T16:37:59,802 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2024-03-07T16:37:59,803 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2024-03-07T16:37:59,804 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2024-03-07T16:37:59,806 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2024-03-07T16:37:59,807 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2024-03-07T16:37:59,809 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2024-03-07T16:37:59,810 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2024-03-07T16:37:59,811 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2024-03-07T16:37:59,812 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2024-03-07T16:37:59,813 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2024-03-07T16:37:59,815 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2024-03-07T16:37:59,816 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2024-03-07T16:37:59,818 adding 'colossalai/inference/__init__.py' 2024-03-07T16:37:59,819 adding 'colossalai/inference/engine/__init__.py' 2024-03-07T16:37:59,821 adding 'colossalai/inference/engine/engine.py' 2024-03-07T16:37:59,823 adding 'colossalai/inference/engine/microbatch_manager.py' 2024-03-07T16:37:59,824 adding 'colossalai/inference/engine/modeling/__init__.py' 2024-03-07T16:37:59,826 adding 'colossalai/inference/engine/modeling/_utils.py' 2024-03-07T16:37:59,828 adding 'colossalai/inference/engine/modeling/bloom.py' 2024-03-07T16:37:59,831 adding 'colossalai/inference/engine/modeling/chatglm2.py' 2024-03-07T16:37:59,834 adding 'colossalai/inference/engine/modeling/llama.py' 2024-03-07T16:37:59,835 adding 'colossalai/inference/engine/policies/__init__.py' 2024-03-07T16:37:59,837 adding 'colossalai/inference/engine/policies/bloom.py' 2024-03-07T16:37:59,838 adding 'colossalai/inference/engine/policies/chatglm2.py' 2024-03-07T16:37:59,839 adding 'colossalai/inference/engine/policies/llama.py' 2024-03-07T16:37:59,841 adding 'colossalai/inference/kv_cache/__init__.py' 2024-03-07T16:37:59,842 adding 'colossalai/inference/kv_cache/batch_infer_state.py' 2024-03-07T16:37:59,844 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2024-03-07T16:37:59,845 adding 'colossalai/inference/quant/__init__.py' 2024-03-07T16:37:59,846 adding 'colossalai/inference/quant/gptq/__init__.py' 2024-03-07T16:37:59,848 adding 'colossalai/inference/quant/gptq/gptq_manager.py' 2024-03-07T16:37:59,849 adding 'colossalai/inference/quant/gptq/cai_gptq/__init__.py' 2024-03-07T16:37:59,851 adding 'colossalai/inference/quant/gptq/cai_gptq/cai_quant_linear.py' 2024-03-07T16:37:59,852 adding 'colossalai/inference/quant/gptq/cai_gptq/gptq_op.py' 2024-03-07T16:37:59,854 adding 'colossalai/inference/quant/smoothquant/__init__.py' 2024-03-07T16:37:59,855 adding 'colossalai/inference/quant/smoothquant/models/__init__.py' 2024-03-07T16:37:59,858 adding 'colossalai/inference/quant/smoothquant/models/base_model.py' 2024-03-07T16:37:59,859 adding 'colossalai/inference/quant/smoothquant/models/linear.py' 2024-03-07T16:37:59,863 adding 'colossalai/inference/quant/smoothquant/models/llama.py' 2024-03-07T16:37:59,864 adding 'colossalai/inference/quant/smoothquant/models/parallel_linear.py' 2024-03-07T16:37:59,866 adding 'colossalai/interface/__init__.py' 2024-03-07T16:37:59,867 adding 'colossalai/interface/model.py' 2024-03-07T16:37:59,869 adding 'colossalai/interface/optimizer.py' 2024-03-07T16:37:59,870 adding 'colossalai/interface/pretrained.py' 2024-03-07T16:37:59,871 adding 'colossalai/kernel/__init__.py' 2024-03-07T16:37:59,873 adding 'colossalai/kernel/kernel_loader.py' 2024-03-07T16:37:59,874 adding 'colossalai/kernel/extensions/__init__.py' 2024-03-07T16:37:59,876 adding 'colossalai/kernel/extensions/base_extension.py' 2024-03-07T16:37:59,877 adding 'colossalai/kernel/extensions/cpp_extension.py' 2024-03-07T16:37:59,878 adding 'colossalai/kernel/extensions/cuda_extension.py' 2024-03-07T16:37:59,880 adding 'colossalai/kernel/extensions/triton_extension.py' 2024-03-07T16:37:59,881 adding 'colossalai/kernel/extensions/utils.py' 2024-03-07T16:37:59,883 adding 'colossalai/kernel/extensions/cpu_adam/__init__.py' 2024-03-07T16:37:59,884 adding 'colossalai/kernel/extensions/cpu_adam/cpu_adam_arm.py' 2024-03-07T16:37:59,886 adding 'colossalai/kernel/extensions/cpu_adam/cpu_adam_x86.py' 2024-03-07T16:37:59,887 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2024-03-07T16:37:59,889 adding 'colossalai/kernel/extensions/csrc/scaled_softmax.py' 2024-03-07T16:37:59,891 adding 'colossalai/kernel/extensions/csrc/arm/cpu_adam_arm.cpp' 2024-03-07T16:37:59,893 adding 'colossalai/kernel/extensions/csrc/arm/cpu_adam_arm.h' 2024-03-07T16:37:59,895 adding 'colossalai/kernel/extensions/csrc/cuda/colossal_C_frontend.cpp' 2024-03-07T16:37:59,896 adding 'colossalai/kernel/extensions/csrc/cuda/compat.h' 2024-03-07T16:37:59,898 adding 'colossalai/kernel/extensions/csrc/cuda/cpu_adam.cpp' 2024-03-07T16:37:59,900 adding 'colossalai/kernel/extensions/csrc/cuda/cpu_adam.h' 2024-03-07T16:37:59,901 adding 'colossalai/kernel/extensions/csrc/cuda/layer_norm_cuda.cpp' 2024-03-07T16:37:59,904 adding 'colossalai/kernel/extensions/csrc/cuda/layer_norm_cuda_kernel.cu' 2024-03-07T16:37:59,905 adding 'colossalai/kernel/extensions/csrc/cuda/moe_cuda.cpp' 2024-03-07T16:37:59,908 adding 'colossalai/kernel/extensions/csrc/cuda/moe_cuda_kernel.cu' 2024-03-07T16:37:59,910 adding 'colossalai/kernel/extensions/csrc/cuda/multi_tensor_adam.cu' 2024-03-07T16:37:59,911 adding 'colossalai/kernel/extensions/csrc/cuda/multi_tensor_apply.cuh' 2024-03-07T16:37:59,913 adding 'colossalai/kernel/extensions/csrc/cuda/multi_tensor_l2norm_kernel.cu' 2024-03-07T16:37:59,915 adding 'colossalai/kernel/extensions/csrc/cuda/multi_tensor_lamb.cu' 2024-03-07T16:37:59,916 adding 'colossalai/kernel/extensions/csrc/cuda/multi_tensor_scale_kernel.cu' 2024-03-07T16:37:59,917 adding 'colossalai/kernel/extensions/csrc/cuda/multi_tensor_sgd_kernel.cu' 2024-03-07T16:37:59,919 adding 'colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax.cpp' 2024-03-07T16:37:59,921 adding 'colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax.h' 2024-03-07T16:37:59,922 adding 'colossalai/kernel/extensions/csrc/cuda/scaled_masked_softmax_cuda.cu' 2024-03-07T16:37:59,923 adding 'colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax.cpp' 2024-03-07T16:37:59,925 adding 'colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax.h' 2024-03-07T16:37:59,926 adding 'colossalai/kernel/extensions/csrc/cuda/scaled_upper_triang_masked_softmax_cuda.cu' 2024-03-07T16:37:59,928 adding 'colossalai/kernel/extensions/csrc/cuda/type_shim.h' 2024-03-07T16:37:59,942 adding 'colossalai/kernel/extensions/csrc/cuda/include/block_reduce.h' 2024-03-07T16:37:59,943 adding 'colossalai/kernel/extensions/flash_attention/__init__.py' 2024-03-07T16:37:59,945 adding 'colossalai/kernel/extensions/flash_attention/flash_attention_dao_cuda.py' 2024-03-07T16:37:59,946 adding 'colossalai/kernel/extensions/flash_attention/flash_attention_npu.py' 2024-03-07T16:37:59,947 adding 'colossalai/kernel/extensions/flash_attention/flash_attention_xformers_cuda.py' 2024-03-07T16:37:59,949 adding 'colossalai/kernel/extensions/layernorm/__init__.py' 2024-03-07T16:37:59,950 adding 'colossalai/kernel/extensions/layernorm/layernorm_cuda.py' 2024-03-07T16:37:59,951 adding 'colossalai/kernel/extensions/moe/__init__.py' 2024-03-07T16:37:59,953 adding 'colossalai/kernel/extensions/moe/moe_cuda.py' 2024-03-07T16:37:59,954 adding 'colossalai/kernel/extensions/optimizer/__init__.py' 2024-03-07T16:37:59,955 adding 'colossalai/kernel/extensions/optimizer/fused_optimizer_cuda.py' 2024-03-07T16:37:59,957 adding 'colossalai/kernel/extensions/softmax/__init__.py' 2024-03-07T16:37:59,958 adding 'colossalai/kernel/extensions/softmax/scaled_masked_softmax_cuda.py' 2024-03-07T16:37:59,959 adding 'colossalai/kernel/extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-03-07T16:37:59,961 adding 'colossalai/kernel/jit/__init__.py' 2024-03-07T16:37:59,962 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2024-03-07T16:37:59,964 adding 'colossalai/kernel/jit/bias_gelu.py' 2024-03-07T16:37:59,965 adding 'colossalai/kernel/jit/option.py' 2024-03-07T16:37:59,967 adding 'colossalai/kernel/triton/__init__.py' 2024-03-07T16:37:59,968 adding 'colossalai/kernel/triton/context_attention.py' 2024-03-07T16:37:59,970 adding 'colossalai/kernel/triton/copy_kv_cache_dest.py' 2024-03-07T16:37:59,971 adding 'colossalai/kernel/triton/custom_autotune.py' 2024-03-07T16:37:59,973 adding 'colossalai/kernel/triton/flash_decoding.py' 2024-03-07T16:37:59,974 adding 'colossalai/kernel/triton/fused_layernorm.py' 2024-03-07T16:37:59,976 adding 'colossalai/kernel/triton/gptq_triton.py' 2024-03-07T16:37:59,978 adding 'colossalai/kernel/triton/int8_rotary_embedding_kernel.py' 2024-03-07T16:37:59,979 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2024-03-07T16:37:59,981 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2024-03-07T16:37:59,982 adding 'colossalai/kernel/triton/self_attention_nofusion.py' 2024-03-07T16:37:59,985 adding 'colossalai/kernel/triton/smooth_attention.py' 2024-03-07T16:37:59,986 adding 'colossalai/kernel/triton/softmax.py' 2024-03-07T16:37:59,988 adding 'colossalai/kernel/triton/token_attention_kernel.py' 2024-03-07T16:37:59,990 adding 'colossalai/lazy/__init__.py' 2024-03-07T16:37:59,991 adding 'colossalai/lazy/construction.py' 2024-03-07T16:37:59,994 adding 'colossalai/lazy/lazy_init.py' 2024-03-07T16:37:59,996 adding 'colossalai/lazy/pretrained.py' 2024-03-07T16:37:59,998 adding 'colossalai/legacy/__init__.py' 2024-03-07T16:37:59,999 adding 'colossalai/legacy/constants.py' 2024-03-07T16:38:00,000 adding 'colossalai/legacy/core.py' 2024-03-07T16:38:00,001 adding 'colossalai/legacy/global_variables.py' 2024-03-07T16:38:00,003 adding 'colossalai/legacy/initialize.py' 2024-03-07T16:38:00,005 adding 'colossalai/legacy/amp/__init__.py' 2024-03-07T16:38:00,006 adding 'colossalai/legacy/amp/amp_type.py' 2024-03-07T16:38:00,008 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2024-03-07T16:38:00,009 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2024-03-07T16:38:00,011 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2024-03-07T16:38:00,013 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2024-03-07T16:38:00,014 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2024-03-07T16:38:00,015 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2024-03-07T16:38:00,017 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2024-03-07T16:38:00,020 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2024-03-07T16:38:00,022 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2024-03-07T16:38:00,023 adding 'colossalai/legacy/builder/__init__.py' 2024-03-07T16:38:00,024 adding 'colossalai/legacy/builder/builder.py' 2024-03-07T16:38:00,026 adding 'colossalai/legacy/communication/__init__.py' 2024-03-07T16:38:00,028 adding 'colossalai/legacy/communication/collective.py' 2024-03-07T16:38:00,030 adding 'colossalai/legacy/communication/p2p.py' 2024-03-07T16:38:00,031 adding 'colossalai/legacy/communication/p2p_v2.py' 2024-03-07T16:38:00,033 adding 'colossalai/legacy/communication/ring.py' 2024-03-07T16:38:00,034 adding 'colossalai/legacy/communication/utils.py' 2024-03-07T16:38:00,036 adding 'colossalai/legacy/context/__init__.py' 2024-03-07T16:38:00,038 adding 'colossalai/legacy/context/parallel_context.py' 2024-03-07T16:38:00,040 adding 'colossalai/legacy/context/parallel_mode.py' 2024-03-07T16:38:00,041 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2024-03-07T16:38:00,043 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2024-03-07T16:38:00,044 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2024-03-07T16:38:00,046 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2024-03-07T16:38:00,047 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2024-03-07T16:38:00,048 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2024-03-07T16:38:00,050 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2024-03-07T16:38:00,051 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2024-03-07T16:38:00,052 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2024-03-07T16:38:00,054 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2024-03-07T16:38:00,055 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2024-03-07T16:38:00,057 adding 'colossalai/legacy/context/random/__init__.py' 2024-03-07T16:38:00,058 adding 'colossalai/legacy/context/random/_helper.py' 2024-03-07T16:38:00,059 adding 'colossalai/legacy/context/random/seed_manager.py' 2024-03-07T16:38:00,061 adding 'colossalai/legacy/engine/__init__.py' 2024-03-07T16:38:00,063 adding 'colossalai/legacy/engine/_base_engine.py' 2024-03-07T16:38:00,064 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2024-03-07T16:38:00,066 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2024-03-07T16:38:00,068 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2024-03-07T16:38:00,069 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2024-03-07T16:38:00,070 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2024-03-07T16:38:00,072 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2024-03-07T16:38:00,073 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2024-03-07T16:38:00,074 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2024-03-07T16:38:00,075 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2024-03-07T16:38:00,076 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2024-03-07T16:38:00,078 adding 'colossalai/legacy/engine/schedule/__init__.py' 2024-03-07T16:38:00,079 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2024-03-07T16:38:00,080 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2024-03-07T16:38:00,084 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2024-03-07T16:38:00,086 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2024-03-07T16:38:00,088 adding 'colossalai/legacy/inference/__init__.py' 2024-03-07T16:38:00,089 adding 'colossalai/legacy/inference/async_engine.py' 2024-03-07T16:38:00,091 adding 'colossalai/legacy/inference/async_manager.py' 2024-03-07T16:38:00,093 adding 'colossalai/legacy/inference/manager.py' 2024-03-07T16:38:00,094 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2024-03-07T16:38:00,095 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2024-03-07T16:38:00,097 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2024-03-07T16:38:00,099 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2024-03-07T16:38:00,101 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2024-03-07T16:38:00,103 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2024-03-07T16:38:00,104 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2024-03-07T16:38:00,105 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2024-03-07T16:38:00,107 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2024-03-07T16:38:00,108 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2024-03-07T16:38:00,110 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2024-03-07T16:38:00,112 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2024-03-07T16:38:00,113 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2024-03-07T16:38:00,116 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2024-03-07T16:38:00,117 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2024-03-07T16:38:00,119 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2024-03-07T16:38:00,120 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2024-03-07T16:38:00,122 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2024-03-07T16:38:00,124 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2024-03-07T16:38:00,125 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2024-03-07T16:38:00,128 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2024-03-07T16:38:00,129 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2024-03-07T16:38:00,131 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2024-03-07T16:38:00,132 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2024-03-07T16:38:00,135 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2024-03-07T16:38:00,138 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2024-03-07T16:38:00,140 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2024-03-07T16:38:00,142 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2024-03-07T16:38:00,143 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2024-03-07T16:38:00,145 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2024-03-07T16:38:00,146 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2024-03-07T16:38:00,148 adding 'colossalai/legacy/nn/__init__.py' 2024-03-07T16:38:00,149 adding 'colossalai/legacy/nn/_ops/__init__.py' 2024-03-07T16:38:00,151 adding 'colossalai/legacy/nn/_ops/_utils.py' 2024-03-07T16:38:00,152 adding 'colossalai/legacy/nn/layer/__init__.py' 2024-03-07T16:38:00,154 adding 'colossalai/legacy/nn/layer/base_layer.py' 2024-03-07T16:38:00,155 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2024-03-07T16:38:00,156 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2024-03-07T16:38:00,157 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2024-03-07T16:38:00,159 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2024-03-07T16:38:00,160 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2024-03-07T16:38:00,162 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2024-03-07T16:38:00,163 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2024-03-07T16:38:00,165 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2024-03-07T16:38:00,166 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2024-03-07T16:38:00,169 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2024-03-07T16:38:00,171 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2024-03-07T16:38:00,174 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2024-03-07T16:38:00,175 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2024-03-07T16:38:00,179 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2024-03-07T16:38:00,181 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2024-03-07T16:38:00,184 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2024-03-07T16:38:00,185 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2024-03-07T16:38:00,189 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2024-03-07T16:38:00,190 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2024-03-07T16:38:00,193 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2024-03-07T16:38:00,194 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2024-03-07T16:38:00,198 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2024-03-07T16:38:00,200 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2024-03-07T16:38:00,201 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2024-03-07T16:38:00,202 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2024-03-07T16:38:00,204 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2024-03-07T16:38:00,206 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2024-03-07T16:38:00,207 adding 'colossalai/legacy/nn/layer/utils/common.py' 2024-03-07T16:38:00,209 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2024-03-07T16:38:00,211 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2024-03-07T16:38:00,212 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2024-03-07T16:38:00,214 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2024-03-07T16:38:00,216 adding 'colossalai/legacy/nn/loss/__init__.py' 2024-03-07T16:38:00,217 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2024-03-07T16:38:00,218 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2024-03-07T16:38:00,220 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2024-03-07T16:38:00,222 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2024-03-07T16:38:00,223 adding 'colossalai/legacy/nn/metric/__init__.py' 2024-03-07T16:38:00,224 adding 'colossalai/legacy/nn/metric/_utils.py' 2024-03-07T16:38:00,226 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2024-03-07T16:38:00,227 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2024-03-07T16:38:00,228 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2024-03-07T16:38:00,230 adding 'colossalai/legacy/nn/parallel/__init__.py' 2024-03-07T16:38:00,231 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2024-03-07T16:38:00,233 adding 'colossalai/legacy/nn/parallel/reducer.py' 2024-03-07T16:38:00,234 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2024-03-07T16:38:00,235 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2024-03-07T16:38:00,236 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2024-03-07T16:38:00,237 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2024-03-07T16:38:00,239 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2024-03-07T16:38:00,240 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2024-03-07T16:38:00,241 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2024-03-07T16:38:00,245 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2024-03-07T16:38:00,246 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2024-03-07T16:38:00,248 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2024-03-07T16:38:00,249 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2024-03-07T16:38:00,251 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2024-03-07T16:38:00,252 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2024-03-07T16:38:00,254 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2024-03-07T16:38:00,256 adding 'colossalai/legacy/pipeline/__init__.py' 2024-03-07T16:38:00,257 adding 'colossalai/legacy/pipeline/layer_spec.py' 2024-03-07T16:38:00,259 adding 'colossalai/legacy/pipeline/pipelinable.py' 2024-03-07T16:38:00,260 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2024-03-07T16:38:00,262 adding 'colossalai/legacy/pipeline/utils.py' 2024-03-07T16:38:00,264 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2024-03-07T16:38:00,265 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2024-03-07T16:38:00,267 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2024-03-07T16:38:00,269 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2024-03-07T16:38:00,271 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2024-03-07T16:38:00,276 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2024-03-07T16:38:00,279 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2024-03-07T16:38:00,280 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2024-03-07T16:38:00,282 adding 'colossalai/legacy/registry/__init__.py' 2024-03-07T16:38:00,284 adding 'colossalai/legacy/registry/registry.py' 2024-03-07T16:38:00,285 adding 'colossalai/legacy/tensor/__init__.py' 2024-03-07T16:38:00,287 adding 'colossalai/legacy/tensor/compute_spec.py' 2024-03-07T16:38:00,288 adding 'colossalai/legacy/tensor/const.py' 2024-03-07T16:38:00,289 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2024-03-07T16:38:00,291 adding 'colossalai/legacy/tensor/distspec.py' 2024-03-07T16:38:00,292 adding 'colossalai/legacy/tensor/op_wrapper.py' 2024-03-07T16:38:00,294 adding 'colossalai/legacy/tensor/process_group.py' 2024-03-07T16:38:00,295 adding 'colossalai/legacy/tensor/tensor_spec.py' 2024-03-07T16:38:00,297 adding 'colossalai/legacy/trainer/__init__.py' 2024-03-07T16:38:00,299 adding 'colossalai/legacy/trainer/_trainer.py' 2024-03-07T16:38:00,301 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2024-03-07T16:38:00,302 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2024-03-07T16:38:00,303 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2024-03-07T16:38:00,305 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2024-03-07T16:38:00,306 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2024-03-07T16:38:00,308 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2024-03-07T16:38:00,312 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2024-03-07T16:38:00,314 adding 'colossalai/legacy/utils/__init__.py' 2024-03-07T16:38:00,316 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2024-03-07T16:38:00,319 adding 'colossalai/legacy/utils/checkpointing.py' 2024-03-07T16:38:00,321 adding 'colossalai/legacy/utils/common.py' 2024-03-07T16:38:00,322 adding 'colossalai/legacy/utils/memory.py' 2024-03-07T16:38:00,324 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2024-03-07T16:38:00,325 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2024-03-07T16:38:00,326 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2024-03-07T16:38:00,328 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2024-03-07T16:38:00,329 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2024-03-07T16:38:00,331 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2024-03-07T16:38:00,332 adding 'colossalai/legacy/utils/profiler/__init__.py' 2024-03-07T16:38:00,333 adding 'colossalai/legacy/utils/profiler/extention.py' 2024-03-07T16:38:00,335 adding 'colossalai/legacy/utils/profiler/profiler.py' 2024-03-07T16:38:00,336 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2024-03-07T16:38:00,338 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2024-03-07T16:38:00,339 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2024-03-07T16:38:00,341 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2024-03-07T16:38:00,342 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2024-03-07T16:38:00,344 adding 'colossalai/legacy/zero/__init__.py' 2024-03-07T16:38:00,346 adding 'colossalai/legacy/zero/gemini/__init__.py' 2024-03-07T16:38:00,347 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2024-03-07T16:38:00,349 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2024-03-07T16:38:00,350 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2024-03-07T16:38:00,352 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2024-03-07T16:38:00,353 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2024-03-07T16:38:00,354 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2024-03-07T16:38:00,356 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2024-03-07T16:38:00,357 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2024-03-07T16:38:00,359 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2024-03-07T16:38:00,360 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2024-03-07T16:38:00,361 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2024-03-07T16:38:00,363 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2024-03-07T16:38:00,364 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2024-03-07T16:38:00,366 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2024-03-07T16:38:00,368 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2024-03-07T16:38:00,370 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2024-03-07T16:38:00,371 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2024-03-07T16:38:00,372 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2024-03-07T16:38:00,373 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2024-03-07T16:38:00,375 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2024-03-07T16:38:00,376 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2024-03-07T16:38:00,378 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2024-03-07T16:38:00,379 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2024-03-07T16:38:00,383 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2024-03-07T16:38:00,384 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2024-03-07T16:38:00,386 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2024-03-07T16:38:00,387 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2024-03-07T16:38:00,389 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2024-03-07T16:38:00,391 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2024-03-07T16:38:00,392 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2024-03-07T16:38:00,394 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2024-03-07T16:38:00,395 adding 'colossalai/logging/__init__.py' 2024-03-07T16:38:00,396 adding 'colossalai/logging/logger.py' 2024-03-07T16:38:00,398 adding 'colossalai/moe/__init__.py' 2024-03-07T16:38:00,400 adding 'colossalai/moe/_operation.py' 2024-03-07T16:38:00,403 adding 'colossalai/moe/checkpoint.py' 2024-03-07T16:38:00,405 adding 'colossalai/moe/experts.py' 2024-03-07T16:38:00,407 adding 'colossalai/moe/layers.py' 2024-03-07T16:38:00,409 adding 'colossalai/moe/load_balance.py' 2024-03-07T16:38:00,412 adding 'colossalai/moe/loss.py' 2024-03-07T16:38:00,413 adding 'colossalai/moe/manager.py' 2024-03-07T16:38:00,416 adding 'colossalai/moe/routers.py' 2024-03-07T16:38:00,418 adding 'colossalai/moe/utils.py' 2024-03-07T16:38:00,420 adding 'colossalai/nn/__init__.py' 2024-03-07T16:38:00,421 adding 'colossalai/nn/init.py' 2024-03-07T16:38:00,423 adding 'colossalai/nn/layer/__init__.py' 2024-03-07T16:38:00,425 adding 'colossalai/nn/layer/colo_attention.py' 2024-03-07T16:38:00,426 adding 'colossalai/nn/layer/layernorm.py' 2024-03-07T16:38:00,427 adding 'colossalai/nn/layer/scaled_softmax.py' 2024-03-07T16:38:00,428 adding 'colossalai/nn/layer/utils.py' 2024-03-07T16:38:00,430 adding 'colossalai/nn/loss/__init__.py' 2024-03-07T16:38:00,432 adding 'colossalai/nn/lr_scheduler/__init__.py' 2024-03-07T16:38:00,433 adding 'colossalai/nn/lr_scheduler/cosine.py' 2024-03-07T16:38:00,434 adding 'colossalai/nn/lr_scheduler/delayed.py' 2024-03-07T16:38:00,436 adding 'colossalai/nn/lr_scheduler/linear.py' 2024-03-07T16:38:00,437 adding 'colossalai/nn/lr_scheduler/multistep.py' 2024-03-07T16:38:00,438 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2024-03-07T16:38:00,440 adding 'colossalai/nn/lr_scheduler/poly.py' 2024-03-07T16:38:00,441 adding 'colossalai/nn/lr_scheduler/torch.py' 2024-03-07T16:38:00,443 adding 'colossalai/nn/optimizer/__init__.py' 2024-03-07T16:38:00,444 adding 'colossalai/nn/optimizer/cpu_adam.py' 2024-03-07T16:38:00,446 adding 'colossalai/nn/optimizer/fused_adam.py' 2024-03-07T16:38:00,448 adding 'colossalai/nn/optimizer/fused_lamb.py' 2024-03-07T16:38:00,449 adding 'colossalai/nn/optimizer/fused_sgd.py' 2024-03-07T16:38:00,451 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2024-03-07T16:38:00,452 adding 'colossalai/nn/optimizer/lamb.py' 2024-03-07T16:38:00,454 adding 'colossalai/nn/optimizer/lars.py' 2024-03-07T16:38:00,455 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2024-03-07T16:38:00,457 adding 'colossalai/pipeline/__init__.py' 2024-03-07T16:38:00,460 adding 'colossalai/pipeline/p2p.py' 2024-03-07T16:38:00,462 adding 'colossalai/pipeline/stage_manager.py' 2024-03-07T16:38:00,464 adding 'colossalai/pipeline/schedule/__init__.py' 2024-03-07T16:38:00,465 adding 'colossalai/pipeline/schedule/_utils.py' 2024-03-07T16:38:00,466 adding 'colossalai/pipeline/schedule/base.py' 2024-03-07T16:38:00,469 adding 'colossalai/pipeline/schedule/generate.py' 2024-03-07T16:38:00,471 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2024-03-07T16:38:00,474 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2024-03-07T16:38:00,476 adding 'colossalai/shardformer/__init__.py' 2024-03-07T16:38:00,477 adding 'colossalai/shardformer/_utils.py' 2024-03-07T16:38:00,479 adding 'colossalai/shardformer/layer/__init__.py' 2024-03-07T16:38:00,481 adding 'colossalai/shardformer/layer/_operation.py' 2024-03-07T16:38:00,483 adding 'colossalai/shardformer/layer/dropout.py' 2024-03-07T16:38:00,485 adding 'colossalai/shardformer/layer/embedding.py' 2024-03-07T16:38:00,487 adding 'colossalai/shardformer/layer/linear.py' 2024-03-07T16:38:00,488 adding 'colossalai/shardformer/layer/loss.py' 2024-03-07T16:38:00,490 adding 'colossalai/shardformer/layer/normalization.py' 2024-03-07T16:38:00,491 adding 'colossalai/shardformer/layer/parallel_module.py' 2024-03-07T16:38:00,494 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2024-03-07T16:38:00,496 adding 'colossalai/shardformer/layer/utils.py' 2024-03-07T16:38:00,498 adding 'colossalai/shardformer/modeling/__init__.py' 2024-03-07T16:38:00,503 adding 'colossalai/shardformer/modeling/bert.py' 2024-03-07T16:38:00,504 adding 'colossalai/shardformer/modeling/blip2.py' 2024-03-07T16:38:00,509 adding 'colossalai/shardformer/modeling/bloom.py' 2024-03-07T16:38:00,511 adding 'colossalai/shardformer/modeling/chatglm2.py' 2024-03-07T16:38:00,514 adding 'colossalai/shardformer/modeling/falcon.py' 2024-03-07T16:38:00,519 adding 'colossalai/shardformer/modeling/gpt2.py' 2024-03-07T16:38:00,522 adding 'colossalai/shardformer/modeling/gptj.py' 2024-03-07T16:38:00,524 adding 'colossalai/shardformer/modeling/jit.py' 2024-03-07T16:38:00,526 adding 'colossalai/shardformer/modeling/llama.py' 2024-03-07T16:38:00,528 adding 'colossalai/shardformer/modeling/mistral.py' 2024-03-07T16:38:00,531 adding 'colossalai/shardformer/modeling/opt.py' 2024-03-07T16:38:00,533 adding 'colossalai/shardformer/modeling/sam.py' 2024-03-07T16:38:00,536 adding 'colossalai/shardformer/modeling/t5.py' 2024-03-07T16:38:00,538 adding 'colossalai/shardformer/modeling/vit.py' 2024-03-07T16:38:00,542 adding 'colossalai/shardformer/modeling/whisper.py' 2024-03-07T16:38:00,544 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2024-03-07T16:38:00,545 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2024-03-07T16:38:00,551 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2024-03-07T16:38:00,553 adding 'colossalai/shardformer/policies/__init__.py' 2024-03-07T16:38:00,555 adding 'colossalai/shardformer/policies/auto_policy.py' 2024-03-07T16:38:00,557 adding 'colossalai/shardformer/policies/base_policy.py' 2024-03-07T16:38:00,559 adding 'colossalai/shardformer/policies/bert.py' 2024-03-07T16:38:00,561 adding 'colossalai/shardformer/policies/blip2.py' 2024-03-07T16:38:00,563 adding 'colossalai/shardformer/policies/bloom.py' 2024-03-07T16:38:00,564 adding 'colossalai/shardformer/policies/chatglm2.py' 2024-03-07T16:38:00,566 adding 'colossalai/shardformer/policies/falcon.py' 2024-03-07T16:38:00,568 adding 'colossalai/shardformer/policies/gpt2.py' 2024-03-07T16:38:00,570 adding 'colossalai/shardformer/policies/gptj.py' 2024-03-07T16:38:00,572 adding 'colossalai/shardformer/policies/llama.py' 2024-03-07T16:38:00,574 adding 'colossalai/shardformer/policies/mistral.py' 2024-03-07T16:38:00,575 adding 'colossalai/shardformer/policies/opt.py' 2024-03-07T16:38:00,577 adding 'colossalai/shardformer/policies/sam.py' 2024-03-07T16:38:00,579 adding 'colossalai/shardformer/policies/t5.py' 2024-03-07T16:38:00,581 adding 'colossalai/shardformer/policies/vit.py' 2024-03-07T16:38:00,583 adding 'colossalai/shardformer/policies/whisper.py' 2024-03-07T16:38:00,585 adding 'colossalai/shardformer/shard/__init__.py' 2024-03-07T16:38:00,586 adding 'colossalai/shardformer/shard/shard_config.py' 2024-03-07T16:38:00,588 adding 'colossalai/shardformer/shard/sharder.py' 2024-03-07T16:38:00,591 adding 'colossalai/shardformer/shard/shardformer.py' 2024-03-07T16:38:00,592 adding 'colossalai/shardformer/shard/utils.py' 2024-03-07T16:38:00,594 adding 'colossalai/tensor/__init__.py' 2024-03-07T16:38:00,595 adding 'colossalai/tensor/colo_parameter.py' 2024-03-07T16:38:00,597 adding 'colossalai/tensor/colo_tensor.py' 2024-03-07T16:38:00,600 adding 'colossalai/tensor/comm_spec.py' 2024-03-07T16:38:00,601 adding 'colossalai/tensor/param_op_hook.py' 2024-03-07T16:38:00,605 adding 'colossalai/tensor/shape_consistency.py' 2024-03-07T16:38:00,607 adding 'colossalai/tensor/sharding_spec.py' 2024-03-07T16:38:00,610 adding 'colossalai/tensor/utils.py' 2024-03-07T16:38:00,612 adding 'colossalai/tensor/d_tensor/__init__.py' 2024-03-07T16:38:00,614 adding 'colossalai/tensor/d_tensor/api.py' 2024-03-07T16:38:00,616 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2024-03-07T16:38:00,617 adding 'colossalai/tensor/d_tensor/layout.py' 2024-03-07T16:38:00,620 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2024-03-07T16:38:00,621 adding 'colossalai/tensor/d_tensor/misc.py' 2024-03-07T16:38:00,623 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2024-03-07T16:38:00,624 adding 'colossalai/tensor/d_tensor/utils.py' 2024-03-07T16:38:00,626 adding 'colossalai/tensor/moe_tensor/__init__.py' 2024-03-07T16:38:00,627 adding 'colossalai/tensor/moe_tensor/api.py' 2024-03-07T16:38:00,628 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2024-03-07T16:38:00,630 adding 'colossalai/testing/__init__.py' 2024-03-07T16:38:00,631 adding 'colossalai/testing/comparison.py' 2024-03-07T16:38:00,633 adding 'colossalai/testing/pytest_wrapper.py' 2024-03-07T16:38:00,634 adding 'colossalai/testing/random.py' 2024-03-07T16:38:00,636 adding 'colossalai/testing/utils.py' 2024-03-07T16:38:00,637 adding 'colossalai/utils/__init__.py' 2024-03-07T16:38:00,639 adding 'colossalai/utils/common.py' 2024-03-07T16:38:00,640 adding 'colossalai/utils/memory.py' 2024-03-07T16:38:00,641 adding 'colossalai/utils/timer.py' 2024-03-07T16:38:00,643 adding 'colossalai/utils/model/__init__.py' 2024-03-07T16:38:00,644 adding 'colossalai/utils/model/utils.py' 2024-03-07T16:38:00,646 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2024-03-07T16:38:00,648 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2024-03-07T16:38:00,649 adding 'colossalai/utils/rank_recorder/__init__.py' 2024-03-07T16:38:00,651 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2024-03-07T16:38:00,653 adding 'colossalai/utils/tensor_detector/__init__.py' 2024-03-07T16:38:00,654 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2024-03-07T16:38:00,656 adding 'colossalai/zero/__init__.py' 2024-03-07T16:38:00,657 adding 'colossalai/zero/wrapper.py' 2024-03-07T16:38:00,659 adding 'colossalai/zero/gemini/__init__.py' 2024-03-07T16:38:00,664 adding 'colossalai/zero/gemini/gemini_ddp.py' 2024-03-07T16:38:00,665 adding 'colossalai/zero/gemini/gemini_hook.py' 2024-03-07T16:38:00,667 adding 'colossalai/zero/gemini/gemini_mgr.py' 2024-03-07T16:38:00,671 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2024-03-07T16:38:00,673 adding 'colossalai/zero/gemini/placement_policy.py' 2024-03-07T16:38:00,674 adding 'colossalai/zero/gemini/utils.py' 2024-03-07T16:38:00,676 adding 'colossalai/zero/gemini/chunk/__init__.py' 2024-03-07T16:38:00,679 adding 'colossalai/zero/gemini/chunk/chunk.py' 2024-03-07T16:38:00,681 adding 'colossalai/zero/gemini/chunk/manager.py' 2024-03-07T16:38:00,683 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2024-03-07T16:38:00,684 adding 'colossalai/zero/gemini/chunk/utils.py' 2024-03-07T16:38:00,686 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2024-03-07T16:38:00,687 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2024-03-07T16:38:00,689 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2024-03-07T16:38:00,690 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2024-03-07T16:38:00,691 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2024-03-07T16:38:00,693 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2024-03-07T16:38:00,694 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2024-03-07T16:38:00,695 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2024-03-07T16:38:00,697 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2024-03-07T16:38:00,698 adding 'colossalai/zero/low_level/__init__.py' 2024-03-07T16:38:00,700 adding 'colossalai/zero/low_level/_utils.py' 2024-03-07T16:38:00,705 adding 'colossalai/zero/low_level/low_level_optim.py' 2024-03-07T16:38:00,706 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2024-03-07T16:38:00,707 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2024-03-07T16:38:00,709 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2024-03-07T16:38:00,710 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2024-03-07T16:38:00,711 adding 'colossalai/zero/low_level/bookkeeping/parameter_store.py' 2024-03-07T16:38:00,713 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2024-03-07T16:38:00,716 adding 'extensions/cpu_adam/__init__.py' 2024-03-07T16:38:00,717 adding 'extensions/cpu_adam/cpu_adam_arm.py' 2024-03-07T16:38:00,718 adding 'extensions/cpu_adam/cpu_adam_x86.py' 2024-03-07T16:38:00,719 adding 'extensions/csrc/__init__.py' 2024-03-07T16:38:00,721 adding 'extensions/csrc/scaled_softmax.py' 2024-03-07T16:38:00,722 adding 'extensions/flash_attention/__init__.py' 2024-03-07T16:38:00,724 adding 'extensions/flash_attention/flash_attention_dao_cuda.py' 2024-03-07T16:38:00,725 adding 'extensions/flash_attention/flash_attention_npu.py' 2024-03-07T16:38:00,726 adding 'extensions/flash_attention/flash_attention_xformers_cuda.py' 2024-03-07T16:38:00,728 adding 'extensions/layernorm/__init__.py' 2024-03-07T16:38:00,729 adding 'extensions/layernorm/layernorm_cuda.py' 2024-03-07T16:38:00,731 adding 'extensions/moe/__init__.py' 2024-03-07T16:38:00,732 adding 'extensions/moe/moe_cuda.py' 2024-03-07T16:38:00,733 adding 'extensions/optimizer/__init__.py' 2024-03-07T16:38:00,735 adding 'extensions/optimizer/fused_optimizer_cuda.py' 2024-03-07T16:38:00,737 adding 'extensions/softmax/__init__.py' 2024-03-07T16:38:00,738 adding 'extensions/softmax/scaled_masked_softmax_cuda.py' 2024-03-07T16:38:00,739 adding 'extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-03-07T16:38:00,742 adding 'colossalai-0.3.6.dist-info/LICENSE' 2024-03-07T16:38:00,745 adding 'colossalai-0.3.6.dist-info/METADATA' 2024-03-07T16:38:00,746 adding 'colossalai-0.3.6.dist-info/WHEEL' 2024-03-07T16:38:00,747 adding 'colossalai-0.3.6.dist-info/entry_points.txt' 2024-03-07T16:38:00,748 adding 'colossalai-0.3.6.dist-info/top_level.txt' 2024-03-07T16:38:00,762 adding 'colossalai-0.3.6.dist-info/RECORD' 2024-03-07T16:38:00,786 removing build/bdist.linux-armv7l/wheel 2024-03-07T16:38:01,104 Building wheel for colossalai (setup.py): finished with status 'done' 2024-03-07T16:38:01,120 Created wheel for colossalai: filename=colossalai-0.3.6-py3-none-any.whl size=1389736 sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 2024-03-07T16:38:01,122 Stored in directory: /tmp/pip-ephem-wheel-cache-pjndjs90/wheels/64/ab/f2/c97b4d5ce3b167a60aac11212b7bdfc514c905b40c7559ed4b 2024-03-07T16:38:01,160 Successfully built colossalai 2024-03-07T16:38:01,205 Removed build tracker: '/tmp/pip-build-tracker-l2qizw93'