2023-09-30T18:28:58,171 Created temporary directory: /tmp/pip-build-tracker-4mb3t7iz 2023-09-30T18:28:58,172 Initialized build tracking at /tmp/pip-build-tracker-4mb3t7iz 2023-09-30T18:28:58,172 Created build tracker: /tmp/pip-build-tracker-4mb3t7iz 2023-09-30T18:28:58,173 Entered build tracker: /tmp/pip-build-tracker-4mb3t7iz 2023-09-30T18:28:58,173 Created temporary directory: /tmp/pip-wheel-l6g2s0qw 2023-09-30T18:28:58,176 Created temporary directory: /tmp/pip-ephem-wheel-cache-1y1w5sif 2023-09-30T18:28:58,198 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-09-30T18:28:58,202 2 location(s) to search for versions of colossalai: 2023-09-30T18:28:58,202 * https://pypi.org/simple/colossalai/ 2023-09-30T18:28:58,202 * https://www.piwheels.org/simple/colossalai/ 2023-09-30T18:28:58,202 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2023-09-30T18:28:58,203 Getting page https://pypi.org/simple/colossalai/ 2023-09-30T18:28:58,205 Found index url https://pypi.org/simple/ 2023-09-30T18:28:58,423 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2023-09-30T18:28:58,427 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2023-09-30T18:28:58,428 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2023-09-30T18:28:58,429 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2023-09-30T18:28:58,430 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2023-09-30T18:28:58,431 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2023-09-30T18:28:58,431 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2023-09-30T18:28:58,433 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2023-09-30T18:28:58,434 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2023-09-30T18:28:58,435 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2023-09-30T18:28:58,435 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2023-09-30T18:28:58,436 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2023-09-30T18:28:58,437 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2023-09-30T18:28:58,438 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2023-09-30T18:28:58,440 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2023-09-30T18:28:58,440 Getting page https://www.piwheels.org/simple/colossalai/ 2023-09-30T18:28:58,441 Found index url https://www.piwheels.org/simple/ 2023-09-30T18:28:58,599 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2023-09-30T18:28:58,603 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-09-30T18:28:58,604 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-09-30T18:28:58,604 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-09-30T18:28:58,605 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-09-30T18:28:58,605 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-09-30T18:28:58,606 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-09-30T18:28:58,606 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-09-30T18:28:58,607 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-09-30T18:28:58,607 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-09-30T18:28:58,608 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-09-30T18:28:58,608 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-09-30T18:28:58,609 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-09-30T18:28:58,610 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2023-09-30T18:28:58,611 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2023-09-30T18:28:58,632 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2023-09-30T18:28:58,651 Collecting colossalai==0.3.3 2023-09-30T18:28:58,654 Created temporary directory: /tmp/pip-unpack-t40c22b4 2023-09-30T18:28:58,793 Downloading colossalai-0.3.3.tar.gz (944 kB) 2023-09-30T18:29:00,696 Added colossalai==0.3.3 from https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz to build tracker '/tmp/pip-build-tracker-4mb3t7iz' 2023-09-30T18:29:00,698 Running setup.py (path:/tmp/pip-wheel-l6g2s0qw/colossalai_cd40739fd7f64d588c55795fb230f158/setup.py) egg_info for package colossalai 2023-09-30T18:29:00,699 Created temporary directory: /tmp/pip-pip-egg-info-rs783wu2 2023-09-30T18:29:00,700 Preparing metadata (setup.py): started 2023-09-30T18:29:00,701 Running command python setup.py egg_info 2023-09-30T18:29:01,900 running egg_info 2023-09-30T18:29:01,901 creating /tmp/pip-pip-egg-info-rs783wu2/colossalai.egg-info 2023-09-30T18:29:01,928 writing /tmp/pip-pip-egg-info-rs783wu2/colossalai.egg-info/PKG-INFO 2023-09-30T18:29:01,932 writing dependency_links to /tmp/pip-pip-egg-info-rs783wu2/colossalai.egg-info/dependency_links.txt 2023-09-30T18:29:01,933 writing entry points to /tmp/pip-pip-egg-info-rs783wu2/colossalai.egg-info/entry_points.txt 2023-09-30T18:29:01,935 writing requirements to /tmp/pip-pip-egg-info-rs783wu2/colossalai.egg-info/requires.txt 2023-09-30T18:29:01,936 writing top-level names to /tmp/pip-pip-egg-info-rs783wu2/colossalai.egg-info/top_level.txt 2023-09-30T18:29:01,937 writing manifest file '/tmp/pip-pip-egg-info-rs783wu2/colossalai.egg-info/SOURCES.txt' 2023-09-30T18:29:02,097 reading manifest file '/tmp/pip-pip-egg-info-rs783wu2/colossalai.egg-info/SOURCES.txt' 2023-09-30T18:29:02,099 reading manifest template 'MANIFEST.in' 2023-09-30T18:29:03,130 warning: no files found matching '*.tr' under directory 'colossalai' 2023-09-30T18:29:03,676 warning: no files found matching '*.cc' under directory 'colossalai' 2023-09-30T18:29:03,933 warning: no files found matching '*.pyi' under directory 'colossalai' 2023-09-30T18:29:03,941 adding license file 'LICENSE' 2023-09-30T18:29:03,968 writing manifest file '/tmp/pip-pip-egg-info-rs783wu2/colossalai.egg-info/SOURCES.txt' 2023-09-30T18:29:04,102 Preparing metadata (setup.py): finished with status 'done' 2023-09-30T18:29:04,107 Source in /tmp/pip-wheel-l6g2s0qw/colossalai_cd40739fd7f64d588c55795fb230f158 has version 0.3.3, which satisfies requirement colossalai==0.3.3 from https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz 2023-09-30T18:29:04,108 Removed colossalai==0.3.3 from https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz from build tracker '/tmp/pip-build-tracker-4mb3t7iz' 2023-09-30T18:29:04,116 Created temporary directory: /tmp/pip-unpack-ge3lnwnl 2023-09-30T18:29:04,118 Created temporary directory: /tmp/pip-unpack-5i9acee6 2023-09-30T18:29:04,134 Building wheels for collected packages: colossalai 2023-09-30T18:29:04,138 Created temporary directory: /tmp/pip-wheel-opk5k4ld 2023-09-30T18:29:04,139 Building wheel for colossalai (setup.py): started 2023-09-30T18:29:04,140 Destination directory: /tmp/pip-wheel-opk5k4ld 2023-09-30T18:29:04,141 Running command python setup.py bdist_wheel 2023-09-30T18:29:05,208 running bdist_wheel 2023-09-30T18:29:05,341 running build 2023-09-30T18:29:05,342 running build_py 2023-09-30T18:29:05,370 creating build 2023-09-30T18:29:05,370 creating build/lib 2023-09-30T18:29:05,371 creating build/lib/colossalai 2023-09-30T18:29:05,372 copying colossalai/__init__.py -> build/lib/colossalai 2023-09-30T18:29:05,374 copying colossalai/version.py -> build/lib/colossalai 2023-09-30T18:29:05,375 copying colossalai/initialize.py -> build/lib/colossalai 2023-09-30T18:29:05,378 creating build/lib/colossalai/cluster 2023-09-30T18:29:05,378 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2023-09-30T18:29:05,381 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2023-09-30T18:29:05,382 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2023-09-30T18:29:05,384 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2023-09-30T18:29:05,386 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2023-09-30T18:29:05,388 creating build/lib/colossalai/nn 2023-09-30T18:29:05,389 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2023-09-30T18:29:05,391 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2023-09-30T18:29:05,393 creating build/lib/colossalai/auto_parallel 2023-09-30T18:29:05,394 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2023-09-30T18:29:05,396 creating build/lib/colossalai/utils 2023-09-30T18:29:05,397 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2023-09-30T18:29:05,398 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2023-09-30T18:29:05,400 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2023-09-30T18:29:05,402 copying colossalai/utils/moe.py -> build/lib/colossalai/utils 2023-09-30T18:29:05,403 copying colossalai/utils/cuda.py -> build/lib/colossalai/utils 2023-09-30T18:29:05,406 creating build/lib/colossalai/device 2023-09-30T18:29:05,406 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2023-09-30T18:29:05,408 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2023-09-30T18:29:05,411 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2023-09-30T18:29:05,412 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2023-09-30T18:29:05,416 creating build/lib/colossalai/tensor 2023-09-30T18:29:05,417 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2023-09-30T18:29:05,418 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2023-09-30T18:29:05,420 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2023-09-30T18:29:05,422 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2023-09-30T18:29:05,424 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2023-09-30T18:29:05,426 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2023-09-30T18:29:05,429 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2023-09-30T18:29:05,432 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2023-09-30T18:29:05,434 creating build/lib/colossalai/interface 2023-09-30T18:29:05,435 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2023-09-30T18:29:05,437 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2023-09-30T18:29:05,438 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2023-09-30T18:29:05,441 creating build/lib/colossalai/fx 2023-09-30T18:29:05,442 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2023-09-30T18:29:05,444 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2023-09-30T18:29:05,445 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2023-09-30T18:29:05,447 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2023-09-30T18:29:05,449 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2023-09-30T18:29:05,451 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2023-09-30T18:29:05,454 creating build/lib/colossalai/_C 2023-09-30T18:29:05,455 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2023-09-30T18:29:05,456 creating build/lib/colossalai/zero 2023-09-30T18:29:05,457 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2023-09-30T18:29:05,459 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2023-09-30T18:29:05,461 creating build/lib/colossalai/cli 2023-09-30T18:29:05,462 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2023-09-30T18:29:05,464 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2023-09-30T18:29:05,466 creating build/lib/colossalai/pipeline 2023-09-30T18:29:05,466 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2023-09-30T18:29:05,468 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2023-09-30T18:29:05,470 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2023-09-30T18:29:05,473 creating build/lib/colossalai/shardformer 2023-09-30T18:29:05,473 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2023-09-30T18:29:05,475 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2023-09-30T18:29:05,477 creating build/lib/colossalai/kernel 2023-09-30T18:29:05,478 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2023-09-30T18:29:05,480 creating build/lib/colossalai/checkpoint_io 2023-09-30T18:29:05,481 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2023-09-30T18:29:05,483 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2023-09-30T18:29:05,485 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2023-09-30T18:29:05,488 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2023-09-30T18:29:05,490 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2023-09-30T18:29:05,492 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2023-09-30T18:29:05,495 creating build/lib/colossalai/booster 2023-09-30T18:29:05,496 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2023-09-30T18:29:05,498 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2023-09-30T18:29:05,500 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2023-09-30T18:29:05,503 creating build/lib/colossalai/logging 2023-09-30T18:29:05,503 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2023-09-30T18:29:05,505 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2023-09-30T18:29:05,508 creating build/lib/colossalai/_analyzer 2023-09-30T18:29:05,509 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2023-09-30T18:29:05,510 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2023-09-30T18:29:05,512 creating build/lib/colossalai/lazy 2023-09-30T18:29:05,513 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2023-09-30T18:29:05,515 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2023-09-30T18:29:05,517 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2023-09-30T18:29:05,520 creating build/lib/colossalai/amp 2023-09-30T18:29:05,520 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2023-09-30T18:29:05,523 creating build/lib/colossalai/testing 2023-09-30T18:29:05,524 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2023-09-30T18:29:05,526 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2023-09-30T18:29:05,528 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2023-09-30T18:29:05,529 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2023-09-30T18:29:05,532 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2023-09-30T18:29:05,534 creating build/lib/colossalai/legacy 2023-09-30T18:29:05,535 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2023-09-30T18:29:05,537 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2023-09-30T18:29:05,538 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2023-09-30T18:29:05,540 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2023-09-30T18:29:05,541 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2023-09-30T18:29:05,544 creating build/lib/colossalai/inference 2023-09-30T18:29:05,545 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2023-09-30T18:29:05,546 creating build/lib/colossalai/context 2023-09-30T18:29:05,547 copying colossalai/context/moe_context.py -> build/lib/colossalai/context 2023-09-30T18:29:05,549 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2023-09-30T18:29:05,551 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2023-09-30T18:29:05,552 copying colossalai/context/config.py -> build/lib/colossalai/context 2023-09-30T18:29:05,554 creating build/lib/colossalai/nn/loss 2023-09-30T18:29:05,555 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2023-09-30T18:29:05,557 copying colossalai/nn/loss/loss_moe.py -> build/lib/colossalai/nn/loss 2023-09-30T18:29:05,559 creating build/lib/colossalai/nn/layer 2023-09-30T18:29:05,560 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2023-09-30T18:29:05,562 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2023-09-30T18:29:05,564 creating build/lib/colossalai/nn/optimizer 2023-09-30T18:29:05,565 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2023-09-30T18:29:05,567 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2023-09-30T18:29:05,569 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2023-09-30T18:29:05,571 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2023-09-30T18:29:05,573 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2023-09-30T18:29:05,575 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2023-09-30T18:29:05,577 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2023-09-30T18:29:05,579 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2023-09-30T18:29:05,581 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2023-09-30T18:29:05,583 creating build/lib/colossalai/nn/lr_scheduler 2023-09-30T18:29:05,584 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2023-09-30T18:29:05,586 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2023-09-30T18:29:05,588 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2023-09-30T18:29:05,590 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2023-09-30T18:29:05,592 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2023-09-30T18:29:05,593 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2023-09-30T18:29:05,595 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2023-09-30T18:29:05,597 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2023-09-30T18:29:05,600 creating build/lib/colossalai/nn/layer/moe 2023-09-30T18:29:05,601 copying colossalai/nn/layer/moe/__init__.py -> build/lib/colossalai/nn/layer/moe 2023-09-30T18:29:05,603 copying colossalai/nn/layer/moe/layers.py -> build/lib/colossalai/nn/layer/moe 2023-09-30T18:29:05,605 copying colossalai/nn/layer/moe/routers.py -> build/lib/colossalai/nn/layer/moe 2023-09-30T18:29:05,607 copying colossalai/nn/layer/moe/utils.py -> build/lib/colossalai/nn/layer/moe 2023-09-30T18:29:05,609 copying colossalai/nn/layer/moe/experts.py -> build/lib/colossalai/nn/layer/moe 2023-09-30T18:29:05,611 copying colossalai/nn/layer/moe/checkpoint.py -> build/lib/colossalai/nn/layer/moe 2023-09-30T18:29:05,613 copying colossalai/nn/layer/moe/_operation.py -> build/lib/colossalai/nn/layer/moe 2023-09-30T18:29:05,615 creating build/lib/colossalai/auto_parallel/tensor_shard 2023-09-30T18:29:05,616 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-09-30T18:29:05,617 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-09-30T18:29:05,620 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-09-30T18:29:05,621 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-09-30T18:29:05,623 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-09-30T18:29:05,626 creating build/lib/colossalai/auto_parallel/meta_profiler 2023-09-30T18:29:05,627 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2023-09-30T18:29:05,629 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2023-09-30T18:29:05,631 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2023-09-30T18:29:05,632 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2023-09-30T18:29:05,634 creating build/lib/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:05,635 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:05,638 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:05,639 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:05,641 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:05,643 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:05,645 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:05,648 creating build/lib/colossalai/auto_parallel/pipeline_shard 2023-09-30T18:29:05,649 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2023-09-30T18:29:05,651 creating build/lib/colossalai/auto_parallel/offload 2023-09-30T18:29:05,652 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2023-09-30T18:29:05,654 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2023-09-30T18:29:05,656 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2023-09-30T18:29:05,659 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2023-09-30T18:29:05,660 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2023-09-30T18:29:05,663 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2023-09-30T18:29:05,664 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2023-09-30T18:29:05,666 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2023-09-30T18:29:05,668 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2023-09-30T18:29:05,670 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2023-09-30T18:29:05,673 creating build/lib/colossalai/auto_parallel/passes 2023-09-30T18:29:05,674 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2023-09-30T18:29:05,677 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2023-09-30T18:29:05,678 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2023-09-30T18:29:05,680 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2023-09-30T18:29:05,682 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2023-09-30T18:29:05,684 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2023-09-30T18:29:05,686 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:05,687 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:05,689 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:05,691 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:05,693 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:05,695 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:05,697 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:05,700 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-09-30T18:29:05,701 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-09-30T18:29:05,703 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-09-30T18:29:05,705 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-09-30T18:29:05,707 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-09-30T18:29:05,709 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-09-30T18:29:05,712 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,713 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,715 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,717 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,719 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,721 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,723 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,724 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,726 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,729 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,731 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,733 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,734 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,736 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,737 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,740 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,741 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,743 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,745 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,747 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,749 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,751 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,753 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,754 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,756 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,758 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,760 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,761 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:05,765 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,765 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,767 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,770 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,772 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,774 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,776 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,778 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,780 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,782 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,784 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,786 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,789 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,791 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,793 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,795 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,797 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,799 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,801 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,803 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:05,806 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:05,807 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:05,809 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:05,810 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:05,812 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:05,814 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:05,816 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:05,819 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:05,820 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:05,822 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:05,824 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:05,826 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:05,828 creating build/lib/colossalai/utils/multi_tensor_apply 2023-09-30T18:29:05,829 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2023-09-30T18:29:05,831 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2023-09-30T18:29:05,833 creating build/lib/colossalai/utils/model 2023-09-30T18:29:05,834 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2023-09-30T18:29:05,835 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2023-09-30T18:29:05,837 creating build/lib/colossalai/utils/rank_recorder 2023-09-30T18:29:05,838 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2023-09-30T18:29:05,840 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2023-09-30T18:29:05,842 creating build/lib/colossalai/utils/tensor_detector 2023-09-30T18:29:05,843 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2023-09-30T18:29:05,845 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2023-09-30T18:29:05,847 creating build/lib/colossalai/tensor/d_tensor 2023-09-30T18:29:05,848 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2023-09-30T18:29:05,850 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2023-09-30T18:29:05,851 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2023-09-30T18:29:05,853 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2023-09-30T18:29:05,855 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2023-09-30T18:29:05,856 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2023-09-30T18:29:05,859 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2023-09-30T18:29:05,861 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2023-09-30T18:29:05,864 creating build/lib/colossalai/fx/profiler 2023-09-30T18:29:05,865 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2023-09-30T18:29:05,867 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2023-09-30T18:29:05,868 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2023-09-30T18:29:05,870 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2023-09-30T18:29:05,872 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2023-09-30T18:29:05,875 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2023-09-30T18:29:05,876 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2023-09-30T18:29:05,878 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2023-09-30T18:29:05,881 creating build/lib/colossalai/fx/tracer 2023-09-30T18:29:05,882 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2023-09-30T18:29:05,884 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2023-09-30T18:29:05,886 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2023-09-30T18:29:05,887 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2023-09-30T18:29:05,889 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2023-09-30T18:29:05,891 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2023-09-30T18:29:05,893 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2023-09-30T18:29:05,895 creating build/lib/colossalai/fx/codegen 2023-09-30T18:29:05,896 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2023-09-30T18:29:05,898 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2023-09-30T18:29:05,901 creating build/lib/colossalai/fx/passes 2023-09-30T18:29:05,902 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2023-09-30T18:29:05,904 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2023-09-30T18:29:05,906 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2023-09-30T18:29:05,908 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2023-09-30T18:29:05,910 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2023-09-30T18:29:05,912 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2023-09-30T18:29:05,914 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2023-09-30T18:29:05,917 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2023-09-30T18:29:05,919 creating build/lib/colossalai/fx/profiler/experimental 2023-09-30T18:29:05,920 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2023-09-30T18:29:05,922 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2023-09-30T18:29:05,924 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2023-09-30T18:29:05,925 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2023-09-30T18:29:05,927 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2023-09-30T18:29:05,930 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:05,931 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:05,932 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:05,934 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:05,936 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:05,938 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:05,940 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:05,941 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:05,943 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:05,945 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:05,946 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:05,948 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:05,950 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:05,951 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:05,953 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:05,955 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:05,957 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:05,958 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:05,960 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:05,962 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:05,963 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:05,965 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:05,967 creating build/lib/colossalai/fx/tracer/meta_patch 2023-09-30T18:29:05,968 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2023-09-30T18:29:05,970 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2023-09-30T18:29:05,971 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2023-09-30T18:29:05,973 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:05,974 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:05,977 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:05,978 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:05,981 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:05,982 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:05,984 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:05,986 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:05,987 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:05,990 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:05,991 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:05,992 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:05,995 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:05,996 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:05,998 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:05,999 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:06,001 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:06,003 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:06,005 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-09-30T18:29:06,006 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-09-30T18:29:06,008 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-09-30T18:29:06,010 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-09-30T18:29:06,011 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-09-30T18:29:06,013 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-09-30T18:29:06,015 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-09-30T18:29:06,016 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-09-30T18:29:06,018 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-09-30T18:29:06,020 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-09-30T18:29:06,021 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-09-30T18:29:06,024 creating build/lib/colossalai/zero/gemini 2023-09-30T18:29:06,025 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2023-09-30T18:29:06,027 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2023-09-30T18:29:06,029 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2023-09-30T18:29:06,031 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2023-09-30T18:29:06,034 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2023-09-30T18:29:06,036 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2023-09-30T18:29:06,038 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2023-09-30T18:29:06,040 copying colossalai/zero/gemini/colo_init_context.py -> build/lib/colossalai/zero/gemini 2023-09-30T18:29:06,042 creating build/lib/colossalai/zero/low_level 2023-09-30T18:29:06,043 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2023-09-30T18:29:06,045 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2023-09-30T18:29:06,047 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2023-09-30T18:29:06,050 creating build/lib/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:06,051 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:06,052 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:06,054 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:06,056 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:06,058 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:06,059 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:06,061 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:06,063 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:06,065 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:06,067 creating build/lib/colossalai/zero/gemini/chunk 2023-09-30T18:29:06,068 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2023-09-30T18:29:06,069 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2023-09-30T18:29:06,071 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2023-09-30T18:29:06,073 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2023-09-30T18:29:06,076 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2023-09-30T18:29:06,078 creating build/lib/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:06,079 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:06,081 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:06,083 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:06,085 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:06,086 copying colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:06,088 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:06,090 creating build/lib/colossalai/cli/launcher 2023-09-30T18:29:06,091 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2023-09-30T18:29:06,093 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2023-09-30T18:29:06,095 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2023-09-30T18:29:06,097 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2023-09-30T18:29:06,099 creating build/lib/colossalai/cli/check 2023-09-30T18:29:06,100 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2023-09-30T18:29:06,102 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2023-09-30T18:29:06,105 creating build/lib/colossalai/pipeline/schedule 2023-09-30T18:29:06,105 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2023-09-30T18:29:06,107 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2023-09-30T18:29:06,109 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2023-09-30T18:29:06,112 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2023-09-30T18:29:06,114 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2023-09-30T18:29:06,116 creating build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,117 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,119 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,121 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,122 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,125 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,128 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,131 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,134 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,137 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,139 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,141 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,145 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,147 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2023-09-30T18:29:06,150 creating build/lib/colossalai/shardformer/shard 2023-09-30T18:29:06,151 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2023-09-30T18:29:06,153 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2023-09-30T18:29:06,155 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2023-09-30T18:29:06,156 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2023-09-30T18:29:06,158 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2023-09-30T18:29:06,160 creating build/lib/colossalai/shardformer/layer 2023-09-30T18:29:06,161 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2023-09-30T18:29:06,163 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2023-09-30T18:29:06,165 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2023-09-30T18:29:06,167 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2023-09-30T18:29:06,169 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2023-09-30T18:29:06,172 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2023-09-30T18:29:06,173 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2023-09-30T18:29:06,176 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2023-09-30T18:29:06,179 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2023-09-30T18:29:06,183 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2023-09-30T18:29:06,187 creating build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,188 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,190 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,193 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,195 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,197 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,200 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,203 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,206 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,208 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,211 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,214 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,217 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,220 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,223 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2023-09-30T18:29:06,227 creating build/lib/colossalai/kernel/triton 2023-09-30T18:29:06,228 copying colossalai/kernel/triton/rotary_embedding_kernel.py -> build/lib/colossalai/kernel/triton 2023-09-30T18:29:06,231 copying colossalai/kernel/triton/fused_layernorm.py -> build/lib/colossalai/kernel/triton 2023-09-30T18:29:06,233 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2023-09-30T18:29:06,235 copying colossalai/kernel/triton/gptq_triton.py -> build/lib/colossalai/kernel/triton 2023-09-30T18:29:06,238 copying colossalai/kernel/triton/copy_kv_cache_dest.py -> build/lib/colossalai/kernel/triton 2023-09-30T18:29:06,240 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2023-09-30T18:29:06,243 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2023-09-30T18:29:06,245 copying colossalai/kernel/triton/context_attention.py -> build/lib/colossalai/kernel/triton 2023-09-30T18:29:06,248 copying colossalai/kernel/triton/token_attention_kernel.py -> build/lib/colossalai/kernel/triton 2023-09-30T18:29:06,251 copying colossalai/kernel/triton/self_attention_nofusion.py -> build/lib/colossalai/kernel/triton 2023-09-30T18:29:06,254 copying colossalai/kernel/triton/rms_norm.py -> build/lib/colossalai/kernel/triton 2023-09-30T18:29:06,257 creating build/lib/colossalai/kernel/jit 2023-09-30T18:29:06,258 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2023-09-30T18:29:06,260 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2023-09-30T18:29:06,262 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2023-09-30T18:29:06,265 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2023-09-30T18:29:06,267 creating build/lib/colossalai/kernel/cuda_native 2023-09-30T18:29:06,268 copying colossalai/kernel/cuda_native/layer_norm.py -> build/lib/colossalai/kernel/cuda_native 2023-09-30T18:29:06,271 copying colossalai/kernel/cuda_native/__init__.py -> build/lib/colossalai/kernel/cuda_native 2023-09-30T18:29:06,273 copying colossalai/kernel/cuda_native/scaled_softmax.py -> build/lib/colossalai/kernel/cuda_native 2023-09-30T18:29:06,276 copying colossalai/kernel/cuda_native/multihead_attention.py -> build/lib/colossalai/kernel/cuda_native 2023-09-30T18:29:06,279 creating build/lib/colossalai/kernel/op_builder 2023-09-30T18:29:06,279 copying colossalai/kernel/op_builder/fused_optim.py -> build/lib/colossalai/kernel/op_builder 2023-09-30T18:29:06,281 copying colossalai/kernel/op_builder/cpu_adam.py -> build/lib/colossalai/kernel/op_builder 2023-09-30T18:29:06,283 copying colossalai/kernel/op_builder/__init__.py -> build/lib/colossalai/kernel/op_builder 2023-09-30T18:29:06,285 copying colossalai/kernel/op_builder/moe.py -> build/lib/colossalai/kernel/op_builder 2023-09-30T18:29:06,286 copying colossalai/kernel/op_builder/gptq.py -> build/lib/colossalai/kernel/op_builder 2023-09-30T18:29:06,288 copying colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/lib/colossalai/kernel/op_builder 2023-09-30T18:29:06,289 copying colossalai/kernel/op_builder/multi_head_attn.py -> build/lib/colossalai/kernel/op_builder 2023-09-30T18:29:06,291 copying colossalai/kernel/op_builder/utils.py -> build/lib/colossalai/kernel/op_builder 2023-09-30T18:29:06,293 copying colossalai/kernel/op_builder/layernorm.py -> build/lib/colossalai/kernel/op_builder 2023-09-30T18:29:06,295 copying colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/colossalai/kernel/op_builder 2023-09-30T18:29:06,296 copying colossalai/kernel/op_builder/builder.py -> build/lib/colossalai/kernel/op_builder 2023-09-30T18:29:06,299 creating build/lib/colossalai/kernel/cuda_native/mha 2023-09-30T18:29:06,300 copying colossalai/kernel/cuda_native/mha/mem_eff_attn.py -> build/lib/colossalai/kernel/cuda_native/mha 2023-09-30T18:29:06,302 copying colossalai/kernel/cuda_native/mha/__init__.py -> build/lib/colossalai/kernel/cuda_native/mha 2023-09-30T18:29:06,304 copying colossalai/kernel/cuda_native/mha/mha.py -> build/lib/colossalai/kernel/cuda_native/mha 2023-09-30T18:29:06,306 copying colossalai/kernel/cuda_native/mha/flash_attn_2.py -> build/lib/colossalai/kernel/cuda_native/mha 2023-09-30T18:29:06,307 copying colossalai/kernel/cuda_native/mha/utils.py -> build/lib/colossalai/kernel/cuda_native/mha 2023-09-30T18:29:06,310 creating build/lib/colossalai/booster/plugin 2023-09-30T18:29:06,311 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2023-09-30T18:29:06,312 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2023-09-30T18:29:06,315 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2023-09-30T18:29:06,318 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2023-09-30T18:29:06,319 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2023-09-30T18:29:06,321 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2023-09-30T18:29:06,323 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2023-09-30T18:29:06,325 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2023-09-30T18:29:06,328 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2023-09-30T18:29:06,330 creating build/lib/colossalai/booster/mixed_precision 2023-09-30T18:29:06,331 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2023-09-30T18:29:06,333 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2023-09-30T18:29:06,335 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2023-09-30T18:29:06,337 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2023-09-30T18:29:06,338 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2023-09-30T18:29:06,340 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2023-09-30T18:29:06,342 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2023-09-30T18:29:06,344 creating build/lib/colossalai/_analyzer/_subclasses 2023-09-30T18:29:06,345 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2023-09-30T18:29:06,347 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2023-09-30T18:29:06,349 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2023-09-30T18:29:06,350 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2023-09-30T18:29:06,353 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2023-09-30T18:29:06,356 creating build/lib/colossalai/_analyzer/fx 2023-09-30T18:29:06,357 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2023-09-30T18:29:06,359 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2023-09-30T18:29:06,360 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2023-09-30T18:29:06,362 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2023-09-30T18:29:06,365 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2023-09-30T18:29:06,368 creating build/lib/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:06,368 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:06,370 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:06,372 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:06,374 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:06,376 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:06,379 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:06,381 creating build/lib/colossalai/_analyzer/fx/passes 2023-09-30T18:29:06,382 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2023-09-30T18:29:06,383 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2023-09-30T18:29:06,386 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2023-09-30T18:29:06,389 creating build/lib/colossalai/amp/naive_amp 2023-09-30T18:29:06,389 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2023-09-30T18:29:06,391 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2023-09-30T18:29:06,394 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2023-09-30T18:29:06,395 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2023-09-30T18:29:06,396 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2023-09-30T18:29:06,398 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2023-09-30T18:29:06,400 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2023-09-30T18:29:06,402 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2023-09-30T18:29:06,403 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2023-09-30T18:29:06,405 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2023-09-30T18:29:06,407 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2023-09-30T18:29:06,409 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2023-09-30T18:29:06,411 creating build/lib/colossalai/legacy/nn 2023-09-30T18:29:06,412 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2023-09-30T18:29:06,414 creating build/lib/colossalai/legacy/utils 2023-09-30T18:29:06,414 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2023-09-30T18:29:06,417 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2023-09-30T18:29:06,419 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2023-09-30T18:29:06,421 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2023-09-30T18:29:06,423 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2023-09-30T18:29:06,425 creating build/lib/colossalai/legacy/tensor 2023-09-30T18:29:06,426 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2023-09-30T18:29:06,428 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2023-09-30T18:29:06,429 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2023-09-30T18:29:06,431 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2023-09-30T18:29:06,433 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2023-09-30T18:29:06,435 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2023-09-30T18:29:06,436 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2023-09-30T18:29:06,438 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2023-09-30T18:29:06,441 creating build/lib/colossalai/legacy/zero 2023-09-30T18:29:06,441 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2023-09-30T18:29:06,444 creating build/lib/colossalai/legacy/pipeline 2023-09-30T18:29:06,444 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2023-09-30T18:29:06,446 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2023-09-30T18:29:06,448 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2023-09-30T18:29:06,450 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2023-09-30T18:29:06,452 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2023-09-30T18:29:06,455 creating build/lib/colossalai/legacy/engine 2023-09-30T18:29:06,455 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2023-09-30T18:29:06,458 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2023-09-30T18:29:06,460 creating build/lib/colossalai/legacy/builder 2023-09-30T18:29:06,461 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2023-09-30T18:29:06,462 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2023-09-30T18:29:06,464 creating build/lib/colossalai/legacy/trainer 2023-09-30T18:29:06,465 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2023-09-30T18:29:06,468 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2023-09-30T18:29:06,470 creating build/lib/colossalai/legacy/amp 2023-09-30T18:29:06,471 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2023-09-30T18:29:06,473 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2023-09-30T18:29:06,475 creating build/lib/colossalai/legacy/registry 2023-09-30T18:29:06,475 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2023-09-30T18:29:06,477 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2023-09-30T18:29:06,479 creating build/lib/colossalai/legacy/context 2023-09-30T18:29:06,480 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2023-09-30T18:29:06,482 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2023-09-30T18:29:06,484 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2023-09-30T18:29:06,486 creating build/lib/colossalai/legacy/communication 2023-09-30T18:29:06,487 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2023-09-30T18:29:06,489 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2023-09-30T18:29:06,491 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2023-09-30T18:29:06,492 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2023-09-30T18:29:06,494 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2023-09-30T18:29:06,496 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2023-09-30T18:29:06,499 creating build/lib/colossalai/legacy/nn/_ops 2023-09-30T18:29:06,500 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2023-09-30T18:29:06,502 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2023-09-30T18:29:06,505 creating build/lib/colossalai/legacy/nn/loss 2023-09-30T18:29:06,506 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2023-09-30T18:29:06,509 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2023-09-30T18:29:06,510 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2023-09-30T18:29:06,513 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2023-09-30T18:29:06,515 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2023-09-30T18:29:06,518 creating build/lib/colossalai/legacy/nn/parallel 2023-09-30T18:29:06,519 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2023-09-30T18:29:06,521 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2023-09-30T18:29:06,523 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2023-09-30T18:29:06,526 creating build/lib/colossalai/legacy/nn/layer 2023-09-30T18:29:06,527 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2023-09-30T18:29:06,529 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2023-09-30T18:29:06,532 creating build/lib/colossalai/legacy/nn/metric 2023-09-30T18:29:06,533 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2023-09-30T18:29:06,535 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2023-09-30T18:29:06,537 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2023-09-30T18:29:06,539 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2023-09-30T18:29:06,541 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2023-09-30T18:29:06,543 creating build/lib/colossalai/legacy/nn/parallel/layers 2023-09-30T18:29:06,545 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2023-09-30T18:29:06,547 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2023-09-30T18:29:06,549 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2023-09-30T18:29:06,551 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2023-09-30T18:29:06,553 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2023-09-30T18:29:06,556 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:06,557 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:06,559 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:06,561 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:06,564 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:06,566 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:06,568 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:06,571 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:06,573 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:06,575 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:06,577 creating build/lib/colossalai/legacy/nn/layer/wrapper 2023-09-30T18:29:06,579 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2023-09-30T18:29:06,580 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2023-09-30T18:29:06,583 creating build/lib/colossalai/legacy/nn/layer/utils 2023-09-30T18:29:06,584 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2023-09-30T18:29:06,586 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2023-09-30T18:29:06,588 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2023-09-30T18:29:06,589 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2023-09-30T18:29:06,591 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2023-09-30T18:29:06,593 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2023-09-30T18:29:06,596 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2023-09-30T18:29:06,600 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2023-09-30T18:29:06,601 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2023-09-30T18:29:06,603 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2023-09-30T18:29:06,605 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2023-09-30T18:29:06,607 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2023-09-30T18:29:06,610 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2023-09-30T18:29:06,611 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2023-09-30T18:29:06,613 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2023-09-30T18:29:06,615 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2023-09-30T18:29:06,618 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2023-09-30T18:29:06,621 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2023-09-30T18:29:06,622 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2023-09-30T18:29:06,624 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2023-09-30T18:29:06,625 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2023-09-30T18:29:06,628 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2023-09-30T18:29:06,632 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:06,633 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:06,635 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:06,637 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:06,639 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:06,641 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:06,643 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:06,646 creating build/lib/colossalai/legacy/nn/layer/vanilla 2023-09-30T18:29:06,647 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2023-09-30T18:29:06,649 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2023-09-30T18:29:06,652 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2023-09-30T18:29:06,653 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2023-09-30T18:29:06,655 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2023-09-30T18:29:06,657 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2023-09-30T18:29:06,659 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2023-09-30T18:29:06,662 creating build/lib/colossalai/legacy/utils/profiler 2023-09-30T18:29:06,662 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2023-09-30T18:29:06,664 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2023-09-30T18:29:06,666 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2023-09-30T18:29:06,668 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2023-09-30T18:29:06,670 creating build/lib/colossalai/legacy/utils/checkpoint 2023-09-30T18:29:06,671 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2023-09-30T18:29:06,673 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2023-09-30T18:29:06,675 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2023-09-30T18:29:06,677 creating build/lib/colossalai/legacy/utils/data_sampler 2023-09-30T18:29:06,678 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2023-09-30T18:29:06,679 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2023-09-30T18:29:06,681 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2023-09-30T18:29:06,683 creating build/lib/colossalai/legacy/utils/profiler/legacy 2023-09-30T18:29:06,684 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2023-09-30T18:29:06,686 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2023-09-30T18:29:06,688 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2023-09-30T18:29:06,690 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2023-09-30T18:29:06,692 creating build/lib/colossalai/legacy/zero/sharded_optim 2023-09-30T18:29:06,693 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2023-09-30T18:29:06,695 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2023-09-30T18:29:06,697 creating build/lib/colossalai/legacy/zero/init_ctx 2023-09-30T18:29:06,698 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2023-09-30T18:29:06,700 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2023-09-30T18:29:06,703 creating build/lib/colossalai/legacy/zero/sharded_param 2023-09-30T18:29:06,703 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2023-09-30T18:29:06,705 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2023-09-30T18:29:06,707 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2023-09-30T18:29:06,709 creating build/lib/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:06,710 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:06,713 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:06,714 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:06,716 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:06,717 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:06,720 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:06,722 creating build/lib/colossalai/legacy/zero/gemini 2023-09-30T18:29:06,723 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2023-09-30T18:29:06,726 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2023-09-30T18:29:06,728 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2023-09-30T18:29:06,729 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2023-09-30T18:29:06,731 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2023-09-30T18:29:06,732 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2023-09-30T18:29:06,735 creating build/lib/colossalai/legacy/zero/shard_utils 2023-09-30T18:29:06,736 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2023-09-30T18:29:06,738 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2023-09-30T18:29:06,739 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2023-09-30T18:29:06,741 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2023-09-30T18:29:06,742 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2023-09-30T18:29:06,744 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2023-09-30T18:29:06,745 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2023-09-30T18:29:06,747 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2023-09-30T18:29:06,749 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2023-09-30T18:29:06,750 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2023-09-30T18:29:06,752 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2023-09-30T18:29:06,754 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2023-09-30T18:29:06,755 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2023-09-30T18:29:06,757 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2023-09-30T18:29:06,759 creating build/lib/colossalai/legacy/pipeline/middleware 2023-09-30T18:29:06,760 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2023-09-30T18:29:06,762 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2023-09-30T18:29:06,764 creating build/lib/colossalai/legacy/pipeline/rpc 2023-09-30T18:29:06,765 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2023-09-30T18:29:06,767 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2023-09-30T18:29:06,771 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2023-09-30T18:29:06,773 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2023-09-30T18:29:06,776 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2023-09-30T18:29:06,777 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2023-09-30T18:29:06,779 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2023-09-30T18:29:06,781 creating build/lib/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:06,782 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:06,784 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:06,785 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:06,787 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:06,789 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:06,790 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:06,792 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:06,793 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:06,795 creating build/lib/colossalai/legacy/engine/schedule 2023-09-30T18:29:06,796 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2023-09-30T18:29:06,798 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2023-09-30T18:29:06,799 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2023-09-30T18:29:06,801 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2023-09-30T18:29:06,804 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2023-09-30T18:29:06,806 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2023-09-30T18:29:06,807 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2023-09-30T18:29:06,809 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2023-09-30T18:29:06,812 creating build/lib/colossalai/legacy/trainer/hooks 2023-09-30T18:29:06,812 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2023-09-30T18:29:06,814 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2023-09-30T18:29:06,816 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2023-09-30T18:29:06,817 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2023-09-30T18:29:06,819 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2023-09-30T18:29:06,821 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2023-09-30T18:29:06,823 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2023-09-30T18:29:06,826 creating build/lib/colossalai/legacy/amp/torch_amp 2023-09-30T18:29:06,827 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2023-09-30T18:29:06,829 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2023-09-30T18:29:06,831 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2023-09-30T18:29:06,834 creating build/lib/colossalai/legacy/amp/apex_amp 2023-09-30T18:29:06,835 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2023-09-30T18:29:06,836 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2023-09-30T18:29:06,838 creating build/lib/colossalai/legacy/amp/naive_amp 2023-09-30T18:29:06,839 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2023-09-30T18:29:06,842 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2023-09-30T18:29:06,843 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2023-09-30T18:29:06,845 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2023-09-30T18:29:06,848 creating build/lib/colossalai/legacy/context/random 2023-09-30T18:29:06,848 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2023-09-30T18:29:06,850 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2023-09-30T18:29:06,852 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2023-09-30T18:29:06,855 creating build/lib/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:06,855 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:06,857 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:06,859 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:06,861 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:06,862 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:06,865 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:06,866 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:06,868 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:06,870 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:06,872 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:06,874 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:06,876 creating build/lib/colossalai/inference/tensor_parallel 2023-09-30T18:29:06,877 copying colossalai/inference/tensor_parallel/__init__.py -> build/lib/colossalai/inference/tensor_parallel 2023-09-30T18:29:06,879 copying colossalai/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/inference/tensor_parallel 2023-09-30T18:29:06,880 copying colossalai/inference/tensor_parallel/engine.py -> build/lib/colossalai/inference/tensor_parallel 2023-09-30T18:29:06,883 copying colossalai/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/inference/tensor_parallel 2023-09-30T18:29:06,885 creating build/lib/colossalai/inference/tensor_parallel/modeling 2023-09-30T18:29:06,886 copying colossalai/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/inference/tensor_parallel/modeling 2023-09-30T18:29:06,888 copying colossalai/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/inference/tensor_parallel/modeling 2023-09-30T18:29:06,891 copying colossalai/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/inference/tensor_parallel/modeling 2023-09-30T18:29:06,892 copying colossalai/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/inference/tensor_parallel/modeling 2023-09-30T18:29:06,895 copying colossalai/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/inference/tensor_parallel/modeling 2023-09-30T18:29:06,898 creating build/lib/colossalai/inference/tensor_parallel/policies 2023-09-30T18:29:06,899 copying colossalai/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/inference/tensor_parallel/policies 2023-09-30T18:29:06,901 copying colossalai/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/inference/tensor_parallel/policies 2023-09-30T18:29:06,903 copying colossalai/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/inference/tensor_parallel/policies 2023-09-30T18:29:06,904 copying colossalai/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/inference/tensor_parallel/policies 2023-09-30T18:29:06,920 creating build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,921 copying colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,923 copying colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,926 copying colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,928 copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,931 copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,933 copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,935 copying colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,937 copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,940 copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,943 copying colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,945 copying colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,947 copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,949 copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,952 copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,954 copying colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,956 copying colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,961 copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,963 copying colossalai/kernel/cuda_native/csrc/compat.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,965 copying colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,968 copying colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,970 copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,973 copying colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,975 copying colossalai/kernel/cuda_native/csrc/type_shim.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:06,978 creating build/lib/colossalai/kernel/cuda_native/csrc/kernels 2023-09-30T18:29:06,979 creating build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:06,980 copying colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:06,983 copying colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:06,986 copying colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:06,988 copying colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:06,991 copying colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:06,993 copying colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:06,996 copying colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:06,998 copying colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:07,001 copying colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:07,003 copying colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:07,006 copying colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:07,010 copying colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:07,124 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-09-30T18:29:07,125 !! 2023-09-30T18:29:07,126 ******************************************************************************** 2023-09-30T18:29:07,126 Please avoid running ``setup.py`` directly. 2023-09-30T18:29:07,127 Instead, use pypa/build, pypa/installer or other 2023-09-30T18:29:07,127 standards-based tools. 2023-09-30T18:29:07,128 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-09-30T18:29:07,129 ******************************************************************************** 2023-09-30T18:29:07,130 !! 2023-09-30T18:29:07,131 self.initialize_options() 2023-09-30T18:29:07,152 installing to build/bdist.linux-armv7l/wheel 2023-09-30T18:29:07,152 running install 2023-09-30T18:29:07,176 running install_lib 2023-09-30T18:29:07,202 creating build/bdist.linux-armv7l 2023-09-30T18:29:07,203 creating build/bdist.linux-armv7l/wheel 2023-09-30T18:29:07,204 creating build/bdist.linux-armv7l/wheel/colossalai 2023-09-30T18:29:07,206 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-09-30T18:29:07,207 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-09-30T18:29:07,209 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-09-30T18:29:07,211 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-09-30T18:29:07,213 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-09-30T18:29:07,215 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-09-30T18:29:07,218 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2023-09-30T18:29:07,219 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2023-09-30T18:29:07,221 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2023-09-30T18:29:07,223 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-09-30T18:29:07,224 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-09-30T18:29:07,226 copying build/lib/colossalai/nn/loss/loss_moe.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-09-30T18:29:07,228 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2023-09-30T18:29:07,229 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2023-09-30T18:29:07,231 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-09-30T18:29:07,232 copying build/lib/colossalai/nn/layer/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-09-30T18:29:07,234 copying build/lib/colossalai/nn/layer/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-09-30T18:29:07,236 copying build/lib/colossalai/nn/layer/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-09-30T18:29:07,239 copying build/lib/colossalai/nn/layer/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-09-30T18:29:07,240 copying build/lib/colossalai/nn/layer/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-09-30T18:29:07,243 copying build/lib/colossalai/nn/layer/moe/checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-09-30T18:29:07,245 copying build/lib/colossalai/nn/layer/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-09-30T18:29:07,247 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2023-09-30T18:29:07,250 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-09-30T18:29:07,251 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-09-30T18:29:07,254 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-09-30T18:29:07,256 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-09-30T18:29:07,259 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-09-30T18:29:07,261 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-09-30T18:29:07,263 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-09-30T18:29:07,266 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-09-30T18:29:07,268 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-09-30T18:29:07,271 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-09-30T18:29:07,274 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-09-30T18:29:07,275 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-09-30T18:29:07,277 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-09-30T18:29:07,280 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-09-30T18:29:07,282 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-09-30T18:29:07,284 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-09-30T18:29:07,286 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-09-30T18:29:07,289 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-09-30T18:29:07,291 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-09-30T18:29:07,294 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2023-09-30T18:29:07,295 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2023-09-30T18:29:07,298 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-09-30T18:29:07,299 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:07,301 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:07,303 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:07,306 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:07,308 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:07,310 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:07,312 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-09-30T18:29:07,315 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-09-30T18:29:07,317 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-09-30T18:29:07,320 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-09-30T18:29:07,322 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-09-30T18:29:07,324 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-09-30T18:29:07,325 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-09-30T18:29:07,328 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-09-30T18:29:07,331 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-09-30T18:29:07,333 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-09-30T18:29:07,336 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-09-30T18:29:07,339 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,340 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,343 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,345 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,347 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,348 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,351 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,353 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,356 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,358 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,361 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,363 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,366 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,368 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,371 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,373 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,377 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,380 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,382 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,385 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,387 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,391 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,394 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,396 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-09-30T18:29:07,398 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,400 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,403 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,405 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,407 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,410 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,413 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,415 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,417 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,419 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,421 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,424 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,426 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,428 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,431 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,433 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,435 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,437 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,440 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,442 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,444 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,446 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,448 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,451 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-09-30T18:29:07,453 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-09-30T18:29:07,457 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-09-30T18:29:07,458 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-09-30T18:29:07,460 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-09-30T18:29:07,462 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-09-30T18:29:07,464 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-09-30T18:29:07,467 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:07,468 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:07,471 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:07,473 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:07,476 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:07,478 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:07,481 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:07,483 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:07,486 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:07,488 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:07,490 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:07,493 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-09-30T18:29:07,496 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:07,497 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:07,499 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:07,501 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:07,503 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:07,506 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:07,509 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-09-30T18:29:07,512 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2023-09-30T18:29:07,513 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2023-09-30T18:29:07,515 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-09-30T18:29:07,516 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-09-30T18:29:07,519 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-09-30T18:29:07,522 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-09-30T18:29:07,525 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-09-30T18:29:07,526 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-09-30T18:29:07,529 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-09-30T18:29:07,531 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-09-30T18:29:07,533 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-09-30T18:29:07,536 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-09-30T18:29:07,538 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-09-30T18:29:07,541 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-09-30T18:29:07,543 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-09-30T18:29:07,546 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-09-30T18:29:07,548 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-09-30T18:29:07,550 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-09-30T18:29:07,553 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-09-30T18:29:07,555 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-09-30T18:29:07,558 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2023-09-30T18:29:07,559 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-09-30T18:29:07,562 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2023-09-30T18:29:07,563 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2023-09-30T18:29:07,565 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2023-09-30T18:29:07,567 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-09-30T18:29:07,570 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-09-30T18:29:07,572 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2023-09-30T18:29:07,573 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2023-09-30T18:29:07,575 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2023-09-30T18:29:07,577 copying build/lib/colossalai/utils/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-09-30T18:29:07,580 copying build/lib/colossalai/utils/cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-09-30T18:29:07,582 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2023-09-30T18:29:07,583 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2023-09-30T18:29:07,585 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2023-09-30T18:29:07,588 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2023-09-30T18:29:07,589 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2023-09-30T18:29:07,592 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2023-09-30T18:29:07,594 creating build/bdist.linux-armv7l/wheel/colossalai/device 2023-09-30T18:29:07,596 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2023-09-30T18:29:07,598 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2023-09-30T18:29:07,601 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2023-09-30T18:29:07,603 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2023-09-30T18:29:07,606 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-09-30T18:29:07,608 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-09-30T18:29:07,610 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-09-30T18:29:07,612 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-09-30T18:29:07,615 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-09-30T18:29:07,618 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-09-30T18:29:07,621 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-09-30T18:29:07,622 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-09-30T18:29:07,624 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-09-30T18:29:07,626 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-09-30T18:29:07,629 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-09-30T18:29:07,631 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-09-30T18:29:07,633 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-09-30T18:29:07,635 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-09-30T18:29:07,637 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-09-30T18:29:07,640 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-09-30T18:29:07,643 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-09-30T18:29:07,646 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-09-30T18:29:07,648 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-09-30T18:29:07,650 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2023-09-30T18:29:07,652 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2023-09-30T18:29:07,654 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2023-09-30T18:29:07,656 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2023-09-30T18:29:07,658 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2023-09-30T18:29:07,660 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-09-30T18:29:07,662 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-09-30T18:29:07,663 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-09-30T18:29:07,665 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-09-30T18:29:07,668 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-09-30T18:29:07,670 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-09-30T18:29:07,672 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-09-30T18:29:07,675 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-09-30T18:29:07,677 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-09-30T18:29:07,680 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-09-30T18:29:07,682 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:07,683 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:07,685 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:07,688 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:07,691 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:07,693 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:07,694 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:07,696 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:07,698 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:07,700 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:07,702 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:07,704 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-09-30T18:29:07,706 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-09-30T18:29:07,708 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-09-30T18:29:07,710 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-09-30T18:29:07,712 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-09-30T18:29:07,714 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:07,715 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:07,717 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:07,719 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:07,721 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:07,723 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:07,726 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:07,728 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:07,730 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:07,732 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-09-30T18:29:07,734 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-09-30T18:29:07,737 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-09-30T18:29:07,739 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-09-30T18:29:07,741 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-09-30T18:29:07,743 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-09-30T18:29:07,746 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-09-30T18:29:07,747 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-09-30T18:29:07,750 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2023-09-30T18:29:07,751 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2023-09-30T18:29:07,753 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:07,754 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:07,756 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:07,758 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:07,760 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:07,762 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:07,764 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:07,766 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:07,767 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-09-30T18:29:07,770 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:07,771 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:07,772 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:07,775 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:07,776 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:07,779 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:07,780 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:07,782 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:07,784 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-09-30T18:29:07,786 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-09-30T18:29:07,788 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-09-30T18:29:07,791 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2023-09-30T18:29:07,792 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2023-09-30T18:29:07,795 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-09-30T18:29:07,796 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-09-30T18:29:07,799 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-09-30T18:29:07,801 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-09-30T18:29:07,803 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-09-30T18:29:07,805 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-09-30T18:29:07,808 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-09-30T18:29:07,809 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-09-30T18:29:07,811 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-09-30T18:29:07,813 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-09-30T18:29:07,816 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-09-30T18:29:07,818 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-09-30T18:29:07,821 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-09-30T18:29:07,824 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-09-30T18:29:07,826 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-09-30T18:29:07,830 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2023-09-30T18:29:07,831 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2023-09-30T18:29:07,833 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2023-09-30T18:29:07,838 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-09-30T18:29:07,841 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-09-30T18:29:07,842 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-09-30T18:29:07,845 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-09-30T18:29:07,847 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-09-30T18:29:07,850 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-09-30T18:29:07,852 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-09-30T18:29:07,855 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-09-30T18:29:07,858 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-09-30T18:29:07,861 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-09-30T18:29:07,864 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-09-30T18:29:07,867 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2023-09-30T18:29:07,868 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C 2023-09-30T18:29:07,871 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2023-09-30T18:29:07,872 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2023-09-30T18:29:07,875 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-09-30T18:29:07,876 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-09-30T18:29:07,878 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-09-30T18:29:07,881 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-09-30T18:29:07,884 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-09-30T18:29:07,887 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-09-30T18:29:07,889 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-09-30T18:29:07,892 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:07,893 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:07,895 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:07,897 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:07,899 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:07,901 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:07,903 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:07,904 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:07,906 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:07,908 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-09-30T18:29:07,910 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-09-30T18:29:07,912 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-09-30T18:29:07,913 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-09-30T18:29:07,915 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-09-30T18:29:07,916 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-09-30T18:29:07,919 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-09-30T18:29:07,921 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-09-30T18:29:07,923 copying build/lib/colossalai/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-09-30T18:29:07,926 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2023-09-30T18:29:07,927 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2023-09-30T18:29:07,929 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2023-09-30T18:29:07,931 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2023-09-30T18:29:07,934 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:07,935 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:07,937 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:07,939 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:07,941 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:07,943 copying build/lib/colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:07,944 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-09-30T18:29:07,946 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2023-09-30T18:29:07,949 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2023-09-30T18:29:07,950 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2023-09-30T18:29:07,952 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-09-30T18:29:07,953 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-09-30T18:29:07,955 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-09-30T18:29:07,957 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-09-30T18:29:07,959 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-09-30T18:29:07,962 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2023-09-30T18:29:07,962 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2023-09-30T18:29:07,965 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2023-09-30T18:29:07,966 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2023-09-30T18:29:07,968 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-09-30T18:29:07,969 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-09-30T18:29:07,975 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-09-30T18:29:07,978 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2023-09-30T18:29:07,978 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2023-09-30T18:29:07,980 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2023-09-30T18:29:07,982 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2023-09-30T18:29:07,985 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2023-09-30T18:29:07,987 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2023-09-30T18:29:07,989 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-09-30T18:29:07,992 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2023-09-30T18:29:07,993 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:07,994 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:07,996 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:08,000 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:08,001 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:08,004 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:08,007 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:08,010 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:08,013 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:08,016 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:08,018 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:08,021 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:08,024 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:08,027 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-09-30T18:29:08,029 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2023-09-30T18:29:08,030 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2023-09-30T18:29:08,032 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2023-09-30T18:29:08,034 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2023-09-30T18:29:08,036 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2023-09-30T18:29:08,037 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2023-09-30T18:29:08,039 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2023-09-30T18:29:08,041 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-09-30T18:29:08,042 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-09-30T18:29:08,044 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-09-30T18:29:08,046 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-09-30T18:29:08,048 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-09-30T18:29:08,050 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-09-30T18:29:08,052 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-09-30T18:29:08,054 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-09-30T18:29:08,056 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-09-30T18:29:08,059 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-09-30T18:29:08,061 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-09-30T18:29:08,064 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2023-09-30T18:29:08,066 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,067 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,069 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,071 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,073 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,075 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,078 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,081 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,083 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,085 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,088 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,090 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,092 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,094 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,096 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-09-30T18:29:08,099 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2023-09-30T18:29:08,101 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2023-09-30T18:29:08,102 copying build/lib/colossalai/kernel/triton/rotary_embedding_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2023-09-30T18:29:08,104 copying build/lib/colossalai/kernel/triton/fused_layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2023-09-30T18:29:08,106 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2023-09-30T18:29:08,107 copying build/lib/colossalai/kernel/triton/gptq_triton.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2023-09-30T18:29:08,110 copying build/lib/colossalai/kernel/triton/copy_kv_cache_dest.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2023-09-30T18:29:08,112 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2023-09-30T18:29:08,114 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2023-09-30T18:29:08,116 copying build/lib/colossalai/kernel/triton/context_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2023-09-30T18:29:08,118 copying build/lib/colossalai/kernel/triton/token_attention_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2023-09-30T18:29:08,120 copying build/lib/colossalai/kernel/triton/self_attention_nofusion.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2023-09-30T18:29:08,123 copying build/lib/colossalai/kernel/triton/rms_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2023-09-30T18:29:08,124 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2023-09-30T18:29:08,126 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-09-30T18:29:08,127 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-09-30T18:29:08,129 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-09-30T18:29:08,131 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-09-30T18:29:08,133 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-09-30T18:29:08,135 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-09-30T18:29:08,136 copying build/lib/colossalai/kernel/cuda_native/layer_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-09-30T18:29:08,138 copying build/lib/colossalai/kernel/cuda_native/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-09-30T18:29:08,141 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,142 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,144 copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,147 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,149 copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,151 copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,153 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,155 copying build/lib/colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,157 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels 2023-09-30T18:29:08,158 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,159 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,162 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,163 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,165 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,167 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,169 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,170 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,172 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,174 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,176 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,177 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,180 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-09-30T18:29:08,182 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,184 copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,187 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,189 copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,191 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,193 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,195 copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,197 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,200 copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,202 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,204 copying build/lib/colossalai/kernel/cuda_native/csrc/compat.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,205 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,208 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,210 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,212 copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,214 copying build/lib/colossalai/kernel/cuda_native/csrc/type_shim.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-09-30T18:29:08,216 copying build/lib/colossalai/kernel/cuda_native/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-09-30T18:29:08,219 copying build/lib/colossalai/kernel/cuda_native/multihead_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-09-30T18:29:08,222 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/mha 2023-09-30T18:29:08,222 copying build/lib/colossalai/kernel/cuda_native/mha/mem_eff_attn.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/mha 2023-09-30T18:29:08,225 copying build/lib/colossalai/kernel/cuda_native/mha/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/mha 2023-09-30T18:29:08,226 copying build/lib/colossalai/kernel/cuda_native/mha/mha.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/mha 2023-09-30T18:29:08,228 copying build/lib/colossalai/kernel/cuda_native/mha/flash_attn_2.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/mha 2023-09-30T18:29:08,230 copying build/lib/colossalai/kernel/cuda_native/mha/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/mha 2023-09-30T18:29:08,233 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-09-30T18:29:08,234 copying build/lib/colossalai/kernel/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-09-30T18:29:08,236 copying build/lib/colossalai/kernel/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-09-30T18:29:08,238 copying build/lib/colossalai/kernel/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-09-30T18:29:08,240 copying build/lib/colossalai/kernel/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-09-30T18:29:08,241 copying build/lib/colossalai/kernel/op_builder/gptq.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-09-30T18:29:08,243 copying build/lib/colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-09-30T18:29:08,245 copying build/lib/colossalai/kernel/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-09-30T18:29:08,246 copying build/lib/colossalai/kernel/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-09-30T18:29:08,248 copying build/lib/colossalai/kernel/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-09-30T18:29:08,250 copying build/lib/colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-09-30T18:29:08,252 copying build/lib/colossalai/kernel/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-09-30T18:29:08,254 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-09-30T18:29:08,255 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-09-30T18:29:08,257 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-09-30T18:29:08,259 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-09-30T18:29:08,262 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-09-30T18:29:08,264 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-09-30T18:29:08,266 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-09-30T18:29:08,269 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-09-30T18:29:08,271 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2023-09-30T18:29:08,272 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-09-30T18:29:08,273 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-09-30T18:29:08,275 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-09-30T18:29:08,278 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-09-30T18:29:08,280 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-09-30T18:29:08,282 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-09-30T18:29:08,283 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-09-30T18:29:08,286 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-09-30T18:29:08,288 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-09-30T18:29:08,290 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-09-30T18:29:08,292 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2023-09-30T18:29:08,294 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-09-30T18:29:08,294 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-09-30T18:29:08,296 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-09-30T18:29:08,298 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-09-30T18:29:08,299 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-09-30T18:29:08,301 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-09-30T18:29:08,303 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-09-30T18:29:08,305 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-09-30T18:29:08,306 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2023-09-30T18:29:08,308 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2023-09-30T18:29:08,310 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2023-09-30T18:29:08,311 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2023-09-30T18:29:08,313 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2023-09-30T18:29:08,316 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2023-09-30T18:29:08,317 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-09-30T18:29:08,318 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-09-30T18:29:08,319 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-09-30T18:29:08,321 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-09-30T18:29:08,323 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-09-30T18:29:08,326 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-09-30T18:29:08,328 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2023-09-30T18:29:08,329 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2023-09-30T18:29:08,331 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-09-30T18:29:08,332 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-09-30T18:29:08,334 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-09-30T18:29:08,336 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-09-30T18:29:08,338 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:08,339 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:08,341 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:08,343 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:08,345 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:08,347 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:08,350 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-09-30T18:29:08,351 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-09-30T18:29:08,354 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2023-09-30T18:29:08,354 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2023-09-30T18:29:08,356 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2023-09-30T18:29:08,358 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2023-09-30T18:29:08,360 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-09-30T18:29:08,363 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2023-09-30T18:29:08,364 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2023-09-30T18:29:08,366 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2023-09-30T18:29:08,368 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2023-09-30T18:29:08,370 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2023-09-30T18:29:08,371 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2023-09-30T18:29:08,373 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-09-30T18:29:08,374 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2023-09-30T18:29:08,375 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2023-09-30T18:29:08,377 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2023-09-30T18:29:08,378 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2023-09-30T18:29:08,380 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2023-09-30T18:29:08,382 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-09-30T18:29:08,383 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-09-30T18:29:08,386 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-09-30T18:29:08,386 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-09-30T18:29:08,388 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-09-30T18:29:08,390 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-09-30T18:29:08,392 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-09-30T18:29:08,394 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2023-09-30T18:29:08,395 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-09-30T18:29:08,398 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-09-30T18:29:08,399 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-09-30T18:29:08,401 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-09-30T18:29:08,403 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-09-30T18:29:08,405 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2023-09-30T18:29:08,406 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2023-09-30T18:29:08,407 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2023-09-30T18:29:08,408 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2023-09-30T18:29:08,410 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2023-09-30T18:29:08,412 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2023-09-30T18:29:08,414 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2023-09-30T18:29:08,415 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2023-09-30T18:29:08,417 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2023-09-30T18:29:08,418 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2023-09-30T18:29:08,421 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2023-09-30T18:29:08,423 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2023-09-30T18:29:08,425 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2023-09-30T18:29:08,426 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2023-09-30T18:29:08,428 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2023-09-30T18:29:08,430 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2023-09-30T18:29:08,431 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:08,433 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:08,435 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:08,437 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:08,439 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:08,441 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:08,443 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:08,445 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:08,447 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:08,449 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2023-09-30T18:29:08,451 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2023-09-30T18:29:08,453 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2023-09-30T18:29:08,455 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2023-09-30T18:29:08,457 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2023-09-30T18:29:08,458 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2023-09-30T18:29:08,460 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2023-09-30T18:29:08,462 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2023-09-30T18:29:08,464 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2023-09-30T18:29:08,465 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2023-09-30T18:29:08,466 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2023-09-30T18:29:08,469 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2023-09-30T18:29:08,470 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2023-09-30T18:29:08,472 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2023-09-30T18:29:08,474 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2023-09-30T18:29:08,475 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2023-09-30T18:29:08,476 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2023-09-30T18:29:08,478 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2023-09-30T18:29:08,481 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2023-09-30T18:29:08,485 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2023-09-30T18:29:08,486 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2023-09-30T18:29:08,487 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2023-09-30T18:29:08,489 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2023-09-30T18:29:08,492 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2023-09-30T18:29:08,494 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2023-09-30T18:29:08,496 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2023-09-30T18:29:08,498 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2023-09-30T18:29:08,499 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2023-09-30T18:29:08,501 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2023-09-30T18:29:08,502 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2023-09-30T18:29:08,505 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2023-09-30T18:29:08,508 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2023-09-30T18:29:08,509 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2023-09-30T18:29:08,511 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2023-09-30T18:29:08,512 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2023-09-30T18:29:08,515 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2023-09-30T18:29:08,518 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:08,519 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:08,521 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:08,523 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:08,525 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:08,526 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:08,528 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2023-09-30T18:29:08,531 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2023-09-30T18:29:08,532 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2023-09-30T18:29:08,533 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2023-09-30T18:29:08,536 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2023-09-30T18:29:08,537 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2023-09-30T18:29:08,539 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2023-09-30T18:29:08,541 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2023-09-30T18:29:08,544 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2023-09-30T18:29:08,546 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2023-09-30T18:29:08,548 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2023-09-30T18:29:08,549 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2023-09-30T18:29:08,551 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2023-09-30T18:29:08,553 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2023-09-30T18:29:08,555 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2023-09-30T18:29:08,557 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2023-09-30T18:29:08,557 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2023-09-30T18:29:08,561 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2023-09-30T18:29:08,561 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2023-09-30T18:29:08,563 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2023-09-30T18:29:08,565 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2023-09-30T18:29:08,567 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2023-09-30T18:29:08,569 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2023-09-30T18:29:08,570 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2023-09-30T18:29:08,572 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2023-09-30T18:29:08,574 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2023-09-30T18:29:08,576 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2023-09-30T18:29:08,578 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2023-09-30T18:29:08,580 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2023-09-30T18:29:08,582 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2023-09-30T18:29:08,585 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2023-09-30T18:29:08,586 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2023-09-30T18:29:08,588 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2023-09-30T18:29:08,589 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2023-09-30T18:29:08,592 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2023-09-30T18:29:08,594 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2023-09-30T18:29:08,596 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2023-09-30T18:29:08,597 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2023-09-30T18:29:08,600 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2023-09-30T18:29:08,602 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2023-09-30T18:29:08,604 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2023-09-30T18:29:08,605 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2023-09-30T18:29:08,606 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2023-09-30T18:29:08,608 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2023-09-30T18:29:08,610 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2023-09-30T18:29:08,612 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2023-09-30T18:29:08,613 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2023-09-30T18:29:08,615 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2023-09-30T18:29:08,617 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2023-09-30T18:29:08,619 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2023-09-30T18:29:08,621 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2023-09-30T18:29:08,622 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2023-09-30T18:29:08,624 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2023-09-30T18:29:08,625 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2023-09-30T18:29:08,627 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2023-09-30T18:29:08,630 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2023-09-30T18:29:08,631 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2023-09-30T18:29:08,633 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2023-09-30T18:29:08,636 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2023-09-30T18:29:08,637 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2023-09-30T18:29:08,639 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2023-09-30T18:29:08,641 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2023-09-30T18:29:08,643 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:08,644 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:08,647 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:08,649 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:08,650 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:08,652 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:08,655 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2023-09-30T18:29:08,657 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2023-09-30T18:29:08,658 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2023-09-30T18:29:08,661 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2023-09-30T18:29:08,662 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2023-09-30T18:29:08,664 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2023-09-30T18:29:08,666 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2023-09-30T18:29:08,667 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2023-09-30T18:29:08,670 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2023-09-30T18:29:08,671 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2023-09-30T18:29:08,673 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2023-09-30T18:29:08,675 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2023-09-30T18:29:08,677 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2023-09-30T18:29:08,678 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2023-09-30T18:29:08,680 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2023-09-30T18:29:08,682 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2023-09-30T18:29:08,684 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2023-09-30T18:29:08,687 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2023-09-30T18:29:08,688 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2023-09-30T18:29:08,690 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2023-09-30T18:29:08,691 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2023-09-30T18:29:08,693 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2023-09-30T18:29:08,695 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2023-09-30T18:29:08,697 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2023-09-30T18:29:08,698 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2023-09-30T18:29:08,700 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2023-09-30T18:29:08,702 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2023-09-30T18:29:08,705 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2023-09-30T18:29:08,707 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2023-09-30T18:29:08,709 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2023-09-30T18:29:08,710 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2023-09-30T18:29:08,711 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2023-09-30T18:29:08,714 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2023-09-30T18:29:08,716 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2023-09-30T18:29:08,718 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2023-09-30T18:29:08,721 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2023-09-30T18:29:08,722 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2023-09-30T18:29:08,724 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2023-09-30T18:29:08,727 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2023-09-30T18:29:08,729 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2023-09-30T18:29:08,732 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2023-09-30T18:29:08,733 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2023-09-30T18:29:08,735 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2023-09-30T18:29:08,737 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:08,738 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:08,740 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:08,742 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:08,744 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:08,745 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:08,748 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:08,749 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:08,751 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2023-09-30T18:29:08,754 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2023-09-30T18:29:08,755 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2023-09-30T18:29:08,757 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2023-09-30T18:29:08,759 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2023-09-30T18:29:08,761 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2023-09-30T18:29:08,764 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2023-09-30T18:29:08,766 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2023-09-30T18:29:08,767 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2023-09-30T18:29:08,769 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2023-09-30T18:29:08,772 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2023-09-30T18:29:08,773 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2023-09-30T18:29:08,775 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2023-09-30T18:29:08,777 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2023-09-30T18:29:08,778 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2023-09-30T18:29:08,781 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2023-09-30T18:29:08,783 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2023-09-30T18:29:08,784 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2023-09-30T18:29:08,786 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2023-09-30T18:29:08,788 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2023-09-30T18:29:08,790 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2023-09-30T18:29:08,791 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2023-09-30T18:29:08,794 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2023-09-30T18:29:08,796 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2023-09-30T18:29:08,798 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2023-09-30T18:29:08,800 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2023-09-30T18:29:08,804 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2023-09-30T18:29:08,805 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2023-09-30T18:29:08,808 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2023-09-30T18:29:08,809 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2023-09-30T18:29:08,810 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2023-09-30T18:29:08,812 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2023-09-30T18:29:08,815 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2023-09-30T18:29:08,816 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2023-09-30T18:29:08,818 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2023-09-30T18:29:08,819 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2023-09-30T18:29:08,821 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2023-09-30T18:29:08,822 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2023-09-30T18:29:08,825 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2023-09-30T18:29:08,827 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2023-09-30T18:29:08,828 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2023-09-30T18:29:08,831 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2023-09-30T18:29:08,832 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2023-09-30T18:29:08,834 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2023-09-30T18:29:08,836 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2023-09-30T18:29:08,837 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2023-09-30T18:29:08,839 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2023-09-30T18:29:08,841 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2023-09-30T18:29:08,842 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2023-09-30T18:29:08,844 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2023-09-30T18:29:08,846 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2023-09-30T18:29:08,848 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:08,849 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:08,851 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:08,853 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:08,855 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:08,857 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:08,859 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:08,861 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:08,863 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:08,865 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:08,867 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:08,869 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2023-09-30T18:29:08,871 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2023-09-30T18:29:08,873 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2023-09-30T18:29:08,874 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2023-09-30T18:29:08,876 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2023-09-30T18:29:08,878 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2023-09-30T18:29:08,879 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2023-09-30T18:29:08,881 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2023-09-30T18:29:08,884 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2023-09-30T18:29:08,886 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2023-09-30T18:29:08,889 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2023-09-30T18:29:08,890 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2023-09-30T18:29:08,892 creating build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel 2023-09-30T18:29:08,893 creating build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/modeling 2023-09-30T18:29:08,894 copying build/lib/colossalai/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/modeling 2023-09-30T18:29:08,896 copying build/lib/colossalai/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/modeling 2023-09-30T18:29:08,898 copying build/lib/colossalai/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/modeling 2023-09-30T18:29:08,900 copying build/lib/colossalai/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/modeling 2023-09-30T18:29:08,903 copying build/lib/colossalai/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/modeling 2023-09-30T18:29:08,905 copying build/lib/colossalai/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel 2023-09-30T18:29:08,907 copying build/lib/colossalai/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel 2023-09-30T18:29:08,909 creating build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/policies 2023-09-30T18:29:08,910 copying build/lib/colossalai/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/policies 2023-09-30T18:29:08,912 copying build/lib/colossalai/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/policies 2023-09-30T18:29:08,914 copying build/lib/colossalai/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/policies 2023-09-30T18:29:08,915 copying build/lib/colossalai/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/policies 2023-09-30T18:29:08,917 copying build/lib/colossalai/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel 2023-09-30T18:29:08,920 copying build/lib/colossalai/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel 2023-09-30T18:29:08,922 creating build/bdist.linux-armv7l/wheel/colossalai/context 2023-09-30T18:29:08,923 copying build/lib/colossalai/context/moe_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-09-30T18:29:08,925 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-09-30T18:29:08,927 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-09-30T18:29:08,928 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-09-30T18:29:08,930 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-09-30T18:29:08,935 running install_egg_info 2023-09-30T18:29:08,965 running egg_info 2023-09-30T18:29:08,991 writing colossalai.egg-info/PKG-INFO 2023-09-30T18:29:08,994 writing dependency_links to colossalai.egg-info/dependency_links.txt 2023-09-30T18:29:08,996 writing entry points to colossalai.egg-info/entry_points.txt 2023-09-30T18:29:08,997 writing requirements to colossalai.egg-info/requires.txt 2023-09-30T18:29:08,998 writing top-level names to colossalai.egg-info/top_level.txt 2023-09-30T18:29:09,137 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2023-09-30T18:29:09,176 reading manifest template 'MANIFEST.in' 2023-09-30T18:29:10,230 warning: no files found matching '*.tr' under directory 'colossalai' 2023-09-30T18:29:10,771 warning: no files found matching '*.cc' under directory 'colossalai' 2023-09-30T18:29:11,067 warning: no files found matching '*.pyi' under directory 'colossalai' 2023-09-30T18:29:11,075 adding license file 'LICENSE' 2023-09-30T18:29:11,112 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2023-09-30T18:29:11,115 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.3.3-py3.11.egg-info 2023-09-30T18:29:11,128 running install_scripts 2023-09-30T18:29:11,148 creating build/bdist.linux-armv7l/wheel/colossalai-0.3.3.dist-info/WHEEL 2023-09-30T18:29:11,151 creating '/tmp/pip-wheel-opk5k4ld/colossalai-0.3.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-09-30T18:29:11,154 adding 'colossalai/__init__.py' 2023-09-30T18:29:11,156 adding 'colossalai/initialize.py' 2023-09-30T18:29:11,157 adding 'colossalai/version.py' 2023-09-30T18:29:11,159 adding 'colossalai/_C/__init__.py' 2023-09-30T18:29:11,160 adding 'colossalai/_analyzer/__init__.py' 2023-09-30T18:29:11,161 adding 'colossalai/_analyzer/envs.py' 2023-09-30T18:29:11,163 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2023-09-30T18:29:11,166 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2023-09-30T18:29:11,167 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2023-09-30T18:29:11,170 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2023-09-30T18:29:11,172 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2023-09-30T18:29:11,173 adding 'colossalai/_analyzer/fx/__init__.py' 2023-09-30T18:29:11,176 adding 'colossalai/_analyzer/fx/codegen.py' 2023-09-30T18:29:11,178 adding 'colossalai/_analyzer/fx/graph_module.py' 2023-09-30T18:29:11,179 adding 'colossalai/_analyzer/fx/node_util.py' 2023-09-30T18:29:11,180 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2023-09-30T18:29:11,182 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2023-09-30T18:29:11,184 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2023-09-30T18:29:11,185 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2023-09-30T18:29:11,187 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2023-09-30T18:29:11,188 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2023-09-30T18:29:11,190 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2023-09-30T18:29:11,191 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2023-09-30T18:29:11,192 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2023-09-30T18:29:11,194 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2023-09-30T18:29:11,196 adding 'colossalai/amp/__init__.py' 2023-09-30T18:29:11,198 adding 'colossalai/amp/naive_amp/__init__.py' 2023-09-30T18:29:11,199 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2023-09-30T18:29:11,201 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2023-09-30T18:29:11,202 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2023-09-30T18:29:11,203 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2023-09-30T18:29:11,204 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2023-09-30T18:29:11,206 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2023-09-30T18:29:11,207 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2023-09-30T18:29:11,208 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2023-09-30T18:29:11,209 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2023-09-30T18:29:11,211 adding 'colossalai/auto_parallel/__init__.py' 2023-09-30T18:29:11,213 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2023-09-30T18:29:11,214 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2023-09-30T18:29:11,216 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2023-09-30T18:29:11,217 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2023-09-30T18:29:11,219 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2023-09-30T18:29:11,221 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2023-09-30T18:29:11,222 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2023-09-30T18:29:11,224 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2023-09-30T18:29:11,225 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2023-09-30T18:29:11,226 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2023-09-30T18:29:11,228 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2023-09-30T18:29:11,229 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2023-09-30T18:29:11,231 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2023-09-30T18:29:11,232 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2023-09-30T18:29:11,234 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2023-09-30T18:29:11,236 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2023-09-30T18:29:11,237 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2023-09-30T18:29:11,239 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2023-09-30T18:29:11,241 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2023-09-30T18:29:11,242 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2023-09-30T18:29:11,243 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2023-09-30T18:29:11,245 adding 'colossalai/auto_parallel/offload/__init__.py' 2023-09-30T18:29:11,246 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2023-09-30T18:29:11,248 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2023-09-30T18:29:11,249 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2023-09-30T18:29:11,250 adding 'colossalai/auto_parallel/offload/region.py' 2023-09-30T18:29:11,253 adding 'colossalai/auto_parallel/offload/region_manager.py' 2023-09-30T18:29:11,254 adding 'colossalai/auto_parallel/offload/runtime.py' 2023-09-30T18:29:11,256 adding 'colossalai/auto_parallel/offload/solver.py' 2023-09-30T18:29:11,259 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2023-09-30T18:29:11,260 adding 'colossalai/auto_parallel/offload/util.py' 2023-09-30T18:29:11,261 adding 'colossalai/auto_parallel/passes/__init__.py' 2023-09-30T18:29:11,263 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2023-09-30T18:29:11,264 adding 'colossalai/auto_parallel/passes/constants.py' 2023-09-30T18:29:11,265 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2023-09-30T18:29:11,267 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2023-09-30T18:29:11,270 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2023-09-30T18:29:11,271 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2023-09-30T18:29:11,273 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2023-09-30T18:29:11,274 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2023-09-30T18:29:11,276 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2023-09-30T18:29:11,277 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2023-09-30T18:29:11,279 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2023-09-30T18:29:11,281 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2023-09-30T18:29:11,283 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2023-09-30T18:29:11,284 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2023-09-30T18:29:11,285 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2023-09-30T18:29:11,287 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2023-09-30T18:29:11,288 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2023-09-30T18:29:11,289 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2023-09-30T18:29:11,291 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2023-09-30T18:29:11,292 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2023-09-30T18:29:11,294 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2023-09-30T18:29:11,295 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2023-09-30T18:29:11,297 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2023-09-30T18:29:11,299 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2023-09-30T18:29:11,302 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2023-09-30T18:29:11,303 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2023-09-30T18:29:11,304 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2023-09-30T18:29:11,306 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2023-09-30T18:29:11,307 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2023-09-30T18:29:11,308 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2023-09-30T18:29:11,309 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2023-09-30T18:29:11,311 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2023-09-30T18:29:11,312 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2023-09-30T18:29:11,313 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2023-09-30T18:29:11,315 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2023-09-30T18:29:11,316 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2023-09-30T18:29:11,317 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2023-09-30T18:29:11,318 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2023-09-30T18:29:11,320 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2023-09-30T18:29:11,322 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2023-09-30T18:29:11,323 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2023-09-30T18:29:11,325 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2023-09-30T18:29:11,327 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2023-09-30T18:29:11,328 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2023-09-30T18:29:11,330 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2023-09-30T18:29:11,331 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2023-09-30T18:29:11,334 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2023-09-30T18:29:11,336 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2023-09-30T18:29:11,337 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2023-09-30T18:29:11,338 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2023-09-30T18:29:11,340 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2023-09-30T18:29:11,342 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2023-09-30T18:29:11,344 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2023-09-30T18:29:11,345 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2023-09-30T18:29:11,346 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2023-09-30T18:29:11,348 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2023-09-30T18:29:11,349 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2023-09-30T18:29:11,351 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2023-09-30T18:29:11,353 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2023-09-30T18:29:11,354 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2023-09-30T18:29:11,357 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2023-09-30T18:29:11,358 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2023-09-30T18:29:11,360 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2023-09-30T18:29:11,362 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2023-09-30T18:29:11,364 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2023-09-30T18:29:11,365 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2023-09-30T18:29:11,367 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2023-09-30T18:29:11,369 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2023-09-30T18:29:11,370 adding 'colossalai/booster/__init__.py' 2023-09-30T18:29:11,371 adding 'colossalai/booster/accelerator.py' 2023-09-30T18:29:11,373 adding 'colossalai/booster/booster.py' 2023-09-30T18:29:11,375 adding 'colossalai/booster/mixed_precision/__init__.py' 2023-09-30T18:29:11,376 adding 'colossalai/booster/mixed_precision/bf16.py' 2023-09-30T18:29:11,378 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2023-09-30T18:29:11,379 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2023-09-30T18:29:11,380 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2023-09-30T18:29:11,381 adding 'colossalai/booster/mixed_precision/fp8.py' 2023-09-30T18:29:11,382 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2023-09-30T18:29:11,384 adding 'colossalai/booster/plugin/__init__.py' 2023-09-30T18:29:11,385 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2023-09-30T18:29:11,388 adding 'colossalai/booster/plugin/gemini_plugin.py' 2023-09-30T18:29:11,391 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2023-09-30T18:29:11,393 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2023-09-30T18:29:11,394 adding 'colossalai/booster/plugin/plugin_base.py' 2023-09-30T18:29:11,395 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2023-09-30T18:29:11,397 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2023-09-30T18:29:11,398 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2023-09-30T18:29:11,400 adding 'colossalai/checkpoint_io/__init__.py' 2023-09-30T18:29:11,402 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2023-09-30T18:29:11,403 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2023-09-30T18:29:11,407 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2023-09-30T18:29:11,408 adding 'colossalai/checkpoint_io/index_file.py' 2023-09-30T18:29:11,412 adding 'colossalai/checkpoint_io/utils.py' 2023-09-30T18:29:11,414 adding 'colossalai/cli/__init__.py' 2023-09-30T18:29:11,415 adding 'colossalai/cli/cli.py' 2023-09-30T18:29:11,416 adding 'colossalai/cli/check/__init__.py' 2023-09-30T18:29:11,418 adding 'colossalai/cli/check/check_installation.py' 2023-09-30T18:29:11,420 adding 'colossalai/cli/launcher/__init__.py' 2023-09-30T18:29:11,421 adding 'colossalai/cli/launcher/hostinfo.py' 2023-09-30T18:29:11,423 adding 'colossalai/cli/launcher/multinode_runner.py' 2023-09-30T18:29:11,425 adding 'colossalai/cli/launcher/run.py' 2023-09-30T18:29:11,426 adding 'colossalai/cluster/__init__.py' 2023-09-30T18:29:11,428 adding 'colossalai/cluster/device_mesh_manager.py' 2023-09-30T18:29:11,429 adding 'colossalai/cluster/dist_coordinator.py' 2023-09-30T18:29:11,431 adding 'colossalai/cluster/process_group_manager.py' 2023-09-30T18:29:11,432 adding 'colossalai/cluster/process_group_mesh.py' 2023-09-30T18:29:11,434 adding 'colossalai/context/__init__.py' 2023-09-30T18:29:11,435 adding 'colossalai/context/config.py' 2023-09-30T18:29:11,437 adding 'colossalai/context/moe_context.py' 2023-09-30T18:29:11,438 adding 'colossalai/context/singleton_meta.py' 2023-09-30T18:29:11,439 adding 'colossalai/device/__init__.py' 2023-09-30T18:29:11,442 adding 'colossalai/device/alpha_beta_profiler.py' 2023-09-30T18:29:11,443 adding 'colossalai/device/calc_pipeline_strategy.py' 2023-09-30T18:29:11,446 adding 'colossalai/device/device_mesh.py' 2023-09-30T18:29:11,448 adding 'colossalai/fx/__init__.py' 2023-09-30T18:29:11,449 adding 'colossalai/fx/_compatibility.py' 2023-09-30T18:29:11,452 adding 'colossalai/fx/_meta_regist_12.py' 2023-09-30T18:29:11,453 adding 'colossalai/fx/_meta_regist_13.py' 2023-09-30T18:29:11,455 adding 'colossalai/fx/graph_module.py' 2023-09-30T18:29:11,456 adding 'colossalai/fx/proxy.py' 2023-09-30T18:29:11,458 adding 'colossalai/fx/codegen/__init__.py' 2023-09-30T18:29:11,462 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2023-09-30T18:29:11,464 adding 'colossalai/fx/passes/__init__.py' 2023-09-30T18:29:11,466 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2023-09-30T18:29:11,468 adding 'colossalai/fx/passes/concrete_info_prop.py' 2023-09-30T18:29:11,470 adding 'colossalai/fx/passes/meta_info_prop.py' 2023-09-30T18:29:11,473 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2023-09-30T18:29:11,474 adding 'colossalai/fx/passes/shard_1d_pass.py' 2023-09-30T18:29:11,476 adding 'colossalai/fx/passes/split_module.py' 2023-09-30T18:29:11,478 adding 'colossalai/fx/passes/utils.py' 2023-09-30T18:29:11,480 adding 'colossalai/fx/profiler/__init__.py' 2023-09-30T18:29:11,481 adding 'colossalai/fx/profiler/constants.py' 2023-09-30T18:29:11,482 adding 'colossalai/fx/profiler/dataflow.py' 2023-09-30T18:29:11,483 adding 'colossalai/fx/profiler/memory_utils.py' 2023-09-30T18:29:11,485 adding 'colossalai/fx/profiler/opcount.py' 2023-09-30T18:29:11,488 adding 'colossalai/fx/profiler/profiler.py' 2023-09-30T18:29:11,489 adding 'colossalai/fx/profiler/shard_utils.py' 2023-09-30T18:29:11,490 adding 'colossalai/fx/profiler/tensor.py' 2023-09-30T18:29:11,492 adding 'colossalai/fx/profiler/experimental/__init__.py' 2023-09-30T18:29:11,493 adding 'colossalai/fx/profiler/experimental/constants.py' 2023-09-30T18:29:11,495 adding 'colossalai/fx/profiler/experimental/profiler.py' 2023-09-30T18:29:11,496 adding 'colossalai/fx/profiler/experimental/registry.py' 2023-09-30T18:29:11,497 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2023-09-30T18:29:11,498 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2023-09-30T18:29:11,500 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2023-09-30T18:29:11,501 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2023-09-30T18:29:11,502 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2023-09-30T18:29:11,503 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2023-09-30T18:29:11,504 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2023-09-30T18:29:11,505 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2023-09-30T18:29:11,506 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2023-09-30T18:29:11,508 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2023-09-30T18:29:11,509 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2023-09-30T18:29:11,511 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2023-09-30T18:29:11,512 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2023-09-30T18:29:11,513 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2023-09-30T18:29:11,514 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2023-09-30T18:29:11,515 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2023-09-30T18:29:11,517 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2023-09-30T18:29:11,518 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2023-09-30T18:29:11,519 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2023-09-30T18:29:11,520 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2023-09-30T18:29:11,521 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2023-09-30T18:29:11,523 adding 'colossalai/fx/tracer/__init__.py' 2023-09-30T18:29:11,525 adding 'colossalai/fx/tracer/_meta_trace.py' 2023-09-30T18:29:11,526 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2023-09-30T18:29:11,527 adding 'colossalai/fx/tracer/_tracer_utils.py' 2023-09-30T18:29:11,530 adding 'colossalai/fx/tracer/experimental.py' 2023-09-30T18:29:11,532 adding 'colossalai/fx/tracer/registry.py' 2023-09-30T18:29:11,535 adding 'colossalai/fx/tracer/tracer.py' 2023-09-30T18:29:11,536 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2023-09-30T18:29:11,538 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2023-09-30T18:29:11,539 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2023-09-30T18:29:11,540 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2023-09-30T18:29:11,542 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2023-09-30T18:29:11,543 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2023-09-30T18:29:11,544 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2023-09-30T18:29:11,545 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2023-09-30T18:29:11,547 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2023-09-30T18:29:11,548 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2023-09-30T18:29:11,549 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2023-09-30T18:29:11,551 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2023-09-30T18:29:11,552 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2023-09-30T18:29:11,553 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2023-09-30T18:29:11,554 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2023-09-30T18:29:11,556 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2023-09-30T18:29:11,557 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2023-09-30T18:29:11,558 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2023-09-30T18:29:11,559 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2023-09-30T18:29:11,561 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2023-09-30T18:29:11,562 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2023-09-30T18:29:11,563 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2023-09-30T18:29:11,564 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2023-09-30T18:29:11,566 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2023-09-30T18:29:11,567 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2023-09-30T18:29:11,568 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2023-09-30T18:29:11,569 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2023-09-30T18:29:11,571 adding 'colossalai/inference/__init__.py' 2023-09-30T18:29:11,572 adding 'colossalai/inference/tensor_parallel/__init__.py' 2023-09-30T18:29:11,574 adding 'colossalai/inference/tensor_parallel/batch_infer_state.py' 2023-09-30T18:29:11,576 adding 'colossalai/inference/tensor_parallel/engine.py' 2023-09-30T18:29:11,578 adding 'colossalai/inference/tensor_parallel/kvcache_manager.py' 2023-09-30T18:29:11,579 adding 'colossalai/inference/tensor_parallel/modeling/__init__.py' 2023-09-30T18:29:11,580 adding 'colossalai/inference/tensor_parallel/modeling/_utils.py' 2023-09-30T18:29:11,583 adding 'colossalai/inference/tensor_parallel/modeling/bloom.py' 2023-09-30T18:29:11,586 adding 'colossalai/inference/tensor_parallel/modeling/chatglm2.py' 2023-09-30T18:29:11,588 adding 'colossalai/inference/tensor_parallel/modeling/llama.py' 2023-09-30T18:29:11,590 adding 'colossalai/inference/tensor_parallel/policies/__init__.py' 2023-09-30T18:29:11,591 adding 'colossalai/inference/tensor_parallel/policies/bloom.py' 2023-09-30T18:29:11,593 adding 'colossalai/inference/tensor_parallel/policies/chatglm2.py' 2023-09-30T18:29:11,594 adding 'colossalai/inference/tensor_parallel/policies/llama.py' 2023-09-30T18:29:11,595 adding 'colossalai/interface/__init__.py' 2023-09-30T18:29:11,597 adding 'colossalai/interface/model.py' 2023-09-30T18:29:11,598 adding 'colossalai/interface/optimizer.py' 2023-09-30T18:29:11,600 adding 'colossalai/kernel/__init__.py' 2023-09-30T18:29:11,601 adding 'colossalai/kernel/cuda_native/__init__.py' 2023-09-30T18:29:11,602 adding 'colossalai/kernel/cuda_native/layer_norm.py' 2023-09-30T18:29:11,604 adding 'colossalai/kernel/cuda_native/multihead_attention.py' 2023-09-30T18:29:11,606 adding 'colossalai/kernel/cuda_native/scaled_softmax.py' 2023-09-30T18:29:11,607 adding 'colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp' 2023-09-30T18:29:11,609 adding 'colossalai/kernel/cuda_native/csrc/compat.h' 2023-09-30T18:29:11,610 adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.cpp' 2023-09-30T18:29:11,612 adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.h' 2023-09-30T18:29:11,613 adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp' 2023-09-30T18:29:11,616 adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu' 2023-09-30T18:29:11,617 adding 'colossalai/kernel/cuda_native/csrc/moe_cuda.cpp' 2023-09-30T18:29:11,620 adding 'colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu' 2023-09-30T18:29:11,621 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu' 2023-09-30T18:29:11,623 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh' 2023-09-30T18:29:11,624 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu' 2023-09-30T18:29:11,626 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu' 2023-09-30T18:29:11,628 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu' 2023-09-30T18:29:11,629 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu' 2023-09-30T18:29:11,631 adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp' 2023-09-30T18:29:11,632 adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h' 2023-09-30T18:29:11,634 adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp' 2023-09-30T18:29:11,636 adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h' 2023-09-30T18:29:11,637 adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu' 2023-09-30T18:29:11,638 adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp' 2023-09-30T18:29:11,640 adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h' 2023-09-30T18:29:11,642 adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu' 2023-09-30T18:29:11,643 adding 'colossalai/kernel/cuda_native/csrc/type_shim.h' 2023-09-30T18:29:11,646 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h' 2023-09-30T18:29:11,647 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/context.h' 2023-09-30T18:29:11,648 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h' 2023-09-30T18:29:11,649 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h' 2023-09-30T18:29:11,651 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h' 2023-09-30T18:29:11,652 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h' 2023-09-30T18:29:11,653 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h' 2023-09-30T18:29:11,655 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h' 2023-09-30T18:29:11,656 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh' 2023-09-30T18:29:11,657 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h' 2023-09-30T18:29:11,659 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h' 2023-09-30T18:29:11,660 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h' 2023-09-30T18:29:11,661 adding 'colossalai/kernel/cuda_native/mha/__init__.py' 2023-09-30T18:29:11,663 adding 'colossalai/kernel/cuda_native/mha/flash_attn_2.py' 2023-09-30T18:29:11,664 adding 'colossalai/kernel/cuda_native/mha/mem_eff_attn.py' 2023-09-30T18:29:11,665 adding 'colossalai/kernel/cuda_native/mha/mha.py' 2023-09-30T18:29:11,667 adding 'colossalai/kernel/cuda_native/mha/utils.py' 2023-09-30T18:29:11,669 adding 'colossalai/kernel/jit/__init__.py' 2023-09-30T18:29:11,670 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2023-09-30T18:29:11,671 adding 'colossalai/kernel/jit/bias_gelu.py' 2023-09-30T18:29:11,672 adding 'colossalai/kernel/jit/option.py' 2023-09-30T18:29:11,674 adding 'colossalai/kernel/op_builder/__init__.py' 2023-09-30T18:29:11,675 adding 'colossalai/kernel/op_builder/builder.py' 2023-09-30T18:29:11,676 adding 'colossalai/kernel/op_builder/cpu_adam.py' 2023-09-30T18:29:11,678 adding 'colossalai/kernel/op_builder/fused_optim.py' 2023-09-30T18:29:11,679 adding 'colossalai/kernel/op_builder/gptq.py' 2023-09-30T18:29:11,680 adding 'colossalai/kernel/op_builder/layernorm.py' 2023-09-30T18:29:11,681 adding 'colossalai/kernel/op_builder/moe.py' 2023-09-30T18:29:11,682 adding 'colossalai/kernel/op_builder/multi_head_attn.py' 2023-09-30T18:29:11,683 adding 'colossalai/kernel/op_builder/scaled_masked_softmax.py' 2023-09-30T18:29:11,684 adding 'colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py' 2023-09-30T18:29:11,686 adding 'colossalai/kernel/op_builder/utils.py' 2023-09-30T18:29:11,688 adding 'colossalai/kernel/triton/__init__.py' 2023-09-30T18:29:11,690 adding 'colossalai/kernel/triton/context_attention.py' 2023-09-30T18:29:11,691 adding 'colossalai/kernel/triton/copy_kv_cache_dest.py' 2023-09-30T18:29:11,692 adding 'colossalai/kernel/triton/fused_layernorm.py' 2023-09-30T18:29:11,694 adding 'colossalai/kernel/triton/gptq_triton.py' 2023-09-30T18:29:11,696 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2023-09-30T18:29:11,697 adding 'colossalai/kernel/triton/rms_norm.py' 2023-09-30T18:29:11,698 adding 'colossalai/kernel/triton/rotary_embedding_kernel.py' 2023-09-30T18:29:11,700 adding 'colossalai/kernel/triton/self_attention_nofusion.py' 2023-09-30T18:29:11,701 adding 'colossalai/kernel/triton/softmax.py' 2023-09-30T18:29:11,704 adding 'colossalai/kernel/triton/token_attention_kernel.py' 2023-09-30T18:29:11,705 adding 'colossalai/lazy/__init__.py' 2023-09-30T18:29:11,706 adding 'colossalai/lazy/construction.py' 2023-09-30T18:29:11,710 adding 'colossalai/lazy/lazy_init.py' 2023-09-30T18:29:11,712 adding 'colossalai/legacy/__init__.py' 2023-09-30T18:29:11,713 adding 'colossalai/legacy/constants.py' 2023-09-30T18:29:11,714 adding 'colossalai/legacy/core.py' 2023-09-30T18:29:11,715 adding 'colossalai/legacy/global_variables.py' 2023-09-30T18:29:11,718 adding 'colossalai/legacy/initialize.py' 2023-09-30T18:29:11,720 adding 'colossalai/legacy/amp/__init__.py' 2023-09-30T18:29:11,721 adding 'colossalai/legacy/amp/amp_type.py' 2023-09-30T18:29:11,722 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2023-09-30T18:29:11,724 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2023-09-30T18:29:11,725 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2023-09-30T18:29:11,727 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2023-09-30T18:29:11,729 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2023-09-30T18:29:11,730 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2023-09-30T18:29:11,732 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2023-09-30T18:29:11,735 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2023-09-30T18:29:11,737 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2023-09-30T18:29:11,739 adding 'colossalai/legacy/builder/__init__.py' 2023-09-30T18:29:11,740 adding 'colossalai/legacy/builder/builder.py' 2023-09-30T18:29:11,742 adding 'colossalai/legacy/communication/__init__.py' 2023-09-30T18:29:11,744 adding 'colossalai/legacy/communication/collective.py' 2023-09-30T18:29:11,746 adding 'colossalai/legacy/communication/p2p.py' 2023-09-30T18:29:11,749 adding 'colossalai/legacy/communication/p2p_v2.py' 2023-09-30T18:29:11,750 adding 'colossalai/legacy/communication/ring.py' 2023-09-30T18:29:11,751 adding 'colossalai/legacy/communication/utils.py' 2023-09-30T18:29:11,753 adding 'colossalai/legacy/context/__init__.py' 2023-09-30T18:29:11,756 adding 'colossalai/legacy/context/parallel_context.py' 2023-09-30T18:29:11,757 adding 'colossalai/legacy/context/parallel_mode.py' 2023-09-30T18:29:11,759 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2023-09-30T18:29:11,760 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2023-09-30T18:29:11,761 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2023-09-30T18:29:11,763 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2023-09-30T18:29:11,764 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2023-09-30T18:29:11,766 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2023-09-30T18:29:11,767 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2023-09-30T18:29:11,768 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2023-09-30T18:29:11,770 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2023-09-30T18:29:11,771 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2023-09-30T18:29:11,772 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2023-09-30T18:29:11,774 adding 'colossalai/legacy/context/random/__init__.py' 2023-09-30T18:29:11,775 adding 'colossalai/legacy/context/random/_helper.py' 2023-09-30T18:29:11,776 adding 'colossalai/legacy/context/random/seed_manager.py' 2023-09-30T18:29:11,778 adding 'colossalai/legacy/engine/__init__.py' 2023-09-30T18:29:11,780 adding 'colossalai/legacy/engine/_base_engine.py' 2023-09-30T18:29:11,782 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2023-09-30T18:29:11,784 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2023-09-30T18:29:11,786 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2023-09-30T18:29:11,787 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2023-09-30T18:29:11,789 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2023-09-30T18:29:11,790 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2023-09-30T18:29:11,791 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2023-09-30T18:29:11,793 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2023-09-30T18:29:11,794 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2023-09-30T18:29:11,795 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2023-09-30T18:29:11,797 adding 'colossalai/legacy/engine/schedule/__init__.py' 2023-09-30T18:29:11,798 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2023-09-30T18:29:11,800 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2023-09-30T18:29:11,803 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2023-09-30T18:29:11,805 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2023-09-30T18:29:11,807 adding 'colossalai/legacy/nn/__init__.py' 2023-09-30T18:29:11,808 adding 'colossalai/legacy/nn/_ops/__init__.py' 2023-09-30T18:29:11,810 adding 'colossalai/legacy/nn/_ops/_utils.py' 2023-09-30T18:29:11,812 adding 'colossalai/legacy/nn/layer/__init__.py' 2023-09-30T18:29:11,813 adding 'colossalai/legacy/nn/layer/base_layer.py' 2023-09-30T18:29:11,815 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2023-09-30T18:29:11,816 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2023-09-30T18:29:11,817 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2023-09-30T18:29:11,819 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2023-09-30T18:29:11,820 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2023-09-30T18:29:11,821 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2023-09-30T18:29:11,823 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2023-09-30T18:29:11,825 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2023-09-30T18:29:11,826 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2023-09-30T18:29:11,830 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2023-09-30T18:29:11,832 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2023-09-30T18:29:11,835 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2023-09-30T18:29:11,837 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2023-09-30T18:29:11,840 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2023-09-30T18:29:11,842 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2023-09-30T18:29:11,845 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2023-09-30T18:29:11,847 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2023-09-30T18:29:11,850 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2023-09-30T18:29:11,852 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2023-09-30T18:29:11,854 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2023-09-30T18:29:11,856 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2023-09-30T18:29:11,859 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2023-09-30T18:29:11,861 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2023-09-30T18:29:11,863 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2023-09-30T18:29:11,864 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2023-09-30T18:29:11,865 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2023-09-30T18:29:11,867 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2023-09-30T18:29:11,868 adding 'colossalai/legacy/nn/layer/utils/common.py' 2023-09-30T18:29:11,870 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2023-09-30T18:29:11,872 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2023-09-30T18:29:11,874 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2023-09-30T18:29:11,875 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2023-09-30T18:29:11,877 adding 'colossalai/legacy/nn/loss/__init__.py' 2023-09-30T18:29:11,878 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2023-09-30T18:29:11,880 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2023-09-30T18:29:11,881 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2023-09-30T18:29:11,883 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2023-09-30T18:29:11,885 adding 'colossalai/legacy/nn/metric/__init__.py' 2023-09-30T18:29:11,886 adding 'colossalai/legacy/nn/metric/_utils.py' 2023-09-30T18:29:11,887 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2023-09-30T18:29:11,888 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2023-09-30T18:29:11,889 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2023-09-30T18:29:11,891 adding 'colossalai/legacy/nn/parallel/__init__.py' 2023-09-30T18:29:11,892 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2023-09-30T18:29:11,894 adding 'colossalai/legacy/nn/parallel/reducer.py' 2023-09-30T18:29:11,896 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2023-09-30T18:29:11,897 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2023-09-30T18:29:11,898 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2023-09-30T18:29:11,899 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2023-09-30T18:29:11,901 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2023-09-30T18:29:11,903 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2023-09-30T18:29:11,904 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2023-09-30T18:29:11,907 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2023-09-30T18:29:11,909 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2023-09-30T18:29:11,911 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2023-09-30T18:29:11,912 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2023-09-30T18:29:11,913 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2023-09-30T18:29:11,915 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2023-09-30T18:29:11,916 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2023-09-30T18:29:11,918 adding 'colossalai/legacy/pipeline/__init__.py' 2023-09-30T18:29:11,919 adding 'colossalai/legacy/pipeline/layer_spec.py' 2023-09-30T18:29:11,921 adding 'colossalai/legacy/pipeline/pipelinable.py' 2023-09-30T18:29:11,922 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2023-09-30T18:29:11,924 adding 'colossalai/legacy/pipeline/utils.py' 2023-09-30T18:29:11,926 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2023-09-30T18:29:11,927 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2023-09-30T18:29:11,929 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2023-09-30T18:29:11,930 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2023-09-30T18:29:11,932 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2023-09-30T18:29:11,938 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2023-09-30T18:29:11,940 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2023-09-30T18:29:11,942 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2023-09-30T18:29:11,944 adding 'colossalai/legacy/registry/__init__.py' 2023-09-30T18:29:11,945 adding 'colossalai/legacy/registry/registry.py' 2023-09-30T18:29:11,947 adding 'colossalai/legacy/tensor/__init__.py' 2023-09-30T18:29:11,948 adding 'colossalai/legacy/tensor/compute_spec.py' 2023-09-30T18:29:11,949 adding 'colossalai/legacy/tensor/const.py' 2023-09-30T18:29:11,950 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2023-09-30T18:29:11,952 adding 'colossalai/legacy/tensor/distspec.py' 2023-09-30T18:29:11,953 adding 'colossalai/legacy/tensor/op_wrapper.py' 2023-09-30T18:29:11,955 adding 'colossalai/legacy/tensor/process_group.py' 2023-09-30T18:29:11,956 adding 'colossalai/legacy/tensor/tensor_spec.py' 2023-09-30T18:29:11,958 adding 'colossalai/legacy/trainer/__init__.py' 2023-09-30T18:29:11,960 adding 'colossalai/legacy/trainer/_trainer.py' 2023-09-30T18:29:11,961 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2023-09-30T18:29:11,963 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2023-09-30T18:29:11,964 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2023-09-30T18:29:11,965 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2023-09-30T18:29:11,967 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2023-09-30T18:29:11,969 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2023-09-30T18:29:11,971 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2023-09-30T18:29:11,972 adding 'colossalai/legacy/utils/__init__.py' 2023-09-30T18:29:11,974 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2023-09-30T18:29:11,976 adding 'colossalai/legacy/utils/checkpointing.py' 2023-09-30T18:29:11,979 adding 'colossalai/legacy/utils/common.py' 2023-09-30T18:29:11,980 adding 'colossalai/legacy/utils/memory.py' 2023-09-30T18:29:11,982 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2023-09-30T18:29:11,984 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2023-09-30T18:29:11,985 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2023-09-30T18:29:11,987 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2023-09-30T18:29:11,988 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2023-09-30T18:29:11,989 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2023-09-30T18:29:11,991 adding 'colossalai/legacy/utils/profiler/__init__.py' 2023-09-30T18:29:11,992 adding 'colossalai/legacy/utils/profiler/extention.py' 2023-09-30T18:29:11,994 adding 'colossalai/legacy/utils/profiler/profiler.py' 2023-09-30T18:29:11,996 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2023-09-30T18:29:11,997 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2023-09-30T18:29:11,999 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2023-09-30T18:29:12,000 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2023-09-30T18:29:12,002 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2023-09-30T18:29:12,003 adding 'colossalai/legacy/zero/__init__.py' 2023-09-30T18:29:12,005 adding 'colossalai/legacy/zero/gemini/__init__.py' 2023-09-30T18:29:12,006 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2023-09-30T18:29:12,008 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2023-09-30T18:29:12,009 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2023-09-30T18:29:12,011 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2023-09-30T18:29:12,012 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2023-09-30T18:29:12,014 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2023-09-30T18:29:12,015 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2023-09-30T18:29:12,016 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2023-09-30T18:29:12,017 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2023-09-30T18:29:12,019 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2023-09-30T18:29:12,020 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2023-09-30T18:29:12,022 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2023-09-30T18:29:12,023 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2023-09-30T18:29:12,025 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2023-09-30T18:29:12,027 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2023-09-30T18:29:12,028 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2023-09-30T18:29:12,029 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2023-09-30T18:29:12,030 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2023-09-30T18:29:12,032 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2023-09-30T18:29:12,033 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2023-09-30T18:29:12,035 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2023-09-30T18:29:12,037 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2023-09-30T18:29:12,040 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2023-09-30T18:29:12,041 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2023-09-30T18:29:12,043 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2023-09-30T18:29:12,045 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2023-09-30T18:29:12,047 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2023-09-30T18:29:12,049 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2023-09-30T18:29:12,050 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2023-09-30T18:29:12,052 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2023-09-30T18:29:12,053 adding 'colossalai/logging/__init__.py' 2023-09-30T18:29:12,055 adding 'colossalai/logging/logger.py' 2023-09-30T18:29:12,057 adding 'colossalai/nn/__init__.py' 2023-09-30T18:29:12,058 adding 'colossalai/nn/init.py' 2023-09-30T18:29:12,060 adding 'colossalai/nn/layer/__init__.py' 2023-09-30T18:29:12,061 adding 'colossalai/nn/layer/utils.py' 2023-09-30T18:29:12,063 adding 'colossalai/nn/layer/moe/__init__.py' 2023-09-30T18:29:12,064 adding 'colossalai/nn/layer/moe/_operation.py' 2023-09-30T18:29:12,065 adding 'colossalai/nn/layer/moe/checkpoint.py' 2023-09-30T18:29:12,067 adding 'colossalai/nn/layer/moe/experts.py' 2023-09-30T18:29:12,069 adding 'colossalai/nn/layer/moe/layers.py' 2023-09-30T18:29:12,071 adding 'colossalai/nn/layer/moe/routers.py' 2023-09-30T18:29:12,072 adding 'colossalai/nn/layer/moe/utils.py' 2023-09-30T18:29:12,074 adding 'colossalai/nn/loss/__init__.py' 2023-09-30T18:29:12,075 adding 'colossalai/nn/loss/loss_moe.py' 2023-09-30T18:29:12,076 adding 'colossalai/nn/lr_scheduler/__init__.py' 2023-09-30T18:29:12,078 adding 'colossalai/nn/lr_scheduler/cosine.py' 2023-09-30T18:29:12,079 adding 'colossalai/nn/lr_scheduler/delayed.py' 2023-09-30T18:29:12,080 adding 'colossalai/nn/lr_scheduler/linear.py' 2023-09-30T18:29:12,082 adding 'colossalai/nn/lr_scheduler/multistep.py' 2023-09-30T18:29:12,083 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2023-09-30T18:29:12,084 adding 'colossalai/nn/lr_scheduler/poly.py' 2023-09-30T18:29:12,085 adding 'colossalai/nn/lr_scheduler/torch.py' 2023-09-30T18:29:12,087 adding 'colossalai/nn/optimizer/__init__.py' 2023-09-30T18:29:12,089 adding 'colossalai/nn/optimizer/cpu_adam.py' 2023-09-30T18:29:12,090 adding 'colossalai/nn/optimizer/fused_adam.py' 2023-09-30T18:29:12,092 adding 'colossalai/nn/optimizer/fused_lamb.py' 2023-09-30T18:29:12,093 adding 'colossalai/nn/optimizer/fused_sgd.py' 2023-09-30T18:29:12,095 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2023-09-30T18:29:12,096 adding 'colossalai/nn/optimizer/lamb.py' 2023-09-30T18:29:12,098 adding 'colossalai/nn/optimizer/lars.py' 2023-09-30T18:29:12,099 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2023-09-30T18:29:12,101 adding 'colossalai/pipeline/__init__.py' 2023-09-30T18:29:12,103 adding 'colossalai/pipeline/p2p.py' 2023-09-30T18:29:12,104 adding 'colossalai/pipeline/stage_manager.py' 2023-09-30T18:29:12,105 adding 'colossalai/pipeline/schedule/__init__.py' 2023-09-30T18:29:12,107 adding 'colossalai/pipeline/schedule/_utils.py' 2023-09-30T18:29:12,108 adding 'colossalai/pipeline/schedule/base.py' 2023-09-30T18:29:12,110 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2023-09-30T18:29:12,112 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2023-09-30T18:29:12,114 adding 'colossalai/shardformer/__init__.py' 2023-09-30T18:29:12,115 adding 'colossalai/shardformer/_utils.py' 2023-09-30T18:29:12,117 adding 'colossalai/shardformer/layer/__init__.py' 2023-09-30T18:29:12,119 adding 'colossalai/shardformer/layer/_operation.py' 2023-09-30T18:29:12,121 adding 'colossalai/shardformer/layer/dropout.py' 2023-09-30T18:29:12,122 adding 'colossalai/shardformer/layer/embedding.py' 2023-09-30T18:29:12,125 adding 'colossalai/shardformer/layer/linear.py' 2023-09-30T18:29:12,126 adding 'colossalai/shardformer/layer/loss.py' 2023-09-30T18:29:12,128 adding 'colossalai/shardformer/layer/normalization.py' 2023-09-30T18:29:12,129 adding 'colossalai/shardformer/layer/parallel_module.py' 2023-09-30T18:29:12,132 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2023-09-30T18:29:12,134 adding 'colossalai/shardformer/layer/utils.py' 2023-09-30T18:29:12,135 adding 'colossalai/shardformer/modeling/__init__.py' 2023-09-30T18:29:12,140 adding 'colossalai/shardformer/modeling/bert.py' 2023-09-30T18:29:12,142 adding 'colossalai/shardformer/modeling/blip2.py' 2023-09-30T18:29:12,147 adding 'colossalai/shardformer/modeling/bloom.py' 2023-09-30T18:29:12,149 adding 'colossalai/shardformer/modeling/chatglm2.py' 2023-09-30T18:29:12,154 adding 'colossalai/shardformer/modeling/gpt2.py' 2023-09-30T18:29:12,155 adding 'colossalai/shardformer/modeling/jit.py' 2023-09-30T18:29:12,158 adding 'colossalai/shardformer/modeling/llama.py' 2023-09-30T18:29:12,161 adding 'colossalai/shardformer/modeling/opt.py' 2023-09-30T18:29:12,163 adding 'colossalai/shardformer/modeling/sam.py' 2023-09-30T18:29:12,166 adding 'colossalai/shardformer/modeling/t5.py' 2023-09-30T18:29:12,168 adding 'colossalai/shardformer/modeling/vit.py' 2023-09-30T18:29:12,173 adding 'colossalai/shardformer/modeling/whisper.py' 2023-09-30T18:29:12,175 adding 'colossalai/shardformer/policies/__init__.py' 2023-09-30T18:29:12,177 adding 'colossalai/shardformer/policies/auto_policy.py' 2023-09-30T18:29:12,178 adding 'colossalai/shardformer/policies/base_policy.py' 2023-09-30T18:29:12,181 adding 'colossalai/shardformer/policies/bert.py' 2023-09-30T18:29:12,182 adding 'colossalai/shardformer/policies/blip2.py' 2023-09-30T18:29:12,184 adding 'colossalai/shardformer/policies/bloom.py' 2023-09-30T18:29:12,186 adding 'colossalai/shardformer/policies/chatglm2.py' 2023-09-30T18:29:12,188 adding 'colossalai/shardformer/policies/gpt2.py' 2023-09-30T18:29:12,189 adding 'colossalai/shardformer/policies/llama.py' 2023-09-30T18:29:12,191 adding 'colossalai/shardformer/policies/opt.py' 2023-09-30T18:29:12,192 adding 'colossalai/shardformer/policies/sam.py' 2023-09-30T18:29:12,194 adding 'colossalai/shardformer/policies/t5.py' 2023-09-30T18:29:12,196 adding 'colossalai/shardformer/policies/vit.py' 2023-09-30T18:29:12,198 adding 'colossalai/shardformer/policies/whisper.py' 2023-09-30T18:29:12,200 adding 'colossalai/shardformer/shard/__init__.py' 2023-09-30T18:29:12,201 adding 'colossalai/shardformer/shard/shard_config.py' 2023-09-30T18:29:12,203 adding 'colossalai/shardformer/shard/sharder.py' 2023-09-30T18:29:12,204 adding 'colossalai/shardformer/shard/shardformer.py' 2023-09-30T18:29:12,205 adding 'colossalai/shardformer/shard/utils.py' 2023-09-30T18:29:12,207 adding 'colossalai/tensor/__init__.py' 2023-09-30T18:29:12,208 adding 'colossalai/tensor/colo_parameter.py' 2023-09-30T18:29:12,210 adding 'colossalai/tensor/colo_tensor.py' 2023-09-30T18:29:12,212 adding 'colossalai/tensor/comm_spec.py' 2023-09-30T18:29:12,213 adding 'colossalai/tensor/param_op_hook.py' 2023-09-30T18:29:12,217 adding 'colossalai/tensor/shape_consistency.py' 2023-09-30T18:29:12,219 adding 'colossalai/tensor/sharding_spec.py' 2023-09-30T18:29:12,221 adding 'colossalai/tensor/utils.py' 2023-09-30T18:29:12,222 adding 'colossalai/tensor/d_tensor/__init__.py' 2023-09-30T18:29:12,224 adding 'colossalai/tensor/d_tensor/api.py' 2023-09-30T18:29:12,226 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2023-09-30T18:29:12,227 adding 'colossalai/tensor/d_tensor/layout.py' 2023-09-30T18:29:12,230 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2023-09-30T18:29:12,231 adding 'colossalai/tensor/d_tensor/misc.py' 2023-09-30T18:29:12,233 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2023-09-30T18:29:12,234 adding 'colossalai/tensor/d_tensor/utils.py' 2023-09-30T18:29:12,236 adding 'colossalai/testing/__init__.py' 2023-09-30T18:29:12,238 adding 'colossalai/testing/comparison.py' 2023-09-30T18:29:12,239 adding 'colossalai/testing/pytest_wrapper.py' 2023-09-30T18:29:12,240 adding 'colossalai/testing/random.py' 2023-09-30T18:29:12,242 adding 'colossalai/testing/utils.py' 2023-09-30T18:29:12,243 adding 'colossalai/utils/__init__.py' 2023-09-30T18:29:12,245 adding 'colossalai/utils/common.py' 2023-09-30T18:29:12,246 adding 'colossalai/utils/cuda.py' 2023-09-30T18:29:12,247 adding 'colossalai/utils/moe.py' 2023-09-30T18:29:12,249 adding 'colossalai/utils/timer.py' 2023-09-30T18:29:12,250 adding 'colossalai/utils/model/__init__.py' 2023-09-30T18:29:12,252 adding 'colossalai/utils/model/utils.py' 2023-09-30T18:29:12,253 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2023-09-30T18:29:12,255 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2023-09-30T18:29:12,256 adding 'colossalai/utils/rank_recorder/__init__.py' 2023-09-30T18:29:12,258 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2023-09-30T18:29:12,260 adding 'colossalai/utils/tensor_detector/__init__.py' 2023-09-30T18:29:12,261 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2023-09-30T18:29:12,263 adding 'colossalai/zero/__init__.py' 2023-09-30T18:29:12,265 adding 'colossalai/zero/wrapper.py' 2023-09-30T18:29:12,266 adding 'colossalai/zero/gemini/__init__.py' 2023-09-30T18:29:12,268 adding 'colossalai/zero/gemini/colo_init_context.py' 2023-09-30T18:29:12,272 adding 'colossalai/zero/gemini/gemini_ddp.py' 2023-09-30T18:29:12,274 adding 'colossalai/zero/gemini/gemini_hook.py' 2023-09-30T18:29:12,275 adding 'colossalai/zero/gemini/gemini_mgr.py' 2023-09-30T18:29:12,279 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2023-09-30T18:29:12,281 adding 'colossalai/zero/gemini/placement_policy.py' 2023-09-30T18:29:12,282 adding 'colossalai/zero/gemini/utils.py' 2023-09-30T18:29:12,284 adding 'colossalai/zero/gemini/chunk/__init__.py' 2023-09-30T18:29:12,287 adding 'colossalai/zero/gemini/chunk/chunk.py' 2023-09-30T18:29:12,289 adding 'colossalai/zero/gemini/chunk/manager.py' 2023-09-30T18:29:12,290 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2023-09-30T18:29:12,292 adding 'colossalai/zero/gemini/chunk/utils.py' 2023-09-30T18:29:12,293 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2023-09-30T18:29:12,294 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2023-09-30T18:29:12,296 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2023-09-30T18:29:12,297 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2023-09-30T18:29:12,299 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2023-09-30T18:29:12,300 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2023-09-30T18:29:12,301 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2023-09-30T18:29:12,302 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2023-09-30T18:29:12,304 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2023-09-30T18:29:12,305 adding 'colossalai/zero/low_level/__init__.py' 2023-09-30T18:29:12,307 adding 'colossalai/zero/low_level/_utils.py' 2023-09-30T18:29:12,310 adding 'colossalai/zero/low_level/low_level_optim.py' 2023-09-30T18:29:12,312 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2023-09-30T18:29:12,313 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2023-09-30T18:29:12,315 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2023-09-30T18:29:12,316 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2023-09-30T18:29:12,317 adding 'colossalai/zero/low_level/bookkeeping/parameter_store.py' 2023-09-30T18:29:12,319 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2023-09-30T18:29:12,322 adding 'colossalai-0.3.3.dist-info/LICENSE' 2023-09-30T18:29:12,325 adding 'colossalai-0.3.3.dist-info/METADATA' 2023-09-30T18:29:12,326 adding 'colossalai-0.3.3.dist-info/WHEEL' 2023-09-30T18:29:12,327 adding 'colossalai-0.3.3.dist-info/entry_points.txt' 2023-09-30T18:29:12,328 adding 'colossalai-0.3.3.dist-info/top_level.txt' 2023-09-30T18:29:12,340 adding 'colossalai-0.3.3.dist-info/RECORD' 2023-09-30T18:29:12,363 removing build/bdist.linux-armv7l/wheel 2023-09-30T18:29:12,672 Building wheel for colossalai (setup.py): finished with status 'done' 2023-09-30T18:29:12,688 Created wheel for colossalai: filename=colossalai-0.3.3-py3-none-any.whl size=1192579 sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 2023-09-30T18:29:12,689 Stored in directory: /tmp/pip-ephem-wheel-cache-1y1w5sif/wheels/a4/64/e7/2ad1d8b5622497ad1dd327e361daf3df7742981e8a68a117ad 2023-09-30T18:29:12,724 Successfully built colossalai 2023-09-30T18:29:12,765 Removed build tracker: '/tmp/pip-build-tracker-4mb3t7iz'