2023-08-01T07:33:38,024 Created temporary directory: /tmp/pip-build-tracker-6s1pisi0 2023-08-01T07:33:38,027 Initialized build tracking at /tmp/pip-build-tracker-6s1pisi0 2023-08-01T07:33:38,028 Created build tracker: /tmp/pip-build-tracker-6s1pisi0 2023-08-01T07:33:38,028 Entered build tracker: /tmp/pip-build-tracker-6s1pisi0 2023-08-01T07:33:38,029 Created temporary directory: /tmp/pip-wheel-awz593yh 2023-08-01T07:33:38,038 Created temporary directory: /tmp/pip-ephem-wheel-cache-3etpjmah 2023-08-01T07:33:38,096 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-08-01T07:33:38,103 2 location(s) to search for versions of colossalai: 2023-08-01T07:33:38,103 * https://pypi.org/simple/colossalai/ 2023-08-01T07:33:38,103 * https://www.piwheels.org/simple/colossalai/ 2023-08-01T07:33:38,104 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2023-08-01T07:33:38,105 Getting page https://pypi.org/simple/colossalai/ 2023-08-01T07:33:38,110 Found index url https://pypi.org/simple/ 2023-08-01T07:33:38,297 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2023-08-01T07:33:38,305 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2023-08-01T07:33:38,306 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2023-08-01T07:33:38,308 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2023-08-01T07:33:38,310 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2023-08-01T07:33:38,311 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2023-08-01T07:33:38,312 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2023-08-01T07:33:38,314 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2023-08-01T07:33:38,315 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2023-08-01T07:33:38,316 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2023-08-01T07:33:38,318 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2023-08-01T07:33:38,319 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2023-08-01T07:33:38,320 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2023-08-01T07:33:38,321 Getting page https://www.piwheels.org/simple/colossalai/ 2023-08-01T07:33:38,323 Found index url https://www.piwheels.org/simple/ 2023-08-01T07:33:38,546 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2023-08-01T07:33:38,556 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-08-01T07:33:38,556 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-08-01T07:33:38,557 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-08-01T07:33:38,557 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-08-01T07:33:38,558 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-08-01T07:33:38,559 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-08-01T07:33:38,559 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-08-01T07:33:38,560 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-08-01T07:33:38,560 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-08-01T07:33:38,561 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-08-01T07:33:38,561 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2023-08-01T07:33:38,562 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2023-08-01T07:33:38,598 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2023-08-01T07:33:38,629 Collecting colossalai==0.3.1 2023-08-01T07:33:38,633 Created temporary directory: /tmp/pip-unpack-qntjch80 2023-08-01T07:33:39,038 Downloading colossalai-0.3.1.tar.gz (831 kB) 2023-08-01T07:33:43,013 Added colossalai==0.3.1 from https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz to build tracker '/tmp/pip-build-tracker-6s1pisi0' 2023-08-01T07:33:43,018 Running setup.py (path:/tmp/pip-wheel-awz593yh/colossalai_f9866503afcd49cab0adc9ecdaa91659/setup.py) egg_info for package colossalai 2023-08-01T07:33:43,020 Created temporary directory: /tmp/pip-pip-egg-info-2hqz08o8 2023-08-01T07:33:43,020 Preparing metadata (setup.py): started 2023-08-01T07:33:43,023 Running command python setup.py egg_info 2023-08-01T07:33:44,881 running egg_info 2023-08-01T07:33:44,886 creating /tmp/pip-pip-egg-info-2hqz08o8/colossalai.egg-info 2023-08-01T07:33:44,954 writing /tmp/pip-pip-egg-info-2hqz08o8/colossalai.egg-info/PKG-INFO 2023-08-01T07:33:44,961 writing dependency_links to /tmp/pip-pip-egg-info-2hqz08o8/colossalai.egg-info/dependency_links.txt 2023-08-01T07:33:44,965 writing entry points to /tmp/pip-pip-egg-info-2hqz08o8/colossalai.egg-info/entry_points.txt 2023-08-01T07:33:44,969 writing requirements to /tmp/pip-pip-egg-info-2hqz08o8/colossalai.egg-info/requires.txt 2023-08-01T07:33:44,972 writing top-level names to /tmp/pip-pip-egg-info-2hqz08o8/colossalai.egg-info/top_level.txt 2023-08-01T07:33:44,975 writing manifest file '/tmp/pip-pip-egg-info-2hqz08o8/colossalai.egg-info/SOURCES.txt' 2023-08-01T07:33:45,411 reading manifest file '/tmp/pip-pip-egg-info-2hqz08o8/colossalai.egg-info/SOURCES.txt' 2023-08-01T07:33:45,416 reading manifest template 'MANIFEST.in' 2023-08-01T07:33:47,726 warning: no files found matching '*.tr' under directory 'colossalai' 2023-08-01T07:33:48,907 warning: no files found matching '*.cc' under directory 'colossalai' 2023-08-01T07:33:49,498 warning: no files found matching '*.pyi' under directory 'colossalai' 2023-08-01T07:33:49,517 adding license file 'LICENSE' 2023-08-01T07:33:49,592 writing manifest file '/tmp/pip-pip-egg-info-2hqz08o8/colossalai.egg-info/SOURCES.txt' 2023-08-01T07:33:49,723 Preparing metadata (setup.py): finished with status 'done' 2023-08-01T07:33:49,740 Source in /tmp/pip-wheel-awz593yh/colossalai_f9866503afcd49cab0adc9ecdaa91659 has version 0.3.1, which satisfies requirement colossalai==0.3.1 from https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz 2023-08-01T07:33:49,741 Removed colossalai==0.3.1 from https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz from build tracker '/tmp/pip-build-tracker-6s1pisi0' 2023-08-01T07:33:49,761 Created temporary directory: /tmp/pip-unpack-hh3zwwzm 2023-08-01T07:33:49,762 Building wheels for collected packages: colossalai 2023-08-01T07:33:49,771 Created temporary directory: /tmp/pip-wheel-pmklw9l5 2023-08-01T07:33:49,771 Building wheel for colossalai (setup.py): started 2023-08-01T07:33:49,774 Destination directory: /tmp/pip-wheel-pmklw9l5 2023-08-01T07:33:49,774 Running command python setup.py bdist_wheel 2023-08-01T07:33:51,504 running bdist_wheel 2023-08-01T07:33:52,238 running build 2023-08-01T07:33:52,239 running build_py 2023-08-01T07:33:52,314 creating build 2023-08-01T07:33:52,316 creating build/lib 2023-08-01T07:33:52,318 creating build/lib/colossalai 2023-08-01T07:33:52,321 copying colossalai/version.py -> build/lib/colossalai 2023-08-01T07:33:52,326 copying colossalai/core.py -> build/lib/colossalai 2023-08-01T07:33:52,330 copying colossalai/__init__.py -> build/lib/colossalai 2023-08-01T07:33:52,335 copying colossalai/global_variables.py -> build/lib/colossalai 2023-08-01T07:33:52,340 copying colossalai/initialize.py -> build/lib/colossalai 2023-08-01T07:33:52,345 copying colossalai/constants.py -> build/lib/colossalai 2023-08-01T07:33:52,350 creating build/lib/colossalai/kernel 2023-08-01T07:33:52,352 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2023-08-01T07:33:52,357 creating build/lib/colossalai/context 2023-08-01T07:33:52,359 copying colossalai/context/moe_context.py -> build/lib/colossalai/context 2023-08-01T07:33:52,363 copying colossalai/context/parallel_context.py -> build/lib/colossalai/context 2023-08-01T07:33:52,368 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2023-08-01T07:33:52,371 copying colossalai/context/parallel_mode.py -> build/lib/colossalai/context 2023-08-01T07:33:52,375 copying colossalai/context/config.py -> build/lib/colossalai/context 2023-08-01T07:33:52,379 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2023-08-01T07:33:52,384 creating build/lib/colossalai/amp 2023-08-01T07:33:52,385 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2023-08-01T07:33:52,389 copying colossalai/amp/amp_type.py -> build/lib/colossalai/amp 2023-08-01T07:33:52,394 creating build/lib/colossalai/builder 2023-08-01T07:33:52,396 copying colossalai/builder/__init__.py -> build/lib/colossalai/builder 2023-08-01T07:33:52,399 copying colossalai/builder/builder.py -> build/lib/colossalai/builder 2023-08-01T07:33:52,404 creating build/lib/colossalai/auto_parallel 2023-08-01T07:33:52,406 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2023-08-01T07:33:52,411 creating build/lib/colossalai/registry 2023-08-01T07:33:52,414 copying colossalai/registry/registry.py -> build/lib/colossalai/registry 2023-08-01T07:33:52,418 copying colossalai/registry/__init__.py -> build/lib/colossalai/registry 2023-08-01T07:33:52,423 creating build/lib/colossalai/_C 2023-08-01T07:33:52,425 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2023-08-01T07:33:52,430 creating build/lib/colossalai/checkpoint_io 2023-08-01T07:33:52,432 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2023-08-01T07:33:52,435 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2023-08-01T07:33:52,440 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2023-08-01T07:33:52,444 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2023-08-01T07:33:52,448 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2023-08-01T07:33:52,454 creating build/lib/colossalai/cli 2023-08-01T07:33:52,456 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2023-08-01T07:33:52,459 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2023-08-01T07:33:52,464 creating build/lib/colossalai/fx 2023-08-01T07:33:52,466 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2023-08-01T07:33:52,471 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2023-08-01T07:33:52,474 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2023-08-01T07:33:52,478 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2023-08-01T07:33:52,483 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2023-08-01T07:33:52,486 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2023-08-01T07:33:52,491 creating build/lib/colossalai/trainer 2023-08-01T07:33:52,493 copying colossalai/trainer/_trainer.py -> build/lib/colossalai/trainer 2023-08-01T07:33:52,497 copying colossalai/trainer/__init__.py -> build/lib/colossalai/trainer 2023-08-01T07:33:52,503 creating build/lib/colossalai/pipeline 2023-08-01T07:33:52,505 copying colossalai/pipeline/pipelinable.py -> build/lib/colossalai/pipeline 2023-08-01T07:33:52,509 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2023-08-01T07:33:52,513 copying colossalai/pipeline/layer_spec.py -> build/lib/colossalai/pipeline 2023-08-01T07:33:52,517 copying colossalai/pipeline/pipeline_process_group.py -> build/lib/colossalai/pipeline 2023-08-01T07:33:52,521 copying colossalai/pipeline/utils.py -> build/lib/colossalai/pipeline 2023-08-01T07:33:52,527 creating build/lib/colossalai/lazy 2023-08-01T07:33:52,529 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2023-08-01T07:33:52,533 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2023-08-01T07:33:52,541 creating build/lib/colossalai/tensor 2023-08-01T07:33:52,543 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,548 copying colossalai/tensor/tensor_spec.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,552 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,557 copying colossalai/tensor/dist_spec_mgr.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,561 copying colossalai/tensor/op_wrapper.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,565 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,568 copying colossalai/tensor/const.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,572 copying colossalai/tensor/process_group.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,576 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,581 copying colossalai/tensor/compute_spec.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,585 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,589 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,594 copying colossalai/tensor/distspec.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,597 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,602 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2023-08-01T07:33:52,608 creating build/lib/colossalai/_analyzer 2023-08-01T07:33:52,610 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2023-08-01T07:33:52,613 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2023-08-01T07:33:52,618 creating build/lib/colossalai/interface 2023-08-01T07:33:52,619 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2023-08-01T07:33:52,623 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2023-08-01T07:33:52,627 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2023-08-01T07:33:52,631 creating build/lib/colossalai/booster 2023-08-01T07:33:52,633 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2023-08-01T07:33:52,638 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2023-08-01T07:33:52,641 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2023-08-01T07:33:52,646 creating build/lib/colossalai/cluster 2023-08-01T07:33:52,647 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2023-08-01T07:33:52,652 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2023-08-01T07:33:52,655 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2023-08-01T07:33:52,659 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2023-08-01T07:33:52,664 creating build/lib/colossalai/device 2023-08-01T07:33:52,666 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2023-08-01T07:33:52,670 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2023-08-01T07:33:52,675 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2023-08-01T07:33:52,678 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2023-08-01T07:33:52,685 creating build/lib/colossalai/zero 2023-08-01T07:33:52,687 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2023-08-01T07:33:52,692 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2023-08-01T07:33:52,696 creating build/lib/colossalai/engine 2023-08-01T07:33:52,699 copying colossalai/engine/__init__.py -> build/lib/colossalai/engine 2023-08-01T07:33:52,703 copying colossalai/engine/_base_engine.py -> build/lib/colossalai/engine 2023-08-01T07:33:52,710 creating build/lib/colossalai/testing 2023-08-01T07:33:52,712 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2023-08-01T07:33:52,717 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2023-08-01T07:33:52,721 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2023-08-01T07:33:52,726 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2023-08-01T07:33:52,731 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2023-08-01T07:33:52,737 creating build/lib/colossalai/nn 2023-08-01T07:33:52,740 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2023-08-01T07:33:52,745 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2023-08-01T07:33:52,751 creating build/lib/colossalai/logging 2023-08-01T07:33:52,752 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2023-08-01T07:33:52,757 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2023-08-01T07:33:52,762 creating build/lib/colossalai/shardformer 2023-08-01T07:33:52,764 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2023-08-01T07:33:52,768 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2023-08-01T07:33:52,773 creating build/lib/colossalai/communication 2023-08-01T07:33:52,774 copying colossalai/communication/p2p_v2.py -> build/lib/colossalai/communication 2023-08-01T07:33:52,779 copying colossalai/communication/__init__.py -> build/lib/colossalai/communication 2023-08-01T07:33:52,782 copying colossalai/communication/collective.py -> build/lib/colossalai/communication 2023-08-01T07:33:52,787 copying colossalai/communication/ring.py -> build/lib/colossalai/communication 2023-08-01T07:33:52,790 copying colossalai/communication/p2p.py -> build/lib/colossalai/communication 2023-08-01T07:33:52,795 copying colossalai/communication/utils.py -> build/lib/colossalai/communication 2023-08-01T07:33:52,802 creating build/lib/colossalai/utils 2023-08-01T07:33:52,804 copying colossalai/utils/moe.py -> build/lib/colossalai/utils 2023-08-01T07:33:52,808 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2023-08-01T07:33:52,812 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2023-08-01T07:33:52,815 copying colossalai/utils/cuda.py -> build/lib/colossalai/utils 2023-08-01T07:33:52,819 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2023-08-01T07:33:52,824 copying colossalai/utils/checkpointing.py -> build/lib/colossalai/utils 2023-08-01T07:33:52,829 copying colossalai/utils/activation_checkpoint.py -> build/lib/colossalai/utils 2023-08-01T07:33:52,833 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2023-08-01T07:33:52,839 creating build/lib/colossalai/kernel/cuda_native 2023-08-01T07:33:52,841 copying colossalai/kernel/cuda_native/layer_norm.py -> build/lib/colossalai/kernel/cuda_native 2023-08-01T07:33:52,845 copying colossalai/kernel/cuda_native/flash_attention.py -> build/lib/colossalai/kernel/cuda_native 2023-08-01T07:33:52,850 copying colossalai/kernel/cuda_native/__init__.py -> build/lib/colossalai/kernel/cuda_native 2023-08-01T07:33:52,854 copying colossalai/kernel/cuda_native/multihead_attention.py -> build/lib/colossalai/kernel/cuda_native 2023-08-01T07:33:52,859 copying colossalai/kernel/cuda_native/scaled_softmax.py -> build/lib/colossalai/kernel/cuda_native 2023-08-01T07:33:52,865 creating build/lib/colossalai/kernel/jit 2023-08-01T07:33:52,867 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2023-08-01T07:33:52,871 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2023-08-01T07:33:52,875 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2023-08-01T07:33:52,878 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2023-08-01T07:33:52,884 creating build/lib/colossalai/kernel/op_builder 2023-08-01T07:33:52,886 copying colossalai/kernel/op_builder/moe.py -> build/lib/colossalai/kernel/op_builder 2023-08-01T07:33:52,890 copying colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/lib/colossalai/kernel/op_builder 2023-08-01T07:33:52,894 copying colossalai/kernel/op_builder/fused_optim.py -> build/lib/colossalai/kernel/op_builder 2023-08-01T07:33:52,897 copying colossalai/kernel/op_builder/cpu_adam.py -> build/lib/colossalai/kernel/op_builder 2023-08-01T07:33:52,901 copying colossalai/kernel/op_builder/__init__.py -> build/lib/colossalai/kernel/op_builder 2023-08-01T07:33:52,905 copying colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/colossalai/kernel/op_builder 2023-08-01T07:33:52,909 copying colossalai/kernel/op_builder/layernorm.py -> build/lib/colossalai/kernel/op_builder 2023-08-01T07:33:52,912 copying colossalai/kernel/op_builder/multi_head_attn.py -> build/lib/colossalai/kernel/op_builder 2023-08-01T07:33:52,916 copying colossalai/kernel/op_builder/utils.py -> build/lib/colossalai/kernel/op_builder 2023-08-01T07:33:52,921 copying colossalai/kernel/op_builder/builder.py -> build/lib/colossalai/kernel/op_builder 2023-08-01T07:33:52,928 creating build/lib/colossalai/context/random 2023-08-01T07:33:52,929 copying colossalai/context/random/_helper.py -> build/lib/colossalai/context/random 2023-08-01T07:33:52,934 copying colossalai/context/random/__init__.py -> build/lib/colossalai/context/random 2023-08-01T07:33:52,937 copying colossalai/context/random/seed_manager.py -> build/lib/colossalai/context/random 2023-08-01T07:33:52,943 creating build/lib/colossalai/context/process_group_initializer 2023-08-01T07:33:52,945 copying colossalai/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/context/process_group_initializer 2023-08-01T07:33:52,949 copying colossalai/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/context/process_group_initializer 2023-08-01T07:33:52,952 copying colossalai/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/context/process_group_initializer 2023-08-01T07:33:52,956 copying colossalai/context/process_group_initializer/__init__.py -> build/lib/colossalai/context/process_group_initializer 2023-08-01T07:33:52,960 copying colossalai/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/context/process_group_initializer 2023-08-01T07:33:52,963 copying colossalai/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/context/process_group_initializer 2023-08-01T07:33:52,968 copying colossalai/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/context/process_group_initializer 2023-08-01T07:33:52,972 copying colossalai/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/context/process_group_initializer 2023-08-01T07:33:52,975 copying colossalai/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/context/process_group_initializer 2023-08-01T07:33:52,979 copying colossalai/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/context/process_group_initializer 2023-08-01T07:33:52,982 copying colossalai/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/context/process_group_initializer 2023-08-01T07:33:52,989 creating build/lib/colossalai/amp/torch_amp 2023-08-01T07:33:52,990 copying colossalai/amp/torch_amp/torch_amp.py -> build/lib/colossalai/amp/torch_amp 2023-08-01T07:33:52,994 copying colossalai/amp/torch_amp/__init__.py -> build/lib/colossalai/amp/torch_amp 2023-08-01T07:33:52,998 copying colossalai/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/amp/torch_amp 2023-08-01T07:33:53,004 creating build/lib/colossalai/amp/apex_amp 2023-08-01T07:33:53,006 copying colossalai/amp/apex_amp/__init__.py -> build/lib/colossalai/amp/apex_amp 2023-08-01T07:33:53,010 copying colossalai/amp/apex_amp/apex_amp.py -> build/lib/colossalai/amp/apex_amp 2023-08-01T07:33:53,015 creating build/lib/colossalai/amp/naive_amp 2023-08-01T07:33:53,016 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2023-08-01T07:33:53,020 copying colossalai/amp/naive_amp/naive_amp.py -> build/lib/colossalai/amp/naive_amp 2023-08-01T07:33:53,024 copying colossalai/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/amp/naive_amp 2023-08-01T07:33:53,029 copying colossalai/amp/naive_amp/_utils.py -> build/lib/colossalai/amp/naive_amp 2023-08-01T07:33:53,034 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2023-08-01T07:33:53,036 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2023-08-01T07:33:53,040 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2023-08-01T07:33:53,043 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2023-08-01T07:33:53,047 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2023-08-01T07:33:53,052 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2023-08-01T07:33:53,054 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2023-08-01T07:33:53,058 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2023-08-01T07:33:53,061 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2023-08-01T07:33:53,065 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2023-08-01T07:33:53,069 creating build/lib/colossalai/auto_parallel/pipeline_shard 2023-08-01T07:33:53,071 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2023-08-01T07:33:53,076 creating build/lib/colossalai/auto_parallel/offload 2023-08-01T07:33:53,078 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2023-08-01T07:33:53,083 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2023-08-01T07:33:53,087 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2023-08-01T07:33:53,092 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2023-08-01T07:33:53,095 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2023-08-01T07:33:53,100 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2023-08-01T07:33:53,103 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2023-08-01T07:33:53,108 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2023-08-01T07:33:53,112 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2023-08-01T07:33:53,116 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2023-08-01T07:33:53,123 creating build/lib/colossalai/auto_parallel/passes 2023-08-01T07:33:53,124 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2023-08-01T07:33:53,129 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2023-08-01T07:33:53,134 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2023-08-01T07:33:53,139 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2023-08-01T07:33:53,142 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2023-08-01T07:33:53,146 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2023-08-01T07:33:53,151 creating build/lib/colossalai/auto_parallel/tensor_shard 2023-08-01T07:33:53,153 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-08-01T07:33:53,156 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-08-01T07:33:53,159 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-08-01T07:33:53,164 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-08-01T07:33:53,170 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-08-01T07:33:53,176 creating build/lib/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:53,178 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:53,183 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:53,188 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:53,192 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:53,195 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:53,200 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:53,206 creating build/lib/colossalai/auto_parallel/meta_profiler 2023-08-01T07:33:53,207 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2023-08-01T07:33:53,211 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2023-08-01T07:33:53,214 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2023-08-01T07:33:53,219 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2023-08-01T07:33:53,229 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,230 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,235 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,239 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,244 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,248 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,252 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,257 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,262 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,266 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,272 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,276 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,280 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,284 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,288 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,292 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,296 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,300 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,303 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,307 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,311 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,315 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,318 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,322 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,325 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,329 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,333 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,336 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:53,341 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-08-01T07:33:53,343 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-08-01T07:33:53,350 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-08-01T07:33:53,353 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-08-01T07:33:53,357 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-08-01T07:33:53,361 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-08-01T07:33:53,367 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:53,369 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:53,373 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:53,377 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:53,381 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:53,385 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:53,390 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:53,397 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,398 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,403 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,408 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,412 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,417 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,421 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,425 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,430 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,434 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,441 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,446 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,451 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,456 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,461 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,466 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,472 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,477 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,481 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,486 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:53,494 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:53,496 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:53,500 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:53,503 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:53,507 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:53,513 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:53,519 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:53,523 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:53,528 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:53,532 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:53,536 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:53,541 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:53,547 creating build/lib/colossalai/cli/benchmark 2023-08-01T07:33:53,549 copying colossalai/cli/benchmark/models.py -> build/lib/colossalai/cli/benchmark 2023-08-01T07:33:53,553 copying colossalai/cli/benchmark/__init__.py -> build/lib/colossalai/cli/benchmark 2023-08-01T07:33:53,558 copying colossalai/cli/benchmark/benchmark.py -> build/lib/colossalai/cli/benchmark 2023-08-01T07:33:53,562 copying colossalai/cli/benchmark/utils.py -> build/lib/colossalai/cli/benchmark 2023-08-01T07:33:53,568 creating build/lib/colossalai/cli/check 2023-08-01T07:33:53,570 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2023-08-01T07:33:53,575 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2023-08-01T07:33:53,581 creating build/lib/colossalai/cli/launcher 2023-08-01T07:33:53,583 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2023-08-01T07:33:53,588 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2023-08-01T07:33:53,592 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2023-08-01T07:33:53,597 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2023-08-01T07:33:53,603 creating build/lib/colossalai/fx/tracer 2023-08-01T07:33:53,606 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2023-08-01T07:33:53,610 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2023-08-01T07:33:53,616 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2023-08-01T07:33:53,621 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2023-08-01T07:33:53,625 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2023-08-01T07:33:53,630 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2023-08-01T07:33:53,634 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2023-08-01T07:33:53,641 creating build/lib/colossalai/fx/codegen 2023-08-01T07:33:53,644 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2023-08-01T07:33:53,648 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2023-08-01T07:33:53,657 creating build/lib/colossalai/fx/profiler 2023-08-01T07:33:53,659 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2023-08-01T07:33:53,665 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2023-08-01T07:33:53,670 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2023-08-01T07:33:53,675 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2023-08-01T07:33:53,679 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2023-08-01T07:33:53,684 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2023-08-01T07:33:53,688 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2023-08-01T07:33:53,692 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2023-08-01T07:33:53,698 creating build/lib/colossalai/fx/passes 2023-08-01T07:33:53,701 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2023-08-01T07:33:53,706 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2023-08-01T07:33:53,711 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2023-08-01T07:33:53,716 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2023-08-01T07:33:53,721 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2023-08-01T07:33:53,725 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2023-08-01T07:33:53,730 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2023-08-01T07:33:53,735 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2023-08-01T07:33:53,741 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2023-08-01T07:33:53,743 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2023-08-01T07:33:53,748 creating build/lib/colossalai/fx/tracer/meta_patch 2023-08-01T07:33:53,749 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2023-08-01T07:33:53,755 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-08-01T07:33:53,757 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-08-01T07:33:53,761 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-08-01T07:33:53,764 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-08-01T07:33:53,768 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-08-01T07:33:53,772 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-08-01T07:33:53,777 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-08-01T07:33:53,779 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-08-01T07:33:53,783 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-08-01T07:33:53,787 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-08-01T07:33:53,791 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-08-01T07:33:53,796 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:53,798 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:53,802 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:53,806 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:53,809 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:53,814 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:53,817 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:53,821 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:53,825 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:53,831 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:53,833 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:53,836 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:53,840 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:53,843 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:53,847 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:53,851 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:53,854 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:53,858 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:53,864 creating build/lib/colossalai/fx/profiler/experimental 2023-08-01T07:33:53,865 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2023-08-01T07:33:53,870 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2023-08-01T07:33:53,873 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2023-08-01T07:33:53,877 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2023-08-01T07:33:53,880 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2023-08-01T07:33:53,886 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:53,888 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:53,893 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:53,896 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:53,900 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:53,903 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:53,907 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:53,910 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:53,915 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:53,919 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:53,922 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:53,926 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:53,931 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:53,933 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:53,937 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:53,941 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:53,944 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:53,948 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:53,951 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:53,955 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:53,959 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:53,963 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:53,969 creating build/lib/colossalai/trainer/hooks 2023-08-01T07:33:53,971 copying colossalai/trainer/hooks/_base_hook.py -> build/lib/colossalai/trainer/hooks 2023-08-01T07:33:53,975 copying colossalai/trainer/hooks/_log_hook.py -> build/lib/colossalai/trainer/hooks 2023-08-01T07:33:53,980 copying colossalai/trainer/hooks/__init__.py -> build/lib/colossalai/trainer/hooks 2023-08-01T07:33:53,983 copying colossalai/trainer/hooks/_metric_hook.py -> build/lib/colossalai/trainer/hooks 2023-08-01T07:33:53,989 copying colossalai/trainer/hooks/_commons_.py -> build/lib/colossalai/trainer/hooks 2023-08-01T07:33:53,993 copying colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/trainer/hooks 2023-08-01T07:33:53,997 copying colossalai/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/trainer/hooks 2023-08-01T07:33:54,003 creating build/lib/colossalai/pipeline/middleware 2023-08-01T07:33:54,005 copying colossalai/pipeline/middleware/__init__.py -> build/lib/colossalai/pipeline/middleware 2023-08-01T07:33:54,010 copying colossalai/pipeline/middleware/topo.py -> build/lib/colossalai/pipeline/middleware 2023-08-01T07:33:54,016 creating build/lib/colossalai/pipeline/rpc 2023-08-01T07:33:54,018 copying colossalai/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/pipeline/rpc 2023-08-01T07:33:54,023 copying colossalai/pipeline/rpc/__init__.py -> build/lib/colossalai/pipeline/rpc 2023-08-01T07:33:54,027 copying colossalai/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/pipeline/rpc 2023-08-01T07:33:54,034 copying colossalai/pipeline/rpc/utils.py -> build/lib/colossalai/pipeline/rpc 2023-08-01T07:33:54,040 creating build/lib/colossalai/pipeline/middleware/adaptor 2023-08-01T07:33:54,042 copying colossalai/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/pipeline/middleware/adaptor 2023-08-01T07:33:54,046 copying colossalai/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/pipeline/middleware/adaptor 2023-08-01T07:33:54,052 creating build/lib/colossalai/tensor/d_tensor 2023-08-01T07:33:54,054 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2023-08-01T07:33:54,059 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2023-08-01T07:33:54,062 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2023-08-01T07:33:54,066 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2023-08-01T07:33:54,071 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2023-08-01T07:33:54,076 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2023-08-01T07:33:54,080 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2023-08-01T07:33:54,084 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2023-08-01T07:33:54,090 creating build/lib/colossalai/_analyzer/fx 2023-08-01T07:33:54,092 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2023-08-01T07:33:54,097 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2023-08-01T07:33:54,102 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2023-08-01T07:33:54,107 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2023-08-01T07:33:54,111 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2023-08-01T07:33:54,118 creating build/lib/colossalai/_analyzer/_subclasses 2023-08-01T07:33:54,120 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2023-08-01T07:33:54,126 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2023-08-01T07:33:54,130 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2023-08-01T07:33:54,135 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2023-08-01T07:33:54,139 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2023-08-01T07:33:54,144 creating build/lib/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:54,146 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:54,150 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:54,154 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:54,158 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:54,163 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:54,167 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:54,173 creating build/lib/colossalai/_analyzer/fx/passes 2023-08-01T07:33:54,174 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2023-08-01T07:33:54,178 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2023-08-01T07:33:54,183 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2023-08-01T07:33:54,189 creating build/lib/colossalai/booster/plugin 2023-08-01T07:33:54,191 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2023-08-01T07:33:54,196 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2023-08-01T07:33:54,201 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2023-08-01T07:33:54,204 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2023-08-01T07:33:54,208 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2023-08-01T07:33:54,212 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2023-08-01T07:33:54,217 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2023-08-01T07:33:54,222 creating build/lib/colossalai/booster/mixed_precision 2023-08-01T07:33:54,224 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2023-08-01T07:33:54,229 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2023-08-01T07:33:54,232 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2023-08-01T07:33:54,236 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2023-08-01T07:33:54,239 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2023-08-01T07:33:54,243 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2023-08-01T07:33:54,247 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2023-08-01T07:33:54,252 creating build/lib/colossalai/zero/low_level 2023-08-01T07:33:54,254 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2023-08-01T07:33:54,260 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2023-08-01T07:33:54,264 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2023-08-01T07:33:54,269 creating build/lib/colossalai/zero/legacy 2023-08-01T07:33:54,271 copying colossalai/zero/legacy/__init__.py -> build/lib/colossalai/zero/legacy 2023-08-01T07:33:54,277 creating build/lib/colossalai/zero/gemini 2023-08-01T07:33:54,279 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2023-08-01T07:33:54,285 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2023-08-01T07:33:54,290 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2023-08-01T07:33:54,293 copying colossalai/zero/gemini/colo_init_context.py -> build/lib/colossalai/zero/gemini 2023-08-01T07:33:54,299 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2023-08-01T07:33:54,303 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2023-08-01T07:33:54,307 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2023-08-01T07:33:54,312 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2023-08-01T07:33:54,319 creating build/lib/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:54,321 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:54,325 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:54,329 copying colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:54,333 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:54,337 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:54,341 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:54,346 creating build/lib/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:54,348 copying colossalai/zero/legacy/sharded_model/__init__.py -> build/lib/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:54,352 copying colossalai/zero/legacy/sharded_model/utils.py -> build/lib/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:54,356 copying colossalai/zero/legacy/sharded_model/reduce_scatter.py -> build/lib/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:54,361 copying colossalai/zero/legacy/sharded_model/sharded_model_v2.py -> build/lib/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:54,366 copying colossalai/zero/legacy/sharded_model/_utils.py -> build/lib/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:54,370 copying colossalai/zero/legacy/sharded_model/zero_hook.py -> build/lib/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:54,376 creating build/lib/colossalai/zero/legacy/shard_utils 2023-08-01T07:33:54,378 copying colossalai/zero/legacy/shard_utils/base_shard_strategy.py -> build/lib/colossalai/zero/legacy/shard_utils 2023-08-01T07:33:54,382 copying colossalai/zero/legacy/shard_utils/__init__.py -> build/lib/colossalai/zero/legacy/shard_utils 2023-08-01T07:33:54,386 copying colossalai/zero/legacy/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/zero/legacy/shard_utils 2023-08-01T07:33:54,390 copying colossalai/zero/legacy/shard_utils/commons.py -> build/lib/colossalai/zero/legacy/shard_utils 2023-08-01T07:33:54,394 copying colossalai/zero/legacy/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/zero/legacy/shard_utils 2023-08-01T07:33:54,400 creating build/lib/colossalai/zero/legacy/init_ctx 2023-08-01T07:33:54,402 copying colossalai/zero/legacy/init_ctx/init_context.py -> build/lib/colossalai/zero/legacy/init_ctx 2023-08-01T07:33:54,407 copying colossalai/zero/legacy/init_ctx/__init__.py -> build/lib/colossalai/zero/legacy/init_ctx 2023-08-01T07:33:54,412 creating build/lib/colossalai/zero/legacy/gemini 2023-08-01T07:33:54,414 copying colossalai/zero/legacy/gemini/tensor_utils.py -> build/lib/colossalai/zero/legacy/gemini 2023-08-01T07:33:54,418 copying colossalai/zero/legacy/gemini/gemini_context.py -> build/lib/colossalai/zero/legacy/gemini 2023-08-01T07:33:54,422 copying colossalai/zero/legacy/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/zero/legacy/gemini 2023-08-01T07:33:54,427 copying colossalai/zero/legacy/gemini/__init__.py -> build/lib/colossalai/zero/legacy/gemini 2023-08-01T07:33:54,431 copying colossalai/zero/legacy/gemini/stateful_tensor.py -> build/lib/colossalai/zero/legacy/gemini 2023-08-01T07:33:54,436 copying colossalai/zero/legacy/gemini/tensor_placement_policy.py -> build/lib/colossalai/zero/legacy/gemini 2023-08-01T07:33:54,441 creating build/lib/colossalai/zero/legacy/sharded_param 2023-08-01T07:33:54,443 copying colossalai/zero/legacy/sharded_param/sharded_tensor.py -> build/lib/colossalai/zero/legacy/sharded_param 2023-08-01T07:33:54,448 copying colossalai/zero/legacy/sharded_param/sharded_param.py -> build/lib/colossalai/zero/legacy/sharded_param 2023-08-01T07:33:54,451 copying colossalai/zero/legacy/sharded_param/__init__.py -> build/lib/colossalai/zero/legacy/sharded_param 2023-08-01T07:33:54,456 creating build/lib/colossalai/zero/legacy/sharded_optim 2023-08-01T07:33:54,458 copying colossalai/zero/legacy/sharded_optim/__init__.py -> build/lib/colossalai/zero/legacy/sharded_optim 2023-08-01T07:33:54,462 copying colossalai/zero/legacy/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/zero/legacy/sharded_optim 2023-08-01T07:33:54,470 creating build/lib/colossalai/zero/legacy/gemini/paramhooks 2023-08-01T07:33:54,472 copying colossalai/zero/legacy/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/zero/legacy/gemini/paramhooks 2023-08-01T07:33:54,476 copying colossalai/zero/legacy/gemini/paramhooks/__init__.py -> build/lib/colossalai/zero/legacy/gemini/paramhooks 2023-08-01T07:33:54,481 creating build/lib/colossalai/zero/legacy/gemini/ophooks 2023-08-01T07:33:54,483 copying colossalai/zero/legacy/gemini/ophooks/__init__.py -> build/lib/colossalai/zero/legacy/gemini/ophooks 2023-08-01T07:33:54,487 copying colossalai/zero/legacy/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/zero/legacy/gemini/ophooks 2023-08-01T07:33:54,492 copying colossalai/zero/legacy/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/zero/legacy/gemini/ophooks 2023-08-01T07:33:54,496 copying colossalai/zero/legacy/gemini/ophooks/utils.py -> build/lib/colossalai/zero/legacy/gemini/ophooks 2023-08-01T07:33:54,501 copying colossalai/zero/legacy/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/zero/legacy/gemini/ophooks 2023-08-01T07:33:54,507 creating build/lib/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:54,509 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:54,513 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:54,517 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:54,521 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:54,525 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:54,528 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:54,533 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:54,537 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:54,541 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:54,546 creating build/lib/colossalai/zero/gemini/chunk 2023-08-01T07:33:54,548 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2023-08-01T07:33:54,552 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2023-08-01T07:33:54,557 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2023-08-01T07:33:54,562 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2023-08-01T07:33:54,567 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2023-08-01T07:33:54,572 creating build/lib/colossalai/engine/schedule 2023-08-01T07:33:54,574 copying colossalai/engine/schedule/_base_schedule.py -> build/lib/colossalai/engine/schedule 2023-08-01T07:33:54,578 copying colossalai/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/engine/schedule 2023-08-01T07:33:54,585 copying colossalai/engine/schedule/__init__.py -> build/lib/colossalai/engine/schedule 2023-08-01T07:33:54,589 copying colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/engine/schedule 2023-08-01T07:33:54,593 copying colossalai/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/engine/schedule 2023-08-01T07:33:54,598 creating build/lib/colossalai/engine/gradient_accumulation 2023-08-01T07:33:54,599 copying colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/engine/gradient_accumulation 2023-08-01T07:33:54,604 copying colossalai/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/engine/gradient_accumulation 2023-08-01T07:33:54,609 creating build/lib/colossalai/engine/gradient_handler 2023-08-01T07:33:54,611 copying colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler 2023-08-01T07:33:54,615 copying colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler 2023-08-01T07:33:54,618 copying colossalai/engine/gradient_handler/__init__.py -> build/lib/colossalai/engine/gradient_handler 2023-08-01T07:33:54,621 copying colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler 2023-08-01T07:33:54,625 copying colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler 2023-08-01T07:33:54,629 copying colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler 2023-08-01T07:33:54,632 copying colossalai/engine/gradient_handler/utils.py -> build/lib/colossalai/engine/gradient_handler 2023-08-01T07:33:54,637 copying colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler 2023-08-01T07:33:54,642 creating build/lib/colossalai/nn/loss 2023-08-01T07:33:54,644 copying colossalai/nn/loss/loss_moe.py -> build/lib/colossalai/nn/loss 2023-08-01T07:33:54,648 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2023-08-01T07:33:54,651 copying colossalai/nn/loss/loss_2d.py -> build/lib/colossalai/nn/loss 2023-08-01T07:33:54,656 copying colossalai/nn/loss/loss_1d.py -> build/lib/colossalai/nn/loss 2023-08-01T07:33:54,660 copying colossalai/nn/loss/loss_2p5d.py -> build/lib/colossalai/nn/loss 2023-08-01T07:33:54,664 copying colossalai/nn/loss/loss_3d.py -> build/lib/colossalai/nn/loss 2023-08-01T07:33:54,673 creating build/lib/colossalai/nn/layer 2023-08-01T07:33:54,675 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2023-08-01T07:33:54,679 copying colossalai/nn/layer/base_layer.py -> build/lib/colossalai/nn/layer 2023-08-01T07:33:54,685 creating build/lib/colossalai/nn/metric 2023-08-01T07:33:54,686 copying colossalai/nn/metric/__init__.py -> build/lib/colossalai/nn/metric 2023-08-01T07:33:54,690 copying colossalai/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/nn/metric 2023-08-01T07:33:54,694 copying colossalai/nn/metric/accuracy_3d.py -> build/lib/colossalai/nn/metric 2023-08-01T07:33:54,698 copying colossalai/nn/metric/accuracy_2d.py -> build/lib/colossalai/nn/metric 2023-08-01T07:33:54,703 copying colossalai/nn/metric/_utils.py -> build/lib/colossalai/nn/metric 2023-08-01T07:33:54,709 creating build/lib/colossalai/nn/lr_scheduler 2023-08-01T07:33:54,711 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2023-08-01T07:33:54,715 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2023-08-01T07:33:54,718 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2023-08-01T07:33:54,722 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2023-08-01T07:33:54,727 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2023-08-01T07:33:54,731 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2023-08-01T07:33:54,736 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2023-08-01T07:33:54,740 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2023-08-01T07:33:54,746 creating build/lib/colossalai/nn/_ops 2023-08-01T07:33:54,748 copying colossalai/nn/_ops/__init__.py -> build/lib/colossalai/nn/_ops 2023-08-01T07:33:54,752 copying colossalai/nn/_ops/batch_norm.py -> build/lib/colossalai/nn/_ops 2023-08-01T07:33:54,756 copying colossalai/nn/_ops/addmm.py -> build/lib/colossalai/nn/_ops 2023-08-01T07:33:54,760 copying colossalai/nn/_ops/linear.py -> build/lib/colossalai/nn/_ops 2023-08-01T07:33:54,764 copying colossalai/nn/_ops/layernorm.py -> build/lib/colossalai/nn/_ops 2023-08-01T07:33:54,768 copying colossalai/nn/_ops/loss.py -> build/lib/colossalai/nn/_ops 2023-08-01T07:33:54,773 copying colossalai/nn/_ops/embedding_bag.py -> build/lib/colossalai/nn/_ops 2023-08-01T07:33:54,777 copying colossalai/nn/_ops/element_wise.py -> build/lib/colossalai/nn/_ops 2023-08-01T07:33:54,782 copying colossalai/nn/_ops/embedding.py -> build/lib/colossalai/nn/_ops 2023-08-01T07:33:54,787 copying colossalai/nn/_ops/view.py -> build/lib/colossalai/nn/_ops 2023-08-01T07:33:54,791 copying colossalai/nn/_ops/_utils.py -> build/lib/colossalai/nn/_ops 2023-08-01T07:33:54,797 creating build/lib/colossalai/nn/parallel 2023-08-01T07:33:54,799 copying colossalai/nn/parallel/data_parallel.py -> build/lib/colossalai/nn/parallel 2023-08-01T07:33:54,804 copying colossalai/nn/parallel/__init__.py -> build/lib/colossalai/nn/parallel 2023-08-01T07:33:54,808 copying colossalai/nn/parallel/reducer.py -> build/lib/colossalai/nn/parallel 2023-08-01T07:33:54,813 creating build/lib/colossalai/nn/optimizer 2023-08-01T07:33:54,815 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2023-08-01T07:33:54,820 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2023-08-01T07:33:54,824 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2023-08-01T07:33:54,829 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2023-08-01T07:33:54,833 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2023-08-01T07:33:54,838 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2023-08-01T07:33:54,843 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2023-08-01T07:33:54,847 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2023-08-01T07:33:54,851 copying colossalai/nn/optimizer/colossalai_optimizer.py -> build/lib/colossalai/nn/optimizer 2023-08-01T07:33:54,855 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2023-08-01T07:33:54,861 creating build/lib/colossalai/nn/layer/vanilla 2023-08-01T07:33:54,862 copying colossalai/nn/layer/vanilla/__init__.py -> build/lib/colossalai/nn/layer/vanilla 2023-08-01T07:33:54,867 copying colossalai/nn/layer/vanilla/layers.py -> build/lib/colossalai/nn/layer/vanilla 2023-08-01T07:33:54,873 creating build/lib/colossalai/nn/layer/parallel_sequence 2023-08-01T07:33:54,874 copying colossalai/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/nn/layer/parallel_sequence 2023-08-01T07:33:54,878 copying colossalai/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/nn/layer/parallel_sequence 2023-08-01T07:33:54,883 copying colossalai/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/nn/layer/parallel_sequence 2023-08-01T07:33:54,888 copying colossalai/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/nn/layer/parallel_sequence 2023-08-01T07:33:54,893 creating build/lib/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:54,895 copying colossalai/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:54,899 copying colossalai/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:54,902 copying colossalai/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:54,907 copying colossalai/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:54,911 copying colossalai/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:54,915 copying colossalai/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:54,921 creating build/lib/colossalai/nn/layer/parallel_2p5d 2023-08-01T07:33:54,922 copying colossalai/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2p5d 2023-08-01T07:33:54,926 copying colossalai/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2p5d 2023-08-01T07:33:54,932 copying colossalai/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/nn/layer/parallel_2p5d 2023-08-01T07:33:54,940 copying colossalai/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2p5d 2023-08-01T07:33:54,945 creating build/lib/colossalai/nn/layer/parallel_3d 2023-08-01T07:33:54,947 copying colossalai/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/nn/layer/parallel_3d 2023-08-01T07:33:54,951 copying colossalai/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/nn/layer/parallel_3d 2023-08-01T07:33:54,956 copying colossalai/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/nn/layer/parallel_3d 2023-08-01T07:33:54,964 copying colossalai/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/nn/layer/parallel_3d 2023-08-01T07:33:54,969 creating build/lib/colossalai/nn/layer/parallel_2d 2023-08-01T07:33:54,971 copying colossalai/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2d 2023-08-01T07:33:54,975 copying colossalai/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2d 2023-08-01T07:33:54,980 copying colossalai/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/nn/layer/parallel_2d 2023-08-01T07:33:54,988 copying colossalai/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2d 2023-08-01T07:33:54,993 creating build/lib/colossalai/nn/layer/parallel_1d 2023-08-01T07:33:54,994 copying colossalai/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/nn/layer/parallel_1d 2023-08-01T07:33:54,998 copying colossalai/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/nn/layer/parallel_1d 2023-08-01T07:33:55,002 copying colossalai/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/nn/layer/parallel_1d 2023-08-01T07:33:55,008 copying colossalai/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/nn/layer/parallel_1d 2023-08-01T07:33:55,015 creating build/lib/colossalai/nn/layer/moe 2023-08-01T07:33:55,017 copying colossalai/nn/layer/moe/experts.py -> build/lib/colossalai/nn/layer/moe 2023-08-01T07:33:55,021 copying colossalai/nn/layer/moe/checkpoint.py -> build/lib/colossalai/nn/layer/moe 2023-08-01T07:33:55,025 copying colossalai/nn/layer/moe/__init__.py -> build/lib/colossalai/nn/layer/moe 2023-08-01T07:33:55,028 copying colossalai/nn/layer/moe/_operation.py -> build/lib/colossalai/nn/layer/moe 2023-08-01T07:33:55,033 copying colossalai/nn/layer/moe/layers.py -> build/lib/colossalai/nn/layer/moe 2023-08-01T07:33:55,037 copying colossalai/nn/layer/moe/utils.py -> build/lib/colossalai/nn/layer/moe 2023-08-01T07:33:55,041 copying colossalai/nn/layer/moe/routers.py -> build/lib/colossalai/nn/layer/moe 2023-08-01T07:33:55,047 creating build/lib/colossalai/nn/layer/wrapper 2023-08-01T07:33:55,049 copying colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/nn/layer/wrapper 2023-08-01T07:33:55,052 copying colossalai/nn/layer/wrapper/__init__.py -> build/lib/colossalai/nn/layer/wrapper 2023-08-01T07:33:55,057 creating build/lib/colossalai/nn/layer/utils 2023-08-01T07:33:55,059 copying colossalai/nn/layer/utils/__init__.py -> build/lib/colossalai/nn/layer/utils 2023-08-01T07:33:55,063 copying colossalai/nn/layer/utils/common.py -> build/lib/colossalai/nn/layer/utils 2023-08-01T07:33:55,068 creating build/lib/colossalai/nn/parallel/layers 2023-08-01T07:33:55,070 copying colossalai/nn/parallel/layers/colo_module.py -> build/lib/colossalai/nn/parallel/layers 2023-08-01T07:33:55,074 copying colossalai/nn/parallel/layers/module_utils.py -> build/lib/colossalai/nn/parallel/layers 2023-08-01T07:33:55,078 copying colossalai/nn/parallel/layers/__init__.py -> build/lib/colossalai/nn/parallel/layers 2023-08-01T07:33:55,082 copying colossalai/nn/parallel/layers/linear.py -> build/lib/colossalai/nn/parallel/layers 2023-08-01T07:33:55,085 copying colossalai/nn/parallel/layers/embedding.py -> build/lib/colossalai/nn/parallel/layers 2023-08-01T07:33:55,092 creating build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:55,093 copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:55,098 copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:55,103 copying colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:55,107 copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:55,111 copying colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:55,115 copying colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:55,119 copying colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:55,123 copying colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:55,127 copying colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:55,134 creating build/lib/colossalai/shardformer/shard 2023-08-01T07:33:55,136 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2023-08-01T07:33:55,139 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2023-08-01T07:33:55,143 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2023-08-01T07:33:55,147 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2023-08-01T07:33:55,153 creating build/lib/colossalai/shardformer/layer 2023-08-01T07:33:55,155 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2023-08-01T07:33:55,159 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2023-08-01T07:33:55,163 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2023-08-01T07:33:55,167 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2023-08-01T07:33:55,172 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2023-08-01T07:33:55,177 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2023-08-01T07:33:55,181 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2023-08-01T07:33:55,185 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2023-08-01T07:33:55,190 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2023-08-01T07:33:55,194 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2023-08-01T07:33:55,202 creating build/lib/colossalai/shardformer/policies 2023-08-01T07:33:55,204 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2023-08-01T07:33:55,209 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2023-08-01T07:33:55,213 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2023-08-01T07:33:55,217 copying colossalai/shardformer/policies/basepolicy.py -> build/lib/colossalai/shardformer/policies 2023-08-01T07:33:55,222 copying colossalai/shardformer/policies/autopolicy.py -> build/lib/colossalai/shardformer/policies 2023-08-01T07:33:55,226 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2023-08-01T07:33:55,229 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2023-08-01T07:33:55,233 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2023-08-01T07:33:55,238 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2023-08-01T07:33:55,242 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2023-08-01T07:33:55,248 creating build/lib/colossalai/shardformer/modeling 2023-08-01T07:33:55,250 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2023-08-01T07:33:55,253 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2023-08-01T07:33:55,258 creating build/lib/colossalai/utils/data_sampler 2023-08-01T07:33:55,260 copying colossalai/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/utils/data_sampler 2023-08-01T07:33:55,265 copying colossalai/utils/data_sampler/__init__.py -> build/lib/colossalai/utils/data_sampler 2023-08-01T07:33:55,269 copying colossalai/utils/data_sampler/base_sampler.py -> build/lib/colossalai/utils/data_sampler 2023-08-01T07:33:55,274 creating build/lib/colossalai/utils/checkpoint_io 2023-08-01T07:33:55,276 copying colossalai/utils/checkpoint_io/constant.py -> build/lib/colossalai/utils/checkpoint_io 2023-08-01T07:33:55,281 copying colossalai/utils/checkpoint_io/convertor.py -> build/lib/colossalai/utils/checkpoint_io 2023-08-01T07:33:55,285 copying colossalai/utils/checkpoint_io/__init__.py -> build/lib/colossalai/utils/checkpoint_io 2023-08-01T07:33:55,289 copying colossalai/utils/checkpoint_io/reader.py -> build/lib/colossalai/utils/checkpoint_io 2023-08-01T07:33:55,293 copying colossalai/utils/checkpoint_io/meta.py -> build/lib/colossalai/utils/checkpoint_io 2023-08-01T07:33:55,297 copying colossalai/utils/checkpoint_io/utils.py -> build/lib/colossalai/utils/checkpoint_io 2023-08-01T07:33:55,302 copying colossalai/utils/checkpoint_io/writer.py -> build/lib/colossalai/utils/checkpoint_io 2023-08-01T07:33:55,306 copying colossalai/utils/checkpoint_io/distributed.py -> build/lib/colossalai/utils/checkpoint_io 2023-08-01T07:33:55,310 copying colossalai/utils/checkpoint_io/io.py -> build/lib/colossalai/utils/checkpoint_io 2023-08-01T07:33:55,315 copying colossalai/utils/checkpoint_io/backend.py -> build/lib/colossalai/utils/checkpoint_io 2023-08-01T07:33:55,320 creating build/lib/colossalai/utils/tensor_detector 2023-08-01T07:33:55,322 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2023-08-01T07:33:55,326 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2023-08-01T07:33:55,331 creating build/lib/colossalai/utils/model 2023-08-01T07:33:55,333 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2023-08-01T07:33:55,336 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2023-08-01T07:33:55,342 creating build/lib/colossalai/utils/profiler 2023-08-01T07:33:55,344 copying colossalai/utils/profiler/profiler.py -> build/lib/colossalai/utils/profiler 2023-08-01T07:33:55,348 copying colossalai/utils/profiler/__init__.py -> build/lib/colossalai/utils/profiler 2023-08-01T07:33:55,352 copying colossalai/utils/profiler/extention.py -> build/lib/colossalai/utils/profiler 2023-08-01T07:33:55,356 copying colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/utils/profiler 2023-08-01T07:33:55,361 creating build/lib/colossalai/utils/multi_tensor_apply 2023-08-01T07:33:55,363 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2023-08-01T07:33:55,367 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2023-08-01T07:33:55,372 creating build/lib/colossalai/utils/rank_recorder 2023-08-01T07:33:55,374 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2023-08-01T07:33:55,378 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2023-08-01T07:33:55,383 creating build/lib/colossalai/utils/checkpoint 2023-08-01T07:33:55,385 copying colossalai/utils/checkpoint/__init__.py -> build/lib/colossalai/utils/checkpoint 2023-08-01T07:33:55,390 copying colossalai/utils/checkpoint/utils.py -> build/lib/colossalai/utils/checkpoint 2023-08-01T07:33:55,393 copying colossalai/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/utils/checkpoint 2023-08-01T07:33:55,399 creating build/lib/colossalai/utils/profiler/legacy 2023-08-01T07:33:55,401 copying colossalai/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/utils/profiler/legacy 2023-08-01T07:33:55,405 copying colossalai/utils/profiler/legacy/__init__.py -> build/lib/colossalai/utils/profiler/legacy 2023-08-01T07:33:55,409 copying colossalai/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/utils/profiler/legacy 2023-08-01T07:33:55,414 copying colossalai/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/utils/profiler/legacy 2023-08-01T07:33:55,455 creating build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,457 copying colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,462 copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,468 copying colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,473 copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,477 copying colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,482 copying colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,487 copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,493 copying colossalai/kernel/cuda_native/csrc/type_shim.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,498 copying colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,503 copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,507 copying colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,511 copying colossalai/kernel/cuda_native/csrc/compat.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,516 copying colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,520 copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,524 copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,529 copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,533 copying colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,538 copying colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,543 copying colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,548 copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,554 copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,558 copying colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,564 copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:55,569 creating build/lib/colossalai/kernel/cuda_native/csrc/kernels 2023-08-01T07:33:55,570 creating build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,573 copying colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,577 copying colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,582 copying colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,587 copying colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,591 copying colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,595 copying colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,600 copying colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,604 copying colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,608 copying colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,612 copying colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,617 copying colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,622 copying colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:55,886 /usr/local/lib/python3.7/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-08-01T07:33:55,887 !! 2023-08-01T07:33:55,888 ******************************************************************************** 2023-08-01T07:33:55,888 Please avoid running ``setup.py`` directly. 2023-08-01T07:33:55,889 Instead, use pypa/build, pypa/installer, pypa/build or 2023-08-01T07:33:55,889 other standards-based tools. 2023-08-01T07:33:55,890 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-08-01T07:33:55,890 ******************************************************************************** 2023-08-01T07:33:55,891 !! 2023-08-01T07:33:55,891 self.initialize_options() 2023-08-01T07:33:55,956 installing to build/bdist.linux-armv7l/wheel 2023-08-01T07:33:55,956 running install 2023-08-01T07:33:56,016 running install_lib 2023-08-01T07:33:56,086 creating build/bdist.linux-armv7l 2023-08-01T07:33:56,087 creating build/bdist.linux-armv7l/wheel 2023-08-01T07:33:56,092 creating build/bdist.linux-armv7l/wheel/colossalai 2023-08-01T07:33:56,095 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2023-08-01T07:33:56,098 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-08-01T07:33:56,100 copying build/lib/colossalai/kernel/cuda_native/layer_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-08-01T07:33:56,104 copying build/lib/colossalai/kernel/cuda_native/flash_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-08-01T07:33:56,110 copying build/lib/colossalai/kernel/cuda_native/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-08-01T07:33:56,113 copying build/lib/colossalai/kernel/cuda_native/multihead_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-08-01T07:33:56,118 copying build/lib/colossalai/kernel/cuda_native/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-08-01T07:33:56,125 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,127 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,131 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,136 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,142 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels 2023-08-01T07:33:56,145 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,147 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,151 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,156 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,160 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,163 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,167 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,171 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,174 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,178 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,182 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,186 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,190 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-08-01T07:33:56,194 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,199 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,203 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,208 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,213 copying build/lib/colossalai/kernel/cuda_native/csrc/type_shim.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,218 copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,222 copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,226 copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,230 copying build/lib/colossalai/kernel/cuda_native/csrc/compat.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,234 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,239 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,242 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,246 copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,250 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,254 copying build/lib/colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,258 copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,264 copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,269 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,273 copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,278 copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-08-01T07:33:56,283 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2023-08-01T07:33:56,288 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-08-01T07:33:56,290 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-08-01T07:33:56,294 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-08-01T07:33:56,298 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-08-01T07:33:56,302 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-08-01T07:33:56,307 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-08-01T07:33:56,308 copying build/lib/colossalai/kernel/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-08-01T07:33:56,312 copying build/lib/colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-08-01T07:33:56,316 copying build/lib/colossalai/kernel/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-08-01T07:33:56,320 copying build/lib/colossalai/kernel/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-08-01T07:33:56,323 copying build/lib/colossalai/kernel/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-08-01T07:33:56,327 copying build/lib/colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-08-01T07:33:56,331 copying build/lib/colossalai/kernel/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-08-01T07:33:56,335 copying build/lib/colossalai/kernel/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-08-01T07:33:56,339 copying build/lib/colossalai/kernel/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-08-01T07:33:56,343 copying build/lib/colossalai/kernel/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-08-01T07:33:56,349 creating build/bdist.linux-armv7l/wheel/colossalai/context 2023-08-01T07:33:56,351 copying build/lib/colossalai/context/moe_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-08-01T07:33:56,355 copying build/lib/colossalai/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-08-01T07:33:56,360 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-08-01T07:33:56,364 creating build/bdist.linux-armv7l/wheel/colossalai/context/random 2023-08-01T07:33:56,366 copying build/lib/colossalai/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random 2023-08-01T07:33:56,371 copying build/lib/colossalai/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random 2023-08-01T07:33:56,374 copying build/lib/colossalai/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random 2023-08-01T07:33:56,378 copying build/lib/colossalai/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-08-01T07:33:56,381 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-08-01T07:33:56,386 creating build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-08-01T07:33:56,388 copying build/lib/colossalai/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-08-01T07:33:56,393 copying build/lib/colossalai/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-08-01T07:33:56,396 copying build/lib/colossalai/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-08-01T07:33:56,400 copying build/lib/colossalai/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-08-01T07:33:56,404 copying build/lib/colossalai/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-08-01T07:33:56,407 copying build/lib/colossalai/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-08-01T07:33:56,412 copying build/lib/colossalai/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-08-01T07:33:56,415 copying build/lib/colossalai/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-08-01T07:33:56,420 copying build/lib/colossalai/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-08-01T07:33:56,424 copying build/lib/colossalai/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-08-01T07:33:56,428 copying build/lib/colossalai/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-08-01T07:33:56,433 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-08-01T07:33:56,439 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2023-08-01T07:33:56,441 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2023-08-01T07:33:56,446 creating build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp 2023-08-01T07:33:56,449 copying build/lib/colossalai/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp 2023-08-01T07:33:56,453 copying build/lib/colossalai/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp 2023-08-01T07:33:56,458 copying build/lib/colossalai/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp 2023-08-01T07:33:56,463 copying build/lib/colossalai/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2023-08-01T07:33:56,469 creating build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp 2023-08-01T07:33:56,471 copying build/lib/colossalai/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp 2023-08-01T07:33:56,476 copying build/lib/colossalai/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp 2023-08-01T07:33:56,481 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-08-01T07:33:56,483 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-08-01T07:33:56,489 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-08-01T07:33:56,491 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-08-01T07:33:56,495 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-08-01T07:33:56,500 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-08-01T07:33:56,504 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-08-01T07:33:56,509 copying build/lib/colossalai/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-08-01T07:33:56,514 copying build/lib/colossalai/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-08-01T07:33:56,520 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2023-08-01T07:33:56,522 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2023-08-01T07:33:56,527 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2023-08-01T07:33:56,531 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2023-08-01T07:33:56,535 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2023-08-01T07:33:56,540 copying build/lib/colossalai/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-08-01T07:33:56,545 creating build/bdist.linux-armv7l/wheel/colossalai/builder 2023-08-01T07:33:56,547 copying build/lib/colossalai/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/builder 2023-08-01T07:33:56,551 copying build/lib/colossalai/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/builder 2023-08-01T07:33:56,556 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2023-08-01T07:33:56,559 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2023-08-01T07:33:56,561 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2023-08-01T07:33:56,564 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2023-08-01T07:33:56,568 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-08-01T07:33:56,570 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-08-01T07:33:56,574 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-08-01T07:33:56,578 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-08-01T07:33:56,583 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-08-01T07:33:56,586 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-08-01T07:33:56,591 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-08-01T07:33:56,594 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-08-01T07:33:56,599 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-08-01T07:33:56,603 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-08-01T07:33:56,607 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-08-01T07:33:56,613 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-08-01T07:33:56,615 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-08-01T07:33:56,619 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-08-01T07:33:56,625 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-08-01T07:33:56,629 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-08-01T07:33:56,632 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-08-01T07:33:56,636 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-08-01T07:33:56,641 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-08-01T07:33:56,645 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,647 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,654 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,659 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,663 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,667 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,671 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,676 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,680 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,683 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,688 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,693 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,695 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,699 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,704 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,708 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,712 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,716 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,720 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,725 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,729 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,736 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,740 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,744 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,748 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,753 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,757 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,762 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,766 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,770 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,773 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-08-01T07:33:56,778 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,781 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,785 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,788 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,792 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,796 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,800 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,803 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,807 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,811 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,814 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,818 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,821 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,825 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,829 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,833 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,837 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-08-01T07:33:56,840 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-08-01T07:33:56,843 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-08-01T07:33:56,847 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-08-01T07:33:56,851 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-08-01T07:33:56,857 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-08-01T07:33:56,858 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-08-01T07:33:56,864 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-08-01T07:33:56,868 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-08-01T07:33:56,872 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-08-01T07:33:56,876 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-08-01T07:33:56,881 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-08-01T07:33:56,886 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:56,888 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:56,893 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:56,896 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:56,901 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:56,905 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:56,910 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-08-01T07:33:56,915 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:56,917 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:56,920 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:56,925 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:56,929 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:56,933 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:56,937 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-08-01T07:33:56,942 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-08-01T07:33:56,944 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-08-01T07:33:56,949 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:56,951 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:56,955 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:56,959 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:56,962 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:56,967 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:56,972 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:56,975 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:56,980 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:56,983 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:56,987 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:56,992 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-08-01T07:33:56,995 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-08-01T07:33:56,999 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-08-01T07:33:57,003 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-08-01T07:33:57,006 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-08-01T07:33:57,011 creating build/bdist.linux-armv7l/wheel/colossalai/registry 2023-08-01T07:33:57,013 copying build/lib/colossalai/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/registry 2023-08-01T07:33:57,017 copying build/lib/colossalai/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/registry 2023-08-01T07:33:57,020 copying build/lib/colossalai/core.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-08-01T07:33:57,025 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2023-08-01T07:33:57,027 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C 2023-08-01T07:33:57,031 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-08-01T07:33:57,033 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-08-01T07:33:57,037 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-08-01T07:33:57,041 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-08-01T07:33:57,046 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-08-01T07:33:57,050 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-08-01T07:33:57,056 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2023-08-01T07:33:57,058 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2023-08-01T07:33:57,063 creating build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark 2023-08-01T07:33:57,064 copying build/lib/colossalai/cli/benchmark/models.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark 2023-08-01T07:33:57,068 copying build/lib/colossalai/cli/benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark 2023-08-01T07:33:57,072 copying build/lib/colossalai/cli/benchmark/benchmark.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark 2023-08-01T07:33:57,076 copying build/lib/colossalai/cli/benchmark/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark 2023-08-01T07:33:57,080 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2023-08-01T07:33:57,085 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2023-08-01T07:33:57,087 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2023-08-01T07:33:57,091 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2023-08-01T07:33:57,096 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-08-01T07:33:57,098 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-08-01T07:33:57,102 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-08-01T07:33:57,106 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-08-01T07:33:57,110 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-08-01T07:33:57,115 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2023-08-01T07:33:57,117 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-08-01T07:33:57,122 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-08-01T07:33:57,126 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-08-01T07:33:57,131 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-08-01T07:33:57,134 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2023-08-01T07:33:57,136 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2023-08-01T07:33:57,141 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-08-01T07:33:57,143 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-08-01T07:33:57,147 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-08-01T07:33:57,150 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-08-01T07:33:57,154 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-08-01T07:33:57,158 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-08-01T07:33:57,163 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-08-01T07:33:57,165 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-08-01T07:33:57,169 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-08-01T07:33:57,173 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-08-01T07:33:57,176 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-08-01T07:33:57,180 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-08-01T07:33:57,184 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-08-01T07:33:57,190 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2023-08-01T07:33:57,193 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:57,195 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:57,199 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:57,203 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:57,206 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:57,211 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:57,214 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:57,218 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:57,223 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-08-01T07:33:57,228 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:57,230 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:57,234 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:57,237 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:57,241 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:57,245 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:57,249 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:57,252 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:57,256 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-08-01T07:33:57,260 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2023-08-01T07:33:57,264 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-08-01T07:33:57,267 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-08-01T07:33:57,271 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-08-01T07:33:57,275 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-08-01T07:33:57,279 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-08-01T07:33:57,286 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2023-08-01T07:33:57,287 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2023-08-01T07:33:57,291 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2023-08-01T07:33:57,299 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-08-01T07:33:57,301 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-08-01T07:33:57,306 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-08-01T07:33:57,311 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-08-01T07:33:57,315 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-08-01T07:33:57,319 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-08-01T07:33:57,323 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-08-01T07:33:57,326 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-08-01T07:33:57,331 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-08-01T07:33:57,334 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:57,337 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:57,341 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:57,344 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:57,348 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:57,352 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:57,355 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:57,359 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:57,363 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:57,367 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:57,371 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:57,374 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-08-01T07:33:57,378 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-08-01T07:33:57,382 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-08-01T07:33:57,386 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-08-01T07:33:57,390 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-08-01T07:33:57,395 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:57,396 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:57,400 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:57,404 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:57,408 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:57,411 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:57,415 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:57,419 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:57,423 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:57,427 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-08-01T07:33:57,431 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-08-01T07:33:57,434 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-08-01T07:33:57,438 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-08-01T07:33:57,443 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-08-01T07:33:57,448 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-08-01T07:33:57,450 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-08-01T07:33:57,455 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-08-01T07:33:57,459 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-08-01T07:33:57,464 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-08-01T07:33:57,468 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-08-01T07:33:57,472 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-08-01T07:33:57,476 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-08-01T07:33:57,481 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-08-01T07:33:57,485 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-08-01T07:33:57,490 creating build/bdist.linux-armv7l/wheel/colossalai/trainer 2023-08-01T07:33:57,492 copying build/lib/colossalai/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer 2023-08-01T07:33:57,497 copying build/lib/colossalai/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer 2023-08-01T07:33:57,502 creating build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-08-01T07:33:57,503 copying build/lib/colossalai/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-08-01T07:33:57,508 copying build/lib/colossalai/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-08-01T07:33:57,512 copying build/lib/colossalai/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-08-01T07:33:57,516 copying build/lib/colossalai/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-08-01T07:33:57,521 copying build/lib/colossalai/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-08-01T07:33:57,524 copying build/lib/colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-08-01T07:33:57,528 copying build/lib/colossalai/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-08-01T07:33:57,532 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-08-01T07:33:57,537 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-08-01T07:33:57,539 copying build/lib/colossalai/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-08-01T07:33:57,544 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-08-01T07:33:57,548 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware 2023-08-01T07:33:57,551 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor 2023-08-01T07:33:57,553 copying build/lib/colossalai/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor 2023-08-01T07:33:57,557 copying build/lib/colossalai/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor 2023-08-01T07:33:57,562 copying build/lib/colossalai/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware 2023-08-01T07:33:57,565 copying build/lib/colossalai/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware 2023-08-01T07:33:57,570 copying build/lib/colossalai/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-08-01T07:33:57,573 copying build/lib/colossalai/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-08-01T07:33:57,579 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc 2023-08-01T07:33:57,581 copying build/lib/colossalai/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc 2023-08-01T07:33:57,586 copying build/lib/colossalai/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc 2023-08-01T07:33:57,590 copying build/lib/colossalai/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc 2023-08-01T07:33:57,597 copying build/lib/colossalai/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc 2023-08-01T07:33:57,602 copying build/lib/colossalai/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-08-01T07:33:57,608 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2023-08-01T07:33:57,610 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2023-08-01T07:33:57,614 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2023-08-01T07:33:57,620 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,622 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,629 copying build/lib/colossalai/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,632 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,637 copying build/lib/colossalai/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,641 copying build/lib/colossalai/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,647 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-08-01T07:33:57,649 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-08-01T07:33:57,653 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-08-01T07:33:57,657 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-08-01T07:33:57,661 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-08-01T07:33:57,667 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-08-01T07:33:57,671 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-08-01T07:33:57,675 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-08-01T07:33:57,678 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-08-01T07:33:57,683 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,686 copying build/lib/colossalai/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,690 copying build/lib/colossalai/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,694 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,699 copying build/lib/colossalai/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,702 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,707 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,711 copying build/lib/colossalai/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,715 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,719 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-08-01T07:33:57,726 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2023-08-01T07:33:57,728 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-08-01T07:33:57,730 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-08-01T07:33:57,735 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:57,737 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:57,742 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:57,745 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:57,750 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:57,753 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:57,757 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-08-01T07:33:57,762 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-08-01T07:33:57,766 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-08-01T07:33:57,772 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-08-01T07:33:57,775 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-08-01T07:33:57,780 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2023-08-01T07:33:57,782 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2023-08-01T07:33:57,786 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2023-08-01T07:33:57,790 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2023-08-01T07:33:57,795 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2023-08-01T07:33:57,799 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-08-01T07:33:57,800 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-08-01T07:33:57,806 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-08-01T07:33:57,810 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-08-01T07:33:57,815 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-08-01T07:33:57,819 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-08-01T07:33:57,822 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2023-08-01T07:33:57,826 copying build/lib/colossalai/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-08-01T07:33:57,830 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2023-08-01T07:33:57,832 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2023-08-01T07:33:57,836 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2023-08-01T07:33:57,839 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2023-08-01T07:33:57,844 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2023-08-01T07:33:57,847 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-08-01T07:33:57,848 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-08-01T07:33:57,853 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-08-01T07:33:57,858 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-08-01T07:33:57,861 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-08-01T07:33:57,864 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-08-01T07:33:57,869 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-08-01T07:33:57,873 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-08-01T07:33:57,876 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2023-08-01T07:33:57,881 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2023-08-01T07:33:57,885 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-08-01T07:33:57,887 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-08-01T07:33:57,891 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-08-01T07:33:57,894 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-08-01T07:33:57,897 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-08-01T07:33:57,901 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-08-01T07:33:57,905 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-08-01T07:33:57,908 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-08-01T07:33:57,912 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2023-08-01T07:33:57,916 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-08-01T07:33:57,918 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-08-01T07:33:57,922 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-08-01T07:33:57,925 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-08-01T07:33:57,930 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-08-01T07:33:57,934 creating build/bdist.linux-armv7l/wheel/colossalai/device 2023-08-01T07:33:57,935 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2023-08-01T07:33:57,940 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2023-08-01T07:33:57,944 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2023-08-01T07:33:57,947 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2023-08-01T07:33:57,953 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2023-08-01T07:33:57,955 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2023-08-01T07:33:57,960 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2023-08-01T07:33:57,965 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2023-08-01T07:33:57,967 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2023-08-01T07:33:57,973 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:57,975 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:57,979 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:57,982 copying build/lib/colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:57,985 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:57,989 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:57,992 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-08-01T07:33:57,996 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2023-08-01T07:33:57,999 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2023-08-01T07:33:58,005 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy 2023-08-01T07:33:58,008 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:58,010 copying build/lib/colossalai/zero/legacy/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:58,014 copying build/lib/colossalai/zero/legacy/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:58,018 copying build/lib/colossalai/zero/legacy/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:58,023 copying build/lib/colossalai/zero/legacy/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:58,031 copying build/lib/colossalai/zero/legacy/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:58,036 copying build/lib/colossalai/zero/legacy/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-08-01T07:33:58,042 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/shard_utils 2023-08-01T07:33:58,044 copying build/lib/colossalai/zero/legacy/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/shard_utils 2023-08-01T07:33:58,049 copying build/lib/colossalai/zero/legacy/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/shard_utils 2023-08-01T07:33:58,054 copying build/lib/colossalai/zero/legacy/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/shard_utils 2023-08-01T07:33:58,058 copying build/lib/colossalai/zero/legacy/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/shard_utils 2023-08-01T07:33:58,063 copying build/lib/colossalai/zero/legacy/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/shard_utils 2023-08-01T07:33:58,070 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/init_ctx 2023-08-01T07:33:58,073 copying build/lib/colossalai/zero/legacy/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/init_ctx 2023-08-01T07:33:58,078 copying build/lib/colossalai/zero/legacy/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/init_ctx 2023-08-01T07:33:58,082 copying build/lib/colossalai/zero/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy 2023-08-01T07:33:58,088 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-08-01T07:33:58,091 copying build/lib/colossalai/zero/legacy/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-08-01T07:33:58,096 copying build/lib/colossalai/zero/legacy/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-08-01T07:33:58,100 copying build/lib/colossalai/zero/legacy/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-08-01T07:33:58,105 copying build/lib/colossalai/zero/legacy/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-08-01T07:33:58,111 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/paramhooks 2023-08-01T07:33:58,114 copying build/lib/colossalai/zero/legacy/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/paramhooks 2023-08-01T07:33:58,118 copying build/lib/colossalai/zero/legacy/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/paramhooks 2023-08-01T07:33:58,122 copying build/lib/colossalai/zero/legacy/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-08-01T07:33:58,126 copying build/lib/colossalai/zero/legacy/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-08-01T07:33:58,132 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/ophooks 2023-08-01T07:33:58,134 copying build/lib/colossalai/zero/legacy/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/ophooks 2023-08-01T07:33:58,138 copying build/lib/colossalai/zero/legacy/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/ophooks 2023-08-01T07:33:58,142 copying build/lib/colossalai/zero/legacy/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/ophooks 2023-08-01T07:33:58,145 copying build/lib/colossalai/zero/legacy/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/ophooks 2023-08-01T07:33:58,150 copying build/lib/colossalai/zero/legacy/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/ophooks 2023-08-01T07:33:58,155 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_param 2023-08-01T07:33:58,157 copying build/lib/colossalai/zero/legacy/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_param 2023-08-01T07:33:58,160 copying build/lib/colossalai/zero/legacy/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_param 2023-08-01T07:33:58,164 copying build/lib/colossalai/zero/legacy/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_param 2023-08-01T07:33:58,169 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_optim 2023-08-01T07:33:58,170 copying build/lib/colossalai/zero/legacy/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_optim 2023-08-01T07:33:58,174 copying build/lib/colossalai/zero/legacy/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_optim 2023-08-01T07:33:58,180 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-08-01T07:33:58,182 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-08-01T07:33:58,188 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-08-01T07:33:58,192 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-08-01T07:33:58,197 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:58,199 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:58,203 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:58,207 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:58,210 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:58,214 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:58,218 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:58,222 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:58,226 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:58,230 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-08-01T07:33:58,233 copying build/lib/colossalai/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-08-01T07:33:58,238 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-08-01T07:33:58,241 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-08-01T07:33:58,246 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-08-01T07:33:58,251 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-08-01T07:33:58,253 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-08-01T07:33:58,257 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-08-01T07:33:58,262 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-08-01T07:33:58,267 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-08-01T07:33:58,271 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-08-01T07:33:58,275 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-08-01T07:33:58,282 creating build/bdist.linux-armv7l/wheel/colossalai/engine 2023-08-01T07:33:58,284 copying build/lib/colossalai/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine 2023-08-01T07:33:58,288 copying build/lib/colossalai/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/engine 2023-08-01T07:33:58,294 creating build/bdist.linux-armv7l/wheel/colossalai/engine/schedule 2023-08-01T07:33:58,296 copying build/lib/colossalai/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule 2023-08-01T07:33:58,301 copying build/lib/colossalai/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule 2023-08-01T07:33:58,308 copying build/lib/colossalai/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule 2023-08-01T07:33:58,311 copying build/lib/colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule 2023-08-01T07:33:58,315 copying build/lib/colossalai/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule 2023-08-01T07:33:58,320 creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation 2023-08-01T07:33:58,322 copying build/lib/colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation 2023-08-01T07:33:58,327 copying build/lib/colossalai/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation 2023-08-01T07:33:58,332 creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-08-01T07:33:58,334 copying build/lib/colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-08-01T07:33:58,338 copying build/lib/colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-08-01T07:33:58,341 copying build/lib/colossalai/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-08-01T07:33:58,345 copying build/lib/colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-08-01T07:33:58,349 copying build/lib/colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-08-01T07:33:58,352 copying build/lib/colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-08-01T07:33:58,356 copying build/lib/colossalai/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-08-01T07:33:58,359 copying build/lib/colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-08-01T07:33:58,364 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2023-08-01T07:33:58,366 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-08-01T07:33:58,370 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-08-01T07:33:58,373 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-08-01T07:33:58,377 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-08-01T07:33:58,381 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-08-01T07:33:58,385 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-08-01T07:33:58,392 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2023-08-01T07:33:58,395 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-08-01T07:33:58,397 copying build/lib/colossalai/nn/loss/loss_moe.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-08-01T07:33:58,401 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-08-01T07:33:58,404 copying build/lib/colossalai/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-08-01T07:33:58,409 copying build/lib/colossalai/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-08-01T07:33:58,413 copying build/lib/colossalai/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-08-01T07:33:58,417 copying build/lib/colossalai/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-08-01T07:33:58,421 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2023-08-01T07:33:58,426 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2023-08-01T07:33:58,431 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2023-08-01T07:33:58,433 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla 2023-08-01T07:33:58,436 copying build/lib/colossalai/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla 2023-08-01T07:33:58,440 copying build/lib/colossalai/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla 2023-08-01T07:33:58,446 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence 2023-08-01T07:33:58,447 copying build/lib/colossalai/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence 2023-08-01T07:33:58,451 copying build/lib/colossalai/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence 2023-08-01T07:33:58,455 copying build/lib/colossalai/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence 2023-08-01T07:33:58,460 copying build/lib/colossalai/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence 2023-08-01T07:33:58,464 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:58,466 copying build/lib/colossalai/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:58,470 copying build/lib/colossalai/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:58,473 copying build/lib/colossalai/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:58,478 copying build/lib/colossalai/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:58,481 copying build/lib/colossalai/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:58,486 copying build/lib/colossalai/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-08-01T07:33:58,490 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d 2023-08-01T07:33:58,492 copying build/lib/colossalai/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d 2023-08-01T07:33:58,496 copying build/lib/colossalai/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d 2023-08-01T07:33:58,502 copying build/lib/colossalai/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d 2023-08-01T07:33:58,509 copying build/lib/colossalai/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d 2023-08-01T07:33:58,514 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d 2023-08-01T07:33:58,516 copying build/lib/colossalai/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d 2023-08-01T07:33:58,520 copying build/lib/colossalai/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d 2023-08-01T07:33:58,526 copying build/lib/colossalai/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d 2023-08-01T07:33:58,533 copying build/lib/colossalai/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d 2023-08-01T07:33:58,537 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2023-08-01T07:33:58,542 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d 2023-08-01T07:33:58,543 copying build/lib/colossalai/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d 2023-08-01T07:33:58,547 copying build/lib/colossalai/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d 2023-08-01T07:33:58,553 copying build/lib/colossalai/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d 2023-08-01T07:33:58,561 copying build/lib/colossalai/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d 2023-08-01T07:33:58,566 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d 2023-08-01T07:33:58,568 copying build/lib/colossalai/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d 2023-08-01T07:33:58,572 copying build/lib/colossalai/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d 2023-08-01T07:33:58,575 copying build/lib/colossalai/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d 2023-08-01T07:33:58,582 copying build/lib/colossalai/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d 2023-08-01T07:33:58,588 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-08-01T07:33:58,590 copying build/lib/colossalai/nn/layer/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-08-01T07:33:58,595 copying build/lib/colossalai/nn/layer/moe/checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-08-01T07:33:58,599 copying build/lib/colossalai/nn/layer/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-08-01T07:33:58,603 copying build/lib/colossalai/nn/layer/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-08-01T07:33:58,607 copying build/lib/colossalai/nn/layer/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-08-01T07:33:58,612 copying build/lib/colossalai/nn/layer/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-08-01T07:33:58,616 copying build/lib/colossalai/nn/layer/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-08-01T07:33:58,621 copying build/lib/colossalai/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2023-08-01T07:33:58,625 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper 2023-08-01T07:33:58,627 copying build/lib/colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper 2023-08-01T07:33:58,631 copying build/lib/colossalai/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper 2023-08-01T07:33:58,637 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils 2023-08-01T07:33:58,638 copying build/lib/colossalai/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils 2023-08-01T07:33:58,642 copying build/lib/colossalai/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils 2023-08-01T07:33:58,647 creating build/bdist.linux-armv7l/wheel/colossalai/nn/metric 2023-08-01T07:33:58,649 copying build/lib/colossalai/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric 2023-08-01T07:33:58,653 copying build/lib/colossalai/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric 2023-08-01T07:33:58,657 copying build/lib/colossalai/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric 2023-08-01T07:33:58,661 copying build/lib/colossalai/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric 2023-08-01T07:33:58,667 copying build/lib/colossalai/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric 2023-08-01T07:33:58,672 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-08-01T07:33:58,674 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-08-01T07:33:58,678 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-08-01T07:33:58,682 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-08-01T07:33:58,686 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-08-01T07:33:58,690 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-08-01T07:33:58,694 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-08-01T07:33:58,699 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-08-01T07:33:58,702 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-08-01T07:33:58,708 creating build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-08-01T07:33:58,709 copying build/lib/colossalai/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-08-01T07:33:58,713 copying build/lib/colossalai/nn/_ops/batch_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-08-01T07:33:58,717 copying build/lib/colossalai/nn/_ops/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-08-01T07:33:58,721 copying build/lib/colossalai/nn/_ops/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-08-01T07:33:58,725 copying build/lib/colossalai/nn/_ops/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-08-01T07:33:58,729 copying build/lib/colossalai/nn/_ops/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-08-01T07:33:58,733 copying build/lib/colossalai/nn/_ops/embedding_bag.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-08-01T07:33:58,738 copying build/lib/colossalai/nn/_ops/element_wise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-08-01T07:33:58,742 copying build/lib/colossalai/nn/_ops/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-08-01T07:33:58,747 copying build/lib/colossalai/nn/_ops/view.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-08-01T07:33:58,750 copying build/lib/colossalai/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-08-01T07:33:58,756 creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel 2023-08-01T07:33:58,758 copying build/lib/colossalai/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel 2023-08-01T07:33:58,762 copying build/lib/colossalai/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel 2023-08-01T07:33:58,766 copying build/lib/colossalai/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel 2023-08-01T07:33:58,771 creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers 2023-08-01T07:33:58,773 copying build/lib/colossalai/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers 2023-08-01T07:33:58,777 copying build/lib/colossalai/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers 2023-08-01T07:33:58,781 copying build/lib/colossalai/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers 2023-08-01T07:33:58,785 copying build/lib/colossalai/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers 2023-08-01T07:33:58,789 copying build/lib/colossalai/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers 2023-08-01T07:33:58,794 creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:58,796 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:58,800 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:58,805 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:58,809 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:58,813 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:58,817 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:58,822 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:58,825 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:58,829 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-08-01T07:33:58,837 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-08-01T07:33:58,838 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-08-01T07:33:58,843 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-08-01T07:33:58,847 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-08-01T07:33:58,852 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-08-01T07:33:58,856 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-08-01T07:33:58,860 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-08-01T07:33:58,865 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-08-01T07:33:58,869 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-08-01T07:33:58,873 copying build/lib/colossalai/nn/optimizer/colossalai_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-08-01T07:33:58,877 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-08-01T07:33:58,882 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2023-08-01T07:33:58,884 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2023-08-01T07:33:58,888 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2023-08-01T07:33:58,893 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2023-08-01T07:33:58,896 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2023-08-01T07:33:58,898 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2023-08-01T07:33:58,902 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2023-08-01T07:33:58,906 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2023-08-01T07:33:58,909 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2023-08-01T07:33:58,914 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2023-08-01T07:33:58,919 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-08-01T07:33:58,921 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-08-01T07:33:58,925 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-08-01T07:33:58,929 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-08-01T07:33:58,933 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-08-01T07:33:58,938 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-08-01T07:33:58,942 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-08-01T07:33:58,946 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-08-01T07:33:58,951 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-08-01T07:33:58,955 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-08-01T07:33:58,960 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2023-08-01T07:33:58,966 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-08-01T07:33:58,968 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-08-01T07:33:58,973 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-08-01T07:33:58,977 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-08-01T07:33:58,982 copying build/lib/colossalai/shardformer/policies/basepolicy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-08-01T07:33:58,986 copying build/lib/colossalai/shardformer/policies/autopolicy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-08-01T07:33:58,991 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-08-01T07:33:58,994 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-08-01T07:33:58,998 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-08-01T07:33:59,003 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-08-01T07:33:59,007 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2023-08-01T07:33:59,013 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-08-01T07:33:59,015 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-08-01T07:33:59,018 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2023-08-01T07:33:59,023 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2023-08-01T07:33:59,028 creating build/bdist.linux-armv7l/wheel/colossalai/communication 2023-08-01T07:33:59,030 copying build/lib/colossalai/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/communication 2023-08-01T07:33:59,035 copying build/lib/colossalai/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/communication 2023-08-01T07:33:59,039 copying build/lib/colossalai/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/communication 2023-08-01T07:33:59,043 copying build/lib/colossalai/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/communication 2023-08-01T07:33:59,047 copying build/lib/colossalai/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/communication 2023-08-01T07:33:59,053 copying build/lib/colossalai/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/communication 2023-08-01T07:33:59,058 copying build/lib/colossalai/constants.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-08-01T07:33:59,063 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2023-08-01T07:33:59,065 copying build/lib/colossalai/utils/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-08-01T07:33:59,070 creating build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler 2023-08-01T07:33:59,072 copying build/lib/colossalai/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler 2023-08-01T07:33:59,078 copying build/lib/colossalai/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler 2023-08-01T07:33:59,081 copying build/lib/colossalai/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler 2023-08-01T07:33:59,085 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-08-01T07:33:59,091 creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-08-01T07:33:59,093 copying build/lib/colossalai/utils/checkpoint_io/constant.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-08-01T07:33:59,097 copying build/lib/colossalai/utils/checkpoint_io/convertor.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-08-01T07:33:59,102 copying build/lib/colossalai/utils/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-08-01T07:33:59,106 copying build/lib/colossalai/utils/checkpoint_io/reader.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-08-01T07:33:59,110 copying build/lib/colossalai/utils/checkpoint_io/meta.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-08-01T07:33:59,114 copying build/lib/colossalai/utils/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-08-01T07:33:59,119 copying build/lib/colossalai/utils/checkpoint_io/writer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-08-01T07:33:59,123 copying build/lib/colossalai/utils/checkpoint_io/distributed.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-08-01T07:33:59,128 copying build/lib/colossalai/utils/checkpoint_io/io.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-08-01T07:33:59,132 copying build/lib/colossalai/utils/checkpoint_io/backend.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-08-01T07:33:59,137 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2023-08-01T07:33:59,139 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2023-08-01T07:33:59,144 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2023-08-01T07:33:59,147 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-08-01T07:33:59,151 copying build/lib/colossalai/utils/cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-08-01T07:33:59,155 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-08-01T07:33:59,160 copying build/lib/colossalai/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-08-01T07:33:59,165 copying build/lib/colossalai/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-08-01T07:33:59,171 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2023-08-01T07:33:59,172 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2023-08-01T07:33:59,176 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2023-08-01T07:33:59,181 creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler 2023-08-01T07:33:59,183 copying build/lib/colossalai/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler 2023-08-01T07:33:59,188 copying build/lib/colossalai/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler 2023-08-01T07:33:59,193 creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy 2023-08-01T07:33:59,194 copying build/lib/colossalai/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy 2023-08-01T07:33:59,198 copying build/lib/colossalai/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy 2023-08-01T07:33:59,202 copying build/lib/colossalai/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy 2023-08-01T07:33:59,207 copying build/lib/colossalai/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy 2023-08-01T07:33:59,211 copying build/lib/colossalai/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler 2023-08-01T07:33:59,214 copying build/lib/colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler 2023-08-01T07:33:59,220 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2023-08-01T07:33:59,221 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2023-08-01T07:33:59,225 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2023-08-01T07:33:59,230 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2023-08-01T07:33:59,232 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2023-08-01T07:33:59,236 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2023-08-01T07:33:59,242 creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint 2023-08-01T07:33:59,243 copying build/lib/colossalai/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint 2023-08-01T07:33:59,248 copying build/lib/colossalai/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint 2023-08-01T07:33:59,251 copying build/lib/colossalai/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint 2023-08-01T07:33:59,256 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-08-01T07:33:59,259 running install_egg_info 2023-08-01T07:33:59,419 running egg_info 2023-08-01T07:33:59,483 writing colossalai.egg-info/PKG-INFO 2023-08-01T07:33:59,488 writing dependency_links to colossalai.egg-info/dependency_links.txt 2023-08-01T07:33:59,492 writing entry points to colossalai.egg-info/entry_points.txt 2023-08-01T07:33:59,495 writing requirements to colossalai.egg-info/requires.txt 2023-08-01T07:33:59,498 writing top-level names to colossalai.egg-info/top_level.txt 2023-08-01T07:33:59,857 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2023-08-01T07:33:59,950 reading manifest template 'MANIFEST.in' 2023-08-01T07:34:02,235 warning: no files found matching '*.tr' under directory 'colossalai' 2023-08-01T07:34:03,367 warning: no files found matching '*.cc' under directory 'colossalai' 2023-08-01T07:34:03,941 warning: no files found matching '*.pyi' under directory 'colossalai' 2023-08-01T07:34:03,960 adding license file 'LICENSE' 2023-08-01T07:34:04,071 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2023-08-01T07:34:04,077 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.3.1-py3.7.egg-info 2023-08-01T07:34:04,106 running install_scripts 2023-08-01T07:34:04,160 creating build/bdist.linux-armv7l/wheel/colossalai-0.3.1.dist-info/WHEEL 2023-08-01T07:34:04,166 creating '/tmp/pip-wheel-pmklw9l5/colossalai-0.3.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-08-01T07:34:04,172 adding 'colossalai/__init__.py' 2023-08-01T07:34:04,175 adding 'colossalai/constants.py' 2023-08-01T07:34:04,178 adding 'colossalai/core.py' 2023-08-01T07:34:04,181 adding 'colossalai/global_variables.py' 2023-08-01T07:34:04,187 adding 'colossalai/initialize.py' 2023-08-01T07:34:04,190 adding 'colossalai/version.py' 2023-08-01T07:34:04,194 adding 'colossalai/_C/__init__.py' 2023-08-01T07:34:04,197 adding 'colossalai/_analyzer/__init__.py' 2023-08-01T07:34:04,200 adding 'colossalai/_analyzer/envs.py' 2023-08-01T07:34:04,203 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2023-08-01T07:34:04,209 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2023-08-01T07:34:04,212 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2023-08-01T07:34:04,218 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2023-08-01T07:34:04,222 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2023-08-01T07:34:04,226 adding 'colossalai/_analyzer/fx/__init__.py' 2023-08-01T07:34:04,232 adding 'colossalai/_analyzer/fx/codegen.py' 2023-08-01T07:34:04,237 adding 'colossalai/_analyzer/fx/graph_module.py' 2023-08-01T07:34:04,241 adding 'colossalai/_analyzer/fx/node_util.py' 2023-08-01T07:34:04,244 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2023-08-01T07:34:04,248 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2023-08-01T07:34:04,252 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2023-08-01T07:34:04,258 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2023-08-01T07:34:04,262 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2023-08-01T07:34:04,265 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2023-08-01T07:34:04,268 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2023-08-01T07:34:04,270 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2023-08-01T07:34:04,274 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2023-08-01T07:34:04,279 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2023-08-01T07:34:04,283 adding 'colossalai/amp/__init__.py' 2023-08-01T07:34:04,285 adding 'colossalai/amp/amp_type.py' 2023-08-01T07:34:04,289 adding 'colossalai/amp/apex_amp/__init__.py' 2023-08-01T07:34:04,292 adding 'colossalai/amp/apex_amp/apex_amp.py' 2023-08-01T07:34:04,296 adding 'colossalai/amp/naive_amp/__init__.py' 2023-08-01T07:34:04,300 adding 'colossalai/amp/naive_amp/_fp16_optimizer.py' 2023-08-01T07:34:04,303 adding 'colossalai/amp/naive_amp/_utils.py' 2023-08-01T07:34:04,307 adding 'colossalai/amp/naive_amp/naive_amp.py' 2023-08-01T07:34:04,311 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2023-08-01T07:34:04,313 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2023-08-01T07:34:04,316 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2023-08-01T07:34:04,319 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2023-08-01T07:34:04,322 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2023-08-01T07:34:04,326 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2023-08-01T07:34:04,329 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2023-08-01T07:34:04,332 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2023-08-01T07:34:04,336 adding 'colossalai/amp/torch_amp/__init__.py' 2023-08-01T07:34:04,344 adding 'colossalai/amp/torch_amp/_grad_scaler.py' 2023-08-01T07:34:04,347 adding 'colossalai/amp/torch_amp/torch_amp.py' 2023-08-01T07:34:04,351 adding 'colossalai/auto_parallel/__init__.py' 2023-08-01T07:34:04,354 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2023-08-01T07:34:04,357 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2023-08-01T07:34:04,361 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2023-08-01T07:34:04,364 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2023-08-01T07:34:04,369 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2023-08-01T07:34:04,373 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2023-08-01T07:34:04,376 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2023-08-01T07:34:04,379 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2023-08-01T07:34:04,381 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2023-08-01T07:34:04,384 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2023-08-01T07:34:04,388 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2023-08-01T07:34:04,392 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2023-08-01T07:34:04,395 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2023-08-01T07:34:04,399 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2023-08-01T07:34:04,402 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2023-08-01T07:34:04,408 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2023-08-01T07:34:04,411 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2023-08-01T07:34:04,414 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2023-08-01T07:34:04,418 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2023-08-01T07:34:04,421 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2023-08-01T07:34:04,423 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2023-08-01T07:34:04,427 adding 'colossalai/auto_parallel/offload/__init__.py' 2023-08-01T07:34:04,431 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2023-08-01T07:34:04,434 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2023-08-01T07:34:04,437 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2023-08-01T07:34:04,440 adding 'colossalai/auto_parallel/offload/region.py' 2023-08-01T07:34:04,446 adding 'colossalai/auto_parallel/offload/region_manager.py' 2023-08-01T07:34:04,450 adding 'colossalai/auto_parallel/offload/runtime.py' 2023-08-01T07:34:04,456 adding 'colossalai/auto_parallel/offload/solver.py' 2023-08-01T07:34:04,462 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2023-08-01T07:34:04,465 adding 'colossalai/auto_parallel/offload/util.py' 2023-08-01T07:34:04,469 adding 'colossalai/auto_parallel/passes/__init__.py' 2023-08-01T07:34:04,472 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2023-08-01T07:34:04,474 adding 'colossalai/auto_parallel/passes/constants.py' 2023-08-01T07:34:04,477 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2023-08-01T07:34:04,481 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2023-08-01T07:34:04,488 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2023-08-01T07:34:04,492 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2023-08-01T07:34:04,496 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2023-08-01T07:34:04,499 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2023-08-01T07:34:04,504 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2023-08-01T07:34:04,507 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2023-08-01T07:34:04,511 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2023-08-01T07:34:04,516 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2023-08-01T07:34:04,519 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2023-08-01T07:34:04,522 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2023-08-01T07:34:04,525 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2023-08-01T07:34:04,529 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2023-08-01T07:34:04,533 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2023-08-01T07:34:04,536 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2023-08-01T07:34:04,539 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2023-08-01T07:34:04,543 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2023-08-01T07:34:04,545 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2023-08-01T07:34:04,548 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2023-08-01T07:34:04,552 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2023-08-01T07:34:04,559 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2023-08-01T07:34:04,564 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2023-08-01T07:34:04,567 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2023-08-01T07:34:04,570 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2023-08-01T07:34:04,573 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2023-08-01T07:34:04,576 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2023-08-01T07:34:04,578 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2023-08-01T07:34:04,581 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2023-08-01T07:34:04,583 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2023-08-01T07:34:04,587 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2023-08-01T07:34:04,589 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2023-08-01T07:34:04,592 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2023-08-01T07:34:04,596 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2023-08-01T07:34:04,599 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2023-08-01T07:34:04,601 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2023-08-01T07:34:04,606 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2023-08-01T07:34:04,610 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2023-08-01T07:34:04,613 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2023-08-01T07:34:04,618 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2023-08-01T07:34:04,622 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2023-08-01T07:34:04,626 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2023-08-01T07:34:04,629 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2023-08-01T07:34:04,633 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2023-08-01T07:34:04,640 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2023-08-01T07:34:04,644 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2023-08-01T07:34:04,648 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2023-08-01T07:34:04,651 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2023-08-01T07:34:04,655 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2023-08-01T07:34:04,659 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2023-08-01T07:34:04,665 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2023-08-01T07:34:04,668 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2023-08-01T07:34:04,671 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2023-08-01T07:34:04,674 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2023-08-01T07:34:04,677 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2023-08-01T07:34:04,681 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2023-08-01T07:34:04,685 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2023-08-01T07:34:04,688 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2023-08-01T07:34:04,694 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2023-08-01T07:34:04,698 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2023-08-01T07:34:04,702 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2023-08-01T07:34:04,706 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2023-08-01T07:34:04,710 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2023-08-01T07:34:04,713 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2023-08-01T07:34:04,717 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2023-08-01T07:34:04,720 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2023-08-01T07:34:04,724 adding 'colossalai/booster/__init__.py' 2023-08-01T07:34:04,727 adding 'colossalai/booster/accelerator.py' 2023-08-01T07:34:04,732 adding 'colossalai/booster/booster.py' 2023-08-01T07:34:04,736 adding 'colossalai/booster/mixed_precision/__init__.py' 2023-08-01T07:34:04,739 adding 'colossalai/booster/mixed_precision/bf16.py' 2023-08-01T07:34:04,742 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2023-08-01T07:34:04,744 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2023-08-01T07:34:04,747 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2023-08-01T07:34:04,750 adding 'colossalai/booster/mixed_precision/fp8.py' 2023-08-01T07:34:04,752 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2023-08-01T07:34:04,756 adding 'colossalai/booster/plugin/__init__.py' 2023-08-01T07:34:04,759 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2023-08-01T07:34:04,764 adding 'colossalai/booster/plugin/gemini_plugin.py' 2023-08-01T07:34:04,769 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2023-08-01T07:34:04,772 adding 'colossalai/booster/plugin/plugin_base.py' 2023-08-01T07:34:04,776 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2023-08-01T07:34:04,779 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2023-08-01T07:34:04,783 adding 'colossalai/builder/__init__.py' 2023-08-01T07:34:04,786 adding 'colossalai/builder/builder.py' 2023-08-01T07:34:04,790 adding 'colossalai/checkpoint_io/__init__.py' 2023-08-01T07:34:04,794 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2023-08-01T07:34:04,799 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2023-08-01T07:34:04,803 adding 'colossalai/checkpoint_io/index_file.py' 2023-08-01T07:34:04,810 adding 'colossalai/checkpoint_io/utils.py' 2023-08-01T07:34:04,814 adding 'colossalai/cli/__init__.py' 2023-08-01T07:34:04,816 adding 'colossalai/cli/cli.py' 2023-08-01T07:34:04,820 adding 'colossalai/cli/benchmark/__init__.py' 2023-08-01T07:34:04,823 adding 'colossalai/cli/benchmark/benchmark.py' 2023-08-01T07:34:04,826 adding 'colossalai/cli/benchmark/models.py' 2023-08-01T07:34:04,829 adding 'colossalai/cli/benchmark/utils.py' 2023-08-01T07:34:04,833 adding 'colossalai/cli/check/__init__.py' 2023-08-01T07:34:04,836 adding 'colossalai/cli/check/check_installation.py' 2023-08-01T07:34:04,841 adding 'colossalai/cli/launcher/__init__.py' 2023-08-01T07:34:04,844 adding 'colossalai/cli/launcher/hostinfo.py' 2023-08-01T07:34:04,847 adding 'colossalai/cli/launcher/multinode_runner.py' 2023-08-01T07:34:04,852 adding 'colossalai/cli/launcher/run.py' 2023-08-01T07:34:04,855 adding 'colossalai/cluster/__init__.py' 2023-08-01T07:34:04,858 adding 'colossalai/cluster/device_mesh_manager.py' 2023-08-01T07:34:04,862 adding 'colossalai/cluster/dist_coordinator.py' 2023-08-01T07:34:04,866 adding 'colossalai/cluster/process_group_manager.py' 2023-08-01T07:34:04,870 adding 'colossalai/communication/__init__.py' 2023-08-01T07:34:04,873 adding 'colossalai/communication/collective.py' 2023-08-01T07:34:04,878 adding 'colossalai/communication/p2p.py' 2023-08-01T07:34:04,882 adding 'colossalai/communication/p2p_v2.py' 2023-08-01T07:34:04,885 adding 'colossalai/communication/ring.py' 2023-08-01T07:34:04,889 adding 'colossalai/communication/utils.py' 2023-08-01T07:34:04,893 adding 'colossalai/context/__init__.py' 2023-08-01T07:34:04,895 adding 'colossalai/context/config.py' 2023-08-01T07:34:04,899 adding 'colossalai/context/moe_context.py' 2023-08-01T07:34:04,905 adding 'colossalai/context/parallel_context.py' 2023-08-01T07:34:04,908 adding 'colossalai/context/parallel_mode.py' 2023-08-01T07:34:04,911 adding 'colossalai/context/singleton_meta.py' 2023-08-01T07:34:04,915 adding 'colossalai/context/process_group_initializer/__init__.py' 2023-08-01T07:34:04,918 adding 'colossalai/context/process_group_initializer/initializer_1d.py' 2023-08-01T07:34:04,921 adding 'colossalai/context/process_group_initializer/initializer_2d.py' 2023-08-01T07:34:04,925 adding 'colossalai/context/process_group_initializer/initializer_2p5d.py' 2023-08-01T07:34:04,929 adding 'colossalai/context/process_group_initializer/initializer_3d.py' 2023-08-01T07:34:04,932 adding 'colossalai/context/process_group_initializer/initializer_data.py' 2023-08-01T07:34:04,936 adding 'colossalai/context/process_group_initializer/initializer_model.py' 2023-08-01T07:34:04,938 adding 'colossalai/context/process_group_initializer/initializer_pipeline.py' 2023-08-01T07:34:04,941 adding 'colossalai/context/process_group_initializer/initializer_sequence.py' 2023-08-01T07:34:04,944 adding 'colossalai/context/process_group_initializer/initializer_tensor.py' 2023-08-01T07:34:04,947 adding 'colossalai/context/process_group_initializer/process_group_initializer.py' 2023-08-01T07:34:04,951 adding 'colossalai/context/random/__init__.py' 2023-08-01T07:34:04,954 adding 'colossalai/context/random/_helper.py' 2023-08-01T07:34:04,957 adding 'colossalai/context/random/seed_manager.py' 2023-08-01T07:34:04,960 adding 'colossalai/device/__init__.py' 2023-08-01T07:34:04,966 adding 'colossalai/device/alpha_beta_profiler.py' 2023-08-01T07:34:04,969 adding 'colossalai/device/calc_pipeline_strategy.py' 2023-08-01T07:34:04,977 adding 'colossalai/device/device_mesh.py' 2023-08-01T07:34:04,981 adding 'colossalai/engine/__init__.py' 2023-08-01T07:34:04,984 adding 'colossalai/engine/_base_engine.py' 2023-08-01T07:34:04,988 adding 'colossalai/engine/gradient_accumulation/__init__.py' 2023-08-01T07:34:04,992 adding 'colossalai/engine/gradient_accumulation/_gradient_accumulation.py' 2023-08-01T07:34:04,996 adding 'colossalai/engine/gradient_handler/__init__.py' 2023-08-01T07:34:04,999 adding 'colossalai/engine/gradient_handler/_base_gradient_handler.py' 2023-08-01T07:34:05,003 adding 'colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py' 2023-08-01T07:34:05,005 adding 'colossalai/engine/gradient_handler/_moe_gradient_handler.py' 2023-08-01T07:34:05,008 adding 'colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2023-08-01T07:34:05,011 adding 'colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2023-08-01T07:34:05,013 adding 'colossalai/engine/gradient_handler/_zero_gradient_handler.py' 2023-08-01T07:34:05,016 adding 'colossalai/engine/gradient_handler/utils.py' 2023-08-01T07:34:05,020 adding 'colossalai/engine/schedule/__init__.py' 2023-08-01T07:34:05,023 adding 'colossalai/engine/schedule/_base_schedule.py' 2023-08-01T07:34:05,026 adding 'colossalai/engine/schedule/_non_pipeline_schedule.py' 2023-08-01T07:34:05,035 adding 'colossalai/engine/schedule/_pipeline_schedule.py' 2023-08-01T07:34:05,040 adding 'colossalai/engine/schedule/_pipeline_schedule_v2.py' 2023-08-01T07:34:05,044 adding 'colossalai/fx/__init__.py' 2023-08-01T07:34:05,047 adding 'colossalai/fx/_compatibility.py' 2023-08-01T07:34:05,052 adding 'colossalai/fx/_meta_regist_12.py' 2023-08-01T07:34:05,055 adding 'colossalai/fx/_meta_regist_13.py' 2023-08-01T07:34:05,059 adding 'colossalai/fx/graph_module.py' 2023-08-01T07:34:05,062 adding 'colossalai/fx/proxy.py' 2023-08-01T07:34:05,066 adding 'colossalai/fx/codegen/__init__.py' 2023-08-01T07:34:05,077 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2023-08-01T07:34:05,082 adding 'colossalai/fx/passes/__init__.py' 2023-08-01T07:34:05,087 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2023-08-01T07:34:05,091 adding 'colossalai/fx/passes/concrete_info_prop.py' 2023-08-01T07:34:05,096 adding 'colossalai/fx/passes/meta_info_prop.py' 2023-08-01T07:34:05,101 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2023-08-01T07:34:05,105 adding 'colossalai/fx/passes/shard_1d_pass.py' 2023-08-01T07:34:05,110 adding 'colossalai/fx/passes/split_module.py' 2023-08-01T07:34:05,114 adding 'colossalai/fx/passes/utils.py' 2023-08-01T07:34:05,118 adding 'colossalai/fx/profiler/__init__.py' 2023-08-01T07:34:05,120 adding 'colossalai/fx/profiler/constants.py' 2023-08-01T07:34:05,123 adding 'colossalai/fx/profiler/dataflow.py' 2023-08-01T07:34:05,126 adding 'colossalai/fx/profiler/memory_utils.py' 2023-08-01T07:34:05,131 adding 'colossalai/fx/profiler/opcount.py' 2023-08-01T07:34:05,137 adding 'colossalai/fx/profiler/profiler.py' 2023-08-01T07:34:05,140 adding 'colossalai/fx/profiler/shard_utils.py' 2023-08-01T07:34:05,144 adding 'colossalai/fx/profiler/tensor.py' 2023-08-01T07:34:05,148 adding 'colossalai/fx/profiler/experimental/__init__.py' 2023-08-01T07:34:05,150 adding 'colossalai/fx/profiler/experimental/constants.py' 2023-08-01T07:34:05,153 adding 'colossalai/fx/profiler/experimental/profiler.py' 2023-08-01T07:34:05,156 adding 'colossalai/fx/profiler/experimental/registry.py' 2023-08-01T07:34:05,159 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2023-08-01T07:34:05,163 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2023-08-01T07:34:05,165 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2023-08-01T07:34:05,168 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2023-08-01T07:34:05,171 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2023-08-01T07:34:05,173 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2023-08-01T07:34:05,176 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2023-08-01T07:34:05,178 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2023-08-01T07:34:05,181 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2023-08-01T07:34:05,183 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2023-08-01T07:34:05,187 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2023-08-01T07:34:05,190 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2023-08-01T07:34:05,193 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2023-08-01T07:34:05,196 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2023-08-01T07:34:05,198 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2023-08-01T07:34:05,201 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2023-08-01T07:34:05,204 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2023-08-01T07:34:05,207 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2023-08-01T07:34:05,210 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2023-08-01T07:34:05,213 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2023-08-01T07:34:05,215 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2023-08-01T07:34:05,219 adding 'colossalai/fx/tracer/__init__.py' 2023-08-01T07:34:05,223 adding 'colossalai/fx/tracer/_meta_trace.py' 2023-08-01T07:34:05,227 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2023-08-01T07:34:05,230 adding 'colossalai/fx/tracer/_tracer_utils.py' 2023-08-01T07:34:05,237 adding 'colossalai/fx/tracer/experimental.py' 2023-08-01T07:34:05,240 adding 'colossalai/fx/tracer/registry.py' 2023-08-01T07:34:05,248 adding 'colossalai/fx/tracer/tracer.py' 2023-08-01T07:34:05,252 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2023-08-01T07:34:05,256 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2023-08-01T07:34:05,259 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2023-08-01T07:34:05,262 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2023-08-01T07:34:05,266 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2023-08-01T07:34:05,269 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2023-08-01T07:34:05,273 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2023-08-01T07:34:05,276 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2023-08-01T07:34:05,279 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2023-08-01T07:34:05,282 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2023-08-01T07:34:05,286 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2023-08-01T07:34:05,290 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2023-08-01T07:34:05,292 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2023-08-01T07:34:05,295 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2023-08-01T07:34:05,298 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2023-08-01T07:34:05,301 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2023-08-01T07:34:05,305 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2023-08-01T07:34:05,308 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2023-08-01T07:34:05,312 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2023-08-01T07:34:05,316 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2023-08-01T07:34:05,319 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2023-08-01T07:34:05,322 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2023-08-01T07:34:05,324 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2023-08-01T07:34:05,327 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2023-08-01T07:34:05,329 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2023-08-01T07:34:05,332 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2023-08-01T07:34:05,335 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2023-08-01T07:34:05,339 adding 'colossalai/interface/__init__.py' 2023-08-01T07:34:05,341 adding 'colossalai/interface/model.py' 2023-08-01T07:34:05,345 adding 'colossalai/interface/optimizer.py' 2023-08-01T07:34:05,348 adding 'colossalai/kernel/__init__.py' 2023-08-01T07:34:05,352 adding 'colossalai/kernel/cuda_native/__init__.py' 2023-08-01T07:34:05,358 adding 'colossalai/kernel/cuda_native/flash_attention.py' 2023-08-01T07:34:05,361 adding 'colossalai/kernel/cuda_native/layer_norm.py' 2023-08-01T07:34:05,365 adding 'colossalai/kernel/cuda_native/multihead_attention.py' 2023-08-01T07:34:05,369 adding 'colossalai/kernel/cuda_native/scaled_softmax.py' 2023-08-01T07:34:05,374 adding 'colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp' 2023-08-01T07:34:05,377 adding 'colossalai/kernel/cuda_native/csrc/compat.h' 2023-08-01T07:34:05,381 adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.cpp' 2023-08-01T07:34:05,384 adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.h' 2023-08-01T07:34:05,388 adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp' 2023-08-01T07:34:05,395 adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu' 2023-08-01T07:34:05,398 adding 'colossalai/kernel/cuda_native/csrc/moe_cuda.cpp' 2023-08-01T07:34:05,404 adding 'colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu' 2023-08-01T07:34:05,407 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu' 2023-08-01T07:34:05,411 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh' 2023-08-01T07:34:05,415 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu' 2023-08-01T07:34:05,420 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu' 2023-08-01T07:34:05,423 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu' 2023-08-01T07:34:05,427 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu' 2023-08-01T07:34:05,432 adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp' 2023-08-01T07:34:05,435 adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h' 2023-08-01T07:34:05,438 adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp' 2023-08-01T07:34:05,443 adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h' 2023-08-01T07:34:05,447 adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu' 2023-08-01T07:34:05,449 adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp' 2023-08-01T07:34:05,454 adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h' 2023-08-01T07:34:05,457 adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu' 2023-08-01T07:34:05,461 adding 'colossalai/kernel/cuda_native/csrc/type_shim.h' 2023-08-01T07:34:05,467 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h' 2023-08-01T07:34:05,470 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/context.h' 2023-08-01T07:34:05,473 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h' 2023-08-01T07:34:05,475 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h' 2023-08-01T07:34:05,478 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h' 2023-08-01T07:34:05,481 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h' 2023-08-01T07:34:05,484 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h' 2023-08-01T07:34:05,487 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h' 2023-08-01T07:34:05,490 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh' 2023-08-01T07:34:05,493 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h' 2023-08-01T07:34:05,495 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h' 2023-08-01T07:34:05,498 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h' 2023-08-01T07:34:05,502 adding 'colossalai/kernel/jit/__init__.py' 2023-08-01T07:34:05,504 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2023-08-01T07:34:05,507 adding 'colossalai/kernel/jit/bias_gelu.py' 2023-08-01T07:34:05,510 adding 'colossalai/kernel/jit/option.py' 2023-08-01T07:34:05,514 adding 'colossalai/kernel/op_builder/__init__.py' 2023-08-01T07:34:05,518 adding 'colossalai/kernel/op_builder/builder.py' 2023-08-01T07:34:05,520 adding 'colossalai/kernel/op_builder/cpu_adam.py' 2023-08-01T07:34:05,523 adding 'colossalai/kernel/op_builder/fused_optim.py' 2023-08-01T07:34:05,526 adding 'colossalai/kernel/op_builder/layernorm.py' 2023-08-01T07:34:05,528 adding 'colossalai/kernel/op_builder/moe.py' 2023-08-01T07:34:05,531 adding 'colossalai/kernel/op_builder/multi_head_attn.py' 2023-08-01T07:34:05,534 adding 'colossalai/kernel/op_builder/scaled_masked_softmax.py' 2023-08-01T07:34:05,537 adding 'colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py' 2023-08-01T07:34:05,540 adding 'colossalai/kernel/op_builder/utils.py' 2023-08-01T07:34:05,544 adding 'colossalai/lazy/__init__.py' 2023-08-01T07:34:05,552 adding 'colossalai/lazy/lazy_init.py' 2023-08-01T07:34:05,556 adding 'colossalai/logging/__init__.py' 2023-08-01T07:34:05,560 adding 'colossalai/logging/logger.py' 2023-08-01T07:34:05,563 adding 'colossalai/nn/__init__.py' 2023-08-01T07:34:05,567 adding 'colossalai/nn/init.py' 2023-08-01T07:34:05,571 adding 'colossalai/nn/_ops/__init__.py' 2023-08-01T07:34:05,575 adding 'colossalai/nn/_ops/_utils.py' 2023-08-01T07:34:05,578 adding 'colossalai/nn/_ops/addmm.py' 2023-08-01T07:34:05,581 adding 'colossalai/nn/_ops/batch_norm.py' 2023-08-01T07:34:05,584 adding 'colossalai/nn/_ops/element_wise.py' 2023-08-01T07:34:05,587 adding 'colossalai/nn/_ops/embedding.py' 2023-08-01T07:34:05,591 adding 'colossalai/nn/_ops/embedding_bag.py' 2023-08-01T07:34:05,593 adding 'colossalai/nn/_ops/layernorm.py' 2023-08-01T07:34:05,597 adding 'colossalai/nn/_ops/linear.py' 2023-08-01T07:34:05,600 adding 'colossalai/nn/_ops/loss.py' 2023-08-01T07:34:05,603 adding 'colossalai/nn/_ops/view.py' 2023-08-01T07:34:05,607 adding 'colossalai/nn/layer/__init__.py' 2023-08-01T07:34:05,610 adding 'colossalai/nn/layer/base_layer.py' 2023-08-01T07:34:05,614 adding 'colossalai/nn/layer/colossalai_layer/__init__.py' 2023-08-01T07:34:05,616 adding 'colossalai/nn/layer/colossalai_layer/_utils.py' 2023-08-01T07:34:05,619 adding 'colossalai/nn/layer/colossalai_layer/dropout.py' 2023-08-01T07:34:05,622 adding 'colossalai/nn/layer/colossalai_layer/embedding.py' 2023-08-01T07:34:05,625 adding 'colossalai/nn/layer/colossalai_layer/linear.py' 2023-08-01T07:34:05,628 adding 'colossalai/nn/layer/colossalai_layer/normalization.py' 2023-08-01T07:34:05,632 adding 'colossalai/nn/layer/moe/__init__.py' 2023-08-01T07:34:05,635 adding 'colossalai/nn/layer/moe/_operation.py' 2023-08-01T07:34:05,638 adding 'colossalai/nn/layer/moe/checkpoint.py' 2023-08-01T07:34:05,641 adding 'colossalai/nn/layer/moe/experts.py' 2023-08-01T07:34:05,645 adding 'colossalai/nn/layer/moe/layers.py' 2023-08-01T07:34:05,649 adding 'colossalai/nn/layer/moe/routers.py' 2023-08-01T07:34:05,652 adding 'colossalai/nn/layer/moe/utils.py' 2023-08-01T07:34:05,656 adding 'colossalai/nn/layer/parallel_1d/__init__.py' 2023-08-01T07:34:05,659 adding 'colossalai/nn/layer/parallel_1d/_operation.py' 2023-08-01T07:34:05,662 adding 'colossalai/nn/layer/parallel_1d/_utils.py' 2023-08-01T07:34:05,671 adding 'colossalai/nn/layer/parallel_1d/layers.py' 2023-08-01T07:34:05,675 adding 'colossalai/nn/layer/parallel_2d/__init__.py' 2023-08-01T07:34:05,682 adding 'colossalai/nn/layer/parallel_2d/_operation.py' 2023-08-01T07:34:05,685 adding 'colossalai/nn/layer/parallel_2d/_utils.py' 2023-08-01T07:34:05,694 adding 'colossalai/nn/layer/parallel_2d/layers.py' 2023-08-01T07:34:05,699 adding 'colossalai/nn/layer/parallel_2p5d/__init__.py' 2023-08-01T07:34:05,706 adding 'colossalai/nn/layer/parallel_2p5d/_operation.py' 2023-08-01T07:34:05,709 adding 'colossalai/nn/layer/parallel_2p5d/_utils.py' 2023-08-01T07:34:05,720 adding 'colossalai/nn/layer/parallel_2p5d/layers.py' 2023-08-01T07:34:05,725 adding 'colossalai/nn/layer/parallel_3d/__init__.py' 2023-08-01T07:34:05,730 adding 'colossalai/nn/layer/parallel_3d/_operation.py' 2023-08-01T07:34:05,734 adding 'colossalai/nn/layer/parallel_3d/_utils.py' 2023-08-01T07:34:05,742 adding 'colossalai/nn/layer/parallel_3d/layers.py' 2023-08-01T07:34:05,746 adding 'colossalai/nn/layer/parallel_sequence/__init__.py' 2023-08-01T07:34:05,750 adding 'colossalai/nn/layer/parallel_sequence/_operation.py' 2023-08-01T07:34:05,752 adding 'colossalai/nn/layer/parallel_sequence/_utils.py' 2023-08-01T07:34:05,756 adding 'colossalai/nn/layer/parallel_sequence/layers.py' 2023-08-01T07:34:05,760 adding 'colossalai/nn/layer/utils/__init__.py' 2023-08-01T07:34:05,763 adding 'colossalai/nn/layer/utils/common.py' 2023-08-01T07:34:05,766 adding 'colossalai/nn/layer/vanilla/__init__.py' 2023-08-01T07:34:05,770 adding 'colossalai/nn/layer/vanilla/layers.py' 2023-08-01T07:34:05,774 adding 'colossalai/nn/layer/wrapper/__init__.py' 2023-08-01T07:34:05,777 adding 'colossalai/nn/layer/wrapper/pipeline_wrapper.py' 2023-08-01T07:34:05,781 adding 'colossalai/nn/loss/__init__.py' 2023-08-01T07:34:05,784 adding 'colossalai/nn/loss/loss_1d.py' 2023-08-01T07:34:05,787 adding 'colossalai/nn/loss/loss_2d.py' 2023-08-01T07:34:05,791 adding 'colossalai/nn/loss/loss_2p5d.py' 2023-08-01T07:34:05,794 adding 'colossalai/nn/loss/loss_3d.py' 2023-08-01T07:34:05,797 adding 'colossalai/nn/loss/loss_moe.py' 2023-08-01T07:34:05,801 adding 'colossalai/nn/lr_scheduler/__init__.py' 2023-08-01T07:34:05,804 adding 'colossalai/nn/lr_scheduler/cosine.py' 2023-08-01T07:34:05,807 adding 'colossalai/nn/lr_scheduler/delayed.py' 2023-08-01T07:34:05,810 adding 'colossalai/nn/lr_scheduler/linear.py' 2023-08-01T07:34:05,813 adding 'colossalai/nn/lr_scheduler/multistep.py' 2023-08-01T07:34:05,816 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2023-08-01T07:34:05,819 adding 'colossalai/nn/lr_scheduler/poly.py' 2023-08-01T07:34:05,822 adding 'colossalai/nn/lr_scheduler/torch.py' 2023-08-01T07:34:05,826 adding 'colossalai/nn/metric/__init__.py' 2023-08-01T07:34:05,828 adding 'colossalai/nn/metric/_utils.py' 2023-08-01T07:34:05,830 adding 'colossalai/nn/metric/accuracy_2d.py' 2023-08-01T07:34:05,833 adding 'colossalai/nn/metric/accuracy_2p5d.py' 2023-08-01T07:34:05,836 adding 'colossalai/nn/metric/accuracy_3d.py' 2023-08-01T07:34:05,840 adding 'colossalai/nn/optimizer/__init__.py' 2023-08-01T07:34:05,842 adding 'colossalai/nn/optimizer/colossalai_optimizer.py' 2023-08-01T07:34:05,846 adding 'colossalai/nn/optimizer/cpu_adam.py' 2023-08-01T07:34:05,850 adding 'colossalai/nn/optimizer/fused_adam.py' 2023-08-01T07:34:05,854 adding 'colossalai/nn/optimizer/fused_lamb.py' 2023-08-01T07:34:05,857 adding 'colossalai/nn/optimizer/fused_sgd.py' 2023-08-01T07:34:05,861 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2023-08-01T07:34:05,864 adding 'colossalai/nn/optimizer/lamb.py' 2023-08-01T07:34:05,868 adding 'colossalai/nn/optimizer/lars.py' 2023-08-01T07:34:05,871 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2023-08-01T07:34:05,875 adding 'colossalai/nn/parallel/__init__.py' 2023-08-01T07:34:05,878 adding 'colossalai/nn/parallel/data_parallel.py' 2023-08-01T07:34:05,881 adding 'colossalai/nn/parallel/reducer.py' 2023-08-01T07:34:05,885 adding 'colossalai/nn/parallel/layers/__init__.py' 2023-08-01T07:34:05,888 adding 'colossalai/nn/parallel/layers/colo_module.py' 2023-08-01T07:34:05,890 adding 'colossalai/nn/parallel/layers/embedding.py' 2023-08-01T07:34:05,893 adding 'colossalai/nn/parallel/layers/linear.py' 2023-08-01T07:34:05,896 adding 'colossalai/nn/parallel/layers/module_utils.py' 2023-08-01T07:34:05,900 adding 'colossalai/nn/parallel/layers/cache_embedding/__init__.py' 2023-08-01T07:34:05,903 adding 'colossalai/nn/parallel/layers/cache_embedding/base_embedding.py' 2023-08-01T07:34:05,911 adding 'colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py' 2023-08-01T07:34:05,915 adding 'colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py' 2023-08-01T07:34:05,918 adding 'colossalai/nn/parallel/layers/cache_embedding/copyer.py' 2023-08-01T07:34:05,921 adding 'colossalai/nn/parallel/layers/cache_embedding/embedding_config.py' 2023-08-01T07:34:05,924 adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2023-08-01T07:34:05,928 adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2023-08-01T07:34:05,932 adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2023-08-01T07:34:05,935 adding 'colossalai/pipeline/__init__.py' 2023-08-01T07:34:05,938 adding 'colossalai/pipeline/layer_spec.py' 2023-08-01T07:34:05,942 adding 'colossalai/pipeline/pipelinable.py' 2023-08-01T07:34:05,946 adding 'colossalai/pipeline/pipeline_process_group.py' 2023-08-01T07:34:05,950 adding 'colossalai/pipeline/utils.py' 2023-08-01T07:34:05,953 adding 'colossalai/pipeline/middleware/__init__.py' 2023-08-01T07:34:05,957 adding 'colossalai/pipeline/middleware/topo.py' 2023-08-01T07:34:05,960 adding 'colossalai/pipeline/middleware/adaptor/__init__.py' 2023-08-01T07:34:05,964 adding 'colossalai/pipeline/middleware/adaptor/fx.py' 2023-08-01T07:34:05,967 adding 'colossalai/pipeline/rpc/__init__.py' 2023-08-01T07:34:05,982 adding 'colossalai/pipeline/rpc/_pipeline_base.py' 2023-08-01T07:34:05,987 adding 'colossalai/pipeline/rpc/_pipeline_schedule.py' 2023-08-01T07:34:05,991 adding 'colossalai/pipeline/rpc/utils.py' 2023-08-01T07:34:05,995 adding 'colossalai/registry/__init__.py' 2023-08-01T07:34:05,998 adding 'colossalai/registry/registry.py' 2023-08-01T07:34:06,001 adding 'colossalai/shardformer/__init__.py' 2023-08-01T07:34:06,004 adding 'colossalai/shardformer/_utils.py' 2023-08-01T07:34:06,008 adding 'colossalai/shardformer/layer/__init__.py' 2023-08-01T07:34:06,011 adding 'colossalai/shardformer/layer/_operation.py' 2023-08-01T07:34:06,014 adding 'colossalai/shardformer/layer/dropout.py' 2023-08-01T07:34:06,018 adding 'colossalai/shardformer/layer/embedding.py' 2023-08-01T07:34:06,023 adding 'colossalai/shardformer/layer/linear.py' 2023-08-01T07:34:06,026 adding 'colossalai/shardformer/layer/loss.py' 2023-08-01T07:34:06,029 adding 'colossalai/shardformer/layer/normalization.py' 2023-08-01T07:34:06,033 adding 'colossalai/shardformer/layer/parallel_module.py' 2023-08-01T07:34:06,039 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2023-08-01T07:34:06,043 adding 'colossalai/shardformer/layer/utils.py' 2023-08-01T07:34:06,046 adding 'colossalai/shardformer/modeling/__init__.py' 2023-08-01T07:34:06,049 adding 'colossalai/shardformer/modeling/bloom.py' 2023-08-01T07:34:06,053 adding 'colossalai/shardformer/policies/__init__.py' 2023-08-01T07:34:06,056 adding 'colossalai/shardformer/policies/autopolicy.py' 2023-08-01T07:34:06,060 adding 'colossalai/shardformer/policies/basepolicy.py' 2023-08-01T07:34:06,063 adding 'colossalai/shardformer/policies/bert.py' 2023-08-01T07:34:06,067 adding 'colossalai/shardformer/policies/bloom.py' 2023-08-01T07:34:06,070 adding 'colossalai/shardformer/policies/gpt2.py' 2023-08-01T07:34:06,073 adding 'colossalai/shardformer/policies/llama.py' 2023-08-01T07:34:06,077 adding 'colossalai/shardformer/policies/opt.py' 2023-08-01T07:34:06,080 adding 'colossalai/shardformer/policies/t5.py' 2023-08-01T07:34:06,083 adding 'colossalai/shardformer/policies/vit.py' 2023-08-01T07:34:06,087 adding 'colossalai/shardformer/shard/__init__.py' 2023-08-01T07:34:06,090 adding 'colossalai/shardformer/shard/shard_config.py' 2023-08-01T07:34:06,093 adding 'colossalai/shardformer/shard/sharder.py' 2023-08-01T07:34:06,096 adding 'colossalai/shardformer/shard/shardformer.py' 2023-08-01T07:34:06,100 adding 'colossalai/tensor/__init__.py' 2023-08-01T07:34:06,103 adding 'colossalai/tensor/colo_parameter.py' 2023-08-01T07:34:06,108 adding 'colossalai/tensor/colo_tensor.py' 2023-08-01T07:34:06,114 adding 'colossalai/tensor/comm_spec.py' 2023-08-01T07:34:06,117 adding 'colossalai/tensor/compute_spec.py' 2023-08-01T07:34:06,119 adding 'colossalai/tensor/const.py' 2023-08-01T07:34:06,123 adding 'colossalai/tensor/dist_spec_mgr.py' 2023-08-01T07:34:06,126 adding 'colossalai/tensor/distspec.py' 2023-08-01T07:34:06,129 adding 'colossalai/tensor/op_wrapper.py' 2023-08-01T07:34:06,132 adding 'colossalai/tensor/param_op_hook.py' 2023-08-01T07:34:06,136 adding 'colossalai/tensor/process_group.py' 2023-08-01T07:34:06,144 adding 'colossalai/tensor/shape_consistency.py' 2023-08-01T07:34:06,150 adding 'colossalai/tensor/sharding_spec.py' 2023-08-01T07:34:06,152 adding 'colossalai/tensor/tensor_spec.py' 2023-08-01T07:34:06,156 adding 'colossalai/tensor/utils.py' 2023-08-01T07:34:06,160 adding 'colossalai/tensor/d_tensor/__init__.py' 2023-08-01T07:34:06,165 adding 'colossalai/tensor/d_tensor/api.py' 2023-08-01T07:34:06,169 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2023-08-01T07:34:06,172 adding 'colossalai/tensor/d_tensor/layout.py' 2023-08-01T07:34:06,178 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2023-08-01T07:34:06,181 adding 'colossalai/tensor/d_tensor/misc.py' 2023-08-01T07:34:06,184 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2023-08-01T07:34:06,187 adding 'colossalai/tensor/d_tensor/utils.py' 2023-08-01T07:34:06,191 adding 'colossalai/testing/__init__.py' 2023-08-01T07:34:06,194 adding 'colossalai/testing/comparison.py' 2023-08-01T07:34:06,197 adding 'colossalai/testing/pytest_wrapper.py' 2023-08-01T07:34:06,200 adding 'colossalai/testing/random.py' 2023-08-01T07:34:06,204 adding 'colossalai/testing/utils.py' 2023-08-01T07:34:06,207 adding 'colossalai/trainer/__init__.py' 2023-08-01T07:34:06,212 adding 'colossalai/trainer/_trainer.py' 2023-08-01T07:34:06,216 adding 'colossalai/trainer/hooks/__init__.py' 2023-08-01T07:34:06,219 adding 'colossalai/trainer/hooks/_base_hook.py' 2023-08-01T07:34:06,222 adding 'colossalai/trainer/hooks/_checkpoint_hook.py' 2023-08-01T07:34:06,224 adding 'colossalai/trainer/hooks/_commons_.py' 2023-08-01T07:34:06,228 adding 'colossalai/trainer/hooks/_log_hook.py' 2023-08-01T07:34:06,231 adding 'colossalai/trainer/hooks/_lr_scheduler_hook.py' 2023-08-01T07:34:06,236 adding 'colossalai/trainer/hooks/_metric_hook.py' 2023-08-01T07:34:06,240 adding 'colossalai/utils/__init__.py' 2023-08-01T07:34:06,245 adding 'colossalai/utils/activation_checkpoint.py' 2023-08-01T07:34:06,249 adding 'colossalai/utils/checkpointing.py' 2023-08-01T07:34:06,255 adding 'colossalai/utils/common.py' 2023-08-01T07:34:06,258 adding 'colossalai/utils/cuda.py' 2023-08-01T07:34:06,262 adding 'colossalai/utils/memory.py' 2023-08-01T07:34:06,264 adding 'colossalai/utils/moe.py' 2023-08-01T07:34:06,268 adding 'colossalai/utils/timer.py' 2023-08-01T07:34:06,271 adding 'colossalai/utils/checkpoint/__init__.py' 2023-08-01T07:34:06,274 adding 'colossalai/utils/checkpoint/module_checkpoint.py' 2023-08-01T07:34:06,277 adding 'colossalai/utils/checkpoint/utils.py' 2023-08-01T07:34:06,281 adding 'colossalai/utils/checkpoint_io/__init__.py' 2023-08-01T07:34:06,284 adding 'colossalai/utils/checkpoint_io/backend.py' 2023-08-01T07:34:06,286 adding 'colossalai/utils/checkpoint_io/constant.py' 2023-08-01T07:34:06,290 adding 'colossalai/utils/checkpoint_io/convertor.py' 2023-08-01T07:34:06,293 adding 'colossalai/utils/checkpoint_io/distributed.py' 2023-08-01T07:34:06,297 adding 'colossalai/utils/checkpoint_io/io.py' 2023-08-01T07:34:06,299 adding 'colossalai/utils/checkpoint_io/meta.py' 2023-08-01T07:34:06,303 adding 'colossalai/utils/checkpoint_io/reader.py' 2023-08-01T07:34:06,307 adding 'colossalai/utils/checkpoint_io/utils.py' 2023-08-01T07:34:06,310 adding 'colossalai/utils/checkpoint_io/writer.py' 2023-08-01T07:34:06,313 adding 'colossalai/utils/data_sampler/__init__.py' 2023-08-01T07:34:06,316 adding 'colossalai/utils/data_sampler/base_sampler.py' 2023-08-01T07:34:06,319 adding 'colossalai/utils/data_sampler/data_parallel_sampler.py' 2023-08-01T07:34:06,323 adding 'colossalai/utils/model/__init__.py' 2023-08-01T07:34:06,326 adding 'colossalai/utils/model/utils.py' 2023-08-01T07:34:06,329 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2023-08-01T07:34:06,332 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2023-08-01T07:34:06,335 adding 'colossalai/utils/profiler/__init__.py' 2023-08-01T07:34:06,338 adding 'colossalai/utils/profiler/extention.py' 2023-08-01T07:34:06,342 adding 'colossalai/utils/profiler/profiler.py' 2023-08-01T07:34:06,345 adding 'colossalai/utils/profiler/stateful_tensor_mem_extention.py' 2023-08-01T07:34:06,348 adding 'colossalai/utils/profiler/legacy/__init__.py' 2023-08-01T07:34:06,352 adding 'colossalai/utils/profiler/legacy/comm_profiler.py' 2023-08-01T07:34:06,356 adding 'colossalai/utils/profiler/legacy/pcie_profiler.py' 2023-08-01T07:34:06,359 adding 'colossalai/utils/profiler/legacy/prof_utils.py' 2023-08-01T07:34:06,362 adding 'colossalai/utils/rank_recorder/__init__.py' 2023-08-01T07:34:06,366 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2023-08-01T07:34:06,369 adding 'colossalai/utils/tensor_detector/__init__.py' 2023-08-01T07:34:06,373 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2023-08-01T07:34:06,377 adding 'colossalai/zero/__init__.py' 2023-08-01T07:34:06,380 adding 'colossalai/zero/wrapper.py' 2023-08-01T07:34:06,384 adding 'colossalai/zero/gemini/__init__.py' 2023-08-01T07:34:06,388 adding 'colossalai/zero/gemini/colo_init_context.py' 2023-08-01T07:34:06,398 adding 'colossalai/zero/gemini/gemini_ddp.py' 2023-08-01T07:34:06,402 adding 'colossalai/zero/gemini/gemini_hook.py' 2023-08-01T07:34:06,405 adding 'colossalai/zero/gemini/gemini_mgr.py' 2023-08-01T07:34:06,415 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2023-08-01T07:34:06,420 adding 'colossalai/zero/gemini/placement_policy.py' 2023-08-01T07:34:06,424 adding 'colossalai/zero/gemini/utils.py' 2023-08-01T07:34:06,429 adding 'colossalai/zero/gemini/chunk/__init__.py' 2023-08-01T07:34:06,435 adding 'colossalai/zero/gemini/chunk/chunk.py' 2023-08-01T07:34:06,440 adding 'colossalai/zero/gemini/chunk/manager.py' 2023-08-01T07:34:06,443 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2023-08-01T07:34:06,446 adding 'colossalai/zero/gemini/chunk/utils.py' 2023-08-01T07:34:06,451 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2023-08-01T07:34:06,454 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2023-08-01T07:34:06,457 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2023-08-01T07:34:06,460 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2023-08-01T07:34:06,463 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2023-08-01T07:34:06,467 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2023-08-01T07:34:06,470 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2023-08-01T07:34:06,474 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2023-08-01T07:34:06,477 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2023-08-01T07:34:06,481 adding 'colossalai/zero/legacy/__init__.py' 2023-08-01T07:34:06,484 adding 'colossalai/zero/legacy/gemini/__init__.py' 2023-08-01T07:34:06,487 adding 'colossalai/zero/legacy/gemini/gemini_context.py' 2023-08-01T07:34:06,491 adding 'colossalai/zero/legacy/gemini/stateful_tensor.py' 2023-08-01T07:34:06,494 adding 'colossalai/zero/legacy/gemini/stateful_tensor_mgr.py' 2023-08-01T07:34:06,498 adding 'colossalai/zero/legacy/gemini/tensor_placement_policy.py' 2023-08-01T07:34:06,501 adding 'colossalai/zero/legacy/gemini/tensor_utils.py' 2023-08-01T07:34:06,505 adding 'colossalai/zero/legacy/gemini/ophooks/__init__.py' 2023-08-01T07:34:06,508 adding 'colossalai/zero/legacy/gemini/ophooks/_shard_grad_ophook.py' 2023-08-01T07:34:06,511 adding 'colossalai/zero/legacy/gemini/ophooks/_shard_param_ophook.py' 2023-08-01T07:34:06,514 adding 'colossalai/zero/legacy/gemini/ophooks/runtime_mem_tracer_hook.py' 2023-08-01T07:34:06,518 adding 'colossalai/zero/legacy/gemini/ophooks/utils.py' 2023-08-01T07:34:06,522 adding 'colossalai/zero/legacy/gemini/paramhooks/__init__.py' 2023-08-01T07:34:06,524 adding 'colossalai/zero/legacy/gemini/paramhooks/_param_hookmgr.py' 2023-08-01T07:34:06,528 adding 'colossalai/zero/legacy/init_ctx/__init__.py' 2023-08-01T07:34:06,532 adding 'colossalai/zero/legacy/init_ctx/init_context.py' 2023-08-01T07:34:06,536 adding 'colossalai/zero/legacy/shard_utils/__init__.py' 2023-08-01T07:34:06,538 adding 'colossalai/zero/legacy/shard_utils/base_shard_strategy.py' 2023-08-01T07:34:06,541 adding 'colossalai/zero/legacy/shard_utils/bucket_tensor_shard_strategy.py' 2023-08-01T07:34:06,544 adding 'colossalai/zero/legacy/shard_utils/commons.py' 2023-08-01T07:34:06,547 adding 'colossalai/zero/legacy/shard_utils/tensor_shard_strategy.py' 2023-08-01T07:34:06,550 adding 'colossalai/zero/legacy/sharded_model/__init__.py' 2023-08-01T07:34:06,553 adding 'colossalai/zero/legacy/sharded_model/_utils.py' 2023-08-01T07:34:06,557 adding 'colossalai/zero/legacy/sharded_model/reduce_scatter.py' 2023-08-01T07:34:06,565 adding 'colossalai/zero/legacy/sharded_model/sharded_model_v2.py' 2023-08-01T07:34:06,568 adding 'colossalai/zero/legacy/sharded_model/utils.py' 2023-08-01T07:34:06,571 adding 'colossalai/zero/legacy/sharded_model/zero_hook.py' 2023-08-01T07:34:06,575 adding 'colossalai/zero/legacy/sharded_optim/__init__.py' 2023-08-01T07:34:06,581 adding 'colossalai/zero/legacy/sharded_optim/sharded_optim_v2.py' 2023-08-01T07:34:06,584 adding 'colossalai/zero/legacy/sharded_param/__init__.py' 2023-08-01T07:34:06,587 adding 'colossalai/zero/legacy/sharded_param/sharded_param.py' 2023-08-01T07:34:06,590 adding 'colossalai/zero/legacy/sharded_param/sharded_tensor.py' 2023-08-01T07:34:06,594 adding 'colossalai/zero/low_level/__init__.py' 2023-08-01T07:34:06,598 adding 'colossalai/zero/low_level/_utils.py' 2023-08-01T07:34:06,605 adding 'colossalai/zero/low_level/low_level_optim.py' 2023-08-01T07:34:06,609 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2023-08-01T07:34:06,612 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2023-08-01T07:34:06,615 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2023-08-01T07:34:06,618 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2023-08-01T07:34:06,620 adding 'colossalai/zero/low_level/bookkeeping/parameter_store.py' 2023-08-01T07:34:06,623 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2023-08-01T07:34:06,632 adding 'colossalai-0.3.1.dist-info/LICENSE' 2023-08-01T07:34:06,639 adding 'colossalai-0.3.1.dist-info/METADATA' 2023-08-01T07:34:06,641 adding 'colossalai-0.3.1.dist-info/WHEEL' 2023-08-01T07:34:06,643 adding 'colossalai-0.3.1.dist-info/entry_points.txt' 2023-08-01T07:34:06,645 adding 'colossalai-0.3.1.dist-info/top_level.txt' 2023-08-01T07:34:06,676 adding 'colossalai-0.3.1.dist-info/RECORD' 2023-08-01T07:34:06,740 removing build/bdist.linux-armv7l/wheel 2023-08-01T07:34:07,292 Building wheel for colossalai (setup.py): finished with status 'done' 2023-08-01T07:34:07,331 Created wheel for colossalai: filename=colossalai-0.3.1-py3-none-any.whl size=1055200 sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 2023-08-01T07:34:07,333 Stored in directory: /tmp/pip-ephem-wheel-cache-3etpjmah/wheels/5c/43/14/5db0a39f67a64001105919a6afd0dbefd3c5e402fec10689cc 2023-08-01T07:34:07,421 Successfully built colossalai 2023-08-01T07:34:07,512 Removed build tracker: '/tmp/pip-build-tracker-6s1pisi0'