2023-05-25T08:36:02,058 Created temporary directory: /tmp/pip-build-tracker-skl7c_il 2023-05-25T08:36:02,061 Initialized build tracking at /tmp/pip-build-tracker-skl7c_il 2023-05-25T08:36:02,061 Created build tracker: /tmp/pip-build-tracker-skl7c_il 2023-05-25T08:36:02,062 Entered build tracker: /tmp/pip-build-tracker-skl7c_il 2023-05-25T08:36:02,063 Created temporary directory: /tmp/pip-wheel-y1fbdjbd 2023-05-25T08:36:02,072 Created temporary directory: /tmp/pip-ephem-wheel-cache-989yt860 2023-05-25T08:36:02,128 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-05-25T08:36:02,136 2 location(s) to search for versions of colossalai: 2023-05-25T08:36:02,136 * https://pypi.org/simple/colossalai/ 2023-05-25T08:36:02,136 * https://www.piwheels.org/simple/colossalai/ 2023-05-25T08:36:02,137 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2023-05-25T08:36:02,138 Getting page https://pypi.org/simple/colossalai/ 2023-05-25T08:36:02,143 Found index url https://pypi.org/simple/ 2023-05-25T08:36:02,326 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2023-05-25T08:36:02,333 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2023-05-25T08:36:02,335 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2023-05-25T08:36:02,336 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2023-05-25T08:36:02,338 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2023-05-25T08:36:02,339 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2023-05-25T08:36:02,341 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2023-05-25T08:36:02,342 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2023-05-25T08:36:02,343 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2023-05-25T08:36:02,345 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2023-05-25T08:36:02,346 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2023-05-25T08:36:02,347 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2023-05-25T08:36:02,348 Getting page https://www.piwheels.org/simple/colossalai/ 2023-05-25T08:36:02,350 Found index url https://www.piwheels.org/simple/ 2023-05-25T08:36:02,636 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2023-05-25T08:36:02,645 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-05-25T08:36:02,646 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-05-25T08:36:02,646 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-05-25T08:36:02,647 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-05-25T08:36:02,647 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-05-25T08:36:02,648 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-05-25T08:36:02,648 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-05-25T08:36:02,649 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-05-25T08:36:02,649 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2023-05-25T08:36:02,650 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2023-05-25T08:36:02,650 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2023-05-25T08:36:02,686 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2023-05-25T08:36:02,717 Collecting colossalai==0.3.0 2023-05-25T08:36:02,722 Created temporary directory: /tmp/pip-unpack-dik2etsx 2023-05-25T08:36:03,072 Downloading colossalai-0.3.0.tar.gz (782 kB) 2023-05-25T08:36:06,773 Added colossalai==0.3.0 from https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz to build tracker '/tmp/pip-build-tracker-skl7c_il' 2023-05-25T08:36:06,777 Running setup.py (path:/tmp/pip-wheel-y1fbdjbd/colossalai_6e46ecf6fae9442686620b6ed1a76cf6/setup.py) egg_info for package colossalai 2023-05-25T08:36:06,778 Created temporary directory: /tmp/pip-pip-egg-info-3sekqore 2023-05-25T08:36:06,779 Preparing metadata (setup.py): started 2023-05-25T08:36:06,781 Running command python setup.py egg_info 2023-05-25T08:36:08,580 running egg_info 2023-05-25T08:36:08,582 creating /tmp/pip-pip-egg-info-3sekqore/colossalai.egg-info 2023-05-25T08:36:08,647 writing /tmp/pip-pip-egg-info-3sekqore/colossalai.egg-info/PKG-INFO 2023-05-25T08:36:08,652 writing dependency_links to /tmp/pip-pip-egg-info-3sekqore/colossalai.egg-info/dependency_links.txt 2023-05-25T08:36:08,656 writing entry points to /tmp/pip-pip-egg-info-3sekqore/colossalai.egg-info/entry_points.txt 2023-05-25T08:36:08,659 writing requirements to /tmp/pip-pip-egg-info-3sekqore/colossalai.egg-info/requires.txt 2023-05-25T08:36:08,661 writing top-level names to /tmp/pip-pip-egg-info-3sekqore/colossalai.egg-info/top_level.txt 2023-05-25T08:36:08,664 writing manifest file '/tmp/pip-pip-egg-info-3sekqore/colossalai.egg-info/SOURCES.txt' 2023-05-25T08:36:09,085 reading manifest file '/tmp/pip-pip-egg-info-3sekqore/colossalai.egg-info/SOURCES.txt' 2023-05-25T08:36:09,089 reading manifest template 'MANIFEST.in' 2023-05-25T08:36:11,338 warning: no files found matching '*.tr' under directory 'colossalai' 2023-05-25T08:36:12,458 warning: no files found matching '*.cc' under directory 'colossalai' 2023-05-25T08:36:13,023 warning: no files found matching '*.pyi' under directory 'colossalai' 2023-05-25T08:36:13,042 adding license file 'LICENSE' 2023-05-25T08:36:13,114 writing manifest file '/tmp/pip-pip-egg-info-3sekqore/colossalai.egg-info/SOURCES.txt' 2023-05-25T08:36:13,240 Preparing metadata (setup.py): finished with status 'done' 2023-05-25T08:36:13,257 Source in /tmp/pip-wheel-y1fbdjbd/colossalai_6e46ecf6fae9442686620b6ed1a76cf6 has version 0.3.0, which satisfies requirement colossalai==0.3.0 from https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz 2023-05-25T08:36:13,259 Removed colossalai==0.3.0 from https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz from build tracker '/tmp/pip-build-tracker-skl7c_il' 2023-05-25T08:36:13,278 Created temporary directory: /tmp/pip-unpack-75633krp 2023-05-25T08:36:13,280 Building wheels for collected packages: colossalai 2023-05-25T08:36:13,289 Created temporary directory: /tmp/pip-wheel-go9cdigx 2023-05-25T08:36:13,290 Building wheel for colossalai (setup.py): started 2023-05-25T08:36:13,292 Destination directory: /tmp/pip-wheel-go9cdigx 2023-05-25T08:36:13,292 Running command python setup.py bdist_wheel 2023-05-25T08:36:14,999 running bdist_wheel 2023-05-25T08:36:15,717 running build 2023-05-25T08:36:15,718 running build_py 2023-05-25T08:36:15,790 creating build 2023-05-25T08:36:15,791 creating build/lib 2023-05-25T08:36:15,793 creating build/lib/colossalai 2023-05-25T08:36:15,795 copying colossalai/initialize.py -> build/lib/colossalai 2023-05-25T08:36:15,800 copying colossalai/version.py -> build/lib/colossalai 2023-05-25T08:36:15,804 copying colossalai/__init__.py -> build/lib/colossalai 2023-05-25T08:36:15,808 copying colossalai/global_variables.py -> build/lib/colossalai 2023-05-25T08:36:15,812 copying colossalai/constants.py -> build/lib/colossalai 2023-05-25T08:36:15,816 copying colossalai/core.py -> build/lib/colossalai 2023-05-25T08:36:15,822 creating build/lib/colossalai/logging 2023-05-25T08:36:15,824 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2023-05-25T08:36:15,828 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2023-05-25T08:36:15,835 creating build/lib/colossalai/testing 2023-05-25T08:36:15,837 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2023-05-25T08:36:15,841 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2023-05-25T08:36:15,846 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2023-05-25T08:36:15,851 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2023-05-25T08:36:15,856 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2023-05-25T08:36:15,861 creating build/lib/colossalai/engine 2023-05-25T08:36:15,864 copying colossalai/engine/__init__.py -> build/lib/colossalai/engine 2023-05-25T08:36:15,869 copying colossalai/engine/_base_engine.py -> build/lib/colossalai/engine 2023-05-25T08:36:15,875 creating build/lib/colossalai/auto_parallel 2023-05-25T08:36:15,877 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2023-05-25T08:36:15,884 creating build/lib/colossalai/tensor 2023-05-25T08:36:15,887 copying colossalai/tensor/tensor_spec.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,892 copying colossalai/tensor/distspec.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,896 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,903 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,907 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,911 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,917 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,921 copying colossalai/tensor/dist_spec_mgr.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,926 copying colossalai/tensor/process_group.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,931 copying colossalai/tensor/compute_spec.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,934 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,939 copying colossalai/tensor/const.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,943 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,949 copying colossalai/tensor/op_wrapper.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,953 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2023-05-25T08:36:15,960 creating build/lib/colossalai/amp 2023-05-25T08:36:15,961 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2023-05-25T08:36:15,965 copying colossalai/amp/amp_type.py -> build/lib/colossalai/amp 2023-05-25T08:36:15,971 creating build/lib/colossalai/trainer 2023-05-25T08:36:15,973 copying colossalai/trainer/_trainer.py -> build/lib/colossalai/trainer 2023-05-25T08:36:15,978 copying colossalai/trainer/__init__.py -> build/lib/colossalai/trainer 2023-05-25T08:36:15,984 creating build/lib/colossalai/utils 2023-05-25T08:36:15,986 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2023-05-25T08:36:15,990 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2023-05-25T08:36:15,995 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2023-05-25T08:36:16,001 copying colossalai/utils/checkpointing.py -> build/lib/colossalai/utils 2023-05-25T08:36:16,005 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2023-05-25T08:36:16,009 copying colossalai/utils/moe.py -> build/lib/colossalai/utils 2023-05-25T08:36:16,013 copying colossalai/utils/activation_checkpoint.py -> build/lib/colossalai/utils 2023-05-25T08:36:16,017 copying colossalai/utils/cuda.py -> build/lib/colossalai/utils 2023-05-25T08:36:16,022 creating build/lib/colossalai/context 2023-05-25T08:36:16,024 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2023-05-25T08:36:16,027 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2023-05-25T08:36:16,030 copying colossalai/context/config.py -> build/lib/colossalai/context 2023-05-25T08:36:16,034 copying colossalai/context/moe_context.py -> build/lib/colossalai/context 2023-05-25T08:36:16,038 copying colossalai/context/parallel_mode.py -> build/lib/colossalai/context 2023-05-25T08:36:16,041 copying colossalai/context/parallel_context.py -> build/lib/colossalai/context 2023-05-25T08:36:16,047 creating build/lib/colossalai/cluster 2023-05-25T08:36:16,049 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2023-05-25T08:36:16,053 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2023-05-25T08:36:16,057 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2023-05-25T08:36:16,060 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2023-05-25T08:36:16,065 creating build/lib/colossalai/booster 2023-05-25T08:36:16,067 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2023-05-25T08:36:16,072 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2023-05-25T08:36:16,075 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2023-05-25T08:36:16,080 creating build/lib/colossalai/communication 2023-05-25T08:36:16,082 copying colossalai/communication/__init__.py -> build/lib/colossalai/communication 2023-05-25T08:36:16,085 copying colossalai/communication/utils.py -> build/lib/colossalai/communication 2023-05-25T08:36:16,089 copying colossalai/communication/p2p_v2.py -> build/lib/colossalai/communication 2023-05-25T08:36:16,093 copying colossalai/communication/p2p.py -> build/lib/colossalai/communication 2023-05-25T08:36:16,098 copying colossalai/communication/collective.py -> build/lib/colossalai/communication 2023-05-25T08:36:16,103 copying colossalai/communication/ring.py -> build/lib/colossalai/communication 2023-05-25T08:36:16,107 creating build/lib/colossalai/cli 2023-05-25T08:36:16,109 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2023-05-25T08:36:16,113 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2023-05-25T08:36:16,117 creating build/lib/colossalai/device 2023-05-25T08:36:16,119 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2023-05-25T08:36:16,123 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2023-05-25T08:36:16,127 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2023-05-25T08:36:16,131 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2023-05-25T08:36:16,137 creating build/lib/colossalai/registry 2023-05-25T08:36:16,138 copying colossalai/registry/__init__.py -> build/lib/colossalai/registry 2023-05-25T08:36:16,142 copying colossalai/registry/registry.py -> build/lib/colossalai/registry 2023-05-25T08:36:16,147 creating build/lib/colossalai/builder 2023-05-25T08:36:16,148 copying colossalai/builder/__init__.py -> build/lib/colossalai/builder 2023-05-25T08:36:16,152 copying colossalai/builder/builder.py -> build/lib/colossalai/builder 2023-05-25T08:36:16,157 creating build/lib/colossalai/zero 2023-05-25T08:36:16,159 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2023-05-25T08:36:16,163 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2023-05-25T08:36:16,168 creating build/lib/colossalai/nn 2023-05-25T08:36:16,170 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2023-05-25T08:36:16,174 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2023-05-25T08:36:16,180 creating build/lib/colossalai/kernel 2023-05-25T08:36:16,181 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2023-05-25T08:36:16,186 creating build/lib/colossalai/checkpoint_io 2023-05-25T08:36:16,188 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2023-05-25T08:36:16,192 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2023-05-25T08:36:16,196 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2023-05-25T08:36:16,201 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2023-05-25T08:36:16,205 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2023-05-25T08:36:16,211 creating build/lib/colossalai/pipeline 2023-05-25T08:36:16,213 copying colossalai/pipeline/pipeline_process_group.py -> build/lib/colossalai/pipeline 2023-05-25T08:36:16,217 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2023-05-25T08:36:16,221 copying colossalai/pipeline/utils.py -> build/lib/colossalai/pipeline 2023-05-25T08:36:16,225 copying colossalai/pipeline/pipelinable.py -> build/lib/colossalai/pipeline 2023-05-25T08:36:16,230 copying colossalai/pipeline/layer_spec.py -> build/lib/colossalai/pipeline 2023-05-25T08:36:16,235 creating build/lib/colossalai/fx 2023-05-25T08:36:16,236 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2023-05-25T08:36:16,240 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2023-05-25T08:36:16,245 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2023-05-25T08:36:16,249 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2023-05-25T08:36:16,253 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2023-05-25T08:36:16,257 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2023-05-25T08:36:16,261 creating build/lib/colossalai/_C 2023-05-25T08:36:16,263 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2023-05-25T08:36:16,267 creating build/lib/colossalai/_analyzer 2023-05-25T08:36:16,269 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2023-05-25T08:36:16,272 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2023-05-25T08:36:16,277 creating build/lib/colossalai/interface 2023-05-25T08:36:16,278 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2023-05-25T08:36:16,283 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2023-05-25T08:36:16,287 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2023-05-25T08:36:16,293 creating build/lib/colossalai/engine/gradient_accumulation 2023-05-25T08:36:16,295 copying colossalai/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/engine/gradient_accumulation 2023-05-25T08:36:16,299 copying colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/engine/gradient_accumulation 2023-05-25T08:36:16,305 creating build/lib/colossalai/engine/gradient_handler 2023-05-25T08:36:16,307 copying colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler 2023-05-25T08:36:16,311 copying colossalai/engine/gradient_handler/__init__.py -> build/lib/colossalai/engine/gradient_handler 2023-05-25T08:36:16,314 copying colossalai/engine/gradient_handler/utils.py -> build/lib/colossalai/engine/gradient_handler 2023-05-25T08:36:16,318 copying colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler 2023-05-25T08:36:16,321 copying colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler 2023-05-25T08:36:16,325 copying colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler 2023-05-25T08:36:16,328 copying colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler 2023-05-25T08:36:16,331 copying colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler 2023-05-25T08:36:16,336 creating build/lib/colossalai/engine/schedule 2023-05-25T08:36:16,338 copying colossalai/engine/schedule/__init__.py -> build/lib/colossalai/engine/schedule 2023-05-25T08:36:16,342 copying colossalai/engine/schedule/_base_schedule.py -> build/lib/colossalai/engine/schedule 2023-05-25T08:36:16,346 copying colossalai/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/engine/schedule 2023-05-25T08:36:16,349 copying colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/engine/schedule 2023-05-25T08:36:16,353 copying colossalai/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/engine/schedule 2023-05-25T08:36:16,360 creating build/lib/colossalai/auto_parallel/meta_profiler 2023-05-25T08:36:16,362 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2023-05-25T08:36:16,366 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2023-05-25T08:36:16,369 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2023-05-25T08:36:16,373 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2023-05-25T08:36:16,378 creating build/lib/colossalai/auto_parallel/passes 2023-05-25T08:36:16,380 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2023-05-25T08:36:16,385 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2023-05-25T08:36:16,388 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2023-05-25T08:36:16,392 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2023-05-25T08:36:16,396 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2023-05-25T08:36:16,399 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2023-05-25T08:36:16,405 creating build/lib/colossalai/auto_parallel/tensor_shard 2023-05-25T08:36:16,407 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-05-25T08:36:16,411 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-05-25T08:36:16,414 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-05-25T08:36:16,417 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-05-25T08:36:16,421 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2023-05-25T08:36:16,426 creating build/lib/colossalai/auto_parallel/pipeline_shard 2023-05-25T08:36:16,428 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2023-05-25T08:36:16,432 creating build/lib/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:16,434 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:16,437 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:16,441 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:16,445 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:16,450 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:16,454 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:16,459 creating build/lib/colossalai/auto_parallel/offload 2023-05-25T08:36:16,461 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2023-05-25T08:36:16,467 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2023-05-25T08:36:16,469 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2023-05-25T08:36:16,474 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2023-05-25T08:36:16,478 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2023-05-25T08:36:16,482 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2023-05-25T08:36:16,485 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2023-05-25T08:36:16,489 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2023-05-25T08:36:16,493 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2023-05-25T08:36:16,497 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2023-05-25T08:36:16,504 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:16,505 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:16,509 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:16,513 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:16,516 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:16,520 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:16,523 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:16,527 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:16,530 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:16,534 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:16,538 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:16,543 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:16,548 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-05-25T08:36:16,550 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-05-25T08:36:16,554 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-05-25T08:36:16,559 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-05-25T08:36:16,562 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-05-25T08:36:16,567 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2023-05-25T08:36:16,573 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:16,575 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:16,579 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:16,583 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:16,586 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:16,590 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:16,595 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:16,604 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,605 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,609 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,613 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,617 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,620 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,624 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,627 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,631 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,635 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,638 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,642 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,645 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,649 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,652 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,656 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,659 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,665 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,670 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,673 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,677 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,680 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,684 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,689 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,694 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,698 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,702 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,706 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:16,714 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,715 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,719 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,723 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,727 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,733 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,738 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,742 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,746 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,750 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,753 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,758 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,762 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,767 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,771 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,774 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,779 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,783 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,787 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,791 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:16,797 creating build/lib/colossalai/tensor/d_tensor 2023-05-25T08:36:16,799 copying colossalai/tensor/d_tensor/d_tensor.py -> build/lib/colossalai/tensor/d_tensor 2023-05-25T08:36:16,804 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2023-05-25T08:36:16,807 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2023-05-25T08:36:16,810 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2023-05-25T08:36:16,814 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2023-05-25T08:36:16,818 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2023-05-25T08:36:16,823 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2023-05-25T08:36:16,828 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2023-05-25T08:36:16,834 creating build/lib/colossalai/amp/naive_amp 2023-05-25T08:36:16,835 copying colossalai/amp/naive_amp/_utils.py -> build/lib/colossalai/amp/naive_amp 2023-05-25T08:36:16,839 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2023-05-25T08:36:16,843 copying colossalai/amp/naive_amp/naive_amp.py -> build/lib/colossalai/amp/naive_amp 2023-05-25T08:36:16,847 copying colossalai/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/amp/naive_amp 2023-05-25T08:36:16,853 creating build/lib/colossalai/amp/torch_amp 2023-05-25T08:36:16,855 copying colossalai/amp/torch_amp/__init__.py -> build/lib/colossalai/amp/torch_amp 2023-05-25T08:36:16,859 copying colossalai/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/amp/torch_amp 2023-05-25T08:36:16,865 copying colossalai/amp/torch_amp/torch_amp.py -> build/lib/colossalai/amp/torch_amp 2023-05-25T08:36:16,869 creating build/lib/colossalai/amp/apex_amp 2023-05-25T08:36:16,871 copying colossalai/amp/apex_amp/__init__.py -> build/lib/colossalai/amp/apex_amp 2023-05-25T08:36:16,875 copying colossalai/amp/apex_amp/apex_amp.py -> build/lib/colossalai/amp/apex_amp 2023-05-25T08:36:16,880 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2023-05-25T08:36:16,881 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2023-05-25T08:36:16,885 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2023-05-25T08:36:16,888 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2023-05-25T08:36:16,892 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2023-05-25T08:36:16,898 creating build/lib/colossalai/trainer/hooks 2023-05-25T08:36:16,900 copying colossalai/trainer/hooks/_metric_hook.py -> build/lib/colossalai/trainer/hooks 2023-05-25T08:36:16,905 copying colossalai/trainer/hooks/__init__.py -> build/lib/colossalai/trainer/hooks 2023-05-25T08:36:16,909 copying colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/trainer/hooks 2023-05-25T08:36:16,913 copying colossalai/trainer/hooks/_base_hook.py -> build/lib/colossalai/trainer/hooks 2023-05-25T08:36:16,917 copying colossalai/trainer/hooks/_commons_.py -> build/lib/colossalai/trainer/hooks 2023-05-25T08:36:16,920 copying colossalai/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/trainer/hooks 2023-05-25T08:36:16,924 copying colossalai/trainer/hooks/_log_hook.py -> build/lib/colossalai/trainer/hooks 2023-05-25T08:36:16,930 creating build/lib/colossalai/utils/multi_tensor_apply 2023-05-25T08:36:16,931 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2023-05-25T08:36:16,936 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2023-05-25T08:36:16,941 creating build/lib/colossalai/utils/profiler 2023-05-25T08:36:16,943 copying colossalai/utils/profiler/__init__.py -> build/lib/colossalai/utils/profiler 2023-05-25T08:36:16,947 copying colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/utils/profiler 2023-05-25T08:36:16,951 copying colossalai/utils/profiler/profiler.py -> build/lib/colossalai/utils/profiler 2023-05-25T08:36:16,955 copying colossalai/utils/profiler/extention.py -> build/lib/colossalai/utils/profiler 2023-05-25T08:36:16,960 creating build/lib/colossalai/utils/model 2023-05-25T08:36:16,962 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2023-05-25T08:36:16,965 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2023-05-25T08:36:16,969 copying colossalai/utils/model/experimental.py -> build/lib/colossalai/utils/model 2023-05-25T08:36:16,974 copying colossalai/utils/model/lazy_init_context.py -> build/lib/colossalai/utils/model 2023-05-25T08:36:16,979 creating build/lib/colossalai/utils/tensor_detector 2023-05-25T08:36:16,981 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2023-05-25T08:36:16,985 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2023-05-25T08:36:16,990 creating build/lib/colossalai/utils/data_sampler 2023-05-25T08:36:16,992 copying colossalai/utils/data_sampler/__init__.py -> build/lib/colossalai/utils/data_sampler 2023-05-25T08:36:16,996 copying colossalai/utils/data_sampler/base_sampler.py -> build/lib/colossalai/utils/data_sampler 2023-05-25T08:36:17,000 copying colossalai/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/utils/data_sampler 2023-05-25T08:36:17,007 creating build/lib/colossalai/utils/rank_recorder 2023-05-25T08:36:17,008 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2023-05-25T08:36:17,013 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2023-05-25T08:36:17,018 creating build/lib/colossalai/utils/checkpoint 2023-05-25T08:36:17,020 copying colossalai/utils/checkpoint/__init__.py -> build/lib/colossalai/utils/checkpoint 2023-05-25T08:36:17,024 copying colossalai/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/utils/checkpoint 2023-05-25T08:36:17,028 copying colossalai/utils/checkpoint/utils.py -> build/lib/colossalai/utils/checkpoint 2023-05-25T08:36:17,034 creating build/lib/colossalai/utils/checkpoint_io 2023-05-25T08:36:17,036 copying colossalai/utils/checkpoint_io/distributed.py -> build/lib/colossalai/utils/checkpoint_io 2023-05-25T08:36:17,040 copying colossalai/utils/checkpoint_io/reader.py -> build/lib/colossalai/utils/checkpoint_io 2023-05-25T08:36:17,045 copying colossalai/utils/checkpoint_io/io.py -> build/lib/colossalai/utils/checkpoint_io 2023-05-25T08:36:17,049 copying colossalai/utils/checkpoint_io/__init__.py -> build/lib/colossalai/utils/checkpoint_io 2023-05-25T08:36:17,053 copying colossalai/utils/checkpoint_io/backend.py -> build/lib/colossalai/utils/checkpoint_io 2023-05-25T08:36:17,056 copying colossalai/utils/checkpoint_io/utils.py -> build/lib/colossalai/utils/checkpoint_io 2023-05-25T08:36:17,061 copying colossalai/utils/checkpoint_io/convertor.py -> build/lib/colossalai/utils/checkpoint_io 2023-05-25T08:36:17,066 copying colossalai/utils/checkpoint_io/meta.py -> build/lib/colossalai/utils/checkpoint_io 2023-05-25T08:36:17,070 copying colossalai/utils/checkpoint_io/writer.py -> build/lib/colossalai/utils/checkpoint_io 2023-05-25T08:36:17,074 copying colossalai/utils/checkpoint_io/constant.py -> build/lib/colossalai/utils/checkpoint_io 2023-05-25T08:36:17,079 creating build/lib/colossalai/utils/profiler/legacy 2023-05-25T08:36:17,081 copying colossalai/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/utils/profiler/legacy 2023-05-25T08:36:17,086 copying colossalai/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/utils/profiler/legacy 2023-05-25T08:36:17,091 copying colossalai/utils/profiler/legacy/__init__.py -> build/lib/colossalai/utils/profiler/legacy 2023-05-25T08:36:17,094 copying colossalai/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/utils/profiler/legacy 2023-05-25T08:36:17,100 creating build/lib/colossalai/context/random 2023-05-25T08:36:17,102 copying colossalai/context/random/__init__.py -> build/lib/colossalai/context/random 2023-05-25T08:36:17,106 copying colossalai/context/random/_helper.py -> build/lib/colossalai/context/random 2023-05-25T08:36:17,110 copying colossalai/context/random/seed_manager.py -> build/lib/colossalai/context/random 2023-05-25T08:36:17,117 creating build/lib/colossalai/context/process_group_initializer 2023-05-25T08:36:17,118 copying colossalai/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/context/process_group_initializer 2023-05-25T08:36:17,122 copying colossalai/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/context/process_group_initializer 2023-05-25T08:36:17,127 copying colossalai/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/context/process_group_initializer 2023-05-25T08:36:17,130 copying colossalai/context/process_group_initializer/__init__.py -> build/lib/colossalai/context/process_group_initializer 2023-05-25T08:36:17,134 copying colossalai/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/context/process_group_initializer 2023-05-25T08:36:17,138 copying colossalai/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/context/process_group_initializer 2023-05-25T08:36:17,142 copying colossalai/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/context/process_group_initializer 2023-05-25T08:36:17,146 copying colossalai/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/context/process_group_initializer 2023-05-25T08:36:17,149 copying colossalai/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/context/process_group_initializer 2023-05-25T08:36:17,153 copying colossalai/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/context/process_group_initializer 2023-05-25T08:36:17,157 copying colossalai/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/context/process_group_initializer 2023-05-25T08:36:17,163 creating build/lib/colossalai/booster/plugin 2023-05-25T08:36:17,164 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2023-05-25T08:36:17,168 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2023-05-25T08:36:17,172 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2023-05-25T08:36:17,176 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2023-05-25T08:36:17,180 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2023-05-25T08:36:17,184 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2023-05-25T08:36:17,188 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2023-05-25T08:36:17,194 creating build/lib/colossalai/booster/mixed_precision 2023-05-25T08:36:17,196 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2023-05-25T08:36:17,199 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2023-05-25T08:36:17,204 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2023-05-25T08:36:17,208 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2023-05-25T08:36:17,212 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2023-05-25T08:36:17,216 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2023-05-25T08:36:17,220 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2023-05-25T08:36:17,225 creating build/lib/colossalai/cli/check 2023-05-25T08:36:17,228 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2023-05-25T08:36:17,233 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2023-05-25T08:36:17,238 creating build/lib/colossalai/cli/launcher 2023-05-25T08:36:17,239 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2023-05-25T08:36:17,244 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2023-05-25T08:36:17,247 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2023-05-25T08:36:17,251 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2023-05-25T08:36:17,256 creating build/lib/colossalai/cli/benchmark 2023-05-25T08:36:17,257 copying colossalai/cli/benchmark/__init__.py -> build/lib/colossalai/cli/benchmark 2023-05-25T08:36:17,261 copying colossalai/cli/benchmark/utils.py -> build/lib/colossalai/cli/benchmark 2023-05-25T08:36:17,265 copying colossalai/cli/benchmark/benchmark.py -> build/lib/colossalai/cli/benchmark 2023-05-25T08:36:17,269 copying colossalai/cli/benchmark/models.py -> build/lib/colossalai/cli/benchmark 2023-05-25T08:36:17,274 creating build/lib/colossalai/zero/gemini 2023-05-25T08:36:17,276 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2023-05-25T08:36:17,281 copying colossalai/zero/gemini/colo_init_context.py -> build/lib/colossalai/zero/gemini 2023-05-25T08:36:17,285 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2023-05-25T08:36:17,290 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2023-05-25T08:36:17,294 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2023-05-25T08:36:17,298 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2023-05-25T08:36:17,302 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2023-05-25T08:36:17,307 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2023-05-25T08:36:17,312 creating build/lib/colossalai/zero/low_level 2023-05-25T08:36:17,314 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2023-05-25T08:36:17,319 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2023-05-25T08:36:17,322 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2023-05-25T08:36:17,329 creating build/lib/colossalai/zero/legacy 2023-05-25T08:36:17,330 copying colossalai/zero/legacy/__init__.py -> build/lib/colossalai/zero/legacy 2023-05-25T08:36:17,336 creating build/lib/colossalai/zero/gemini/chunk 2023-05-25T08:36:17,338 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2023-05-25T08:36:17,345 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2023-05-25T08:36:17,348 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2023-05-25T08:36:17,352 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2023-05-25T08:36:17,356 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2023-05-25T08:36:17,363 creating build/lib/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:17,365 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:17,369 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:17,372 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:17,376 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:17,380 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:17,383 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:17,387 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:17,392 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:17,396 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:17,401 creating build/lib/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:17,403 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:17,407 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:17,410 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:17,414 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:17,418 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:17,421 copying colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:17,426 creating build/lib/colossalai/zero/legacy/sharded_param 2023-05-25T08:36:17,428 copying colossalai/zero/legacy/sharded_param/__init__.py -> build/lib/colossalai/zero/legacy/sharded_param 2023-05-25T08:36:17,432 copying colossalai/zero/legacy/sharded_param/sharded_param.py -> build/lib/colossalai/zero/legacy/sharded_param 2023-05-25T08:36:17,435 copying colossalai/zero/legacy/sharded_param/sharded_tensor.py -> build/lib/colossalai/zero/legacy/sharded_param 2023-05-25T08:36:17,440 creating build/lib/colossalai/zero/legacy/init_ctx 2023-05-25T08:36:17,442 copying colossalai/zero/legacy/init_ctx/__init__.py -> build/lib/colossalai/zero/legacy/init_ctx 2023-05-25T08:36:17,446 copying colossalai/zero/legacy/init_ctx/init_context.py -> build/lib/colossalai/zero/legacy/init_ctx 2023-05-25T08:36:17,453 creating build/lib/colossalai/zero/legacy/gemini 2023-05-25T08:36:17,455 copying colossalai/zero/legacy/gemini/gemini_context.py -> build/lib/colossalai/zero/legacy/gemini 2023-05-25T08:36:17,458 copying colossalai/zero/legacy/gemini/__init__.py -> build/lib/colossalai/zero/legacy/gemini 2023-05-25T08:36:17,462 copying colossalai/zero/legacy/gemini/stateful_tensor.py -> build/lib/colossalai/zero/legacy/gemini 2023-05-25T08:36:17,466 copying colossalai/zero/legacy/gemini/tensor_utils.py -> build/lib/colossalai/zero/legacy/gemini 2023-05-25T08:36:17,470 copying colossalai/zero/legacy/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/zero/legacy/gemini 2023-05-25T08:36:17,474 copying colossalai/zero/legacy/gemini/tensor_placement_policy.py -> build/lib/colossalai/zero/legacy/gemini 2023-05-25T08:36:17,480 creating build/lib/colossalai/zero/legacy/sharded_optim 2023-05-25T08:36:17,482 copying colossalai/zero/legacy/sharded_optim/__init__.py -> build/lib/colossalai/zero/legacy/sharded_optim 2023-05-25T08:36:17,486 copying colossalai/zero/legacy/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/zero/legacy/sharded_optim 2023-05-25T08:36:17,493 creating build/lib/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:17,495 copying colossalai/zero/legacy/sharded_model/_utils.py -> build/lib/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:17,499 copying colossalai/zero/legacy/sharded_model/__init__.py -> build/lib/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:17,503 copying colossalai/zero/legacy/sharded_model/utils.py -> build/lib/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:17,506 copying colossalai/zero/legacy/sharded_model/sharded_model_v2.py -> build/lib/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:17,512 copying colossalai/zero/legacy/sharded_model/zero_hook.py -> build/lib/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:17,516 copying colossalai/zero/legacy/sharded_model/reduce_scatter.py -> build/lib/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:17,522 creating build/lib/colossalai/zero/legacy/shard_utils 2023-05-25T08:36:17,524 copying colossalai/zero/legacy/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/zero/legacy/shard_utils 2023-05-25T08:36:17,527 copying colossalai/zero/legacy/shard_utils/__init__.py -> build/lib/colossalai/zero/legacy/shard_utils 2023-05-25T08:36:17,531 copying colossalai/zero/legacy/shard_utils/base_shard_strategy.py -> build/lib/colossalai/zero/legacy/shard_utils 2023-05-25T08:36:17,535 copying colossalai/zero/legacy/shard_utils/commons.py -> build/lib/colossalai/zero/legacy/shard_utils 2023-05-25T08:36:17,538 copying colossalai/zero/legacy/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/zero/legacy/shard_utils 2023-05-25T08:36:17,544 creating build/lib/colossalai/zero/legacy/gemini/paramhooks 2023-05-25T08:36:17,546 copying colossalai/zero/legacy/gemini/paramhooks/__init__.py -> build/lib/colossalai/zero/legacy/gemini/paramhooks 2023-05-25T08:36:17,550 copying colossalai/zero/legacy/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/zero/legacy/gemini/paramhooks 2023-05-25T08:36:17,555 creating build/lib/colossalai/zero/legacy/gemini/ophooks 2023-05-25T08:36:17,557 copying colossalai/zero/legacy/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/zero/legacy/gemini/ophooks 2023-05-25T08:36:17,561 copying colossalai/zero/legacy/gemini/ophooks/__init__.py -> build/lib/colossalai/zero/legacy/gemini/ophooks 2023-05-25T08:36:17,565 copying colossalai/zero/legacy/gemini/ophooks/utils.py -> build/lib/colossalai/zero/legacy/gemini/ophooks 2023-05-25T08:36:17,570 copying colossalai/zero/legacy/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/zero/legacy/gemini/ophooks 2023-05-25T08:36:17,574 copying colossalai/zero/legacy/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/zero/legacy/gemini/ophooks 2023-05-25T08:36:17,579 creating build/lib/colossalai/nn/_ops 2023-05-25T08:36:17,581 copying colossalai/nn/_ops/_utils.py -> build/lib/colossalai/nn/_ops 2023-05-25T08:36:17,586 copying colossalai/nn/_ops/view.py -> build/lib/colossalai/nn/_ops 2023-05-25T08:36:17,590 copying colossalai/nn/_ops/loss.py -> build/lib/colossalai/nn/_ops 2023-05-25T08:36:17,594 copying colossalai/nn/_ops/addmm.py -> build/lib/colossalai/nn/_ops 2023-05-25T08:36:17,599 copying colossalai/nn/_ops/__init__.py -> build/lib/colossalai/nn/_ops 2023-05-25T08:36:17,603 copying colossalai/nn/_ops/embedding_bag.py -> build/lib/colossalai/nn/_ops 2023-05-25T08:36:17,607 copying colossalai/nn/_ops/layernorm.py -> build/lib/colossalai/nn/_ops 2023-05-25T08:36:17,611 copying colossalai/nn/_ops/element_wise.py -> build/lib/colossalai/nn/_ops 2023-05-25T08:36:17,616 copying colossalai/nn/_ops/embedding.py -> build/lib/colossalai/nn/_ops 2023-05-25T08:36:17,620 copying colossalai/nn/_ops/batch_norm.py -> build/lib/colossalai/nn/_ops 2023-05-25T08:36:17,623 copying colossalai/nn/_ops/linear.py -> build/lib/colossalai/nn/_ops 2023-05-25T08:36:17,629 creating build/lib/colossalai/nn/loss 2023-05-25T08:36:17,631 copying colossalai/nn/loss/loss_2p5d.py -> build/lib/colossalai/nn/loss 2023-05-25T08:36:17,636 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2023-05-25T08:36:17,640 copying colossalai/nn/loss/loss_moe.py -> build/lib/colossalai/nn/loss 2023-05-25T08:36:17,644 copying colossalai/nn/loss/loss_1d.py -> build/lib/colossalai/nn/loss 2023-05-25T08:36:17,648 copying colossalai/nn/loss/loss_2d.py -> build/lib/colossalai/nn/loss 2023-05-25T08:36:17,653 copying colossalai/nn/loss/loss_3d.py -> build/lib/colossalai/nn/loss 2023-05-25T08:36:17,659 creating build/lib/colossalai/nn/optimizer 2023-05-25T08:36:17,661 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2023-05-25T08:36:17,665 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2023-05-25T08:36:17,668 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2023-05-25T08:36:17,673 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2023-05-25T08:36:17,677 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2023-05-25T08:36:17,682 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2023-05-25T08:36:17,687 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2023-05-25T08:36:17,691 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2023-05-25T08:36:17,695 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2023-05-25T08:36:17,699 copying colossalai/nn/optimizer/colossalai_optimizer.py -> build/lib/colossalai/nn/optimizer 2023-05-25T08:36:17,704 creating build/lib/colossalai/nn/layer 2023-05-25T08:36:17,706 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2023-05-25T08:36:17,710 copying colossalai/nn/layer/base_layer.py -> build/lib/colossalai/nn/layer 2023-05-25T08:36:17,715 creating build/lib/colossalai/nn/lr_scheduler 2023-05-25T08:36:17,717 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2023-05-25T08:36:17,721 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2023-05-25T08:36:17,725 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2023-05-25T08:36:17,728 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2023-05-25T08:36:17,733 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2023-05-25T08:36:17,736 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2023-05-25T08:36:17,741 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2023-05-25T08:36:17,745 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2023-05-25T08:36:17,751 creating build/lib/colossalai/nn/metric 2023-05-25T08:36:17,753 copying colossalai/nn/metric/_utils.py -> build/lib/colossalai/nn/metric 2023-05-25T08:36:17,757 copying colossalai/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/nn/metric 2023-05-25T08:36:17,760 copying colossalai/nn/metric/__init__.py -> build/lib/colossalai/nn/metric 2023-05-25T08:36:17,764 copying colossalai/nn/metric/accuracy_3d.py -> build/lib/colossalai/nn/metric 2023-05-25T08:36:17,768 copying colossalai/nn/metric/accuracy_2d.py -> build/lib/colossalai/nn/metric 2023-05-25T08:36:17,773 creating build/lib/colossalai/nn/parallel 2023-05-25T08:36:17,775 copying colossalai/nn/parallel/__init__.py -> build/lib/colossalai/nn/parallel 2023-05-25T08:36:17,779 copying colossalai/nn/parallel/data_parallel.py -> build/lib/colossalai/nn/parallel 2023-05-25T08:36:17,783 copying colossalai/nn/parallel/reducer.py -> build/lib/colossalai/nn/parallel 2023-05-25T08:36:17,788 creating build/lib/colossalai/nn/layer/parallel_2p5d 2023-05-25T08:36:17,790 copying colossalai/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2p5d 2023-05-25T08:36:17,794 copying colossalai/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/nn/layer/parallel_2p5d 2023-05-25T08:36:17,801 copying colossalai/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2p5d 2023-05-25T08:36:17,805 copying colossalai/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2p5d 2023-05-25T08:36:17,814 creating build/lib/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:17,816 copying colossalai/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:17,819 copying colossalai/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:17,823 copying colossalai/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:17,827 copying colossalai/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:17,831 copying colossalai/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:17,835 copying colossalai/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:17,840 creating build/lib/colossalai/nn/layer/parallel_sequence 2023-05-25T08:36:17,842 copying colossalai/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/nn/layer/parallel_sequence 2023-05-25T08:36:17,846 copying colossalai/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/nn/layer/parallel_sequence 2023-05-25T08:36:17,851 copying colossalai/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/nn/layer/parallel_sequence 2023-05-25T08:36:17,854 copying colossalai/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/nn/layer/parallel_sequence 2023-05-25T08:36:17,860 creating build/lib/colossalai/nn/layer/utils 2023-05-25T08:36:17,861 copying colossalai/nn/layer/utils/common.py -> build/lib/colossalai/nn/layer/utils 2023-05-25T08:36:17,865 copying colossalai/nn/layer/utils/__init__.py -> build/lib/colossalai/nn/layer/utils 2023-05-25T08:36:17,870 creating build/lib/colossalai/nn/layer/parallel_3d 2023-05-25T08:36:17,872 copying colossalai/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/nn/layer/parallel_3d 2023-05-25T08:36:17,876 copying colossalai/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/nn/layer/parallel_3d 2023-05-25T08:36:17,883 copying colossalai/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/nn/layer/parallel_3d 2023-05-25T08:36:17,887 copying colossalai/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/nn/layer/parallel_3d 2023-05-25T08:36:17,894 creating build/lib/colossalai/nn/layer/moe 2023-05-25T08:36:17,896 copying colossalai/nn/layer/moe/layers.py -> build/lib/colossalai/nn/layer/moe 2023-05-25T08:36:17,901 copying colossalai/nn/layer/moe/__init__.py -> build/lib/colossalai/nn/layer/moe 2023-05-25T08:36:17,905 copying colossalai/nn/layer/moe/experts.py -> build/lib/colossalai/nn/layer/moe 2023-05-25T08:36:17,909 copying colossalai/nn/layer/moe/utils.py -> build/lib/colossalai/nn/layer/moe 2023-05-25T08:36:17,913 copying colossalai/nn/layer/moe/routers.py -> build/lib/colossalai/nn/layer/moe 2023-05-25T08:36:17,918 copying colossalai/nn/layer/moe/_operation.py -> build/lib/colossalai/nn/layer/moe 2023-05-25T08:36:17,922 copying colossalai/nn/layer/moe/checkpoint.py -> build/lib/colossalai/nn/layer/moe 2023-05-25T08:36:17,927 creating build/lib/colossalai/nn/layer/parallel_2d 2023-05-25T08:36:17,929 copying colossalai/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2d 2023-05-25T08:36:17,933 copying colossalai/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/nn/layer/parallel_2d 2023-05-25T08:36:17,941 copying colossalai/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2d 2023-05-25T08:36:17,945 copying colossalai/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2d 2023-05-25T08:36:17,953 creating build/lib/colossalai/nn/layer/parallel_1d 2023-05-25T08:36:17,955 copying colossalai/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/nn/layer/parallel_1d 2023-05-25T08:36:17,960 copying colossalai/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/nn/layer/parallel_1d 2023-05-25T08:36:17,966 copying colossalai/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/nn/layer/parallel_1d 2023-05-25T08:36:17,970 copying colossalai/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/nn/layer/parallel_1d 2023-05-25T08:36:17,975 creating build/lib/colossalai/nn/layer/wrapper 2023-05-25T08:36:17,976 copying colossalai/nn/layer/wrapper/__init__.py -> build/lib/colossalai/nn/layer/wrapper 2023-05-25T08:36:17,980 copying colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/nn/layer/wrapper 2023-05-25T08:36:17,985 creating build/lib/colossalai/nn/layer/vanilla 2023-05-25T08:36:17,987 copying colossalai/nn/layer/vanilla/layers.py -> build/lib/colossalai/nn/layer/vanilla 2023-05-25T08:36:17,992 copying colossalai/nn/layer/vanilla/__init__.py -> build/lib/colossalai/nn/layer/vanilla 2023-05-25T08:36:17,997 creating build/lib/colossalai/nn/parallel/layers 2023-05-25T08:36:17,999 copying colossalai/nn/parallel/layers/__init__.py -> build/lib/colossalai/nn/parallel/layers 2023-05-25T08:36:18,003 copying colossalai/nn/parallel/layers/module_utils.py -> build/lib/colossalai/nn/parallel/layers 2023-05-25T08:36:18,007 copying colossalai/nn/parallel/layers/colo_module.py -> build/lib/colossalai/nn/parallel/layers 2023-05-25T08:36:18,011 copying colossalai/nn/parallel/layers/embedding.py -> build/lib/colossalai/nn/parallel/layers 2023-05-25T08:36:18,014 copying colossalai/nn/parallel/layers/linear.py -> build/lib/colossalai/nn/parallel/layers 2023-05-25T08:36:18,022 creating build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:18,023 copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:18,028 copying colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:18,033 copying colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:18,039 copying colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:18,042 copying colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:18,046 copying colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:18,050 copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:18,055 copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:18,059 copying colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:18,064 creating build/lib/colossalai/kernel/cuda_native 2023-05-25T08:36:18,066 copying colossalai/kernel/cuda_native/flash_attention.py -> build/lib/colossalai/kernel/cuda_native 2023-05-25T08:36:18,072 copying colossalai/kernel/cuda_native/__init__.py -> build/lib/colossalai/kernel/cuda_native 2023-05-25T08:36:18,075 copying colossalai/kernel/cuda_native/multihead_attention.py -> build/lib/colossalai/kernel/cuda_native 2023-05-25T08:36:18,080 copying colossalai/kernel/cuda_native/scaled_softmax.py -> build/lib/colossalai/kernel/cuda_native 2023-05-25T08:36:18,086 copying colossalai/kernel/cuda_native/layer_norm.py -> build/lib/colossalai/kernel/cuda_native 2023-05-25T08:36:18,091 creating build/lib/colossalai/kernel/jit 2023-05-25T08:36:18,092 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2023-05-25T08:36:18,096 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2023-05-25T08:36:18,099 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2023-05-25T08:36:18,104 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2023-05-25T08:36:18,109 creating build/lib/colossalai/kernel/op_builder 2023-05-25T08:36:18,111 copying colossalai/kernel/op_builder/__init__.py -> build/lib/colossalai/kernel/op_builder 2023-05-25T08:36:18,115 copying colossalai/kernel/op_builder/utils.py -> build/lib/colossalai/kernel/op_builder 2023-05-25T08:36:18,120 copying colossalai/kernel/op_builder/builder.py -> build/lib/colossalai/kernel/op_builder 2023-05-25T08:36:18,124 copying colossalai/kernel/op_builder/layernorm.py -> build/lib/colossalai/kernel/op_builder 2023-05-25T08:36:18,128 copying colossalai/kernel/op_builder/cpu_adam.py -> build/lib/colossalai/kernel/op_builder 2023-05-25T08:36:18,132 copying colossalai/kernel/op_builder/multi_head_attn.py -> build/lib/colossalai/kernel/op_builder 2023-05-25T08:36:18,135 copying colossalai/kernel/op_builder/moe.py -> build/lib/colossalai/kernel/op_builder 2023-05-25T08:36:18,139 copying colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/lib/colossalai/kernel/op_builder 2023-05-25T08:36:18,142 copying colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/colossalai/kernel/op_builder 2023-05-25T08:36:18,146 copying colossalai/kernel/op_builder/fused_optim.py -> build/lib/colossalai/kernel/op_builder 2023-05-25T08:36:18,152 creating build/lib/colossalai/pipeline/rpc 2023-05-25T08:36:18,154 copying colossalai/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/pipeline/rpc 2023-05-25T08:36:18,162 copying colossalai/pipeline/rpc/__init__.py -> build/lib/colossalai/pipeline/rpc 2023-05-25T08:36:18,165 copying colossalai/pipeline/rpc/utils.py -> build/lib/colossalai/pipeline/rpc 2023-05-25T08:36:18,169 copying colossalai/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/pipeline/rpc 2023-05-25T08:36:18,176 creating build/lib/colossalai/pipeline/middleware 2023-05-25T08:36:18,177 copying colossalai/pipeline/middleware/__init__.py -> build/lib/colossalai/pipeline/middleware 2023-05-25T08:36:18,182 copying colossalai/pipeline/middleware/topo.py -> build/lib/colossalai/pipeline/middleware 2023-05-25T08:36:18,188 creating build/lib/colossalai/pipeline/middleware/adaptor 2023-05-25T08:36:18,190 copying colossalai/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/pipeline/middleware/adaptor 2023-05-25T08:36:18,194 copying colossalai/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/pipeline/middleware/adaptor 2023-05-25T08:36:18,200 creating build/lib/colossalai/fx/codegen 2023-05-25T08:36:18,201 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2023-05-25T08:36:18,205 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2023-05-25T08:36:18,213 creating build/lib/colossalai/fx/passes 2023-05-25T08:36:18,215 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2023-05-25T08:36:18,220 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2023-05-25T08:36:18,224 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2023-05-25T08:36:18,228 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2023-05-25T08:36:18,233 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2023-05-25T08:36:18,237 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2023-05-25T08:36:18,242 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2023-05-25T08:36:18,246 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2023-05-25T08:36:18,253 creating build/lib/colossalai/fx/profiler 2023-05-25T08:36:18,254 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2023-05-25T08:36:18,258 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2023-05-25T08:36:18,262 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2023-05-25T08:36:18,265 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2023-05-25T08:36:18,270 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2023-05-25T08:36:18,274 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2023-05-25T08:36:18,278 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2023-05-25T08:36:18,282 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2023-05-25T08:36:18,289 creating build/lib/colossalai/fx/tracer 2023-05-25T08:36:18,291 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2023-05-25T08:36:18,295 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2023-05-25T08:36:18,299 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2023-05-25T08:36:18,303 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2023-05-25T08:36:18,309 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2023-05-25T08:36:18,313 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2023-05-25T08:36:18,319 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2023-05-25T08:36:18,324 creating build/lib/colossalai/fx/profiler/experimental 2023-05-25T08:36:18,325 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2023-05-25T08:36:18,329 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2023-05-25T08:36:18,333 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2023-05-25T08:36:18,337 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2023-05-25T08:36:18,342 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2023-05-25T08:36:18,347 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:18,349 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:18,353 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:18,358 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:18,361 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:18,365 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:18,368 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:18,372 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:18,375 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:18,379 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:18,385 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:18,386 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:18,390 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:18,394 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:18,398 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:18,402 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:18,406 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:18,409 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:18,413 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:18,416 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:18,419 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:18,424 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:18,429 creating build/lib/colossalai/fx/tracer/meta_patch 2023-05-25T08:36:18,431 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2023-05-25T08:36:18,436 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2023-05-25T08:36:18,437 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2023-05-25T08:36:18,443 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:18,445 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:18,450 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:18,454 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:18,457 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:18,461 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:18,465 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:18,469 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:18,473 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:18,478 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:18,480 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:18,485 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:18,489 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:18,494 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:18,498 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:18,502 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:18,505 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:18,509 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:18,514 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-05-25T08:36:18,517 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-05-25T08:36:18,521 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-05-25T08:36:18,525 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-05-25T08:36:18,528 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-05-25T08:36:18,532 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-05-25T08:36:18,537 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-05-25T08:36:18,539 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-05-25T08:36:18,543 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-05-25T08:36:18,547 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-05-25T08:36:18,551 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-05-25T08:36:18,556 creating build/lib/colossalai/_analyzer/fx 2023-05-25T08:36:18,559 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2023-05-25T08:36:18,563 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2023-05-25T08:36:18,567 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2023-05-25T08:36:18,571 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2023-05-25T08:36:18,574 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2023-05-25T08:36:18,581 creating build/lib/colossalai/_analyzer/_subclasses 2023-05-25T08:36:18,582 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2023-05-25T08:36:18,586 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2023-05-25T08:36:18,590 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2023-05-25T08:36:18,595 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2023-05-25T08:36:18,599 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2023-05-25T08:36:18,605 creating build/lib/colossalai/_analyzer/fx/passes 2023-05-25T08:36:18,606 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2023-05-25T08:36:18,610 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2023-05-25T08:36:18,614 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2023-05-25T08:36:18,620 creating build/lib/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:18,622 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:18,627 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:18,631 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:18,634 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:18,638 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:18,642 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:18,672 creating build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,674 copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,679 copying colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,683 copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,689 copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,694 copying colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,699 copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,705 copying colossalai/kernel/cuda_native/csrc/type_shim.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,710 copying colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,717 copying colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,722 copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,727 copying colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,732 copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,737 copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,741 copying colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,747 copying colossalai/kernel/cuda_native/csrc/compat.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,752 copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,756 copying colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,762 copying colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,767 copying colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,771 copying colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,776 copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,781 copying colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,786 copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:18,792 creating build/lib/colossalai/kernel/cuda_native/csrc/kernels 2023-05-25T08:36:18,792 creating build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:18,795 copying colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:18,799 copying colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:18,804 copying colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:18,808 copying colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:18,812 copying colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:18,816 copying colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:18,821 copying colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:18,825 copying colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:18,830 copying colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:18,834 copying colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:18,838 copying colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:18,842 copying colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:19,092 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-05-25T08:36:19,092 !! 2023-05-25T08:36:19,093 ******************************************************************************** 2023-05-25T08:36:19,094 Please avoid running ``setup.py`` directly. 2023-05-25T08:36:19,094 Instead, use pypa/build, pypa/installer, pypa/build or 2023-05-25T08:36:19,094 other standards-based tools. 2023-05-25T08:36:19,095 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-05-25T08:36:19,095 ******************************************************************************** 2023-05-25T08:36:19,096 !! 2023-05-25T08:36:19,096 self.initialize_options() 2023-05-25T08:36:19,160 installing to build/bdist.linux-armv7l/wheel 2023-05-25T08:36:19,161 running install 2023-05-25T08:36:19,219 running install_lib 2023-05-25T08:36:19,290 creating build/bdist.linux-armv7l 2023-05-25T08:36:19,291 creating build/bdist.linux-armv7l/wheel 2023-05-25T08:36:19,296 creating build/bdist.linux-armv7l/wheel/colossalai 2023-05-25T08:36:19,299 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2023-05-25T08:36:19,302 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2023-05-25T08:36:19,306 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2023-05-25T08:36:19,312 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2023-05-25T08:36:19,314 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-05-25T08:36:19,318 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-05-25T08:36:19,322 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-05-25T08:36:19,325 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-05-25T08:36:19,330 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2023-05-25T08:36:19,335 creating build/bdist.linux-armv7l/wheel/colossalai/engine 2023-05-25T08:36:19,337 copying build/lib/colossalai/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine 2023-05-25T08:36:19,342 creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation 2023-05-25T08:36:19,344 copying build/lib/colossalai/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation 2023-05-25T08:36:19,348 copying build/lib/colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation 2023-05-25T08:36:19,354 creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-05-25T08:36:19,356 copying build/lib/colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-05-25T08:36:19,360 copying build/lib/colossalai/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-05-25T08:36:19,364 copying build/lib/colossalai/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-05-25T08:36:19,368 copying build/lib/colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-05-25T08:36:19,373 copying build/lib/colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-05-25T08:36:19,377 copying build/lib/colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-05-25T08:36:19,381 copying build/lib/colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-05-25T08:36:19,384 copying build/lib/colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler 2023-05-25T08:36:19,388 copying build/lib/colossalai/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/engine 2023-05-25T08:36:19,393 creating build/bdist.linux-armv7l/wheel/colossalai/engine/schedule 2023-05-25T08:36:19,395 copying build/lib/colossalai/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule 2023-05-25T08:36:19,399 copying build/lib/colossalai/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule 2023-05-25T08:36:19,403 copying build/lib/colossalai/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule 2023-05-25T08:36:19,407 copying build/lib/colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule 2023-05-25T08:36:19,411 copying build/lib/colossalai/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule 2023-05-25T08:36:19,418 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-05-25T08:36:19,423 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-05-25T08:36:19,426 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-05-25T08:36:19,431 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2023-05-25T08:36:19,434 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-05-25T08:36:19,437 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:19,439 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:19,444 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:19,447 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:19,451 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:19,455 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:19,458 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:19,462 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:19,466 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:19,470 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:19,475 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:19,480 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2023-05-25T08:36:19,484 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-05-25T08:36:19,487 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-05-25T08:36:19,492 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-05-25T08:36:19,495 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2023-05-25T08:36:19,500 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-05-25T08:36:19,502 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-05-25T08:36:19,507 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-05-25T08:36:19,510 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-05-25T08:36:19,515 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-05-25T08:36:19,519 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-05-25T08:36:19,523 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2023-05-25T08:36:19,527 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2023-05-25T08:36:19,531 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-05-25T08:36:19,534 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-05-25T08:36:19,536 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-05-25T08:36:19,540 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-05-25T08:36:19,545 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-05-25T08:36:19,548 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-05-25T08:36:19,553 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2023-05-25T08:36:19,558 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-05-25T08:36:19,563 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-05-25T08:36:19,567 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:19,568 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:19,573 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:19,576 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:19,580 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:19,585 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:19,589 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2023-05-25T08:36:19,593 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-05-25T08:36:19,596 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-05-25T08:36:19,600 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2023-05-25T08:36:19,606 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,608 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,612 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,616 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,620 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,624 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,628 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,631 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,635 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,638 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,642 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,646 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,649 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,653 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,657 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,661 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,666 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,672 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,677 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,682 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,686 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,690 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,695 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,703 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,705 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,710 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,714 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,719 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,725 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,731 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,735 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,739 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,743 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,747 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,752 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,756 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,761 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,766 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,769 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,775 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,779 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,784 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,788 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2023-05-25T08:36:19,793 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,798 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,803 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,808 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,812 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2023-05-25T08:36:19,819 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2023-05-25T08:36:19,821 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2023-05-25T08:36:19,826 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:19,828 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:19,833 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:19,840 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:19,846 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:19,852 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:19,858 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2023-05-25T08:36:19,864 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-05-25T08:36:19,867 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-05-25T08:36:19,873 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-05-25T08:36:19,877 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-05-25T08:36:19,882 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-05-25T08:36:19,887 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-05-25T08:36:19,892 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-05-25T08:36:19,896 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-05-25T08:36:19,901 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-05-25T08:36:19,906 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-05-25T08:36:19,912 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2023-05-25T08:36:19,917 copying build/lib/colossalai/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-05-25T08:36:19,922 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:19,925 copying build/lib/colossalai/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:19,929 copying build/lib/colossalai/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:19,933 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:19,940 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:19,945 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:19,949 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:19,954 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:19,960 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-05-25T08:36:19,962 copying build/lib/colossalai/tensor/d_tensor/d_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-05-25T08:36:19,967 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-05-25T08:36:19,970 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-05-25T08:36:19,973 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-05-25T08:36:19,977 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-05-25T08:36:19,982 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-05-25T08:36:19,987 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-05-25T08:36:19,993 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2023-05-25T08:36:19,998 copying build/lib/colossalai/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:20,003 copying build/lib/colossalai/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:20,008 copying build/lib/colossalai/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:20,012 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:20,018 copying build/lib/colossalai/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:20,022 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:20,027 copying build/lib/colossalai/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:20,032 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2023-05-25T08:36:20,038 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2023-05-25T08:36:20,040 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2023-05-25T08:36:20,045 copying build/lib/colossalai/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2023-05-25T08:36:20,050 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-05-25T08:36:20,052 copying build/lib/colossalai/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-05-25T08:36:20,056 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-05-25T08:36:20,061 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-05-25T08:36:20,063 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-05-25T08:36:20,067 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-05-25T08:36:20,070 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-05-25T08:36:20,074 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2023-05-25T08:36:20,078 copying build/lib/colossalai/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-05-25T08:36:20,082 copying build/lib/colossalai/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2023-05-25T08:36:20,088 creating build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp 2023-05-25T08:36:20,090 copying build/lib/colossalai/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp 2023-05-25T08:36:20,094 copying build/lib/colossalai/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp 2023-05-25T08:36:20,099 copying build/lib/colossalai/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp 2023-05-25T08:36:20,104 creating build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp 2023-05-25T08:36:20,106 copying build/lib/colossalai/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp 2023-05-25T08:36:20,110 copying build/lib/colossalai/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp 2023-05-25T08:36:20,114 creating build/bdist.linux-armv7l/wheel/colossalai/trainer 2023-05-25T08:36:20,116 copying build/lib/colossalai/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer 2023-05-25T08:36:20,121 copying build/lib/colossalai/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer 2023-05-25T08:36:20,126 creating build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-05-25T08:36:20,128 copying build/lib/colossalai/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-05-25T08:36:20,133 copying build/lib/colossalai/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-05-25T08:36:20,137 copying build/lib/colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-05-25T08:36:20,141 copying build/lib/colossalai/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-05-25T08:36:20,146 copying build/lib/colossalai/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-05-25T08:36:20,150 copying build/lib/colossalai/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-05-25T08:36:20,154 copying build/lib/colossalai/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks 2023-05-25T08:36:20,161 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2023-05-25T08:36:20,164 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-05-25T08:36:20,169 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2023-05-25T08:36:20,172 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2023-05-25T08:36:20,176 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2023-05-25T08:36:20,180 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-05-25T08:36:20,186 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-05-25T08:36:20,191 copying build/lib/colossalai/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-05-25T08:36:20,196 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-05-25T08:36:20,201 creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler 2023-05-25T08:36:20,202 copying build/lib/colossalai/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler 2023-05-25T08:36:20,207 copying build/lib/colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler 2023-05-25T08:36:20,210 copying build/lib/colossalai/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler 2023-05-25T08:36:20,214 copying build/lib/colossalai/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler 2023-05-25T08:36:20,219 creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy 2023-05-25T08:36:20,221 copying build/lib/colossalai/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy 2023-05-25T08:36:20,225 copying build/lib/colossalai/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy 2023-05-25T08:36:20,229 copying build/lib/colossalai/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy 2023-05-25T08:36:20,233 copying build/lib/colossalai/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy 2023-05-25T08:36:20,238 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2023-05-25T08:36:20,239 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2023-05-25T08:36:20,243 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2023-05-25T08:36:20,246 copying build/lib/colossalai/utils/model/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2023-05-25T08:36:20,251 copying build/lib/colossalai/utils/model/lazy_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2023-05-25T08:36:20,257 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2023-05-25T08:36:20,258 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2023-05-25T08:36:20,262 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2023-05-25T08:36:20,268 creating build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler 2023-05-25T08:36:20,269 copying build/lib/colossalai/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler 2023-05-25T08:36:20,273 copying build/lib/colossalai/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler 2023-05-25T08:36:20,277 copying build/lib/colossalai/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler 2023-05-25T08:36:20,282 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2023-05-25T08:36:20,283 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2023-05-25T08:36:20,287 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2023-05-25T08:36:20,292 copying build/lib/colossalai/utils/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-05-25T08:36:20,295 copying build/lib/colossalai/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-05-25T08:36:20,301 creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint 2023-05-25T08:36:20,302 copying build/lib/colossalai/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint 2023-05-25T08:36:20,306 copying build/lib/colossalai/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint 2023-05-25T08:36:20,310 copying build/lib/colossalai/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint 2023-05-25T08:36:20,315 creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-05-25T08:36:20,317 copying build/lib/colossalai/utils/checkpoint_io/distributed.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-05-25T08:36:20,321 copying build/lib/colossalai/utils/checkpoint_io/reader.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-05-25T08:36:20,326 copying build/lib/colossalai/utils/checkpoint_io/io.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-05-25T08:36:20,331 copying build/lib/colossalai/utils/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-05-25T08:36:20,334 copying build/lib/colossalai/utils/checkpoint_io/backend.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-05-25T08:36:20,338 copying build/lib/colossalai/utils/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-05-25T08:36:20,342 copying build/lib/colossalai/utils/checkpoint_io/convertor.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-05-25T08:36:20,346 copying build/lib/colossalai/utils/checkpoint_io/meta.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-05-25T08:36:20,350 copying build/lib/colossalai/utils/checkpoint_io/writer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-05-25T08:36:20,353 copying build/lib/colossalai/utils/checkpoint_io/constant.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io 2023-05-25T08:36:20,357 copying build/lib/colossalai/utils/cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2023-05-25T08:36:20,360 copying build/lib/colossalai/constants.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-05-25T08:36:20,365 creating build/bdist.linux-armv7l/wheel/colossalai/context 2023-05-25T08:36:20,367 creating build/bdist.linux-armv7l/wheel/colossalai/context/random 2023-05-25T08:36:20,369 copying build/lib/colossalai/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random 2023-05-25T08:36:20,373 copying build/lib/colossalai/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random 2023-05-25T08:36:20,378 copying build/lib/colossalai/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random 2023-05-25T08:36:20,381 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-05-25T08:36:20,385 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-05-25T08:36:20,388 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-05-25T08:36:20,392 copying build/lib/colossalai/context/moe_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-05-25T08:36:20,396 copying build/lib/colossalai/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-05-25T08:36:20,399 copying build/lib/colossalai/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2023-05-25T08:36:20,406 creating build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-05-25T08:36:20,408 copying build/lib/colossalai/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-05-25T08:36:20,412 copying build/lib/colossalai/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-05-25T08:36:20,416 copying build/lib/colossalai/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-05-25T08:36:20,420 copying build/lib/colossalai/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-05-25T08:36:20,423 copying build/lib/colossalai/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-05-25T08:36:20,427 copying build/lib/colossalai/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-05-25T08:36:20,430 copying build/lib/colossalai/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-05-25T08:36:20,435 copying build/lib/colossalai/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-05-25T08:36:20,438 copying build/lib/colossalai/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-05-25T08:36:20,442 copying build/lib/colossalai/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-05-25T08:36:20,447 copying build/lib/colossalai/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer 2023-05-25T08:36:20,452 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-05-25T08:36:20,453 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-05-25T08:36:20,457 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-05-25T08:36:20,461 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-05-25T08:36:20,464 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2023-05-25T08:36:20,469 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2023-05-25T08:36:20,472 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-05-25T08:36:20,474 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-05-25T08:36:20,478 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-05-25T08:36:20,482 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-05-25T08:36:20,486 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-05-25T08:36:20,490 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-05-25T08:36:20,494 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-05-25T08:36:20,498 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2023-05-25T08:36:20,503 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2023-05-25T08:36:20,507 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2023-05-25T08:36:20,510 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2023-05-25T08:36:20,515 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-05-25T08:36:20,516 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-05-25T08:36:20,520 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-05-25T08:36:20,525 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-05-25T08:36:20,528 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-05-25T08:36:20,531 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-05-25T08:36:20,535 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-05-25T08:36:20,538 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2023-05-25T08:36:20,543 creating build/bdist.linux-armv7l/wheel/colossalai/communication 2023-05-25T08:36:20,544 copying build/lib/colossalai/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/communication 2023-05-25T08:36:20,548 copying build/lib/colossalai/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/communication 2023-05-25T08:36:20,552 copying build/lib/colossalai/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/communication 2023-05-25T08:36:20,557 copying build/lib/colossalai/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/communication 2023-05-25T08:36:20,562 copying build/lib/colossalai/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/communication 2023-05-25T08:36:20,566 copying build/lib/colossalai/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/communication 2023-05-25T08:36:20,570 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2023-05-25T08:36:20,572 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2023-05-25T08:36:20,577 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2023-05-25T08:36:20,579 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2023-05-25T08:36:20,583 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2023-05-25T08:36:20,588 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2023-05-25T08:36:20,592 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-05-25T08:36:20,594 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-05-25T08:36:20,598 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-05-25T08:36:20,602 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-05-25T08:36:20,606 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2023-05-25T08:36:20,611 creating build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark 2023-05-25T08:36:20,612 copying build/lib/colossalai/cli/benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark 2023-05-25T08:36:20,616 copying build/lib/colossalai/cli/benchmark/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark 2023-05-25T08:36:20,621 copying build/lib/colossalai/cli/benchmark/benchmark.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark 2023-05-25T08:36:20,625 copying build/lib/colossalai/cli/benchmark/models.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark 2023-05-25T08:36:20,629 creating build/bdist.linux-armv7l/wheel/colossalai/device 2023-05-25T08:36:20,631 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2023-05-25T08:36:20,635 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2023-05-25T08:36:20,639 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2023-05-25T08:36:20,644 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2023-05-25T08:36:20,649 creating build/bdist.linux-armv7l/wheel/colossalai/registry 2023-05-25T08:36:20,651 copying build/lib/colossalai/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/registry 2023-05-25T08:36:20,655 copying build/lib/colossalai/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/registry 2023-05-25T08:36:20,660 creating build/bdist.linux-armv7l/wheel/colossalai/builder 2023-05-25T08:36:20,661 copying build/lib/colossalai/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/builder 2023-05-25T08:36:20,665 copying build/lib/colossalai/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/builder 2023-05-25T08:36:20,670 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2023-05-25T08:36:20,672 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2023-05-25T08:36:20,677 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-05-25T08:36:20,680 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-05-25T08:36:20,681 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-05-25T08:36:20,687 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-05-25T08:36:20,690 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-05-25T08:36:20,694 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-05-25T08:36:20,698 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2023-05-25T08:36:20,703 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-05-25T08:36:20,707 copying build/lib/colossalai/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-05-25T08:36:20,711 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-05-25T08:36:20,717 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-05-25T08:36:20,721 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-05-25T08:36:20,725 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-05-25T08:36:20,731 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:20,733 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:20,737 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:20,741 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:20,745 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:20,750 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:20,755 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:20,759 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:20,764 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:20,768 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2023-05-25T08:36:20,771 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-05-25T08:36:20,776 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2023-05-25T08:36:20,781 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2023-05-25T08:36:20,783 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2023-05-25T08:36:20,787 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2023-05-25T08:36:20,791 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2023-05-25T08:36:20,798 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:20,799 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:20,803 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:20,807 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:20,811 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:20,815 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:20,818 copying build/lib/colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2023-05-25T08:36:20,822 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2023-05-25T08:36:20,827 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy 2023-05-25T08:36:20,830 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_param 2023-05-25T08:36:20,832 copying build/lib/colossalai/zero/legacy/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_param 2023-05-25T08:36:20,836 copying build/lib/colossalai/zero/legacy/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_param 2023-05-25T08:36:20,840 copying build/lib/colossalai/zero/legacy/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_param 2023-05-25T08:36:20,845 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/init_ctx 2023-05-25T08:36:20,846 copying build/lib/colossalai/zero/legacy/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/init_ctx 2023-05-25T08:36:20,850 copying build/lib/colossalai/zero/legacy/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/init_ctx 2023-05-25T08:36:20,855 copying build/lib/colossalai/zero/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy 2023-05-25T08:36:20,859 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-05-25T08:36:20,861 copying build/lib/colossalai/zero/legacy/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-05-25T08:36:20,865 copying build/lib/colossalai/zero/legacy/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-05-25T08:36:20,869 copying build/lib/colossalai/zero/legacy/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-05-25T08:36:20,873 copying build/lib/colossalai/zero/legacy/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-05-25T08:36:20,877 copying build/lib/colossalai/zero/legacy/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-05-25T08:36:20,882 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/paramhooks 2023-05-25T08:36:20,884 copying build/lib/colossalai/zero/legacy/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/paramhooks 2023-05-25T08:36:20,888 copying build/lib/colossalai/zero/legacy/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/paramhooks 2023-05-25T08:36:20,892 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/ophooks 2023-05-25T08:36:20,894 copying build/lib/colossalai/zero/legacy/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/ophooks 2023-05-25T08:36:20,898 copying build/lib/colossalai/zero/legacy/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/ophooks 2023-05-25T08:36:20,901 copying build/lib/colossalai/zero/legacy/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/ophooks 2023-05-25T08:36:20,905 copying build/lib/colossalai/zero/legacy/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/ophooks 2023-05-25T08:36:20,910 copying build/lib/colossalai/zero/legacy/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini/ophooks 2023-05-25T08:36:20,914 copying build/lib/colossalai/zero/legacy/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/gemini 2023-05-25T08:36:20,919 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_optim 2023-05-25T08:36:20,920 copying build/lib/colossalai/zero/legacy/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_optim 2023-05-25T08:36:20,924 copying build/lib/colossalai/zero/legacy/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_optim 2023-05-25T08:36:20,931 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:20,932 copying build/lib/colossalai/zero/legacy/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:20,936 copying build/lib/colossalai/zero/legacy/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:20,940 copying build/lib/colossalai/zero/legacy/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:20,943 copying build/lib/colossalai/zero/legacy/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:20,949 copying build/lib/colossalai/zero/legacy/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:20,953 copying build/lib/colossalai/zero/legacy/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/sharded_model 2023-05-25T08:36:20,959 creating build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/shard_utils 2023-05-25T08:36:20,961 copying build/lib/colossalai/zero/legacy/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/shard_utils 2023-05-25T08:36:20,966 copying build/lib/colossalai/zero/legacy/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/shard_utils 2023-05-25T08:36:20,970 copying build/lib/colossalai/zero/legacy/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/shard_utils 2023-05-25T08:36:20,975 copying build/lib/colossalai/zero/legacy/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/shard_utils 2023-05-25T08:36:20,979 copying build/lib/colossalai/zero/legacy/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/legacy/shard_utils 2023-05-25T08:36:20,984 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2023-05-25T08:36:20,987 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2023-05-25T08:36:20,994 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2023-05-25T08:36:21,000 creating build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-05-25T08:36:21,002 copying build/lib/colossalai/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-05-25T08:36:21,007 copying build/lib/colossalai/nn/_ops/view.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-05-25T08:36:21,011 copying build/lib/colossalai/nn/_ops/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-05-25T08:36:21,014 copying build/lib/colossalai/nn/_ops/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-05-25T08:36:21,018 copying build/lib/colossalai/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-05-25T08:36:21,022 copying build/lib/colossalai/nn/_ops/embedding_bag.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-05-25T08:36:21,026 copying build/lib/colossalai/nn/_ops/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-05-25T08:36:21,029 copying build/lib/colossalai/nn/_ops/element_wise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-05-25T08:36:21,034 copying build/lib/colossalai/nn/_ops/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-05-25T08:36:21,041 copying build/lib/colossalai/nn/_ops/batch_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-05-25T08:36:21,044 copying build/lib/colossalai/nn/_ops/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops 2023-05-25T08:36:21,050 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-05-25T08:36:21,052 copying build/lib/colossalai/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-05-25T08:36:21,056 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-05-25T08:36:21,059 copying build/lib/colossalai/nn/loss/loss_moe.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-05-25T08:36:21,063 copying build/lib/colossalai/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-05-25T08:36:21,067 copying build/lib/colossalai/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-05-25T08:36:21,072 copying build/lib/colossalai/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2023-05-25T08:36:21,077 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-05-25T08:36:21,078 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-05-25T08:36:21,083 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-05-25T08:36:21,087 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-05-25T08:36:21,091 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-05-25T08:36:21,096 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-05-25T08:36:21,100 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-05-25T08:36:21,104 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-05-25T08:36:21,108 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-05-25T08:36:21,112 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-05-25T08:36:21,116 copying build/lib/colossalai/nn/optimizer/colossalai_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2023-05-25T08:36:21,121 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2023-05-25T08:36:21,123 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d 2023-05-25T08:36:21,125 copying build/lib/colossalai/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d 2023-05-25T08:36:21,129 copying build/lib/colossalai/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d 2023-05-25T08:36:21,135 copying build/lib/colossalai/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d 2023-05-25T08:36:21,139 copying build/lib/colossalai/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d 2023-05-25T08:36:21,145 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2023-05-25T08:36:21,149 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:21,151 copying build/lib/colossalai/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:21,155 copying build/lib/colossalai/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:21,158 copying build/lib/colossalai/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:21,162 copying build/lib/colossalai/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:21,165 copying build/lib/colossalai/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:21,169 copying build/lib/colossalai/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer 2023-05-25T08:36:21,175 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence 2023-05-25T08:36:21,177 copying build/lib/colossalai/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence 2023-05-25T08:36:21,182 copying build/lib/colossalai/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence 2023-05-25T08:36:21,187 copying build/lib/colossalai/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence 2023-05-25T08:36:21,191 copying build/lib/colossalai/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence 2023-05-25T08:36:21,198 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils 2023-05-25T08:36:21,200 copying build/lib/colossalai/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils 2023-05-25T08:36:21,205 copying build/lib/colossalai/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils 2023-05-25T08:36:21,210 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d 2023-05-25T08:36:21,212 copying build/lib/colossalai/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d 2023-05-25T08:36:21,217 copying build/lib/colossalai/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d 2023-05-25T08:36:21,225 copying build/lib/colossalai/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d 2023-05-25T08:36:21,228 copying build/lib/colossalai/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d 2023-05-25T08:36:21,235 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-05-25T08:36:21,236 copying build/lib/colossalai/nn/layer/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-05-25T08:36:21,241 copying build/lib/colossalai/nn/layer/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-05-25T08:36:21,245 copying build/lib/colossalai/nn/layer/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-05-25T08:36:21,249 copying build/lib/colossalai/nn/layer/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-05-25T08:36:21,252 copying build/lib/colossalai/nn/layer/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-05-25T08:36:21,257 copying build/lib/colossalai/nn/layer/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-05-25T08:36:21,261 copying build/lib/colossalai/nn/layer/moe/checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe 2023-05-25T08:36:21,265 copying build/lib/colossalai/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2023-05-25T08:36:21,269 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d 2023-05-25T08:36:21,271 copying build/lib/colossalai/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d 2023-05-25T08:36:21,275 copying build/lib/colossalai/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d 2023-05-25T08:36:21,281 copying build/lib/colossalai/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d 2023-05-25T08:36:21,285 copying build/lib/colossalai/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d 2023-05-25T08:36:21,292 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d 2023-05-25T08:36:21,293 copying build/lib/colossalai/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d 2023-05-25T08:36:21,297 copying build/lib/colossalai/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d 2023-05-25T08:36:21,304 copying build/lib/colossalai/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d 2023-05-25T08:36:21,307 copying build/lib/colossalai/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d 2023-05-25T08:36:21,312 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper 2023-05-25T08:36:21,313 copying build/lib/colossalai/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper 2023-05-25T08:36:21,317 copying build/lib/colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper 2023-05-25T08:36:21,322 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla 2023-05-25T08:36:21,323 copying build/lib/colossalai/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla 2023-05-25T08:36:21,328 copying build/lib/colossalai/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla 2023-05-25T08:36:21,334 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-05-25T08:36:21,335 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-05-25T08:36:21,339 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-05-25T08:36:21,343 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-05-25T08:36:21,346 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-05-25T08:36:21,350 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-05-25T08:36:21,354 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-05-25T08:36:21,358 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-05-25T08:36:21,362 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2023-05-25T08:36:21,366 creating build/bdist.linux-armv7l/wheel/colossalai/nn/metric 2023-05-25T08:36:21,368 copying build/lib/colossalai/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric 2023-05-25T08:36:21,372 copying build/lib/colossalai/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric 2023-05-25T08:36:21,375 copying build/lib/colossalai/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric 2023-05-25T08:36:21,379 copying build/lib/colossalai/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric 2023-05-25T08:36:21,382 copying build/lib/colossalai/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric 2023-05-25T08:36:21,387 creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel 2023-05-25T08:36:21,390 creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers 2023-05-25T08:36:21,393 creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:21,395 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:21,400 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:21,404 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:21,410 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:21,413 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:21,417 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:21,420 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:21,425 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:21,429 copying build/lib/colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding 2023-05-25T08:36:21,433 copying build/lib/colossalai/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers 2023-05-25T08:36:21,436 copying build/lib/colossalai/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers 2023-05-25T08:36:21,440 copying build/lib/colossalai/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers 2023-05-25T08:36:21,444 copying build/lib/colossalai/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers 2023-05-25T08:36:21,447 copying build/lib/colossalai/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers 2023-05-25T08:36:21,451 copying build/lib/colossalai/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel 2023-05-25T08:36:21,455 copying build/lib/colossalai/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel 2023-05-25T08:36:21,459 copying build/lib/colossalai/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel 2023-05-25T08:36:21,464 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2023-05-25T08:36:21,465 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2023-05-25T08:36:21,470 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-05-25T08:36:21,472 copying build/lib/colossalai/kernel/cuda_native/flash_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-05-25T08:36:21,480 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,482 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,486 copying build/lib/colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,489 copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,495 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,498 copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,502 copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,507 copying build/lib/colossalai/kernel/cuda_native/csrc/type_shim.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,512 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,517 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,521 copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,526 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels 2023-05-25T08:36:21,529 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,531 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,536 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,540 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,543 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,547 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,550 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,554 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,557 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,561 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,566 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,569 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,573 copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include 2023-05-25T08:36:21,577 copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,582 copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,586 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,590 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,595 copying build/lib/colossalai/kernel/cuda_native/csrc/compat.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,598 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,602 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,606 copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,612 copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,616 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,620 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,625 copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,630 copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc 2023-05-25T08:36:21,635 copying build/lib/colossalai/kernel/cuda_native/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-05-25T08:36:21,638 copying build/lib/colossalai/kernel/cuda_native/multihead_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-05-25T08:36:21,643 copying build/lib/colossalai/kernel/cuda_native/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-05-25T08:36:21,647 copying build/lib/colossalai/kernel/cuda_native/layer_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native 2023-05-25T08:36:21,652 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-05-25T08:36:21,654 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-05-25T08:36:21,657 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-05-25T08:36:21,661 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-05-25T08:36:21,664 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2023-05-25T08:36:21,669 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-05-25T08:36:21,671 copying build/lib/colossalai/kernel/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-05-25T08:36:21,675 copying build/lib/colossalai/kernel/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-05-25T08:36:21,679 copying build/lib/colossalai/kernel/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-05-25T08:36:21,684 copying build/lib/colossalai/kernel/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-05-25T08:36:21,688 copying build/lib/colossalai/kernel/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-05-25T08:36:21,692 copying build/lib/colossalai/kernel/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-05-25T08:36:21,695 copying build/lib/colossalai/kernel/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-05-25T08:36:21,699 copying build/lib/colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-05-25T08:36:21,703 copying build/lib/colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-05-25T08:36:21,706 copying build/lib/colossalai/kernel/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder 2023-05-25T08:36:21,711 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-05-25T08:36:21,713 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-05-25T08:36:21,716 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-05-25T08:36:21,722 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-05-25T08:36:21,727 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-05-25T08:36:21,731 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2023-05-25T08:36:21,737 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-05-25T08:36:21,739 copying build/lib/colossalai/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-05-25T08:36:21,743 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-05-25T08:36:21,746 copying build/lib/colossalai/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-05-25T08:36:21,752 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc 2023-05-25T08:36:21,754 copying build/lib/colossalai/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc 2023-05-25T08:36:21,761 copying build/lib/colossalai/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc 2023-05-25T08:36:21,764 copying build/lib/colossalai/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc 2023-05-25T08:36:21,769 copying build/lib/colossalai/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc 2023-05-25T08:36:21,775 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware 2023-05-25T08:36:21,777 copying build/lib/colossalai/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware 2023-05-25T08:36:21,780 copying build/lib/colossalai/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware 2023-05-25T08:36:21,786 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor 2023-05-25T08:36:21,787 copying build/lib/colossalai/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor 2023-05-25T08:36:21,791 copying build/lib/colossalai/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor 2023-05-25T08:36:21,795 copying build/lib/colossalai/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-05-25T08:36:21,800 copying build/lib/colossalai/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2023-05-25T08:36:21,805 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2023-05-25T08:36:21,808 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2023-05-25T08:36:21,809 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2023-05-25T08:36:21,814 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2023-05-25T08:36:21,819 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-05-25T08:36:21,823 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-05-25T08:36:21,829 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-05-25T08:36:21,835 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-05-25T08:36:21,837 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-05-25T08:36:21,841 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-05-25T08:36:21,847 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-05-25T08:36:21,852 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-05-25T08:36:21,857 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-05-25T08:36:21,862 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-05-25T08:36:21,867 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-05-25T08:36:21,873 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2023-05-25T08:36:21,879 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-05-25T08:36:21,884 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-05-25T08:36:21,889 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-05-25T08:36:21,892 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-05-25T08:36:21,897 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-05-25T08:36:21,899 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-05-25T08:36:21,904 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-05-25T08:36:21,909 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:21,912 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:21,916 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:21,921 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:21,925 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:21,929 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:21,934 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:21,938 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:21,943 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:21,948 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2023-05-25T08:36:21,952 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-05-25T08:36:21,956 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-05-25T08:36:21,962 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:21,965 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:21,970 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:21,975 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:21,979 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:21,984 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:21,988 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:21,992 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:21,997 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:22,000 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:22,004 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:22,008 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2023-05-25T08:36:22,011 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2023-05-25T08:36:22,015 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-05-25T08:36:22,019 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-05-25T08:36:22,023 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-05-25T08:36:22,029 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-05-25T08:36:22,033 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-05-25T08:36:22,038 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-05-25T08:36:22,043 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2023-05-25T08:36:22,049 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-05-25T08:36:22,053 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2023-05-25T08:36:22,056 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:22,059 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:22,064 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:22,068 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:22,073 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:22,078 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:22,083 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:22,087 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:22,091 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2023-05-25T08:36:22,095 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2023-05-25T08:36:22,101 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:22,104 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:22,109 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:22,113 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:22,117 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:22,122 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:22,126 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:22,130 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:22,134 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2023-05-25T08:36:22,138 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-05-25T08:36:22,142 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-05-25T08:36:22,146 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-05-25T08:36:22,149 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-05-25T08:36:22,155 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-05-25T08:36:22,159 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-05-25T08:36:22,166 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2023-05-25T08:36:22,168 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2023-05-25T08:36:22,172 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-05-25T08:36:22,174 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-05-25T08:36:22,179 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-05-25T08:36:22,183 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-05-25T08:36:22,187 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-05-25T08:36:22,191 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2023-05-25T08:36:22,196 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-05-25T08:36:22,199 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-05-25T08:36:22,205 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-05-25T08:36:22,209 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-05-25T08:36:22,213 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2023-05-25T08:36:22,217 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2023-05-25T08:36:22,220 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2023-05-25T08:36:22,225 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2023-05-25T08:36:22,227 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C 2023-05-25T08:36:22,231 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2023-05-25T08:36:22,233 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2023-05-25T08:36:22,237 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2023-05-25T08:36:22,242 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-05-25T08:36:22,244 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-05-25T08:36:22,251 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2023-05-25T08:36:22,252 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2023-05-25T08:36:22,256 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2023-05-25T08:36:22,261 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2023-05-25T08:36:22,266 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-05-25T08:36:22,271 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:22,273 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:22,276 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:22,281 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:22,286 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:22,290 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:22,295 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2023-05-25T08:36:22,300 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-05-25T08:36:22,305 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-05-25T08:36:22,310 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2023-05-25T08:36:22,317 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-05-25T08:36:22,319 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-05-25T08:36:22,324 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-05-25T08:36:22,328 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-05-25T08:36:22,334 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-05-25T08:36:22,338 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2023-05-25T08:36:22,344 copying build/lib/colossalai/core.py -> build/bdist.linux-armv7l/wheel/colossalai 2023-05-25T08:36:22,350 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2023-05-25T08:36:22,353 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2023-05-25T08:36:22,357 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2023-05-25T08:36:22,362 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2023-05-25T08:36:22,366 running install_egg_info 2023-05-25T08:36:22,526 running egg_info 2023-05-25T08:36:22,591 writing colossalai.egg-info/PKG-INFO 2023-05-25T08:36:22,596 writing dependency_links to colossalai.egg-info/dependency_links.txt 2023-05-25T08:36:22,600 writing entry points to colossalai.egg-info/entry_points.txt 2023-05-25T08:36:22,603 writing requirements to colossalai.egg-info/requires.txt 2023-05-25T08:36:22,606 writing top-level names to colossalai.egg-info/top_level.txt 2023-05-25T08:36:22,930 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2023-05-25T08:36:23,016 reading manifest template 'MANIFEST.in' 2023-05-25T08:36:25,277 warning: no files found matching '*.tr' under directory 'colossalai' 2023-05-25T08:36:26,406 warning: no files found matching '*.cc' under directory 'colossalai' 2023-05-25T08:36:26,986 warning: no files found matching '*.pyi' under directory 'colossalai' 2023-05-25T08:36:27,005 adding license file 'LICENSE' 2023-05-25T08:36:27,119 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2023-05-25T08:36:27,125 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.3.0-py3.7.egg-info 2023-05-25T08:36:27,154 running install_scripts 2023-05-25T08:36:27,204 creating build/bdist.linux-armv7l/wheel/colossalai-0.3.0.dist-info/WHEEL 2023-05-25T08:36:27,209 creating '/tmp/pip-wheel-go9cdigx/colossalai-0.3.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-05-25T08:36:27,216 adding 'colossalai/__init__.py' 2023-05-25T08:36:27,220 adding 'colossalai/constants.py' 2023-05-25T08:36:27,223 adding 'colossalai/core.py' 2023-05-25T08:36:27,226 adding 'colossalai/global_variables.py' 2023-05-25T08:36:27,232 adding 'colossalai/initialize.py' 2023-05-25T08:36:27,235 adding 'colossalai/version.py' 2023-05-25T08:36:27,238 adding 'colossalai/_C/__init__.py' 2023-05-25T08:36:27,242 adding 'colossalai/_analyzer/__init__.py' 2023-05-25T08:36:27,244 adding 'colossalai/_analyzer/envs.py' 2023-05-25T08:36:27,248 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2023-05-25T08:36:27,253 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2023-05-25T08:36:27,256 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2023-05-25T08:36:27,262 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2023-05-25T08:36:27,266 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2023-05-25T08:36:27,270 adding 'colossalai/_analyzer/fx/__init__.py' 2023-05-25T08:36:27,275 adding 'colossalai/_analyzer/fx/codegen.py' 2023-05-25T08:36:27,280 adding 'colossalai/_analyzer/fx/graph_module.py' 2023-05-25T08:36:27,284 adding 'colossalai/_analyzer/fx/node_util.py' 2023-05-25T08:36:27,287 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2023-05-25T08:36:27,290 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2023-05-25T08:36:27,295 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2023-05-25T08:36:27,299 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2023-05-25T08:36:27,303 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2023-05-25T08:36:27,306 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2023-05-25T08:36:27,309 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2023-05-25T08:36:27,312 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2023-05-25T08:36:27,315 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2023-05-25T08:36:27,320 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2023-05-25T08:36:27,324 adding 'colossalai/amp/__init__.py' 2023-05-25T08:36:27,326 adding 'colossalai/amp/amp_type.py' 2023-05-25T08:36:27,330 adding 'colossalai/amp/apex_amp/__init__.py' 2023-05-25T08:36:27,333 adding 'colossalai/amp/apex_amp/apex_amp.py' 2023-05-25T08:36:27,337 adding 'colossalai/amp/naive_amp/__init__.py' 2023-05-25T08:36:27,342 adding 'colossalai/amp/naive_amp/_fp16_optimizer.py' 2023-05-25T08:36:27,345 adding 'colossalai/amp/naive_amp/_utils.py' 2023-05-25T08:36:27,348 adding 'colossalai/amp/naive_amp/naive_amp.py' 2023-05-25T08:36:27,352 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2023-05-25T08:36:27,354 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2023-05-25T08:36:27,357 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2023-05-25T08:36:27,360 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2023-05-25T08:36:27,364 adding 'colossalai/amp/torch_amp/__init__.py' 2023-05-25T08:36:27,372 adding 'colossalai/amp/torch_amp/_grad_scaler.py' 2023-05-25T08:36:27,375 adding 'colossalai/amp/torch_amp/torch_amp.py' 2023-05-25T08:36:27,379 adding 'colossalai/auto_parallel/__init__.py' 2023-05-25T08:36:27,383 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2023-05-25T08:36:27,385 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2023-05-25T08:36:27,389 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2023-05-25T08:36:27,392 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2023-05-25T08:36:27,397 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2023-05-25T08:36:27,401 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2023-05-25T08:36:27,404 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2023-05-25T08:36:27,407 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2023-05-25T08:36:27,409 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2023-05-25T08:36:27,413 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2023-05-25T08:36:27,416 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2023-05-25T08:36:27,419 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2023-05-25T08:36:27,422 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2023-05-25T08:36:27,426 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2023-05-25T08:36:27,429 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2023-05-25T08:36:27,434 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2023-05-25T08:36:27,438 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2023-05-25T08:36:27,441 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2023-05-25T08:36:27,444 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2023-05-25T08:36:27,447 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2023-05-25T08:36:27,450 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2023-05-25T08:36:27,454 adding 'colossalai/auto_parallel/offload/__init__.py' 2023-05-25T08:36:27,457 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2023-05-25T08:36:27,460 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2023-05-25T08:36:27,463 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2023-05-25T08:36:27,466 adding 'colossalai/auto_parallel/offload/region.py' 2023-05-25T08:36:27,472 adding 'colossalai/auto_parallel/offload/region_manager.py' 2023-05-25T08:36:27,476 adding 'colossalai/auto_parallel/offload/runtime.py' 2023-05-25T08:36:27,482 adding 'colossalai/auto_parallel/offload/solver.py' 2023-05-25T08:36:27,487 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2023-05-25T08:36:27,490 adding 'colossalai/auto_parallel/offload/util.py' 2023-05-25T08:36:27,494 adding 'colossalai/auto_parallel/passes/__init__.py' 2023-05-25T08:36:27,497 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2023-05-25T08:36:27,500 adding 'colossalai/auto_parallel/passes/constants.py' 2023-05-25T08:36:27,503 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2023-05-25T08:36:27,507 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2023-05-25T08:36:27,514 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2023-05-25T08:36:27,518 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2023-05-25T08:36:27,522 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2023-05-25T08:36:27,524 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2023-05-25T08:36:27,529 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2023-05-25T08:36:27,532 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2023-05-25T08:36:27,537 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2023-05-25T08:36:27,542 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2023-05-25T08:36:27,545 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2023-05-25T08:36:27,547 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2023-05-25T08:36:27,551 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2023-05-25T08:36:27,554 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2023-05-25T08:36:27,557 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2023-05-25T08:36:27,560 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2023-05-25T08:36:27,564 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2023-05-25T08:36:27,567 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2023-05-25T08:36:27,569 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2023-05-25T08:36:27,572 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2023-05-25T08:36:27,576 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2023-05-25T08:36:27,582 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2023-05-25T08:36:27,588 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2023-05-25T08:36:27,591 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2023-05-25T08:36:27,594 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2023-05-25T08:36:27,596 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2023-05-25T08:36:27,599 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2023-05-25T08:36:27,602 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2023-05-25T08:36:27,604 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2023-05-25T08:36:27,607 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2023-05-25T08:36:27,610 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2023-05-25T08:36:27,613 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2023-05-25T08:36:27,616 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2023-05-25T08:36:27,619 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2023-05-25T08:36:27,621 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2023-05-25T08:36:27,624 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2023-05-25T08:36:27,628 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2023-05-25T08:36:27,632 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2023-05-25T08:36:27,636 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2023-05-25T08:36:27,641 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2023-05-25T08:36:27,645 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2023-05-25T08:36:27,648 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2023-05-25T08:36:27,651 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2023-05-25T08:36:27,655 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2023-05-25T08:36:27,663 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2023-05-25T08:36:27,667 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2023-05-25T08:36:27,670 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2023-05-25T08:36:27,673 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2023-05-25T08:36:27,677 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2023-05-25T08:36:27,681 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2023-05-25T08:36:27,685 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2023-05-25T08:36:27,689 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2023-05-25T08:36:27,691 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2023-05-25T08:36:27,694 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2023-05-25T08:36:27,697 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2023-05-25T08:36:27,701 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2023-05-25T08:36:27,705 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2023-05-25T08:36:27,708 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2023-05-25T08:36:27,715 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2023-05-25T08:36:27,719 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2023-05-25T08:36:27,722 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2023-05-25T08:36:27,726 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2023-05-25T08:36:27,730 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2023-05-25T08:36:27,733 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2023-05-25T08:36:27,737 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2023-05-25T08:36:27,740 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2023-05-25T08:36:27,744 adding 'colossalai/booster/__init__.py' 2023-05-25T08:36:27,746 adding 'colossalai/booster/accelerator.py' 2023-05-25T08:36:27,750 adding 'colossalai/booster/booster.py' 2023-05-25T08:36:27,754 adding 'colossalai/booster/mixed_precision/__init__.py' 2023-05-25T08:36:27,757 adding 'colossalai/booster/mixed_precision/bf16.py' 2023-05-25T08:36:27,760 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2023-05-25T08:36:27,762 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2023-05-25T08:36:27,765 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2023-05-25T08:36:27,768 adding 'colossalai/booster/mixed_precision/fp8.py' 2023-05-25T08:36:27,770 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2023-05-25T08:36:27,774 adding 'colossalai/booster/plugin/__init__.py' 2023-05-25T08:36:27,777 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2023-05-25T08:36:27,781 adding 'colossalai/booster/plugin/gemini_plugin.py' 2023-05-25T08:36:27,785 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2023-05-25T08:36:27,788 adding 'colossalai/booster/plugin/plugin_base.py' 2023-05-25T08:36:27,791 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2023-05-25T08:36:27,795 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2023-05-25T08:36:27,799 adding 'colossalai/builder/__init__.py' 2023-05-25T08:36:27,802 adding 'colossalai/builder/builder.py' 2023-05-25T08:36:27,805 adding 'colossalai/checkpoint_io/__init__.py' 2023-05-25T08:36:27,809 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2023-05-25T08:36:27,813 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2023-05-25T08:36:27,816 adding 'colossalai/checkpoint_io/index_file.py' 2023-05-25T08:36:27,821 adding 'colossalai/checkpoint_io/utils.py' 2023-05-25T08:36:27,825 adding 'colossalai/cli/__init__.py' 2023-05-25T08:36:27,827 adding 'colossalai/cli/cli.py' 2023-05-25T08:36:27,831 adding 'colossalai/cli/benchmark/__init__.py' 2023-05-25T08:36:27,834 adding 'colossalai/cli/benchmark/benchmark.py' 2023-05-25T08:36:27,837 adding 'colossalai/cli/benchmark/models.py' 2023-05-25T08:36:27,840 adding 'colossalai/cli/benchmark/utils.py' 2023-05-25T08:36:27,843 adding 'colossalai/cli/check/__init__.py' 2023-05-25T08:36:27,847 adding 'colossalai/cli/check/check_installation.py' 2023-05-25T08:36:27,852 adding 'colossalai/cli/launcher/__init__.py' 2023-05-25T08:36:27,855 adding 'colossalai/cli/launcher/hostinfo.py' 2023-05-25T08:36:27,858 adding 'colossalai/cli/launcher/multinode_runner.py' 2023-05-25T08:36:27,862 adding 'colossalai/cli/launcher/run.py' 2023-05-25T08:36:27,866 adding 'colossalai/cluster/__init__.py' 2023-05-25T08:36:27,869 adding 'colossalai/cluster/device_mesh_manager.py' 2023-05-25T08:36:27,872 adding 'colossalai/cluster/dist_coordinator.py' 2023-05-25T08:36:27,875 adding 'colossalai/cluster/process_group_manager.py' 2023-05-25T08:36:27,879 adding 'colossalai/communication/__init__.py' 2023-05-25T08:36:27,883 adding 'colossalai/communication/collective.py' 2023-05-25T08:36:27,887 adding 'colossalai/communication/p2p.py' 2023-05-25T08:36:27,892 adding 'colossalai/communication/p2p_v2.py' 2023-05-25T08:36:27,895 adding 'colossalai/communication/ring.py' 2023-05-25T08:36:27,898 adding 'colossalai/communication/utils.py' 2023-05-25T08:36:27,901 adding 'colossalai/context/__init__.py' 2023-05-25T08:36:27,904 adding 'colossalai/context/config.py' 2023-05-25T08:36:27,908 adding 'colossalai/context/moe_context.py' 2023-05-25T08:36:27,914 adding 'colossalai/context/parallel_context.py' 2023-05-25T08:36:27,917 adding 'colossalai/context/parallel_mode.py' 2023-05-25T08:36:27,920 adding 'colossalai/context/singleton_meta.py' 2023-05-25T08:36:27,924 adding 'colossalai/context/process_group_initializer/__init__.py' 2023-05-25T08:36:27,926 adding 'colossalai/context/process_group_initializer/initializer_1d.py' 2023-05-25T08:36:27,929 adding 'colossalai/context/process_group_initializer/initializer_2d.py' 2023-05-25T08:36:27,933 adding 'colossalai/context/process_group_initializer/initializer_2p5d.py' 2023-05-25T08:36:27,937 adding 'colossalai/context/process_group_initializer/initializer_3d.py' 2023-05-25T08:36:27,940 adding 'colossalai/context/process_group_initializer/initializer_data.py' 2023-05-25T08:36:27,943 adding 'colossalai/context/process_group_initializer/initializer_model.py' 2023-05-25T08:36:27,946 adding 'colossalai/context/process_group_initializer/initializer_pipeline.py' 2023-05-25T08:36:27,949 adding 'colossalai/context/process_group_initializer/initializer_sequence.py' 2023-05-25T08:36:27,951 adding 'colossalai/context/process_group_initializer/initializer_tensor.py' 2023-05-25T08:36:27,954 adding 'colossalai/context/process_group_initializer/process_group_initializer.py' 2023-05-25T08:36:27,958 adding 'colossalai/context/random/__init__.py' 2023-05-25T08:36:27,961 adding 'colossalai/context/random/_helper.py' 2023-05-25T08:36:27,964 adding 'colossalai/context/random/seed_manager.py' 2023-05-25T08:36:27,967 adding 'colossalai/device/__init__.py' 2023-05-25T08:36:27,972 adding 'colossalai/device/alpha_beta_profiler.py' 2023-05-25T08:36:27,976 adding 'colossalai/device/calc_pipeline_strategy.py' 2023-05-25T08:36:27,980 adding 'colossalai/device/device_mesh.py' 2023-05-25T08:36:27,984 adding 'colossalai/engine/__init__.py' 2023-05-25T08:36:27,987 adding 'colossalai/engine/_base_engine.py' 2023-05-25T08:36:27,992 adding 'colossalai/engine/gradient_accumulation/__init__.py' 2023-05-25T08:36:27,996 adding 'colossalai/engine/gradient_accumulation/_gradient_accumulation.py' 2023-05-25T08:36:27,999 adding 'colossalai/engine/gradient_handler/__init__.py' 2023-05-25T08:36:28,002 adding 'colossalai/engine/gradient_handler/_base_gradient_handler.py' 2023-05-25T08:36:28,005 adding 'colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py' 2023-05-25T08:36:28,007 adding 'colossalai/engine/gradient_handler/_moe_gradient_handler.py' 2023-05-25T08:36:28,010 adding 'colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2023-05-25T08:36:28,013 adding 'colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2023-05-25T08:36:28,015 adding 'colossalai/engine/gradient_handler/_zero_gradient_handler.py' 2023-05-25T08:36:28,018 adding 'colossalai/engine/gradient_handler/utils.py' 2023-05-25T08:36:28,021 adding 'colossalai/engine/schedule/__init__.py' 2023-05-25T08:36:28,025 adding 'colossalai/engine/schedule/_base_schedule.py' 2023-05-25T08:36:28,028 adding 'colossalai/engine/schedule/_non_pipeline_schedule.py' 2023-05-25T08:36:28,037 adding 'colossalai/engine/schedule/_pipeline_schedule.py' 2023-05-25T08:36:28,042 adding 'colossalai/engine/schedule/_pipeline_schedule_v2.py' 2023-05-25T08:36:28,045 adding 'colossalai/fx/__init__.py' 2023-05-25T08:36:28,048 adding 'colossalai/fx/_compatibility.py' 2023-05-25T08:36:28,054 adding 'colossalai/fx/_meta_regist_12.py' 2023-05-25T08:36:28,057 adding 'colossalai/fx/_meta_regist_13.py' 2023-05-25T08:36:28,060 adding 'colossalai/fx/graph_module.py' 2023-05-25T08:36:28,063 adding 'colossalai/fx/proxy.py' 2023-05-25T08:36:28,067 adding 'colossalai/fx/codegen/__init__.py' 2023-05-25T08:36:28,077 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2023-05-25T08:36:28,081 adding 'colossalai/fx/passes/__init__.py' 2023-05-25T08:36:28,086 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2023-05-25T08:36:28,090 adding 'colossalai/fx/passes/concrete_info_prop.py' 2023-05-25T08:36:28,095 adding 'colossalai/fx/passes/meta_info_prop.py' 2023-05-25T08:36:28,101 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2023-05-25T08:36:28,104 adding 'colossalai/fx/passes/shard_1d_pass.py' 2023-05-25T08:36:28,109 adding 'colossalai/fx/passes/split_module.py' 2023-05-25T08:36:28,113 adding 'colossalai/fx/passes/utils.py' 2023-05-25T08:36:28,116 adding 'colossalai/fx/profiler/__init__.py' 2023-05-25T08:36:28,119 adding 'colossalai/fx/profiler/constants.py' 2023-05-25T08:36:28,122 adding 'colossalai/fx/profiler/dataflow.py' 2023-05-25T08:36:28,125 adding 'colossalai/fx/profiler/memory_utils.py' 2023-05-25T08:36:28,129 adding 'colossalai/fx/profiler/opcount.py' 2023-05-25T08:36:28,134 adding 'colossalai/fx/profiler/profiler.py' 2023-05-25T08:36:28,138 adding 'colossalai/fx/profiler/shard_utils.py' 2023-05-25T08:36:28,141 adding 'colossalai/fx/profiler/tensor.py' 2023-05-25T08:36:28,145 adding 'colossalai/fx/profiler/experimental/__init__.py' 2023-05-25T08:36:28,147 adding 'colossalai/fx/profiler/experimental/constants.py' 2023-05-25T08:36:28,150 adding 'colossalai/fx/profiler/experimental/profiler.py' 2023-05-25T08:36:28,153 adding 'colossalai/fx/profiler/experimental/registry.py' 2023-05-25T08:36:28,156 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2023-05-25T08:36:28,159 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2023-05-25T08:36:28,162 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2023-05-25T08:36:28,165 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2023-05-25T08:36:28,168 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2023-05-25T08:36:28,170 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2023-05-25T08:36:28,173 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2023-05-25T08:36:28,175 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2023-05-25T08:36:28,178 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2023-05-25T08:36:28,180 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2023-05-25T08:36:28,184 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2023-05-25T08:36:28,187 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2023-05-25T08:36:28,189 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2023-05-25T08:36:28,193 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2023-05-25T08:36:28,196 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2023-05-25T08:36:28,200 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2023-05-25T08:36:28,203 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2023-05-25T08:36:28,206 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2023-05-25T08:36:28,209 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2023-05-25T08:36:28,211 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2023-05-25T08:36:28,214 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2023-05-25T08:36:28,217 adding 'colossalai/fx/tracer/__init__.py' 2023-05-25T08:36:28,220 adding 'colossalai/fx/tracer/_meta_trace.py' 2023-05-25T08:36:28,224 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2023-05-25T08:36:28,226 adding 'colossalai/fx/tracer/_tracer_utils.py' 2023-05-25T08:36:28,234 adding 'colossalai/fx/tracer/experimental.py' 2023-05-25T08:36:28,238 adding 'colossalai/fx/tracer/registry.py' 2023-05-25T08:36:28,248 adding 'colossalai/fx/tracer/tracer.py' 2023-05-25T08:36:28,252 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2023-05-25T08:36:28,256 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2023-05-25T08:36:28,258 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2023-05-25T08:36:28,261 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2023-05-25T08:36:28,264 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2023-05-25T08:36:28,267 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2023-05-25T08:36:28,270 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2023-05-25T08:36:28,273 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2023-05-25T08:36:28,276 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2023-05-25T08:36:28,279 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2023-05-25T08:36:28,283 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2023-05-25T08:36:28,288 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2023-05-25T08:36:28,291 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2023-05-25T08:36:28,295 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2023-05-25T08:36:28,298 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2023-05-25T08:36:28,301 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2023-05-25T08:36:28,303 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2023-05-25T08:36:28,306 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2023-05-25T08:36:28,309 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2023-05-25T08:36:28,313 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2023-05-25T08:36:28,315 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2023-05-25T08:36:28,318 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2023-05-25T08:36:28,321 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2023-05-25T08:36:28,323 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2023-05-25T08:36:28,326 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2023-05-25T08:36:28,328 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2023-05-25T08:36:28,331 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2023-05-25T08:36:28,335 adding 'colossalai/interface/__init__.py' 2023-05-25T08:36:28,337 adding 'colossalai/interface/model.py' 2023-05-25T08:36:28,340 adding 'colossalai/interface/optimizer.py' 2023-05-25T08:36:28,344 adding 'colossalai/kernel/__init__.py' 2023-05-25T08:36:28,347 adding 'colossalai/kernel/cuda_native/__init__.py' 2023-05-25T08:36:28,354 adding 'colossalai/kernel/cuda_native/flash_attention.py' 2023-05-25T08:36:28,357 adding 'colossalai/kernel/cuda_native/layer_norm.py' 2023-05-25T08:36:28,361 adding 'colossalai/kernel/cuda_native/multihead_attention.py' 2023-05-25T08:36:28,365 adding 'colossalai/kernel/cuda_native/scaled_softmax.py' 2023-05-25T08:36:28,369 adding 'colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp' 2023-05-25T08:36:28,372 adding 'colossalai/kernel/cuda_native/csrc/compat.h' 2023-05-25T08:36:28,377 adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.cpp' 2023-05-25T08:36:28,380 adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.h' 2023-05-25T08:36:28,383 adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp' 2023-05-25T08:36:28,390 adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu' 2023-05-25T08:36:28,394 adding 'colossalai/kernel/cuda_native/csrc/moe_cuda.cpp' 2023-05-25T08:36:28,399 adding 'colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu' 2023-05-25T08:36:28,403 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu' 2023-05-25T08:36:28,407 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh' 2023-05-25T08:36:28,411 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu' 2023-05-25T08:36:28,415 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu' 2023-05-25T08:36:28,419 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu' 2023-05-25T08:36:28,422 adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu' 2023-05-25T08:36:28,427 adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp' 2023-05-25T08:36:28,431 adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h' 2023-05-25T08:36:28,434 adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp' 2023-05-25T08:36:28,439 adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h' 2023-05-25T08:36:28,442 adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu' 2023-05-25T08:36:28,445 adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp' 2023-05-25T08:36:28,450 adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h' 2023-05-25T08:36:28,453 adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu' 2023-05-25T08:36:28,457 adding 'colossalai/kernel/cuda_native/csrc/type_shim.h' 2023-05-25T08:36:28,463 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h' 2023-05-25T08:36:28,466 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/context.h' 2023-05-25T08:36:28,468 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h' 2023-05-25T08:36:28,471 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h' 2023-05-25T08:36:28,474 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h' 2023-05-25T08:36:28,476 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h' 2023-05-25T08:36:28,479 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h' 2023-05-25T08:36:28,483 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h' 2023-05-25T08:36:28,486 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh' 2023-05-25T08:36:28,489 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h' 2023-05-25T08:36:28,492 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h' 2023-05-25T08:36:28,495 adding 'colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h' 2023-05-25T08:36:28,501 adding 'colossalai/kernel/jit/__init__.py' 2023-05-25T08:36:28,504 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2023-05-25T08:36:28,507 adding 'colossalai/kernel/jit/bias_gelu.py' 2023-05-25T08:36:28,510 adding 'colossalai/kernel/jit/option.py' 2023-05-25T08:36:28,514 adding 'colossalai/kernel/op_builder/__init__.py' 2023-05-25T08:36:28,518 adding 'colossalai/kernel/op_builder/builder.py' 2023-05-25T08:36:28,521 adding 'colossalai/kernel/op_builder/cpu_adam.py' 2023-05-25T08:36:28,523 adding 'colossalai/kernel/op_builder/fused_optim.py' 2023-05-25T08:36:28,526 adding 'colossalai/kernel/op_builder/layernorm.py' 2023-05-25T08:36:28,528 adding 'colossalai/kernel/op_builder/moe.py' 2023-05-25T08:36:28,531 adding 'colossalai/kernel/op_builder/multi_head_attn.py' 2023-05-25T08:36:28,534 adding 'colossalai/kernel/op_builder/scaled_masked_softmax.py' 2023-05-25T08:36:28,536 adding 'colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py' 2023-05-25T08:36:28,540 adding 'colossalai/kernel/op_builder/utils.py' 2023-05-25T08:36:28,544 adding 'colossalai/logging/__init__.py' 2023-05-25T08:36:28,548 adding 'colossalai/logging/logger.py' 2023-05-25T08:36:28,552 adding 'colossalai/nn/__init__.py' 2023-05-25T08:36:28,555 adding 'colossalai/nn/init.py' 2023-05-25T08:36:28,559 adding 'colossalai/nn/_ops/__init__.py' 2023-05-25T08:36:28,563 adding 'colossalai/nn/_ops/_utils.py' 2023-05-25T08:36:28,566 adding 'colossalai/nn/_ops/addmm.py' 2023-05-25T08:36:28,568 adding 'colossalai/nn/_ops/batch_norm.py' 2023-05-25T08:36:28,572 adding 'colossalai/nn/_ops/element_wise.py' 2023-05-25T08:36:28,575 adding 'colossalai/nn/_ops/embedding.py' 2023-05-25T08:36:28,579 adding 'colossalai/nn/_ops/embedding_bag.py' 2023-05-25T08:36:28,582 adding 'colossalai/nn/_ops/layernorm.py' 2023-05-25T08:36:28,585 adding 'colossalai/nn/_ops/linear.py' 2023-05-25T08:36:28,588 adding 'colossalai/nn/_ops/loss.py' 2023-05-25T08:36:28,591 adding 'colossalai/nn/_ops/view.py' 2023-05-25T08:36:28,595 adding 'colossalai/nn/layer/__init__.py' 2023-05-25T08:36:28,597 adding 'colossalai/nn/layer/base_layer.py' 2023-05-25T08:36:28,601 adding 'colossalai/nn/layer/colossalai_layer/__init__.py' 2023-05-25T08:36:28,604 adding 'colossalai/nn/layer/colossalai_layer/_utils.py' 2023-05-25T08:36:28,607 adding 'colossalai/nn/layer/colossalai_layer/dropout.py' 2023-05-25T08:36:28,611 adding 'colossalai/nn/layer/colossalai_layer/embedding.py' 2023-05-25T08:36:28,615 adding 'colossalai/nn/layer/colossalai_layer/linear.py' 2023-05-25T08:36:28,617 adding 'colossalai/nn/layer/colossalai_layer/normalization.py' 2023-05-25T08:36:28,621 adding 'colossalai/nn/layer/moe/__init__.py' 2023-05-25T08:36:28,625 adding 'colossalai/nn/layer/moe/_operation.py' 2023-05-25T08:36:28,628 adding 'colossalai/nn/layer/moe/checkpoint.py' 2023-05-25T08:36:28,632 adding 'colossalai/nn/layer/moe/experts.py' 2023-05-25T08:36:28,635 adding 'colossalai/nn/layer/moe/layers.py' 2023-05-25T08:36:28,640 adding 'colossalai/nn/layer/moe/routers.py' 2023-05-25T08:36:28,643 adding 'colossalai/nn/layer/moe/utils.py' 2023-05-25T08:36:28,646 adding 'colossalai/nn/layer/parallel_1d/__init__.py' 2023-05-25T08:36:28,649 adding 'colossalai/nn/layer/parallel_1d/_operation.py' 2023-05-25T08:36:28,652 adding 'colossalai/nn/layer/parallel_1d/_utils.py' 2023-05-25T08:36:28,661 adding 'colossalai/nn/layer/parallel_1d/layers.py' 2023-05-25T08:36:28,666 adding 'colossalai/nn/layer/parallel_2d/__init__.py' 2023-05-25T08:36:28,673 adding 'colossalai/nn/layer/parallel_2d/_operation.py' 2023-05-25T08:36:28,676 adding 'colossalai/nn/layer/parallel_2d/_utils.py' 2023-05-25T08:36:28,684 adding 'colossalai/nn/layer/parallel_2d/layers.py' 2023-05-25T08:36:28,689 adding 'colossalai/nn/layer/parallel_2p5d/__init__.py' 2023-05-25T08:36:28,696 adding 'colossalai/nn/layer/parallel_2p5d/_operation.py' 2023-05-25T08:36:28,699 adding 'colossalai/nn/layer/parallel_2p5d/_utils.py' 2023-05-25T08:36:28,708 adding 'colossalai/nn/layer/parallel_2p5d/layers.py' 2023-05-25T08:36:28,713 adding 'colossalai/nn/layer/parallel_3d/__init__.py' 2023-05-25T08:36:28,718 adding 'colossalai/nn/layer/parallel_3d/_operation.py' 2023-05-25T08:36:28,722 adding 'colossalai/nn/layer/parallel_3d/_utils.py' 2023-05-25T08:36:28,730 adding 'colossalai/nn/layer/parallel_3d/layers.py' 2023-05-25T08:36:28,734 adding 'colossalai/nn/layer/parallel_sequence/__init__.py' 2023-05-25T08:36:28,737 adding 'colossalai/nn/layer/parallel_sequence/_operation.py' 2023-05-25T08:36:28,740 adding 'colossalai/nn/layer/parallel_sequence/_utils.py' 2023-05-25T08:36:28,744 adding 'colossalai/nn/layer/parallel_sequence/layers.py' 2023-05-25T08:36:28,748 adding 'colossalai/nn/layer/utils/__init__.py' 2023-05-25T08:36:28,751 adding 'colossalai/nn/layer/utils/common.py' 2023-05-25T08:36:28,754 adding 'colossalai/nn/layer/vanilla/__init__.py' 2023-05-25T08:36:28,759 adding 'colossalai/nn/layer/vanilla/layers.py' 2023-05-25T08:36:28,763 adding 'colossalai/nn/layer/wrapper/__init__.py' 2023-05-25T08:36:28,765 adding 'colossalai/nn/layer/wrapper/pipeline_wrapper.py' 2023-05-25T08:36:28,769 adding 'colossalai/nn/loss/__init__.py' 2023-05-25T08:36:28,772 adding 'colossalai/nn/loss/loss_1d.py' 2023-05-25T08:36:28,776 adding 'colossalai/nn/loss/loss_2d.py' 2023-05-25T08:36:28,779 adding 'colossalai/nn/loss/loss_2p5d.py' 2023-05-25T08:36:28,782 adding 'colossalai/nn/loss/loss_3d.py' 2023-05-25T08:36:28,785 adding 'colossalai/nn/loss/loss_moe.py' 2023-05-25T08:36:28,789 adding 'colossalai/nn/lr_scheduler/__init__.py' 2023-05-25T08:36:28,792 adding 'colossalai/nn/lr_scheduler/cosine.py' 2023-05-25T08:36:28,795 adding 'colossalai/nn/lr_scheduler/delayed.py' 2023-05-25T08:36:28,798 adding 'colossalai/nn/lr_scheduler/linear.py' 2023-05-25T08:36:28,801 adding 'colossalai/nn/lr_scheduler/multistep.py' 2023-05-25T08:36:28,805 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2023-05-25T08:36:28,807 adding 'colossalai/nn/lr_scheduler/poly.py' 2023-05-25T08:36:28,810 adding 'colossalai/nn/lr_scheduler/torch.py' 2023-05-25T08:36:28,814 adding 'colossalai/nn/metric/__init__.py' 2023-05-25T08:36:28,816 adding 'colossalai/nn/metric/_utils.py' 2023-05-25T08:36:28,819 adding 'colossalai/nn/metric/accuracy_2d.py' 2023-05-25T08:36:28,822 adding 'colossalai/nn/metric/accuracy_2p5d.py' 2023-05-25T08:36:28,824 adding 'colossalai/nn/metric/accuracy_3d.py' 2023-05-25T08:36:28,828 adding 'colossalai/nn/optimizer/__init__.py' 2023-05-25T08:36:28,831 adding 'colossalai/nn/optimizer/colossalai_optimizer.py' 2023-05-25T08:36:28,834 adding 'colossalai/nn/optimizer/cpu_adam.py' 2023-05-25T08:36:28,838 adding 'colossalai/nn/optimizer/fused_adam.py' 2023-05-25T08:36:28,842 adding 'colossalai/nn/optimizer/fused_lamb.py' 2023-05-25T08:36:28,846 adding 'colossalai/nn/optimizer/fused_sgd.py' 2023-05-25T08:36:28,849 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2023-05-25T08:36:28,852 adding 'colossalai/nn/optimizer/lamb.py' 2023-05-25T08:36:28,856 adding 'colossalai/nn/optimizer/lars.py' 2023-05-25T08:36:28,859 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2023-05-25T08:36:28,863 adding 'colossalai/nn/parallel/__init__.py' 2023-05-25T08:36:28,866 adding 'colossalai/nn/parallel/data_parallel.py' 2023-05-25T08:36:28,869 adding 'colossalai/nn/parallel/reducer.py' 2023-05-25T08:36:28,873 adding 'colossalai/nn/parallel/layers/__init__.py' 2023-05-25T08:36:28,876 adding 'colossalai/nn/parallel/layers/colo_module.py' 2023-05-25T08:36:28,878 adding 'colossalai/nn/parallel/layers/embedding.py' 2023-05-25T08:36:28,881 adding 'colossalai/nn/parallel/layers/linear.py' 2023-05-25T08:36:28,884 adding 'colossalai/nn/parallel/layers/module_utils.py' 2023-05-25T08:36:28,888 adding 'colossalai/nn/parallel/layers/cache_embedding/__init__.py' 2023-05-25T08:36:28,890 adding 'colossalai/nn/parallel/layers/cache_embedding/base_embedding.py' 2023-05-25T08:36:28,898 adding 'colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py' 2023-05-25T08:36:28,902 adding 'colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py' 2023-05-25T08:36:28,906 adding 'colossalai/nn/parallel/layers/cache_embedding/copyer.py' 2023-05-25T08:36:28,908 adding 'colossalai/nn/parallel/layers/cache_embedding/embedding_config.py' 2023-05-25T08:36:28,911 adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2023-05-25T08:36:28,915 adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2023-05-25T08:36:28,919 adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2023-05-25T08:36:28,923 adding 'colossalai/pipeline/__init__.py' 2023-05-25T08:36:28,925 adding 'colossalai/pipeline/layer_spec.py' 2023-05-25T08:36:28,929 adding 'colossalai/pipeline/pipelinable.py' 2023-05-25T08:36:28,933 adding 'colossalai/pipeline/pipeline_process_group.py' 2023-05-25T08:36:28,937 adding 'colossalai/pipeline/utils.py' 2023-05-25T08:36:28,940 adding 'colossalai/pipeline/middleware/__init__.py' 2023-05-25T08:36:28,944 adding 'colossalai/pipeline/middleware/topo.py' 2023-05-25T08:36:28,947 adding 'colossalai/pipeline/middleware/adaptor/__init__.py' 2023-05-25T08:36:28,951 adding 'colossalai/pipeline/middleware/adaptor/fx.py' 2023-05-25T08:36:28,954 adding 'colossalai/pipeline/rpc/__init__.py' 2023-05-25T08:36:28,969 adding 'colossalai/pipeline/rpc/_pipeline_base.py' 2023-05-25T08:36:28,975 adding 'colossalai/pipeline/rpc/_pipeline_schedule.py' 2023-05-25T08:36:28,978 adding 'colossalai/pipeline/rpc/utils.py' 2023-05-25T08:36:28,982 adding 'colossalai/registry/__init__.py' 2023-05-25T08:36:28,985 adding 'colossalai/registry/registry.py' 2023-05-25T08:36:28,989 adding 'colossalai/tensor/__init__.py' 2023-05-25T08:36:28,992 adding 'colossalai/tensor/colo_parameter.py' 2023-05-25T08:36:28,997 adding 'colossalai/tensor/colo_tensor.py' 2023-05-25T08:36:29,003 adding 'colossalai/tensor/comm_spec.py' 2023-05-25T08:36:29,006 adding 'colossalai/tensor/compute_spec.py' 2023-05-25T08:36:29,009 adding 'colossalai/tensor/const.py' 2023-05-25T08:36:29,012 adding 'colossalai/tensor/dist_spec_mgr.py' 2023-05-25T08:36:29,015 adding 'colossalai/tensor/distspec.py' 2023-05-25T08:36:29,018 adding 'colossalai/tensor/op_wrapper.py' 2023-05-25T08:36:29,021 adding 'colossalai/tensor/param_op_hook.py' 2023-05-25T08:36:29,025 adding 'colossalai/tensor/process_group.py' 2023-05-25T08:36:29,034 adding 'colossalai/tensor/shape_consistency.py' 2023-05-25T08:36:29,039 adding 'colossalai/tensor/sharding_spec.py' 2023-05-25T08:36:29,042 adding 'colossalai/tensor/tensor_spec.py' 2023-05-25T08:36:29,045 adding 'colossalai/tensor/utils.py' 2023-05-25T08:36:29,049 adding 'colossalai/tensor/d_tensor/__init__.py' 2023-05-25T08:36:29,053 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2023-05-25T08:36:29,056 adding 'colossalai/tensor/d_tensor/d_tensor.py' 2023-05-25T08:36:29,059 adding 'colossalai/tensor/d_tensor/layout.py' 2023-05-25T08:36:29,065 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2023-05-25T08:36:29,068 adding 'colossalai/tensor/d_tensor/misc.py' 2023-05-25T08:36:29,072 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2023-05-25T08:36:29,075 adding 'colossalai/tensor/d_tensor/utils.py' 2023-05-25T08:36:29,079 adding 'colossalai/testing/__init__.py' 2023-05-25T08:36:29,082 adding 'colossalai/testing/comparison.py' 2023-05-25T08:36:29,084 adding 'colossalai/testing/pytest_wrapper.py' 2023-05-25T08:36:29,087 adding 'colossalai/testing/random.py' 2023-05-25T08:36:29,090 adding 'colossalai/testing/utils.py' 2023-05-25T08:36:29,094 adding 'colossalai/trainer/__init__.py' 2023-05-25T08:36:29,099 adding 'colossalai/trainer/_trainer.py' 2023-05-25T08:36:29,103 adding 'colossalai/trainer/hooks/__init__.py' 2023-05-25T08:36:29,106 adding 'colossalai/trainer/hooks/_base_hook.py' 2023-05-25T08:36:29,108 adding 'colossalai/trainer/hooks/_checkpoint_hook.py' 2023-05-25T08:36:29,111 adding 'colossalai/trainer/hooks/_commons_.py' 2023-05-25T08:36:29,115 adding 'colossalai/trainer/hooks/_log_hook.py' 2023-05-25T08:36:29,118 adding 'colossalai/trainer/hooks/_lr_scheduler_hook.py' 2023-05-25T08:36:29,123 adding 'colossalai/trainer/hooks/_metric_hook.py' 2023-05-25T08:36:29,127 adding 'colossalai/utils/__init__.py' 2023-05-25T08:36:29,131 adding 'colossalai/utils/activation_checkpoint.py' 2023-05-25T08:36:29,135 adding 'colossalai/utils/checkpointing.py' 2023-05-25T08:36:29,141 adding 'colossalai/utils/common.py' 2023-05-25T08:36:29,144 adding 'colossalai/utils/cuda.py' 2023-05-25T08:36:29,148 adding 'colossalai/utils/memory.py' 2023-05-25T08:36:29,151 adding 'colossalai/utils/moe.py' 2023-05-25T08:36:29,154 adding 'colossalai/utils/timer.py' 2023-05-25T08:36:29,158 adding 'colossalai/utils/checkpoint/__init__.py' 2023-05-25T08:36:29,161 adding 'colossalai/utils/checkpoint/module_checkpoint.py' 2023-05-25T08:36:29,164 adding 'colossalai/utils/checkpoint/utils.py' 2023-05-25T08:36:29,168 adding 'colossalai/utils/checkpoint_io/__init__.py' 2023-05-25T08:36:29,170 adding 'colossalai/utils/checkpoint_io/backend.py' 2023-05-25T08:36:29,173 adding 'colossalai/utils/checkpoint_io/constant.py' 2023-05-25T08:36:29,176 adding 'colossalai/utils/checkpoint_io/convertor.py' 2023-05-25T08:36:29,179 adding 'colossalai/utils/checkpoint_io/distributed.py' 2023-05-25T08:36:29,183 adding 'colossalai/utils/checkpoint_io/io.py' 2023-05-25T08:36:29,186 adding 'colossalai/utils/checkpoint_io/meta.py' 2023-05-25T08:36:29,189 adding 'colossalai/utils/checkpoint_io/reader.py' 2023-05-25T08:36:29,192 adding 'colossalai/utils/checkpoint_io/utils.py' 2023-05-25T08:36:29,196 adding 'colossalai/utils/checkpoint_io/writer.py' 2023-05-25T08:36:29,199 adding 'colossalai/utils/data_sampler/__init__.py' 2023-05-25T08:36:29,201 adding 'colossalai/utils/data_sampler/base_sampler.py' 2023-05-25T08:36:29,205 adding 'colossalai/utils/data_sampler/data_parallel_sampler.py' 2023-05-25T08:36:29,209 adding 'colossalai/utils/model/__init__.py' 2023-05-25T08:36:29,215 adding 'colossalai/utils/model/experimental.py' 2023-05-25T08:36:29,220 adding 'colossalai/utils/model/lazy_init_context.py' 2023-05-25T08:36:29,223 adding 'colossalai/utils/model/utils.py' 2023-05-25T08:36:29,226 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2023-05-25T08:36:29,229 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2023-05-25T08:36:29,232 adding 'colossalai/utils/profiler/__init__.py' 2023-05-25T08:36:29,235 adding 'colossalai/utils/profiler/extention.py' 2023-05-25T08:36:29,238 adding 'colossalai/utils/profiler/profiler.py' 2023-05-25T08:36:29,242 adding 'colossalai/utils/profiler/stateful_tensor_mem_extention.py' 2023-05-25T08:36:29,250 adding 'colossalai/utils/profiler/legacy/__init__.py' 2023-05-25T08:36:29,254 adding 'colossalai/utils/profiler/legacy/comm_profiler.py' 2023-05-25T08:36:29,257 adding 'colossalai/utils/profiler/legacy/pcie_profiler.py' 2023-05-25T08:36:29,260 adding 'colossalai/utils/profiler/legacy/prof_utils.py' 2023-05-25T08:36:29,264 adding 'colossalai/utils/rank_recorder/__init__.py' 2023-05-25T08:36:29,267 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2023-05-25T08:36:29,271 adding 'colossalai/utils/tensor_detector/__init__.py' 2023-05-25T08:36:29,274 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2023-05-25T08:36:29,278 adding 'colossalai/zero/__init__.py' 2023-05-25T08:36:29,281 adding 'colossalai/zero/wrapper.py' 2023-05-25T08:36:29,285 adding 'colossalai/zero/gemini/__init__.py' 2023-05-25T08:36:29,288 adding 'colossalai/zero/gemini/colo_init_context.py' 2023-05-25T08:36:29,299 adding 'colossalai/zero/gemini/gemini_ddp.py' 2023-05-25T08:36:29,302 adding 'colossalai/zero/gemini/gemini_hook.py' 2023-05-25T08:36:29,306 adding 'colossalai/zero/gemini/gemini_mgr.py' 2023-05-25T08:36:29,311 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2023-05-25T08:36:29,315 adding 'colossalai/zero/gemini/placement_policy.py' 2023-05-25T08:36:29,318 adding 'colossalai/zero/gemini/utils.py' 2023-05-25T08:36:29,322 adding 'colossalai/zero/gemini/chunk/__init__.py' 2023-05-25T08:36:29,328 adding 'colossalai/zero/gemini/chunk/chunk.py' 2023-05-25T08:36:29,333 adding 'colossalai/zero/gemini/chunk/manager.py' 2023-05-25T08:36:29,336 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2023-05-25T08:36:29,339 adding 'colossalai/zero/gemini/chunk/utils.py' 2023-05-25T08:36:29,343 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2023-05-25T08:36:29,346 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2023-05-25T08:36:29,349 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2023-05-25T08:36:29,352 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2023-05-25T08:36:29,355 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2023-05-25T08:36:29,357 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2023-05-25T08:36:29,360 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2023-05-25T08:36:29,364 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2023-05-25T08:36:29,367 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2023-05-25T08:36:29,371 adding 'colossalai/zero/legacy/__init__.py' 2023-05-25T08:36:29,374 adding 'colossalai/zero/legacy/gemini/__init__.py' 2023-05-25T08:36:29,377 adding 'colossalai/zero/legacy/gemini/gemini_context.py' 2023-05-25T08:36:29,381 adding 'colossalai/zero/legacy/gemini/stateful_tensor.py' 2023-05-25T08:36:29,384 adding 'colossalai/zero/legacy/gemini/stateful_tensor_mgr.py' 2023-05-25T08:36:29,387 adding 'colossalai/zero/legacy/gemini/tensor_placement_policy.py' 2023-05-25T08:36:29,390 adding 'colossalai/zero/legacy/gemini/tensor_utils.py' 2023-05-25T08:36:29,394 adding 'colossalai/zero/legacy/gemini/ophooks/__init__.py' 2023-05-25T08:36:29,398 adding 'colossalai/zero/legacy/gemini/ophooks/_shard_grad_ophook.py' 2023-05-25T08:36:29,402 adding 'colossalai/zero/legacy/gemini/ophooks/_shard_param_ophook.py' 2023-05-25T08:36:29,405 adding 'colossalai/zero/legacy/gemini/ophooks/runtime_mem_tracer_hook.py' 2023-05-25T08:36:29,409 adding 'colossalai/zero/legacy/gemini/ophooks/utils.py' 2023-05-25T08:36:29,412 adding 'colossalai/zero/legacy/gemini/paramhooks/__init__.py' 2023-05-25T08:36:29,415 adding 'colossalai/zero/legacy/gemini/paramhooks/_param_hookmgr.py' 2023-05-25T08:36:29,418 adding 'colossalai/zero/legacy/init_ctx/__init__.py' 2023-05-25T08:36:29,423 adding 'colossalai/zero/legacy/init_ctx/init_context.py' 2023-05-25T08:36:29,427 adding 'colossalai/zero/legacy/shard_utils/__init__.py' 2023-05-25T08:36:29,429 adding 'colossalai/zero/legacy/shard_utils/base_shard_strategy.py' 2023-05-25T08:36:29,432 adding 'colossalai/zero/legacy/shard_utils/bucket_tensor_shard_strategy.py' 2023-05-25T08:36:29,435 adding 'colossalai/zero/legacy/shard_utils/commons.py' 2023-05-25T08:36:29,438 adding 'colossalai/zero/legacy/shard_utils/tensor_shard_strategy.py' 2023-05-25T08:36:29,444 adding 'colossalai/zero/legacy/sharded_model/__init__.py' 2023-05-25T08:36:29,448 adding 'colossalai/zero/legacy/sharded_model/_utils.py' 2023-05-25T08:36:29,452 adding 'colossalai/zero/legacy/sharded_model/reduce_scatter.py' 2023-05-25T08:36:29,460 adding 'colossalai/zero/legacy/sharded_model/sharded_model_v2.py' 2023-05-25T08:36:29,463 adding 'colossalai/zero/legacy/sharded_model/utils.py' 2023-05-25T08:36:29,467 adding 'colossalai/zero/legacy/sharded_model/zero_hook.py' 2023-05-25T08:36:29,470 adding 'colossalai/zero/legacy/sharded_optim/__init__.py' 2023-05-25T08:36:29,476 adding 'colossalai/zero/legacy/sharded_optim/sharded_optim_v2.py' 2023-05-25T08:36:29,480 adding 'colossalai/zero/legacy/sharded_param/__init__.py' 2023-05-25T08:36:29,484 adding 'colossalai/zero/legacy/sharded_param/sharded_param.py' 2023-05-25T08:36:29,487 adding 'colossalai/zero/legacy/sharded_param/sharded_tensor.py' 2023-05-25T08:36:29,493 adding 'colossalai/zero/low_level/__init__.py' 2023-05-25T08:36:29,497 adding 'colossalai/zero/low_level/_utils.py' 2023-05-25T08:36:29,505 adding 'colossalai/zero/low_level/low_level_optim.py' 2023-05-25T08:36:29,509 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2023-05-25T08:36:29,512 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2023-05-25T08:36:29,514 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2023-05-25T08:36:29,517 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2023-05-25T08:36:29,520 adding 'colossalai/zero/low_level/bookkeeping/parameter_store.py' 2023-05-25T08:36:29,523 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2023-05-25T08:36:29,532 adding 'colossalai-0.3.0.dist-info/LICENSE' 2023-05-25T08:36:29,538 adding 'colossalai-0.3.0.dist-info/METADATA' 2023-05-25T08:36:29,541 adding 'colossalai-0.3.0.dist-info/WHEEL' 2023-05-25T08:36:29,543 adding 'colossalai-0.3.0.dist-info/entry_points.txt' 2023-05-25T08:36:29,545 adding 'colossalai-0.3.0.dist-info/top_level.txt' 2023-05-25T08:36:29,575 adding 'colossalai-0.3.0.dist-info/RECORD' 2023-05-25T08:36:29,635 removing build/bdist.linux-armv7l/wheel 2023-05-25T08:36:30,145 Building wheel for colossalai (setup.py): finished with status 'done' 2023-05-25T08:36:30,181 Created wheel for colossalai: filename=colossalai-0.3.0-py3-none-any.whl size=997646 sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db 2023-05-25T08:36:30,183 Stored in directory: /tmp/pip-ephem-wheel-cache-989yt860/wheels/6d/79/f2/5f48f38978f07e6b5c94d214963dc1384d8816fec0cb7095d3 2023-05-25T08:36:30,268 Successfully built colossalai 2023-05-25T08:36:30,342 Removed build tracker: '/tmp/pip-build-tracker-skl7c_il'