2023-02-15T09:02:43,554 Created temporary directory: /tmp/pip-ephem-wheel-cache-mvg_n6ny
2023-02-15T09:02:43,559 Created temporary directory: /tmp/pip-build-tracker-wqq850vi
2023-02-15T09:02:43,559 Initialized build tracking at /tmp/pip-build-tracker-wqq850vi
2023-02-15T09:02:43,560 Created build tracker: /tmp/pip-build-tracker-wqq850vi
2023-02-15T09:02:43,560 Entered build tracker: /tmp/pip-build-tracker-wqq850vi
2023-02-15T09:02:43,561 Created temporary directory: /tmp/pip-wheel-up5t3c9w
2023-02-15T09:02:43,569 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453
2023-02-15T09:02:43,575 Created temporary directory: /tmp/pip-ephem-wheel-cache-4f5jlg0n
2023-02-15T09:02:43,631 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-02-15T09:02:43,639 2 location(s) to search for versions of colossalai:
2023-02-15T09:02:43,639 * https://pypi.org/simple/colossalai/
2023-02-15T09:02:43,639 * https://www.piwheels.org/simple/colossalai/
2023-02-15T09:02:43,640 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/
2023-02-15T09:02:43,641 Getting page https://pypi.org/simple/colossalai/
2023-02-15T09:02:43,644 Found index url https://pypi.org/simple
2023-02-15T09:02:43,834 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json
2023-02-15T09:02:43,839   Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0
2023-02-15T09:02:43,841   Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1
2023-02-15T09:02:43,842   Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2
2023-02-15T09:02:43,844   Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3
2023-02-15T09:02:43,845   Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4
2023-02-15T09:02:43,847   Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5
2023-02-15T09:02:43,847 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/
2023-02-15T09:02:43,848 Getting page https://www.piwheels.org/simple/colossalai/
2023-02-15T09:02:43,850 Found index url https://www.piwheels.org/simple
2023-02-15T09:02:44,066 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html
2023-02-15T09:02:44,072   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-02-15T09:02:44,073   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-02-15T09:02:44,073   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-02-15T09:02:44,074   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-02-15T09:02:44,074   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-02-15T09:02:44,075 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/
2023-02-15T09:02:44,075 Skipping link: not a file: https://pypi.org/simple/colossalai/
2023-02-15T09:02:44,110 Given no hashes to check 1 links for project 'colossalai': discarding no candidates
2023-02-15T09:02:44,140 Collecting colossalai==0.2.5
2023-02-15T09:02:44,144   Created temporary directory: /tmp/pip-unpack-wlw54zd3
2023-02-15T09:02:44,431   Downloading colossalai-0.2.5.tar.gz (674 kB)
2023-02-15T09:02:47,586   Added colossalai==0.2.5 from https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz to build tracker '/tmp/pip-build-tracker-wqq850vi'
2023-02-15T09:02:47,589   Running setup.py (path:/tmp/pip-wheel-up5t3c9w/colossalai_96b8446da99a489ebf7ddc9b18687594/setup.py) egg_info for package colossalai
2023-02-15T09:02:47,591   Created temporary directory: /tmp/pip-pip-egg-info-49c9jp7t
2023-02-15T09:02:47,591   Preparing metadata (setup.py): started
2023-02-15T09:02:47,593   Running command python setup.py egg_info
2023-02-15T09:02:50,374   running egg_info
2023-02-15T09:02:50,378   creating /tmp/pip-pip-egg-info-49c9jp7t/colossalai.egg-info
2023-02-15T09:02:50,441   writing /tmp/pip-pip-egg-info-49c9jp7t/colossalai.egg-info/PKG-INFO
2023-02-15T09:02:50,447   writing dependency_links to /tmp/pip-pip-egg-info-49c9jp7t/colossalai.egg-info/dependency_links.txt
2023-02-15T09:02:50,450   writing entry points to /tmp/pip-pip-egg-info-49c9jp7t/colossalai.egg-info/entry_points.txt
2023-02-15T09:02:50,453   writing requirements to /tmp/pip-pip-egg-info-49c9jp7t/colossalai.egg-info/requires.txt
2023-02-15T09:02:50,455   writing top-level names to /tmp/pip-pip-egg-info-49c9jp7t/colossalai.egg-info/top_level.txt
2023-02-15T09:02:50,458   writing manifest file '/tmp/pip-pip-egg-info-49c9jp7t/colossalai.egg-info/SOURCES.txt'
2023-02-15T09:02:50,854   reading manifest file '/tmp/pip-pip-egg-info-49c9jp7t/colossalai.egg-info/SOURCES.txt'
2023-02-15T09:02:50,857   reading manifest template 'MANIFEST.in'
2023-02-15T09:02:52,836   warning: no files found matching '*.tr' under directory 'colossalai'
2023-02-15T09:02:53,815   warning: no files found matching '*.cc' under directory 'colossalai'
2023-02-15T09:02:54,302   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-02-15T09:02:54,320   adding license file 'LICENSE'
2023-02-15T09:02:54,386   writing manifest file '/tmp/pip-pip-egg-info-49c9jp7t/colossalai.egg-info/SOURCES.txt'
2023-02-15T09:02:54,604   Preparing metadata (setup.py): finished with status 'done'
2023-02-15T09:02:54,620   Source in /tmp/pip-wheel-up5t3c9w/colossalai_96b8446da99a489ebf7ddc9b18687594 has version 0.2.5, which satisfies requirement colossalai==0.2.5 from https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz
2023-02-15T09:02:54,622   Removed colossalai==0.2.5 from https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz from build tracker '/tmp/pip-build-tracker-wqq850vi'
2023-02-15T09:02:54,640 Created temporary directory: /tmp/pip-unpack-a2l061hu
2023-02-15T09:02:54,642 Building wheels for collected packages: colossalai
2023-02-15T09:02:54,651   Created temporary directory: /tmp/pip-wheel-6zrayzcm
2023-02-15T09:02:54,652   Building wheel for colossalai (setup.py): started
2023-02-15T09:02:54,654   Destination directory: /tmp/pip-wheel-6zrayzcm
2023-02-15T09:02:54,654   Running command python setup.py bdist_wheel
2023-02-15T09:02:57,318   running bdist_wheel
2023-02-15T09:02:58,077   running build
2023-02-15T09:02:58,078   running build_py
2023-02-15T09:02:58,149   creating build
2023-02-15T09:02:58,151   creating build/lib
2023-02-15T09:02:58,152   creating build/lib/op_builder
2023-02-15T09:02:58,155   copying op_builder/cpu_adam.py -> build/lib/op_builder
2023-02-15T09:02:58,158   copying op_builder/__init__.py -> build/lib/op_builder
2023-02-15T09:02:58,161   copying op_builder/scaled_masked_softmax.py -> build/lib/op_builder
2023-02-15T09:02:58,164   copying op_builder/moe.py -> build/lib/op_builder
2023-02-15T09:02:58,167   copying op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/op_builder
2023-02-15T09:02:58,169   copying op_builder/builder.py -> build/lib/op_builder
2023-02-15T09:02:58,173   copying op_builder/multi_head_attn.py -> build/lib/op_builder
2023-02-15T09:02:58,176   copying op_builder/utils.py -> build/lib/op_builder
2023-02-15T09:02:58,178   copying op_builder/layernorm.py -> build/lib/op_builder
2023-02-15T09:02:58,181   copying op_builder/fused_optim.py -> build/lib/op_builder
2023-02-15T09:02:58,186   creating build/lib/colossalai
2023-02-15T09:02:58,187   copying colossalai/__init__.py -> build/lib/colossalai
2023-02-15T09:02:58,190   copying colossalai/constants.py -> build/lib/colossalai
2023-02-15T09:02:58,193   copying colossalai/core.py -> build/lib/colossalai
2023-02-15T09:02:58,196   copying colossalai/initialize.py -> build/lib/colossalai
2023-02-15T09:02:58,201   copying colossalai/version.py -> build/lib/colossalai
2023-02-15T09:02:58,203   copying colossalai/global_variables.py -> build/lib/colossalai
2023-02-15T09:02:58,208   creating build/lib/colossalai/engine
2023-02-15T09:02:58,209   copying colossalai/engine/__init__.py -> build/lib/colossalai/engine
2023-02-15T09:02:58,213   copying colossalai/engine/_base_engine.py -> build/lib/colossalai/engine
2023-02-15T09:02:58,218   creating build/lib/colossalai/context
2023-02-15T09:02:58,219   copying colossalai/context/moe_context.py -> build/lib/colossalai/context
2023-02-15T09:02:58,223   copying colossalai/context/__init__.py -> build/lib/colossalai/context
2023-02-15T09:02:58,226   copying colossalai/context/config.py -> build/lib/colossalai/context
2023-02-15T09:02:58,229   copying colossalai/context/parallel_context.py -> build/lib/colossalai/context
2023-02-15T09:02:58,234   copying colossalai/context/parallel_mode.py -> build/lib/colossalai/context
2023-02-15T09:02:58,238   copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context
2023-02-15T09:02:58,243   creating build/lib/colossalai/trainer
2023-02-15T09:02:58,244   copying colossalai/trainer/__init__.py -> build/lib/colossalai/trainer
2023-02-15T09:02:58,248   copying colossalai/trainer/_trainer.py -> build/lib/colossalai/trainer
2023-02-15T09:02:58,253   creating build/lib/colossalai/builder
2023-02-15T09:02:58,254   copying colossalai/builder/__init__.py -> build/lib/colossalai/builder
2023-02-15T09:02:58,257   copying colossalai/builder/builder.py -> build/lib/colossalai/builder
2023-02-15T09:02:58,262   creating build/lib/colossalai/_C
2023-02-15T09:02:58,263   copying colossalai/_C/__init__.py -> build/lib/colossalai/_C
2023-02-15T09:02:58,267   creating build/lib/colossalai/registry
2023-02-15T09:02:58,268   copying colossalai/registry/__init__.py -> build/lib/colossalai/registry
2023-02-15T09:02:58,272   copying colossalai/registry/registry.py -> build/lib/colossalai/registry
2023-02-15T09:02:58,276   creating build/lib/colossalai/logging
2023-02-15T09:02:58,277   copying colossalai/logging/logger.py -> build/lib/colossalai/logging
2023-02-15T09:02:58,281   copying colossalai/logging/__init__.py -> build/lib/colossalai/logging
2023-02-15T09:02:58,286   creating build/lib/colossalai/auto_parallel
2023-02-15T09:02:58,287   copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel
2023-02-15T09:02:58,291   creating build/lib/colossalai/gemini
2023-02-15T09:02:58,293   copying colossalai/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/gemini
2023-02-15T09:02:58,296   copying colossalai/gemini/__init__.py -> build/lib/colossalai/gemini
2023-02-15T09:02:58,299   copying colossalai/gemini/gemini_mgr.py -> build/lib/colossalai/gemini
2023-02-15T09:02:58,303   copying colossalai/gemini/gemini_context.py -> build/lib/colossalai/gemini
2023-02-15T09:02:58,306   copying colossalai/gemini/placement_policy.py -> build/lib/colossalai/gemini
2023-02-15T09:02:58,310   copying colossalai/gemini/stateful_tensor.py -> build/lib/colossalai/gemini
2023-02-15T09:02:58,314   copying colossalai/gemini/tensor_utils.py -> build/lib/colossalai/gemini
2023-02-15T09:02:58,317   copying colossalai/gemini/tensor_placement_policy.py -> build/lib/colossalai/gemini
2023-02-15T09:02:58,322   creating build/lib/colossalai/nn
2023-02-15T09:02:58,323   copying colossalai/nn/__init__.py -> build/lib/colossalai/nn
2023-02-15T09:02:58,326   copying colossalai/nn/init.py -> build/lib/colossalai/nn
2023-02-15T09:02:58,332   creating build/lib/colossalai/zero
2023-02-15T09:02:58,333   copying colossalai/zero/__init__.py -> build/lib/colossalai/zero
2023-02-15T09:02:58,337   creating build/lib/colossalai/amp
2023-02-15T09:02:58,339   copying colossalai/amp/__init__.py -> build/lib/colossalai/amp
2023-02-15T09:02:58,342   copying colossalai/amp/amp_type.py -> build/lib/colossalai/amp
2023-02-15T09:02:58,347   creating build/lib/colossalai/utils
2023-02-15T09:02:58,349   copying colossalai/utils/__init__.py -> build/lib/colossalai/utils
2023-02-15T09:02:58,352   copying colossalai/utils/moe.py -> build/lib/colossalai/utils
2023-02-15T09:02:58,356   copying colossalai/utils/timer.py -> build/lib/colossalai/utils
2023-02-15T09:02:58,359   copying colossalai/utils/cuda.py -> build/lib/colossalai/utils
2023-02-15T09:02:58,363   copying colossalai/utils/common.py -> build/lib/colossalai/utils
2023-02-15T09:02:58,368   copying colossalai/utils/checkpointing.py -> build/lib/colossalai/utils
2023-02-15T09:02:58,373   copying colossalai/utils/memory.py -> build/lib/colossalai/utils
2023-02-15T09:02:58,377   copying colossalai/utils/activation_checkpoint.py -> build/lib/colossalai/utils
2023-02-15T09:02:58,382   creating build/lib/colossalai/communication
2023-02-15T09:02:58,384   copying colossalai/communication/__init__.py -> build/lib/colossalai/communication
2023-02-15T09:02:58,387   copying colossalai/communication/p2p_v2.py -> build/lib/colossalai/communication
2023-02-15T09:02:58,391   copying colossalai/communication/ring.py -> build/lib/colossalai/communication
2023-02-15T09:02:58,395   copying colossalai/communication/p2p.py -> build/lib/colossalai/communication
2023-02-15T09:02:58,399   copying colossalai/communication/collective.py -> build/lib/colossalai/communication
2023-02-15T09:02:58,404   copying colossalai/communication/utils.py -> build/lib/colossalai/communication
2023-02-15T09:02:58,409   creating build/lib/colossalai/kernel
2023-02-15T09:02:58,410   copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel
2023-02-15T09:02:58,415   creating build/lib/colossalai/device
2023-02-15T09:02:58,417   copying colossalai/device/__init__.py -> build/lib/colossalai/device
2023-02-15T09:02:58,420   copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device
2023-02-15T09:02:58,424   copying colossalai/device/device_mesh.py -> build/lib/colossalai/device
2023-02-15T09:02:58,429   copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device
2023-02-15T09:02:58,435   creating build/lib/colossalai/fx
2023-02-15T09:02:58,436   copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx
2023-02-15T09:02:58,441   copying colossalai/fx/__init__.py -> build/lib/colossalai/fx
2023-02-15T09:02:58,444   copying colossalai/fx/_meta_registrations.py -> build/lib/colossalai/fx
2023-02-15T09:02:58,449   copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx
2023-02-15T09:02:58,452   copying colossalai/fx/proxy.py -> build/lib/colossalai/fx
2023-02-15T09:02:58,457   creating build/lib/colossalai/testing
2023-02-15T09:02:58,458   copying colossalai/testing/__init__.py -> build/lib/colossalai/testing
2023-02-15T09:02:58,462   copying colossalai/testing/comparison.py -> build/lib/colossalai/testing
2023-02-15T09:02:58,465   copying colossalai/testing/utils.py -> build/lib/colossalai/testing
2023-02-15T09:02:58,470   copying colossalai/testing/random.py -> build/lib/colossalai/testing
2023-02-15T09:02:58,473   copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing
2023-02-15T09:02:58,478   creating build/lib/colossalai/pipeline
2023-02-15T09:02:58,480   copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline
2023-02-15T09:02:58,484   copying colossalai/pipeline/utils.py -> build/lib/colossalai/pipeline
2023-02-15T09:02:58,488   copying colossalai/pipeline/pipelinable.py -> build/lib/colossalai/pipeline
2023-02-15T09:02:58,493   copying colossalai/pipeline/layer_spec.py -> build/lib/colossalai/pipeline
2023-02-15T09:02:58,496   copying colossalai/pipeline/pipeline_process_group.py -> build/lib/colossalai/pipeline
2023-02-15T09:02:58,501   creating build/lib/colossalai/cli
2023-02-15T09:02:58,503   copying colossalai/cli/__init__.py -> build/lib/colossalai/cli
2023-02-15T09:02:58,506   copying colossalai/cli/cli.py -> build/lib/colossalai/cli
2023-02-15T09:02:58,512   creating build/lib/colossalai/tensor
2023-02-15T09:02:58,515   copying colossalai/tensor/const.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,518   copying colossalai/tensor/dist_spec_mgr.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,523   copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,526   copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,530   copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,535   copying colossalai/tensor/distspec.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,539   copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,543   copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,547   copying colossalai/tensor/compute_spec.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,551   copying colossalai/tensor/tensor_spec.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,554   copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,560   copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,564   copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,571   copying colossalai/tensor/op_wrapper.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,575   copying colossalai/tensor/process_group.py -> build/lib/colossalai/tensor
2023-02-15T09:02:58,580   creating build/lib/colossalai/engine/schedule
2023-02-15T09:02:58,582   copying colossalai/engine/schedule/__init__.py -> build/lib/colossalai/engine/schedule
2023-02-15T09:02:58,586   copying colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/engine/schedule
2023-02-15T09:02:58,589   copying colossalai/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/engine/schedule
2023-02-15T09:02:58,593   copying colossalai/engine/schedule/_base_schedule.py -> build/lib/colossalai/engine/schedule
2023-02-15T09:02:58,597   copying colossalai/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/engine/schedule
2023-02-15T09:02:58,606   creating build/lib/colossalai/engine/gradient_handler
2023-02-15T09:02:58,608   copying colossalai/engine/gradient_handler/__init__.py -> build/lib/colossalai/engine/gradient_handler
2023-02-15T09:02:58,611   copying colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-15T09:02:58,615   copying colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-15T09:02:58,618   copying colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-15T09:02:58,621   copying colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-15T09:02:58,625   copying colossalai/engine/gradient_handler/utils.py -> build/lib/colossalai/engine/gradient_handler
2023-02-15T09:02:58,628   copying colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-15T09:02:58,631   copying colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-15T09:02:58,636   creating build/lib/colossalai/engine/gradient_accumulation
2023-02-15T09:02:58,638   copying colossalai/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/engine/gradient_accumulation
2023-02-15T09:02:58,641   copying colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/engine/gradient_accumulation
2023-02-15T09:02:58,648   creating build/lib/colossalai/context/process_group_initializer
2023-02-15T09:02:58,649   copying colossalai/context/process_group_initializer/__init__.py -> build/lib/colossalai/context/process_group_initializer
2023-02-15T09:02:58,653   copying colossalai/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-15T09:02:58,658   copying colossalai/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/context/process_group_initializer
2023-02-15T09:02:58,661   copying colossalai/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-15T09:02:58,666   copying colossalai/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/context/process_group_initializer
2023-02-15T09:02:58,669   copying colossalai/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-15T09:02:58,673   copying colossalai/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/context/process_group_initializer
2023-02-15T09:02:58,677   copying colossalai/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/context/process_group_initializer
2023-02-15T09:02:58,680   copying colossalai/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-15T09:02:58,683   copying colossalai/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/context/process_group_initializer
2023-02-15T09:02:58,686   copying colossalai/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/context/process_group_initializer
2023-02-15T09:02:58,691   creating build/lib/colossalai/context/random
2023-02-15T09:02:58,693   copying colossalai/context/random/__init__.py -> build/lib/colossalai/context/random
2023-02-15T09:02:58,696   copying colossalai/context/random/seed_manager.py -> build/lib/colossalai/context/random
2023-02-15T09:02:58,700   copying colossalai/context/random/_helper.py -> build/lib/colossalai/context/random
2023-02-15T09:02:58,706   creating build/lib/colossalai/trainer/hooks
2023-02-15T09:02:58,707   copying colossalai/trainer/hooks/__init__.py -> build/lib/colossalai/trainer/hooks
2023-02-15T09:02:58,711   copying colossalai/trainer/hooks/_metric_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-15T09:02:58,716   copying colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-15T09:02:58,719   copying colossalai/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-15T09:02:58,723   copying colossalai/trainer/hooks/_commons_.py -> build/lib/colossalai/trainer/hooks
2023-02-15T09:02:58,726   copying colossalai/trainer/hooks/_base_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-15T09:02:58,730   copying colossalai/trainer/hooks/_log_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-15T09:02:58,736   creating build/lib/colossalai/auto_parallel/tensor_shard
2023-02-15T09:02:58,737   copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-15T09:02:58,740   copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-15T09:02:58,744   copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-15T09:02:58,748   copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-15T09:02:58,752   copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-15T09:02:58,757   creating build/lib/colossalai/auto_parallel/pipeline_shard
2023-02-15T09:02:58,758   copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard
2023-02-15T09:02:58,762   creating build/lib/colossalai/auto_parallel/meta_profiler
2023-02-15T09:02:58,764   copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-15T09:02:58,767   copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-15T09:02:58,771   copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-15T09:02:58,774   copying colossalai/auto_parallel/meta_profiler/metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-15T09:02:58,779   creating build/lib/colossalai/auto_parallel/passes
2023-02-15T09:02:58,781   copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes
2023-02-15T09:02:58,784   copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes
2023-02-15T09:02:58,787   copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-02-15T09:02:58,791   copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes
2023-02-15T09:02:58,795   copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-02-15T09:02:58,800   copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-02-15T09:02:58,806   creating build/lib/colossalai/auto_parallel/checkpoint
2023-02-15T09:02:58,807   copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-15T09:02:58,812   copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-15T09:02:58,816   copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-15T09:02:58,819   copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-15T09:02:58,822   copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-15T09:02:58,826   copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-15T09:02:58,831   creating build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-15T09:02:58,832   copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-15T09:02:58,838   copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-15T09:02:58,841   copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-15T09:02:58,845   copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-15T09:02:58,849   copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-15T09:02:58,858   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,859   copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,863   copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,866   copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,870   copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,874   copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,877   copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,880   copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,883   copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,887   copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,890   copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,893   copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,896   copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,899   copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,903   copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,907   copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,911   copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,915   copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,918   copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,921   copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,925   copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,929   copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,932   copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,936   copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,940   copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,943   copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,948   copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,953   copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:02:58,962   creating build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:02:58,964   copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:02:58,968   copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:02:58,972   copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:02:58,976   copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:02:58,981   copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:02:58,985   copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:02:58,993   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:58,995   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,001   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,004   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,009   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,012   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,016   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,020   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,024   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,028   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,032   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,036   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,039   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,043   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,048   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,052   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,055   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,059   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,062   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,068   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:02:59,073   creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:02:59,074   copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:02:59,078   copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:02:59,081   copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:02:59,086   copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:02:59,090   copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:02:59,094   copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:02:59,098   copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:02:59,103   creating build/lib/colossalai/gemini/paramhooks
2023-02-15T09:02:59,104   copying colossalai/gemini/paramhooks/__init__.py -> build/lib/colossalai/gemini/paramhooks
2023-02-15T09:02:59,108   copying colossalai/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/gemini/paramhooks
2023-02-15T09:02:59,113   creating build/lib/colossalai/gemini/memory_tracer
2023-02-15T09:02:59,115   copying colossalai/gemini/memory_tracer/__init__.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-15T09:02:59,118   copying colossalai/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-15T09:02:59,122   copying colossalai/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-15T09:02:59,125   copying colossalai/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-15T09:02:59,129   copying colossalai/gemini/memory_tracer/utils.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-15T09:02:59,132   copying colossalai/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-15T09:02:59,135   copying colossalai/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-15T09:02:59,138   copying colossalai/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-15T09:02:59,142   copying colossalai/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-15T09:02:59,147   creating build/lib/colossalai/gemini/chunk
2023-02-15T09:02:59,148   copying colossalai/gemini/chunk/__init__.py -> build/lib/colossalai/gemini/chunk
2023-02-15T09:02:59,151   copying colossalai/gemini/chunk/chunk.py -> build/lib/colossalai/gemini/chunk
2023-02-15T09:02:59,156   copying colossalai/gemini/chunk/utils.py -> build/lib/colossalai/gemini/chunk
2023-02-15T09:02:59,159   copying colossalai/gemini/chunk/manager.py -> build/lib/colossalai/gemini/chunk
2023-02-15T09:02:59,164   copying colossalai/gemini/chunk/search_utils.py -> build/lib/colossalai/gemini/chunk
2023-02-15T09:02:59,169   creating build/lib/colossalai/gemini/ophooks
2023-02-15T09:02:59,170   copying colossalai/gemini/ophooks/__init__.py -> build/lib/colossalai/gemini/ophooks
2023-02-15T09:02:59,174   copying colossalai/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/gemini/ophooks
2023-02-15T09:02:59,177   copying colossalai/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/gemini/ophooks
2023-02-15T09:02:59,180   copying colossalai/gemini/ophooks/utils.py -> build/lib/colossalai/gemini/ophooks
2023-02-15T09:02:59,184   copying colossalai/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/gemini/ophooks
2023-02-15T09:02:59,189   creating build/lib/colossalai/nn/_ops
2023-02-15T09:02:59,191   copying colossalai/nn/_ops/loss.py -> build/lib/colossalai/nn/_ops
2023-02-15T09:02:59,195   copying colossalai/nn/_ops/__init__.py -> build/lib/colossalai/nn/_ops
2023-02-15T09:02:59,198   copying colossalai/nn/_ops/linear.py -> build/lib/colossalai/nn/_ops
2023-02-15T09:02:59,201   copying colossalai/nn/_ops/embedding_bag.py -> build/lib/colossalai/nn/_ops
2023-02-15T09:02:59,205   copying colossalai/nn/_ops/view.py -> build/lib/colossalai/nn/_ops
2023-02-15T09:02:59,208   copying colossalai/nn/_ops/batch_norm.py -> build/lib/colossalai/nn/_ops
2023-02-15T09:02:59,211   copying colossalai/nn/_ops/addmm.py -> build/lib/colossalai/nn/_ops
2023-02-15T09:02:59,215   copying colossalai/nn/_ops/element_wise.py -> build/lib/colossalai/nn/_ops
2023-02-15T09:02:59,219   copying colossalai/nn/_ops/layernorm.py -> build/lib/colossalai/nn/_ops
2023-02-15T09:02:59,222   copying colossalai/nn/_ops/embedding.py -> build/lib/colossalai/nn/_ops
2023-02-15T09:02:59,226   copying colossalai/nn/_ops/_utils.py -> build/lib/colossalai/nn/_ops
2023-02-15T09:02:59,232   creating build/lib/colossalai/nn/parallel
2023-02-15T09:02:59,234   copying colossalai/nn/parallel/gemini_parallel.py -> build/lib/colossalai/nn/parallel
2023-02-15T09:02:59,237   copying colossalai/nn/parallel/__init__.py -> build/lib/colossalai/nn/parallel
2023-02-15T09:02:59,241   copying colossalai/nn/parallel/utils.py -> build/lib/colossalai/nn/parallel
2023-02-15T09:02:59,245   copying colossalai/nn/parallel/data_parallel.py -> build/lib/colossalai/nn/parallel
2023-02-15T09:02:59,250   copying colossalai/nn/parallel/reducer.py -> build/lib/colossalai/nn/parallel
2023-02-15T09:02:59,253   copying colossalai/nn/parallel/zero_wrapper.py -> build/lib/colossalai/nn/parallel
2023-02-15T09:02:59,259   creating build/lib/colossalai/nn/loss
2023-02-15T09:02:59,260   copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss
2023-02-15T09:02:59,264   copying colossalai/nn/loss/loss_2d.py -> build/lib/colossalai/nn/loss
2023-02-15T09:02:59,268   copying colossalai/nn/loss/loss_moe.py -> build/lib/colossalai/nn/loss
2023-02-15T09:02:59,272   copying colossalai/nn/loss/loss_2p5d.py -> build/lib/colossalai/nn/loss
2023-02-15T09:02:59,277   copying colossalai/nn/loss/loss_3d.py -> build/lib/colossalai/nn/loss
2023-02-15T09:02:59,282   copying colossalai/nn/loss/loss_1d.py -> build/lib/colossalai/nn/loss
2023-02-15T09:02:59,287   creating build/lib/colossalai/nn/lr_scheduler
2023-02-15T09:02:59,289   copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-15T09:02:59,293   copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-15T09:02:59,296   copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-15T09:02:59,299   copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-15T09:02:59,303   copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-15T09:02:59,306   copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-15T09:02:59,309   copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-15T09:02:59,314   copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-15T09:02:59,319   creating build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,321   copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,325   copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,329   copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,334   copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,337   copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,340   copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,345   copying colossalai/nn/optimizer/gemini_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,348   copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,352   copying colossalai/nn/optimizer/colossalai_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,355   copying colossalai/nn/optimizer/zero_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,360   copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,364   copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer
2023-02-15T09:02:59,369   creating build/lib/colossalai/nn/layer
2023-02-15T09:02:59,370   copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer
2023-02-15T09:02:59,374   copying colossalai/nn/layer/base_layer.py -> build/lib/colossalai/nn/layer
2023-02-15T09:02:59,378   creating build/lib/colossalai/nn/metric
2023-02-15T09:02:59,380   copying colossalai/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/nn/metric
2023-02-15T09:02:59,383   copying colossalai/nn/metric/__init__.py -> build/lib/colossalai/nn/metric
2023-02-15T09:02:59,386   copying colossalai/nn/metric/accuracy_2d.py -> build/lib/colossalai/nn/metric
2023-02-15T09:02:59,389   copying colossalai/nn/metric/accuracy_3d.py -> build/lib/colossalai/nn/metric
2023-02-15T09:02:59,392   copying colossalai/nn/metric/_utils.py -> build/lib/colossalai/nn/metric
2023-02-15T09:02:59,397   creating build/lib/colossalai/nn/parallel/layers
2023-02-15T09:02:59,398   copying colossalai/nn/parallel/layers/__init__.py -> build/lib/colossalai/nn/parallel/layers
2023-02-15T09:02:59,402   copying colossalai/nn/parallel/layers/linear.py -> build/lib/colossalai/nn/parallel/layers
2023-02-15T09:02:59,405   copying colossalai/nn/parallel/layers/module_utils.py -> build/lib/colossalai/nn/parallel/layers
2023-02-15T09:02:59,410   copying colossalai/nn/parallel/layers/colo_module.py -> build/lib/colossalai/nn/parallel/layers
2023-02-15T09:02:59,413   copying colossalai/nn/parallel/layers/embedding.py -> build/lib/colossalai/nn/parallel/layers
2023-02-15T09:02:59,419   creating build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:02:59,421   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:02:59,425   copying colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:02:59,428   copying colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:02:59,432   copying colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:02:59,436   copying colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:02:59,439   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:02:59,444   copying colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:02:59,447   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:02:59,451   copying colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:02:59,458   creating build/lib/colossalai/nn/layer/parallel_2d
2023-02-15T09:02:59,459   copying colossalai/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-15T09:02:59,466   copying colossalai/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-15T09:02:59,469   copying colossalai/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-15T09:02:59,474   copying colossalai/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-15T09:02:59,479   creating build/lib/colossalai/nn/layer/colossalai_layer
2023-02-15T09:02:59,481   copying colossalai/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-15T09:02:59,484   copying colossalai/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-15T09:02:59,488   copying colossalai/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-15T09:02:59,491   copying colossalai/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-15T09:02:59,494   copying colossalai/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-15T09:02:59,498   copying colossalai/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-15T09:02:59,502   creating build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-15T09:02:59,503   copying colossalai/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-15T09:02:59,509   copying colossalai/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-15T09:02:59,513   copying colossalai/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-15T09:02:59,518   copying colossalai/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-15T09:02:59,523   creating build/lib/colossalai/nn/layer/utils
2023-02-15T09:02:59,524   copying colossalai/nn/layer/utils/__init__.py -> build/lib/colossalai/nn/layer/utils
2023-02-15T09:02:59,527   copying colossalai/nn/layer/utils/common.py -> build/lib/colossalai/nn/layer/utils
2023-02-15T09:02:59,532   creating build/lib/colossalai/nn/layer/parallel_3d
2023-02-15T09:02:59,533   copying colossalai/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-15T09:02:59,540   copying colossalai/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-15T09:02:59,544   copying colossalai/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-15T09:02:59,548   copying colossalai/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-15T09:02:59,553   creating build/lib/colossalai/nn/layer/moe
2023-02-15T09:02:59,555   copying colossalai/nn/layer/moe/layers.py -> build/lib/colossalai/nn/layer/moe
2023-02-15T09:02:59,559   copying colossalai/nn/layer/moe/__init__.py -> build/lib/colossalai/nn/layer/moe
2023-02-15T09:02:59,562   copying colossalai/nn/layer/moe/experts.py -> build/lib/colossalai/nn/layer/moe
2023-02-15T09:02:59,566   copying colossalai/nn/layer/moe/utils.py -> build/lib/colossalai/nn/layer/moe
2023-02-15T09:02:59,569   copying colossalai/nn/layer/moe/routers.py -> build/lib/colossalai/nn/layer/moe
2023-02-15T09:02:59,572   copying colossalai/nn/layer/moe/_operation.py -> build/lib/colossalai/nn/layer/moe
2023-02-15T09:02:59,578   creating build/lib/colossalai/nn/layer/parallel_sequence
2023-02-15T09:02:59,579   copying colossalai/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-15T09:02:59,583   copying colossalai/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-15T09:02:59,586   copying colossalai/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-15T09:02:59,590   copying colossalai/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-15T09:02:59,595   creating build/lib/colossalai/nn/layer/parallel_1d
2023-02-15T09:02:59,596   copying colossalai/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-15T09:02:59,603   copying colossalai/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-15T09:02:59,606   copying colossalai/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-15T09:02:59,609   copying colossalai/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-15T09:02:59,614   creating build/lib/colossalai/nn/layer/wrapper
2023-02-15T09:02:59,616   copying colossalai/nn/layer/wrapper/__init__.py -> build/lib/colossalai/nn/layer/wrapper
2023-02-15T09:02:59,619   copying colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/nn/layer/wrapper
2023-02-15T09:02:59,623   creating build/lib/colossalai/nn/layer/vanilla
2023-02-15T09:02:59,625   copying colossalai/nn/layer/vanilla/layers.py -> build/lib/colossalai/nn/layer/vanilla
2023-02-15T09:02:59,629   copying colossalai/nn/layer/vanilla/__init__.py -> build/lib/colossalai/nn/layer/vanilla
2023-02-15T09:02:59,634   creating build/lib/colossalai/zero/sharded_model
2023-02-15T09:02:59,635   copying colossalai/zero/sharded_model/__init__.py -> build/lib/colossalai/zero/sharded_model
2023-02-15T09:02:59,639   copying colossalai/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/zero/sharded_model
2023-02-15T09:02:59,643   copying colossalai/zero/sharded_model/utils.py -> build/lib/colossalai/zero/sharded_model
2023-02-15T09:02:59,646   copying colossalai/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/zero/sharded_model
2023-02-15T09:02:59,651   copying colossalai/zero/sharded_model/_utils.py -> build/lib/colossalai/zero/sharded_model
2023-02-15T09:02:59,656   creating build/lib/colossalai/zero/shard_utils
2023-02-15T09:02:59,658   copying colossalai/zero/shard_utils/__init__.py -> build/lib/colossalai/zero/shard_utils
2023-02-15T09:02:59,661   copying colossalai/zero/shard_utils/commons.py -> build/lib/colossalai/zero/shard_utils
2023-02-15T09:02:59,664   copying colossalai/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-02-15T09:02:59,667   copying colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-02-15T09:02:59,671   copying colossalai/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-02-15T09:02:59,676   creating build/lib/colossalai/zero/sharded_optim
2023-02-15T09:02:59,677   copying colossalai/zero/sharded_optim/__init__.py -> build/lib/colossalai/zero/sharded_optim
2023-02-15T09:02:59,681   copying colossalai/zero/sharded_optim/low_level_optim.py -> build/lib/colossalai/zero/sharded_optim
2023-02-15T09:02:59,686   copying colossalai/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/zero/sharded_optim
2023-02-15T09:02:59,690   copying colossalai/zero/sharded_optim/_utils.py -> build/lib/colossalai/zero/sharded_optim
2023-02-15T09:02:59,696   creating build/lib/colossalai/zero/init_ctx
2023-02-15T09:02:59,697   copying colossalai/zero/init_ctx/__init__.py -> build/lib/colossalai/zero/init_ctx
2023-02-15T09:02:59,700   copying colossalai/zero/init_ctx/init_context.py -> build/lib/colossalai/zero/init_ctx
2023-02-15T09:02:59,706   creating build/lib/colossalai/zero/utils
2023-02-15T09:02:59,707   copying colossalai/zero/utils/__init__.py -> build/lib/colossalai/zero/utils
2023-02-15T09:02:59,711   copying colossalai/zero/utils/zero_hook.py -> build/lib/colossalai/zero/utils
2023-02-15T09:02:59,715   copying colossalai/zero/utils/gemini_hook.py -> build/lib/colossalai/zero/utils
2023-02-15T09:02:59,719   creating build/lib/colossalai/zero/sharded_param
2023-02-15T09:02:59,721   copying colossalai/zero/sharded_param/sharded_param.py -> build/lib/colossalai/zero/sharded_param
2023-02-15T09:02:59,725   copying colossalai/zero/sharded_param/__init__.py -> build/lib/colossalai/zero/sharded_param
2023-02-15T09:02:59,728   copying colossalai/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/zero/sharded_param
2023-02-15T09:02:59,733   creating build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:02:59,736   copying colossalai/zero/sharded_optim/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:02:59,739   copying colossalai/zero/sharded_optim/bookkeeping/__init__.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:02:59,743   copying colossalai/zero/sharded_optim/bookkeeping/base_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:02:59,747   copying colossalai/zero/sharded_optim/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:02:59,751   copying colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:02:59,755   copying colossalai/zero/sharded_optim/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:02:59,760   creating build/lib/colossalai/amp/apex_amp
2023-02-15T09:02:59,762   copying colossalai/amp/apex_amp/__init__.py -> build/lib/colossalai/amp/apex_amp
2023-02-15T09:02:59,766   copying colossalai/amp/apex_amp/apex_amp.py -> build/lib/colossalai/amp/apex_amp
2023-02-15T09:02:59,771   creating build/lib/colossalai/amp/naive_amp
2023-02-15T09:02:59,773   copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp
2023-02-15T09:02:59,777   copying colossalai/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/amp/naive_amp
2023-02-15T09:02:59,781   copying colossalai/amp/naive_amp/naive_amp.py -> build/lib/colossalai/amp/naive_amp
2023-02-15T09:02:59,785   copying colossalai/amp/naive_amp/_utils.py -> build/lib/colossalai/amp/naive_amp
2023-02-15T09:02:59,790   creating build/lib/colossalai/amp/torch_amp
2023-02-15T09:02:59,792   copying colossalai/amp/torch_amp/__init__.py -> build/lib/colossalai/amp/torch_amp
2023-02-15T09:02:59,796   copying colossalai/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/amp/torch_amp
2023-02-15T09:02:59,802   copying colossalai/amp/torch_amp/torch_amp.py -> build/lib/colossalai/amp/torch_amp
2023-02-15T09:02:59,807   creating build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-15T09:02:59,809   copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-15T09:02:59,812   copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-15T09:02:59,817   copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-15T09:02:59,820   copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-15T09:02:59,824   creating build/lib/colossalai/utils/data_sampler
2023-02-15T09:02:59,826   copying colossalai/utils/data_sampler/__init__.py -> build/lib/colossalai/utils/data_sampler
2023-02-15T09:02:59,829   copying colossalai/utils/data_sampler/base_sampler.py -> build/lib/colossalai/utils/data_sampler
2023-02-15T09:02:59,832   copying colossalai/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/utils/data_sampler
2023-02-15T09:02:59,838   creating build/lib/colossalai/utils/tensor_detector
2023-02-15T09:02:59,839   copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector
2023-02-15T09:02:59,843   copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector
2023-02-15T09:02:59,850   creating build/lib/colossalai/utils/rank_recorder
2023-02-15T09:02:59,851   copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder
2023-02-15T09:02:59,855   copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder
2023-02-15T09:02:59,860   creating build/lib/colossalai/utils/multi_tensor_apply
2023-02-15T09:02:59,862   copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-02-15T09:02:59,865   copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-02-15T09:02:59,870   creating build/lib/colossalai/utils/profiler
2023-02-15T09:02:59,871   copying colossalai/utils/profiler/__init__.py -> build/lib/colossalai/utils/profiler
2023-02-15T09:02:59,875   copying colossalai/utils/profiler/extention.py -> build/lib/colossalai/utils/profiler
2023-02-15T09:02:59,878   copying colossalai/utils/profiler/profiler.py -> build/lib/colossalai/utils/profiler
2023-02-15T09:02:59,882   copying colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/utils/profiler
2023-02-15T09:02:59,887   creating build/lib/colossalai/utils/model
2023-02-15T09:02:59,888   copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model
2023-02-15T09:02:59,891   copying colossalai/utils/model/lazy_init_context.py -> build/lib/colossalai/utils/model
2023-02-15T09:02:59,895   copying colossalai/utils/model/colo_init_context.py -> build/lib/colossalai/utils/model
2023-02-15T09:02:59,899   copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model
2023-02-15T09:02:59,903   copying colossalai/utils/model/experimental.py -> build/lib/colossalai/utils/model
2023-02-15T09:02:59,908   creating build/lib/colossalai/utils/checkpoint
2023-02-15T09:02:59,910   copying colossalai/utils/checkpoint/__init__.py -> build/lib/colossalai/utils/checkpoint
2023-02-15T09:02:59,913   copying colossalai/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/utils/checkpoint
2023-02-15T09:02:59,917   copying colossalai/utils/checkpoint/utils.py -> build/lib/colossalai/utils/checkpoint
2023-02-15T09:02:59,923   creating build/lib/colossalai/utils/checkpoint_io
2023-02-15T09:02:59,925   copying colossalai/utils/checkpoint_io/convertor.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-15T09:02:59,929   copying colossalai/utils/checkpoint_io/meta.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-15T09:02:59,932   copying colossalai/utils/checkpoint_io/__init__.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-15T09:02:59,936   copying colossalai/utils/checkpoint_io/io.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-15T09:02:59,940   copying colossalai/utils/checkpoint_io/distributed.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-15T09:02:59,944   copying colossalai/utils/checkpoint_io/utils.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-15T09:02:59,948   copying colossalai/utils/checkpoint_io/backend.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-15T09:02:59,952   copying colossalai/utils/checkpoint_io/reader.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-15T09:02:59,956   copying colossalai/utils/checkpoint_io/writer.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-15T09:02:59,959   copying colossalai/utils/checkpoint_io/constant.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-15T09:02:59,964   creating build/lib/colossalai/utils/profiler/legacy
2023-02-15T09:02:59,965   copying colossalai/utils/profiler/legacy/__init__.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-15T09:02:59,969   copying colossalai/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-15T09:02:59,972   copying colossalai/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-15T09:02:59,977   copying colossalai/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-15T09:02:59,981   creating build/lib/colossalai/kernel/cuda_native
2023-02-15T09:02:59,983   copying colossalai/kernel/cuda_native/__init__.py -> build/lib/colossalai/kernel/cuda_native
2023-02-15T09:02:59,986   copying colossalai/kernel/cuda_native/multihead_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-02-15T09:02:59,990   copying colossalai/kernel/cuda_native/layer_norm.py -> build/lib/colossalai/kernel/cuda_native
2023-02-15T09:02:59,993   copying colossalai/kernel/cuda_native/flash_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-02-15T09:02:59,998   copying colossalai/kernel/cuda_native/scaled_softmax.py -> build/lib/colossalai/kernel/cuda_native
2023-02-15T09:03:00,003   creating build/lib/colossalai/kernel/jit
2023-02-15T09:03:00,005   copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit
2023-02-15T09:03:00,008   copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit
2023-02-15T09:03:00,011   copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit
2023-02-15T09:03:00,015   copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit
2023-02-15T09:03:00,020   creating build/lib/colossalai/kernel/op_builder
2023-02-15T09:03:00,021   copying colossalai/kernel/op_builder/cpu_adam.py -> build/lib/colossalai/kernel/op_builder
2023-02-15T09:03:00,025   copying colossalai/kernel/op_builder/__init__.py -> build/lib/colossalai/kernel/op_builder
2023-02-15T09:03:00,028   copying colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-02-15T09:03:00,031   copying colossalai/kernel/op_builder/moe.py -> build/lib/colossalai/kernel/op_builder
2023-02-15T09:03:00,035   copying colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-02-15T09:03:00,038   copying colossalai/kernel/op_builder/builder.py -> build/lib/colossalai/kernel/op_builder
2023-02-15T09:03:00,042   copying colossalai/kernel/op_builder/multi_head_attn.py -> build/lib/colossalai/kernel/op_builder
2023-02-15T09:03:00,046   copying colossalai/kernel/op_builder/utils.py -> build/lib/colossalai/kernel/op_builder
2023-02-15T09:03:00,050   copying colossalai/kernel/op_builder/layernorm.py -> build/lib/colossalai/kernel/op_builder
2023-02-15T09:03:00,053   copying colossalai/kernel/op_builder/fused_optim.py -> build/lib/colossalai/kernel/op_builder
2023-02-15T09:03:00,057   creating build/lib/colossalai/fx/codegen
2023-02-15T09:03:00,059   copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen
2023-02-15T09:03:00,062   copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen
2023-02-15T09:03:00,069   creating build/lib/colossalai/fx/tracer
2023-02-15T09:03:00,071   copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer
2023-02-15T09:03:00,074   copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer
2023-02-15T09:03:00,077   copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer
2023-02-15T09:03:00,081   copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer
2023-02-15T09:03:00,085   copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer
2023-02-15T09:03:00,090   copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer
2023-02-15T09:03:00,093   copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer
2023-02-15T09:03:00,100   creating build/lib/colossalai/fx/profiler
2023-02-15T09:03:00,101   copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler
2023-02-15T09:03:00,104   copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler
2023-02-15T09:03:00,109   copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler
2023-02-15T09:03:00,112   copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler
2023-02-15T09:03:00,116   copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler
2023-02-15T09:03:00,120   copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler
2023-02-15T09:03:00,124   copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler
2023-02-15T09:03:00,127   copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler
2023-02-15T09:03:00,132   creating build/lib/colossalai/fx/passes
2023-02-15T09:03:00,134   copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes
2023-02-15T09:03:00,138   copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes
2023-02-15T09:03:00,141   copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes
2023-02-15T09:03:00,145   copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes
2023-02-15T09:03:00,149   copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes
2023-02-15T09:03:00,153   copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes
2023-02-15T09:03:00,157   copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes
2023-02-15T09:03:00,160   copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes
2023-02-15T09:03:00,166   creating build/lib/colossalai/fx/tracer/meta_patch
2023-02-15T09:03:00,167   copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch
2023-02-15T09:03:00,171   creating build/lib/colossalai/fx/tracer/bias_addition_patch
2023-02-15T09:03:00,173   copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch
2023-02-15T09:03:00,178   creating build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:00,179   copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:00,183   copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:00,186   copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:00,189   copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:00,192   copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:00,196   copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:00,199   copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:00,202   copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:00,207   creating build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:00,208   copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:00,212   copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:00,216   copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:00,219   copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:00,223   copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:00,226   copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:00,230   copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:00,233   copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:00,238   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-15T09:03:00,239   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-15T09:03:00,243   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-15T09:03:00,246   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-15T09:03:00,250   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-15T09:03:00,253   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-15T09:03:00,258   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-15T09:03:00,259   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-15T09:03:00,263   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-15T09:03:00,266   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-15T09:03:00,269   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-15T09:03:00,275   creating build/lib/colossalai/fx/profiler/experimental
2023-02-15T09:03:00,276   copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-15T09:03:00,280   copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-15T09:03:00,283   copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-15T09:03:00,286   copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-15T09:03:00,290   copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-15T09:03:00,296   creating build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:00,297   copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:00,301   copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:00,304   copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:00,307   copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:00,311   copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:00,314   copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:00,317   copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:00,321   copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:00,324   copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:00,329   creating build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:00,331   copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:00,334   copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:00,337   copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:00,341   copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:00,345   copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:00,348   copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:00,351   copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:00,354   copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:00,357   copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:00,361   copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:00,364   copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:00,369   creating build/lib/colossalai/fx/passes/algorithms
2023-02-15T09:03:00,370   copying colossalai/fx/passes/algorithms/ckpt_solver_rotor.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-15T09:03:00,375   copying colossalai/fx/passes/algorithms/__init__.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-15T09:03:00,378   copying colossalai/fx/passes/algorithms/linearize.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-15T09:03:00,381   copying colossalai/fx/passes/algorithms/ckpt_solver_chen.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-15T09:03:00,385   copying colossalai/fx/passes/algorithms/build_c_ext.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-15T09:03:00,388   copying colossalai/fx/passes/algorithms/operation.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-15T09:03:00,392   copying colossalai/fx/passes/algorithms/ckpt_solver_pofo.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-15T09:03:00,398   creating build/lib/colossalai/pipeline/middleware
2023-02-15T09:03:00,400   copying colossalai/pipeline/middleware/topo.py -> build/lib/colossalai/pipeline/middleware
2023-02-15T09:03:00,404   copying colossalai/pipeline/middleware/__init__.py -> build/lib/colossalai/pipeline/middleware
2023-02-15T09:03:00,409   creating build/lib/colossalai/pipeline/rpc
2023-02-15T09:03:00,410   copying colossalai/pipeline/rpc/__init__.py -> build/lib/colossalai/pipeline/rpc
2023-02-15T09:03:00,414   copying colossalai/pipeline/rpc/utils.py -> build/lib/colossalai/pipeline/rpc
2023-02-15T09:03:00,417   copying colossalai/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/pipeline/rpc
2023-02-15T09:03:00,425   copying colossalai/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/pipeline/rpc
2023-02-15T09:03:00,431   creating build/lib/colossalai/pipeline/middleware/adaptor
2023-02-15T09:03:00,432   copying colossalai/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/pipeline/middleware/adaptor
2023-02-15T09:03:00,436   copying colossalai/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/pipeline/middleware/adaptor
2023-02-15T09:03:00,442   creating build/lib/colossalai/cli/benchmark
2023-02-15T09:03:00,444   copying colossalai/cli/benchmark/benchmark.py -> build/lib/colossalai/cli/benchmark
2023-02-15T09:03:00,448   copying colossalai/cli/benchmark/__init__.py -> build/lib/colossalai/cli/benchmark
2023-02-15T09:03:00,451   copying colossalai/cli/benchmark/models.py -> build/lib/colossalai/cli/benchmark
2023-02-15T09:03:00,454   copying colossalai/cli/benchmark/utils.py -> build/lib/colossalai/cli/benchmark
2023-02-15T09:03:00,460   creating build/lib/colossalai/cli/launcher
2023-02-15T09:03:00,461   copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher
2023-02-15T09:03:00,465   copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher
2023-02-15T09:03:00,469   copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher
2023-02-15T09:03:00,473   copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher
2023-02-15T09:03:00,478   creating build/lib/colossalai/cli/check
2023-02-15T09:03:00,480   copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check
2023-02-15T09:03:00,484   copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check
2023-02-15T09:03:00,522   creating build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,524   copying colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,528   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,534   copying colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,539   copying colossalai/kernel/cuda_native/csrc/type_shim.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,544   copying colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,549   copying colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,554   copying colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,559   copying colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,563   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,568   copying colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,572   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,578   copying colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,584   copying colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,588   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,593   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,597   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,602   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,606   copying colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,612   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,617   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,623   copying colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,629   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,632   copying colossalai/kernel/cuda_native/csrc/compat.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:00,637   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels
2023-02-15T09:03:00,637   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,639   copying colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,643   copying colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,648   copying colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,652   copying colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,656   copying colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,660   copying colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,663   copying colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,667   copying colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,671   copying colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,676   copying colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,679   copying colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,683   copying colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:00,916   /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
2023-02-15T09:03:00,917     setuptools.SetuptoolsDeprecationWarning,
2023-02-15T09:03:00,982   installing to build/bdist.linux-armv7l/wheel
2023-02-15T09:03:00,982   running install
2023-02-15T09:03:01,044   running install_lib
2023-02-15T09:03:01,115   creating build/bdist.linux-armv7l
2023-02-15T09:03:01,116   creating build/bdist.linux-armv7l/wheel
2023-02-15T09:03:01,119   creating build/bdist.linux-armv7l/wheel/op_builder
2023-02-15T09:03:01,121   copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-15T09:03:01,125   copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-15T09:03:01,129   copying build/lib/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-15T09:03:01,133   copying build/lib/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-15T09:03:01,136   copying build/lib/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-15T09:03:01,140   copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-15T09:03:01,144   copying build/lib/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-15T09:03:01,148   copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-15T09:03:01,151   copying build/lib/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-15T09:03:01,155   copying build/lib/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-15T09:03:01,160   creating build/bdist.linux-armv7l/wheel/colossalai
2023-02-15T09:03:01,163   creating build/bdist.linux-armv7l/wheel/colossalai/engine
2023-02-15T09:03:01,165   copying build/lib/colossalai/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine
2023-02-15T09:03:01,170   creating build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-15T09:03:01,171   copying build/lib/colossalai/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-15T09:03:01,175   copying build/lib/colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-15T09:03:01,180   copying build/lib/colossalai/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-15T09:03:01,184   copying build/lib/colossalai/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-15T09:03:01,188   copying build/lib/colossalai/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-15T09:03:01,194   copying build/lib/colossalai/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/engine
2023-02-15T09:03:01,199   creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-15T09:03:01,200   copying build/lib/colossalai/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-15T09:03:01,204   copying build/lib/colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-15T09:03:01,208   copying build/lib/colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-15T09:03:01,211   copying build/lib/colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-15T09:03:01,215   copying build/lib/colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-15T09:03:01,218   copying build/lib/colossalai/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-15T09:03:01,222   copying build/lib/colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-15T09:03:01,225   copying build/lib/colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-15T09:03:01,230   creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-02-15T09:03:01,231   copying build/lib/colossalai/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-02-15T09:03:01,235   copying build/lib/colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-02-15T09:03:01,241   creating build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-15T09:03:01,242   copying build/lib/colossalai/context/moe_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-15T09:03:01,247   copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-15T09:03:01,251   copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-15T09:03:01,254   copying build/lib/colossalai/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-15T09:03:01,260   creating build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-15T09:03:01,262   copying build/lib/colossalai/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-15T09:03:01,266   copying build/lib/colossalai/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-15T09:03:01,271   copying build/lib/colossalai/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-15T09:03:01,274   copying build/lib/colossalai/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-15T09:03:01,278   copying build/lib/colossalai/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-15T09:03:01,282   copying build/lib/colossalai/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-15T09:03:01,286   copying build/lib/colossalai/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-15T09:03:01,289   copying build/lib/colossalai/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-15T09:03:01,292   copying build/lib/colossalai/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-15T09:03:01,295   copying build/lib/colossalai/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-15T09:03:01,299   copying build/lib/colossalai/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-15T09:03:01,302   copying build/lib/colossalai/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-15T09:03:01,306   creating build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-15T09:03:01,308   copying build/lib/colossalai/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-15T09:03:01,311   copying build/lib/colossalai/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-15T09:03:01,314   copying build/lib/colossalai/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-15T09:03:01,318   copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-15T09:03:01,322   creating build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-02-15T09:03:01,323   copying build/lib/colossalai/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-02-15T09:03:01,327   copying build/lib/colossalai/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-02-15T09:03:01,332   creating build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-15T09:03:01,333   copying build/lib/colossalai/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-15T09:03:01,337   copying build/lib/colossalai/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-15T09:03:01,341   copying build/lib/colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-15T09:03:01,345   copying build/lib/colossalai/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-15T09:03:01,348   copying build/lib/colossalai/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-15T09:03:01,351   copying build/lib/colossalai/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-15T09:03:01,354   copying build/lib/colossalai/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-15T09:03:01,358   copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-15T09:03:01,361   copying build/lib/colossalai/constants.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-15T09:03:01,366   creating build/bdist.linux-armv7l/wheel/colossalai/builder
2023-02-15T09:03:01,367   copying build/lib/colossalai/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/builder
2023-02-15T09:03:01,370   copying build/lib/colossalai/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/builder
2023-02-15T09:03:01,375   creating build/bdist.linux-armv7l/wheel/colossalai/_C
2023-02-15T09:03:01,376   copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C
2023-02-15T09:03:01,380   creating build/bdist.linux-armv7l/wheel/colossalai/registry
2023-02-15T09:03:01,381   copying build/lib/colossalai/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/registry
2023-02-15T09:03:01,385   copying build/lib/colossalai/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/registry
2023-02-15T09:03:01,389   creating build/bdist.linux-armv7l/wheel/colossalai/logging
2023-02-15T09:03:01,390   copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-02-15T09:03:01,394   copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-02-15T09:03:01,398   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-02-15T09:03:01,401   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-15T09:03:01,402   copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-15T09:03:01,405   copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-15T09:03:01,410   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-15T09:03:01,411   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-15T09:03:01,416   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-15T09:03:01,419   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-15T09:03:01,423   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-15T09:03:01,427   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-15T09:03:01,433   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,435   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,439   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,442   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,447   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,451   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,455   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,459   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,463   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,466   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,470   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,474   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,478   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,482   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,486   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,492   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,494   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,499   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,503   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,508   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,512   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,516   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,520   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,525   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,529   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,534   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,538   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,542   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,547   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,552   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,556   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,559   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,564   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,567   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,573   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-15T09:03:01,577   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,580   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,584   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,587   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,591   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,595   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,598   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,601   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,605   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,608   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,612   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,617   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,621   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-15T09:03:01,627   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:03:01,629   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:03:01,633   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:03:01,637   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:03:01,642   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:03:01,646   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:03:01,650   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-15T09:03:01,655   copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-15T09:03:01,659   copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-15T09:03:01,665   copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-15T09:03:01,668   copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-02-15T09:03:01,673   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-02-15T09:03:01,675   copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-02-15T09:03:01,679   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-15T09:03:01,681   copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-15T09:03:01,686   copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-15T09:03:01,689   copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-15T09:03:01,693   copying build/lib/colossalai/auto_parallel/meta_profiler/metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-15T09:03:01,698   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:03:01,700   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:03:01,703   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:03:01,706   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:03:01,711   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:03:01,715   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:03:01,719   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:03:01,723   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-15T09:03:01,728   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-15T09:03:01,729   copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-15T09:03:01,732   copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-15T09:03:01,735   copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-15T09:03:01,739   copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-15T09:03:01,743   copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-15T09:03:01,748   copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-15T09:03:01,753   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-15T09:03:01,754   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-15T09:03:01,759   copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-15T09:03:01,762   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-15T09:03:01,765   copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-15T09:03:01,768   copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-15T09:03:01,772   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-15T09:03:01,777   creating build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-15T09:03:01,778   copying build/lib/colossalai/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-15T09:03:01,782   copying build/lib/colossalai/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-15T09:03:01,786   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-02-15T09:03:01,788   copying build/lib/colossalai/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-02-15T09:03:01,791   copying build/lib/colossalai/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-02-15T09:03:01,794   copying build/lib/colossalai/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-15T09:03:01,798   copying build/lib/colossalai/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-15T09:03:01,801   copying build/lib/colossalai/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-15T09:03:01,806   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-15T09:03:01,808   copying build/lib/colossalai/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-15T09:03:01,811   copying build/lib/colossalai/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-15T09:03:01,815   copying build/lib/colossalai/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-15T09:03:01,818   copying build/lib/colossalai/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-15T09:03:01,821   copying build/lib/colossalai/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-15T09:03:01,824   copying build/lib/colossalai/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-15T09:03:01,827   copying build/lib/colossalai/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-15T09:03:01,830   copying build/lib/colossalai/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-15T09:03:01,834   copying build/lib/colossalai/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-15T09:03:01,838   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-15T09:03:01,839   copying build/lib/colossalai/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-15T09:03:01,842   copying build/lib/colossalai/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-15T09:03:01,847   copying build/lib/colossalai/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-15T09:03:01,850   copying build/lib/colossalai/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-15T09:03:01,855   copying build/lib/colossalai/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-15T09:03:01,858   copying build/lib/colossalai/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-15T09:03:01,862   copying build/lib/colossalai/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-15T09:03:01,867   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-15T09:03:01,869   copying build/lib/colossalai/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-15T09:03:01,872   copying build/lib/colossalai/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-15T09:03:01,875   copying build/lib/colossalai/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-15T09:03:01,878   copying build/lib/colossalai/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-15T09:03:01,882   copying build/lib/colossalai/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-15T09:03:01,885   copying build/lib/colossalai/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-15T09:03:01,890   creating build/bdist.linux-armv7l/wheel/colossalai/nn
2023-02-15T09:03:01,891   copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-02-15T09:03:01,897   creating build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-15T09:03:01,898   copying build/lib/colossalai/nn/_ops/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-15T09:03:01,901   copying build/lib/colossalai/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-15T09:03:01,904   copying build/lib/colossalai/nn/_ops/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-15T09:03:01,908   copying build/lib/colossalai/nn/_ops/embedding_bag.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-15T09:03:01,912   copying build/lib/colossalai/nn/_ops/view.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-15T09:03:01,915   copying build/lib/colossalai/nn/_ops/batch_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-15T09:03:01,918   copying build/lib/colossalai/nn/_ops/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-15T09:03:01,921   copying build/lib/colossalai/nn/_ops/element_wise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-15T09:03:01,925   copying build/lib/colossalai/nn/_ops/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-15T09:03:01,928   copying build/lib/colossalai/nn/_ops/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-15T09:03:01,932   copying build/lib/colossalai/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-15T09:03:01,937   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-15T09:03:01,938   copying build/lib/colossalai/nn/parallel/gemini_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-15T09:03:01,942   copying build/lib/colossalai/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-15T09:03:01,945   copying build/lib/colossalai/nn/parallel/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-15T09:03:01,949   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-15T09:03:01,951   copying build/lib/colossalai/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-15T09:03:01,954   copying build/lib/colossalai/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-15T09:03:01,958   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:03:01,960   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:03:01,964   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:03:01,967   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:03:01,970   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:03:01,974   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:03:01,977   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:03:01,981   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:03:01,984   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:03:01,988   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-15T09:03:01,993   copying build/lib/colossalai/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-15T09:03:01,997   copying build/lib/colossalai/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-15T09:03:02,000   copying build/lib/colossalai/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-15T09:03:02,004   copying build/lib/colossalai/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-15T09:03:02,010   copying build/lib/colossalai/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-15T09:03:02,014   copying build/lib/colossalai/nn/parallel/zero_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-15T09:03:02,020   creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-15T09:03:02,022   copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-15T09:03:02,025   copying build/lib/colossalai/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-15T09:03:02,029   copying build/lib/colossalai/nn/loss/loss_moe.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-15T09:03:02,032   copying build/lib/colossalai/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-15T09:03:02,036   copying build/lib/colossalai/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-15T09:03:02,040   copying build/lib/colossalai/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-15T09:03:02,044   copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-02-15T09:03:02,049   creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-15T09:03:02,050   copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-15T09:03:02,055   copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-15T09:03:02,058   copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-15T09:03:02,061   copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-15T09:03:02,064   copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-15T09:03:02,068   copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-15T09:03:02,071   copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-15T09:03:02,075   copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-15T09:03:02,079   creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,081   copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,085   copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,088   copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,092   copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,095   copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,099   copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,104   copying build/lib/colossalai/nn/optimizer/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,109   copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,114   copying build/lib/colossalai/nn/optimizer/colossalai_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,117   copying build/lib/colossalai/nn/optimizer/zero_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,121   copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,125   copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-15T09:03:02,130   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-02-15T09:03:02,131   copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-02-15T09:03:02,135   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-15T09:03:02,137   copying build/lib/colossalai/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-15T09:03:02,144   copying build/lib/colossalai/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-15T09:03:02,147   copying build/lib/colossalai/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-15T09:03:02,152   copying build/lib/colossalai/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-15T09:03:02,157   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-15T09:03:02,158   copying build/lib/colossalai/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-15T09:03:02,161   copying build/lib/colossalai/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-15T09:03:02,165   copying build/lib/colossalai/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-15T09:03:02,168   copying build/lib/colossalai/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-15T09:03:02,171   copying build/lib/colossalai/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-15T09:03:02,175   copying build/lib/colossalai/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-15T09:03:02,179   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-15T09:03:02,180   copying build/lib/colossalai/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-15T09:03:02,186   copying build/lib/colossalai/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-15T09:03:02,190   copying build/lib/colossalai/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-15T09:03:02,195   copying build/lib/colossalai/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-15T09:03:02,199   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-02-15T09:03:02,201   copying build/lib/colossalai/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-02-15T09:03:02,204   copying build/lib/colossalai/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-02-15T09:03:02,208   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-15T09:03:02,209   copying build/lib/colossalai/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-15T09:03:02,216   copying build/lib/colossalai/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-15T09:03:02,220   copying build/lib/colossalai/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-15T09:03:02,224   copying build/lib/colossalai/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-15T09:03:02,229   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-15T09:03:02,230   copying build/lib/colossalai/nn/layer/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-15T09:03:02,236   copying build/lib/colossalai/nn/layer/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-15T09:03:02,239   copying build/lib/colossalai/nn/layer/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-15T09:03:02,244   copying build/lib/colossalai/nn/layer/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-15T09:03:02,248   copying build/lib/colossalai/nn/layer/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-15T09:03:02,253   copying build/lib/colossalai/nn/layer/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-15T09:03:02,259   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-15T09:03:02,261   copying build/lib/colossalai/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-15T09:03:02,266   copying build/lib/colossalai/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-15T09:03:02,270   copying build/lib/colossalai/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-15T09:03:02,274   copying build/lib/colossalai/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-15T09:03:02,279   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-15T09:03:02,281   copying build/lib/colossalai/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-15T09:03:02,289   copying build/lib/colossalai/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-15T09:03:02,293   copying build/lib/colossalai/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-15T09:03:02,297   copying build/lib/colossalai/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-15T09:03:02,303   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-02-15T09:03:02,305   copying build/lib/colossalai/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-02-15T09:03:02,308   copying build/lib/colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-02-15T09:03:02,313   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-02-15T09:03:02,314   copying build/lib/colossalai/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-02-15T09:03:02,319   copying build/lib/colossalai/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-02-15T09:03:02,322   copying build/lib/colossalai/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-02-15T09:03:02,326   creating build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-15T09:03:02,328   copying build/lib/colossalai/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-15T09:03:02,331   copying build/lib/colossalai/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-15T09:03:02,334   copying build/lib/colossalai/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-15T09:03:02,338   copying build/lib/colossalai/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-15T09:03:02,341   copying build/lib/colossalai/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-15T09:03:02,344   copying build/lib/colossalai/core.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-15T09:03:02,348   creating build/bdist.linux-armv7l/wheel/colossalai/zero
2023-02-15T09:03:02,350   copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero
2023-02-15T09:03:02,354   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-15T09:03:02,356   copying build/lib/colossalai/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-15T09:03:02,359   copying build/lib/colossalai/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-15T09:03:02,363   copying build/lib/colossalai/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-15T09:03:02,366   copying build/lib/colossalai/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-15T09:03:02,371   copying build/lib/colossalai/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-15T09:03:02,376   creating build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-15T09:03:02,377   copying build/lib/colossalai/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-15T09:03:02,380   copying build/lib/colossalai/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-15T09:03:02,383   copying build/lib/colossalai/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-15T09:03:02,387   copying build/lib/colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-15T09:03:02,390   copying build/lib/colossalai/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-15T09:03:02,394   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-15T09:03:02,395   copying build/lib/colossalai/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-15T09:03:02,400   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:03:02,401   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:03:02,405   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:03:02,408   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:03:02,411   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:03:02,414   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:03:02,417   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-15T09:03:02,420   copying build/lib/colossalai/zero/sharded_optim/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-15T09:03:02,426   copying build/lib/colossalai/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-15T09:03:02,431   copying build/lib/colossalai/zero/sharded_optim/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-15T09:03:02,437   creating build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-02-15T09:03:02,439   copying build/lib/colossalai/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-02-15T09:03:02,443   copying build/lib/colossalai/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-02-15T09:03:02,448   creating build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-15T09:03:02,450   copying build/lib/colossalai/zero/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-15T09:03:02,453   copying build/lib/colossalai/zero/utils/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-15T09:03:02,457   copying build/lib/colossalai/zero/utils/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-15T09:03:02,461   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-15T09:03:02,462   copying build/lib/colossalai/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-15T09:03:02,466   copying build/lib/colossalai/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-15T09:03:02,469   copying build/lib/colossalai/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-15T09:03:02,473   creating build/bdist.linux-armv7l/wheel/colossalai/amp
2023-02-15T09:03:02,474   copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-02-15T09:03:02,479   creating build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-02-15T09:03:02,481   copying build/lib/colossalai/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-02-15T09:03:02,484   copying build/lib/colossalai/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-02-15T09:03:02,489   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-15T09:03:02,491   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-15T09:03:02,493   copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-15T09:03:02,496   copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-15T09:03:02,500   copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-15T09:03:02,503   copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-15T09:03:02,506   copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-15T09:03:02,509   copying build/lib/colossalai/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-15T09:03:02,514   copying build/lib/colossalai/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-15T09:03:02,519   copying build/lib/colossalai/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-15T09:03:02,522   copying build/lib/colossalai/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-02-15T09:03:02,527   creating build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-15T09:03:02,529   copying build/lib/colossalai/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-15T09:03:02,533   copying build/lib/colossalai/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-15T09:03:02,539   copying build/lib/colossalai/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-15T09:03:02,544   creating build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-15T09:03:02,547   creating build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-15T09:03:02,549   copying build/lib/colossalai/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-15T09:03:02,553   copying build/lib/colossalai/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-15T09:03:02,556   copying build/lib/colossalai/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-15T09:03:02,561   creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-02-15T09:03:02,562   copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-02-15T09:03:02,566   copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-02-15T09:03:02,570   copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-15T09:03:02,573   copying build/lib/colossalai/utils/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-15T09:03:02,577   creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-02-15T09:03:02,578   copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-02-15T09:03:02,581   copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-02-15T09:03:02,585   copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-15T09:03:02,590   creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-02-15T09:03:02,591   copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-02-15T09:03:02,595   copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-02-15T09:03:02,598   copying build/lib/colossalai/utils/cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-15T09:03:02,602   creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-15T09:03:02,603   copying build/lib/colossalai/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-15T09:03:02,606   copying build/lib/colossalai/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-15T09:03:02,609   copying build/lib/colossalai/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-15T09:03:02,615   copying build/lib/colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-15T09:03:02,623   creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-15T09:03:02,624   copying build/lib/colossalai/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-15T09:03:02,628   copying build/lib/colossalai/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-15T09:03:02,631   copying build/lib/colossalai/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-15T09:03:02,635   copying build/lib/colossalai/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-15T09:03:02,639   copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-15T09:03:02,644   copying build/lib/colossalai/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-15T09:03:02,649   creating build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-15T09:03:02,650   copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-15T09:03:02,653   copying build/lib/colossalai/utils/model/lazy_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-15T09:03:02,657   copying build/lib/colossalai/utils/model/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-15T09:03:02,662   copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-15T09:03:02,665   copying build/lib/colossalai/utils/model/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-15T09:03:02,670   copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-15T09:03:02,675   creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-15T09:03:02,677   copying build/lib/colossalai/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-15T09:03:02,681   copying build/lib/colossalai/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-15T09:03:02,685   copying build/lib/colossalai/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-15T09:03:02,690   creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-15T09:03:02,692   copying build/lib/colossalai/utils/checkpoint_io/convertor.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-15T09:03:02,697   copying build/lib/colossalai/utils/checkpoint_io/meta.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-15T09:03:02,701   copying build/lib/colossalai/utils/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-15T09:03:02,705   copying build/lib/colossalai/utils/checkpoint_io/io.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-15T09:03:02,709   copying build/lib/colossalai/utils/checkpoint_io/distributed.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-15T09:03:02,714   copying build/lib/colossalai/utils/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-15T09:03:02,719   copying build/lib/colossalai/utils/checkpoint_io/backend.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-15T09:03:02,722   copying build/lib/colossalai/utils/checkpoint_io/reader.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-15T09:03:02,727   copying build/lib/colossalai/utils/checkpoint_io/writer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-15T09:03:02,730   copying build/lib/colossalai/utils/checkpoint_io/constant.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-15T09:03:02,733   copying build/lib/colossalai/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-15T09:03:02,738   creating build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-15T09:03:02,740   copying build/lib/colossalai/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-15T09:03:02,743   copying build/lib/colossalai/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-15T09:03:02,747   copying build/lib/colossalai/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-15T09:03:02,750   copying build/lib/colossalai/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-15T09:03:02,755   copying build/lib/colossalai/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-15T09:03:02,759   copying build/lib/colossalai/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-15T09:03:02,763   creating build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-02-15T09:03:02,765   copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-02-15T09:03:02,769   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-15T09:03:02,770   copying build/lib/colossalai/kernel/cuda_native/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-15T09:03:02,775   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,777   copying build/lib/colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,780   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,785   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,790   copying build/lib/colossalai/kernel/cuda_native/csrc/type_shim.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,795   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,799   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,804   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,808   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,813   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels
2023-02-15T09:03:02,817   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,819   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,823   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,828   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,834   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,837   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,841   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,844   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,847   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,851   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,855   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,858   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,862   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-15T09:03:02,865   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,870   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,875   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,880   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,886   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,890   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,894   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,898   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,902   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,905   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,909   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,913   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,918   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,922   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,926   copying build/lib/colossalai/kernel/cuda_native/csrc/compat.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-15T09:03:02,929   copying build/lib/colossalai/kernel/cuda_native/multihead_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-15T09:03:02,933   copying build/lib/colossalai/kernel/cuda_native/layer_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-15T09:03:02,936   copying build/lib/colossalai/kernel/cuda_native/flash_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-15T09:03:02,941   copying build/lib/colossalai/kernel/cuda_native/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-15T09:03:02,946   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-15T09:03:02,947   copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-15T09:03:02,950   copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-15T09:03:02,953   copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-15T09:03:02,956   copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-15T09:03:02,962   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-15T09:03:02,964   copying build/lib/colossalai/kernel/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-15T09:03:02,967   copying build/lib/colossalai/kernel/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-15T09:03:02,970   copying build/lib/colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-15T09:03:02,974   copying build/lib/colossalai/kernel/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-15T09:03:02,977   copying build/lib/colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-15T09:03:02,980   copying build/lib/colossalai/kernel/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-15T09:03:02,983   copying build/lib/colossalai/kernel/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-15T09:03:02,987   copying build/lib/colossalai/kernel/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-15T09:03:02,990   copying build/lib/colossalai/kernel/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-15T09:03:02,993   copying build/lib/colossalai/kernel/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-15T09:03:02,997   creating build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-15T09:03:02,998   copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-15T09:03:03,002   copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-15T09:03:03,006   copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-15T09:03:03,010   copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-15T09:03:03,015   creating build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-15T09:03:03,017   copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-15T09:03:03,021   copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-15T09:03:03,025   creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-02-15T09:03:03,026   copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-02-15T09:03:03,030   copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-02-15T09:03:03,036   copying build/lib/colossalai/fx/_meta_registrations.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-15T09:03:03,042   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-15T09:03:03,044   copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-15T09:03:03,047   copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-15T09:03:03,050   copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-15T09:03:03,054   copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-15T09:03:03,058   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-02-15T09:03:03,059   copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-02-15T09:03:03,065   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:03,066   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:03,069   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:03,073   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:03,076   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:03,080   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:03,084   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:03,087   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:03,090   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-15T09:03:03,095   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:03,096   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:03,100   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:03,104   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:03,107   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:03,111   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:03,115   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:03,118   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:03,121   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-15T09:03:03,126   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-02-15T09:03:03,127   copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-02-15T09:03:03,132   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-15T09:03:03,133   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-15T09:03:03,137   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-15T09:03:03,140   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-15T09:03:03,144   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-15T09:03:03,147   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-15T09:03:03,151   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-15T09:03:03,153   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-15T09:03:03,156   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-15T09:03:03,159   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-15T09:03:03,163   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-15T09:03:03,166   copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-15T09:03:03,172   copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-15T09:03:03,176   copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-15T09:03:03,181   copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-15T09:03:03,185   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-15T09:03:03,188   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-15T09:03:03,190   copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-15T09:03:03,193   copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-15T09:03:03,196   copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-15T09:03:03,200   copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-15T09:03:03,204   copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-15T09:03:03,208   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:03,209   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:03,214   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:03,217   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:03,220   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:03,223   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:03,227   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:03,230   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:03,234   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:03,237   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-15T09:03:03,242   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:03,243   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:03,246   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:03,250   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:03,254   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:03,258   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:03,261   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:03,264   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:03,268   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:03,271   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:03,274   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:03,277   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-15T09:03:03,281   copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-15T09:03:03,284   copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-15T09:03:03,288   copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-15T09:03:03,292   copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-15T09:03:03,296   copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-15T09:03:03,300   copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-15T09:03:03,304   copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-15T09:03:03,308   copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-15T09:03:03,313   creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-15T09:03:03,314   copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-15T09:03:03,320   creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-15T09:03:03,321   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-15T09:03:03,326   copying build/lib/colossalai/fx/passes/algorithms/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-15T09:03:03,329   copying build/lib/colossalai/fx/passes/algorithms/linearize.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-15T09:03:03,333   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-15T09:03:03,336   copying build/lib/colossalai/fx/passes/algorithms/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-15T09:03:03,339   copying build/lib/colossalai/fx/passes/algorithms/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-15T09:03:03,344   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_pofo.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-15T09:03:03,349   copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-15T09:03:03,352   copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-15T09:03:03,356   copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-15T09:03:03,361   copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-15T09:03:03,365   copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-15T09:03:03,369   copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-15T09:03:03,373   copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-15T09:03:03,378   copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-15T09:03:03,382   creating build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-15T09:03:03,384   copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-15T09:03:03,387   copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-15T09:03:03,390   copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-15T09:03:03,394   copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-15T09:03:03,398   copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-15T09:03:03,402   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-15T09:03:03,404   copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-15T09:03:03,408   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-02-15T09:03:03,409   copying build/lib/colossalai/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-02-15T09:03:03,414   copying build/lib/colossalai/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-02-15T09:03:03,418   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-02-15T09:03:03,419   copying build/lib/colossalai/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-02-15T09:03:03,422   copying build/lib/colossalai/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-02-15T09:03:03,426   copying build/lib/colossalai/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-15T09:03:03,431   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-15T09:03:03,433   copying build/lib/colossalai/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-15T09:03:03,437   copying build/lib/colossalai/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-15T09:03:03,440   copying build/lib/colossalai/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-15T09:03:03,448   copying build/lib/colossalai/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-15T09:03:03,452   copying build/lib/colossalai/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-15T09:03:03,456   copying build/lib/colossalai/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-15T09:03:03,459   copying build/lib/colossalai/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-15T09:03:03,464   creating build/bdist.linux-armv7l/wheel/colossalai/cli
2023-02-15T09:03:03,466   copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-02-15T09:03:03,469   copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-02-15T09:03:03,473   creating build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-15T09:03:03,474   copying build/lib/colossalai/cli/benchmark/benchmark.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-15T09:03:03,478   copying build/lib/colossalai/cli/benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-15T09:03:03,481   copying build/lib/colossalai/cli/benchmark/models.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-15T09:03:03,484   copying build/lib/colossalai/cli/benchmark/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-15T09:03:03,489   creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-15T09:03:03,490   copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-15T09:03:03,494   copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-15T09:03:03,498   copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-15T09:03:03,501   copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-15T09:03:03,506   creating build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-02-15T09:03:03,508   copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-02-15T09:03:03,511   copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-02-15T09:03:03,515   copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-15T09:03:03,519   copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-15T09:03:03,522   copying build/lib/colossalai/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-15T09:03:03,527   creating build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,528   copying build/lib/colossalai/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,531   copying build/lib/colossalai/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,535   copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,538   copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,542   copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,546   copying build/lib/colossalai/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,549   copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,553   copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,557   copying build/lib/colossalai/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,560   copying build/lib/colossalai/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,563   copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,567   copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,571   copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,576   copying build/lib/colossalai/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,579   copying build/lib/colossalai/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-15T09:03:03,583   running install_egg_info
2023-02-15T09:03:03,785   running egg_info
2023-02-15T09:03:03,847   writing colossalai.egg-info/PKG-INFO
2023-02-15T09:03:03,853   writing dependency_links to colossalai.egg-info/dependency_links.txt
2023-02-15T09:03:03,857   writing entry points to colossalai.egg-info/entry_points.txt
2023-02-15T09:03:03,859   writing requirements to colossalai.egg-info/requires.txt
2023-02-15T09:03:03,861   writing top-level names to colossalai.egg-info/top_level.txt
2023-02-15T09:03:04,111   reading manifest file 'colossalai.egg-info/SOURCES.txt'
2023-02-15T09:03:04,173   reading manifest template 'MANIFEST.in'
2023-02-15T09:03:06,170   warning: no files found matching '*.tr' under directory 'colossalai'
2023-02-15T09:03:07,163   warning: no files found matching '*.cc' under directory 'colossalai'
2023-02-15T09:03:07,676   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-02-15T09:03:07,695   adding license file 'LICENSE'
2023-02-15T09:03:07,795   writing manifest file 'colossalai.egg-info/SOURCES.txt'
2023-02-15T09:03:07,799   Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.2.5-py3.7.egg-info
2023-02-15T09:03:07,826   running install_scripts
2023-02-15T09:03:08,005   adding license file "LICENSE" (matched pattern "LICEN[CS]E*")
2023-02-15T09:03:08,015   creating build/bdist.linux-armv7l/wheel/colossalai-0.2.5.dist-info/WHEEL
2023-02-15T09:03:08,019   creating '/tmp/pip-wheel-6zrayzcm/colossalai-0.2.5-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2023-02-15T09:03:08,025   adding 'colossalai/__init__.py'
2023-02-15T09:03:08,027   adding 'colossalai/constants.py'
2023-02-15T09:03:08,030   adding 'colossalai/core.py'
2023-02-15T09:03:08,032   adding 'colossalai/global_variables.py'
2023-02-15T09:03:08,038   adding 'colossalai/initialize.py'
2023-02-15T09:03:08,040   adding 'colossalai/version.py'
2023-02-15T09:03:08,043   adding 'colossalai/_C/__init__.py'
2023-02-15T09:03:08,047   adding 'colossalai/amp/__init__.py'
2023-02-15T09:03:08,049   adding 'colossalai/amp/amp_type.py'
2023-02-15T09:03:08,052   adding 'colossalai/amp/apex_amp/__init__.py'
2023-02-15T09:03:08,056   adding 'colossalai/amp/apex_amp/apex_amp.py'
2023-02-15T09:03:08,060   adding 'colossalai/amp/naive_amp/__init__.py'
2023-02-15T09:03:08,064   adding 'colossalai/amp/naive_amp/_fp16_optimizer.py'
2023-02-15T09:03:08,067   adding 'colossalai/amp/naive_amp/_utils.py'
2023-02-15T09:03:08,070   adding 'colossalai/amp/naive_amp/naive_amp.py'
2023-02-15T09:03:08,074   adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py'
2023-02-15T09:03:08,077   adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py'
2023-02-15T09:03:08,079   adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py'
2023-02-15T09:03:08,082   adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py'
2023-02-15T09:03:08,085   adding 'colossalai/amp/torch_amp/__init__.py'
2023-02-15T09:03:08,093   adding 'colossalai/amp/torch_amp/_grad_scaler.py'
2023-02-15T09:03:08,096   adding 'colossalai/amp/torch_amp/torch_amp.py'
2023-02-15T09:03:08,099   adding 'colossalai/auto_parallel/__init__.py'
2023-02-15T09:03:08,103   adding 'colossalai/auto_parallel/checkpoint/__init__.py'
2023-02-15T09:03:08,105   adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py'
2023-02-15T09:03:08,108   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py'
2023-02-15T09:03:08,111   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py'
2023-02-15T09:03:08,116   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py'
2023-02-15T09:03:08,120   adding 'colossalai/auto_parallel/checkpoint/operation.py'
2023-02-15T09:03:08,123   adding 'colossalai/auto_parallel/meta_profiler/__init__.py'
2023-02-15T09:03:08,125   adding 'colossalai/auto_parallel/meta_profiler/constants.py'
2023-02-15T09:03:08,128   adding 'colossalai/auto_parallel/meta_profiler/metainfo.py'
2023-02-15T09:03:08,131   adding 'colossalai/auto_parallel/meta_profiler/registry.py'
2023-02-15T09:03:08,134   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py'
2023-02-15T09:03:08,137   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py'
2023-02-15T09:03:08,140   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py'
2023-02-15T09:03:08,143   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py'
2023-02-15T09:03:08,148   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py'
2023-02-15T09:03:08,153   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py'
2023-02-15T09:03:08,156   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py'
2023-02-15T09:03:08,159   adding 'colossalai/auto_parallel/passes/__init__.py'
2023-02-15T09:03:08,162   adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py'
2023-02-15T09:03:08,165   adding 'colossalai/auto_parallel/passes/constants.py'
2023-02-15T09:03:08,168   adding 'colossalai/auto_parallel/passes/meta_info_prop.py'
2023-02-15T09:03:08,172   adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py'
2023-02-15T09:03:08,179   adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py'
2023-02-15T09:03:08,182   adding 'colossalai/auto_parallel/pipeline_shard/__init__.py'
2023-02-15T09:03:08,185   adding 'colossalai/auto_parallel/tensor_shard/__init__.py'
2023-02-15T09:03:08,188   adding 'colossalai/auto_parallel/tensor_shard/constants.py'
2023-02-15T09:03:08,192   adding 'colossalai/auto_parallel/tensor_shard/initialize.py'
2023-02-15T09:03:08,195   adding 'colossalai/auto_parallel/tensor_shard/options.py'
2023-02-15T09:03:08,199   adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py'
2023-02-15T09:03:08,204   adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py'
2023-02-15T09:03:08,206   adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py'
2023-02-15T09:03:08,209   adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py'
2023-02-15T09:03:08,212   adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py'
2023-02-15T09:03:08,215   adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py'
2023-02-15T09:03:08,218   adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py'
2023-02-15T09:03:08,220   adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py'
2023-02-15T09:03:08,224   adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py'
2023-02-15T09:03:08,227   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py'
2023-02-15T09:03:08,229   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py'
2023-02-15T09:03:08,232   adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py'
2023-02-15T09:03:08,236   adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py'
2023-02-15T09:03:08,242   adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py'
2023-02-15T09:03:08,247   adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py'
2023-02-15T09:03:08,250   adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py'
2023-02-15T09:03:08,252   adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py'
2023-02-15T09:03:08,255   adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py'
2023-02-15T09:03:08,257   adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py'
2023-02-15T09:03:08,259   adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py'
2023-02-15T09:03:08,262   adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py'
2023-02-15T09:03:08,264   adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py'
2023-02-15T09:03:08,267   adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py'
2023-02-15T09:03:08,269   adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py'
2023-02-15T09:03:08,272   adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py'
2023-02-15T09:03:08,274   adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py'
2023-02-15T09:03:08,277   adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py'
2023-02-15T09:03:08,279   adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py'
2023-02-15T09:03:08,283   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py'
2023-02-15T09:03:08,287   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py'
2023-02-15T09:03:08,290   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py'
2023-02-15T09:03:08,295   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py'
2023-02-15T09:03:08,298   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py'
2023-02-15T09:03:08,301   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py'
2023-02-15T09:03:08,305   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py'
2023-02-15T09:03:08,308   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py'
2023-02-15T09:03:08,315   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py'
2023-02-15T09:03:08,319   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py'
2023-02-15T09:03:08,322   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py'
2023-02-15T09:03:08,325   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py'
2023-02-15T09:03:08,329   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py'
2023-02-15T09:03:08,332   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py'
2023-02-15T09:03:08,336   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py'
2023-02-15T09:03:08,339   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py'
2023-02-15T09:03:08,342   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py'
2023-02-15T09:03:08,345   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py'
2023-02-15T09:03:08,347   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py'
2023-02-15T09:03:08,351   adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py'
2023-02-15T09:03:08,354   adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py'
2023-02-15T09:03:08,357   adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py'
2023-02-15T09:03:08,363   adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py'
2023-02-15T09:03:08,367   adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py'
2023-02-15T09:03:08,370   adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py'
2023-02-15T09:03:08,373   adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py'
2023-02-15T09:03:08,376   adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py'
2023-02-15T09:03:08,379   adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py'
2023-02-15T09:03:08,382   adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py'
2023-02-15T09:03:08,385   adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py'
2023-02-15T09:03:08,388   adding 'colossalai/builder/__init__.py'
2023-02-15T09:03:08,391   adding 'colossalai/builder/builder.py'
2023-02-15T09:03:08,394   adding 'colossalai/cli/__init__.py'
2023-02-15T09:03:08,396   adding 'colossalai/cli/cli.py'
2023-02-15T09:03:08,399   adding 'colossalai/cli/benchmark/__init__.py'
2023-02-15T09:03:08,402   adding 'colossalai/cli/benchmark/benchmark.py'
2023-02-15T09:03:08,405   adding 'colossalai/cli/benchmark/models.py'
2023-02-15T09:03:08,407   adding 'colossalai/cli/benchmark/utils.py'
2023-02-15T09:03:08,411   adding 'colossalai/cli/check/__init__.py'
2023-02-15T09:03:08,414   adding 'colossalai/cli/check/check_installation.py'
2023-02-15T09:03:08,418   adding 'colossalai/cli/launcher/__init__.py'
2023-02-15T09:03:08,420   adding 'colossalai/cli/launcher/hostinfo.py'
2023-02-15T09:03:08,424   adding 'colossalai/cli/launcher/multinode_runner.py'
2023-02-15T09:03:08,428   adding 'colossalai/cli/launcher/run.py'
2023-02-15T09:03:08,431   adding 'colossalai/communication/__init__.py'
2023-02-15T09:03:08,435   adding 'colossalai/communication/collective.py'
2023-02-15T09:03:08,439   adding 'colossalai/communication/p2p.py'
2023-02-15T09:03:08,443   adding 'colossalai/communication/p2p_v2.py'
2023-02-15T09:03:08,446   adding 'colossalai/communication/ring.py'
2023-02-15T09:03:08,449   adding 'colossalai/communication/utils.py'
2023-02-15T09:03:08,452   adding 'colossalai/context/__init__.py'
2023-02-15T09:03:08,455   adding 'colossalai/context/config.py'
2023-02-15T09:03:08,458   adding 'colossalai/context/moe_context.py'
2023-02-15T09:03:08,464   adding 'colossalai/context/parallel_context.py'
2023-02-15T09:03:08,467   adding 'colossalai/context/parallel_mode.py'
2023-02-15T09:03:08,469   adding 'colossalai/context/singleton_meta.py'
2023-02-15T09:03:08,472   adding 'colossalai/context/process_group_initializer/__init__.py'
2023-02-15T09:03:08,475   adding 'colossalai/context/process_group_initializer/initializer_1d.py'
2023-02-15T09:03:08,478   adding 'colossalai/context/process_group_initializer/initializer_2d.py'
2023-02-15T09:03:08,481   adding 'colossalai/context/process_group_initializer/initializer_2p5d.py'
2023-02-15T09:03:08,485   adding 'colossalai/context/process_group_initializer/initializer_3d.py'
2023-02-15T09:03:08,488   adding 'colossalai/context/process_group_initializer/initializer_data.py'
2023-02-15T09:03:08,490   adding 'colossalai/context/process_group_initializer/initializer_model.py'
2023-02-15T09:03:08,493   adding 'colossalai/context/process_group_initializer/initializer_pipeline.py'
2023-02-15T09:03:08,495   adding 'colossalai/context/process_group_initializer/initializer_sequence.py'
2023-02-15T09:03:08,498   adding 'colossalai/context/process_group_initializer/initializer_tensor.py'
2023-02-15T09:03:08,500   adding 'colossalai/context/process_group_initializer/process_group_initializer.py'
2023-02-15T09:03:08,504   adding 'colossalai/context/random/__init__.py'
2023-02-15T09:03:08,506   adding 'colossalai/context/random/_helper.py'
2023-02-15T09:03:08,509   adding 'colossalai/context/random/seed_manager.py'
2023-02-15T09:03:08,513   adding 'colossalai/device/__init__.py'
2023-02-15T09:03:08,518   adding 'colossalai/device/alpha_beta_profiler.py'
2023-02-15T09:03:08,521   adding 'colossalai/device/calc_pipeline_strategy.py'
2023-02-15T09:03:08,525   adding 'colossalai/device/device_mesh.py'
2023-02-15T09:03:08,528   adding 'colossalai/engine/__init__.py'
2023-02-15T09:03:08,532   adding 'colossalai/engine/_base_engine.py'
2023-02-15T09:03:08,535   adding 'colossalai/engine/gradient_accumulation/__init__.py'
2023-02-15T09:03:08,539   adding 'colossalai/engine/gradient_accumulation/_gradient_accumulation.py'
2023-02-15T09:03:08,543   adding 'colossalai/engine/gradient_handler/__init__.py'
2023-02-15T09:03:08,545   adding 'colossalai/engine/gradient_handler/_base_gradient_handler.py'
2023-02-15T09:03:08,547   adding 'colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py'
2023-02-15T09:03:08,550   adding 'colossalai/engine/gradient_handler/_moe_gradient_handler.py'
2023-02-15T09:03:08,552   adding 'colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py'
2023-02-15T09:03:08,555   adding 'colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py'
2023-02-15T09:03:08,557   adding 'colossalai/engine/gradient_handler/_zero_gradient_handler.py'
2023-02-15T09:03:08,559   adding 'colossalai/engine/gradient_handler/utils.py'
2023-02-15T09:03:08,562   adding 'colossalai/engine/schedule/__init__.py'
2023-02-15T09:03:08,566   adding 'colossalai/engine/schedule/_base_schedule.py'
2023-02-15T09:03:08,569   adding 'colossalai/engine/schedule/_non_pipeline_schedule.py'
2023-02-15T09:03:08,577   adding 'colossalai/engine/schedule/_pipeline_schedule.py'
2023-02-15T09:03:08,581   adding 'colossalai/engine/schedule/_pipeline_schedule_v2.py'
2023-02-15T09:03:08,585   adding 'colossalai/fx/__init__.py'
2023-02-15T09:03:08,588   adding 'colossalai/fx/_compatibility.py'
2023-02-15T09:03:08,593   adding 'colossalai/fx/_meta_registrations.py'
2023-02-15T09:03:08,597   adding 'colossalai/fx/graph_module.py'
2023-02-15T09:03:08,599   adding 'colossalai/fx/proxy.py'
2023-02-15T09:03:08,603   adding 'colossalai/fx/codegen/__init__.py'
2023-02-15T09:03:08,613   adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py'
2023-02-15T09:03:08,617   adding 'colossalai/fx/passes/__init__.py'
2023-02-15T09:03:08,620   adding 'colossalai/fx/passes/adding_split_node_pass.py'
2023-02-15T09:03:08,624   adding 'colossalai/fx/passes/concrete_info_prop.py'
2023-02-15T09:03:08,629   adding 'colossalai/fx/passes/meta_info_prop.py'
2023-02-15T09:03:08,635   adding 'colossalai/fx/passes/passes_for_gpt2_test.py'
2023-02-15T09:03:08,638   adding 'colossalai/fx/passes/shard_1d_pass.py'
2023-02-15T09:03:08,643   adding 'colossalai/fx/passes/split_module.py'
2023-02-15T09:03:08,646   adding 'colossalai/fx/passes/utils.py'
2023-02-15T09:03:08,650   adding 'colossalai/fx/passes/algorithms/__init__.py'
2023-02-15T09:03:08,652   adding 'colossalai/fx/passes/algorithms/build_c_ext.py'
2023-02-15T09:03:08,654   adding 'colossalai/fx/passes/algorithms/ckpt_solver_chen.py'
2023-02-15T09:03:08,660   adding 'colossalai/fx/passes/algorithms/ckpt_solver_pofo.py'
2023-02-15T09:03:08,665   adding 'colossalai/fx/passes/algorithms/ckpt_solver_rotor.py'
2023-02-15T09:03:08,668   adding 'colossalai/fx/passes/algorithms/linearize.py'
2023-02-15T09:03:08,672   adding 'colossalai/fx/passes/algorithms/operation.py'
2023-02-15T09:03:08,675   adding 'colossalai/fx/profiler/__init__.py'
2023-02-15T09:03:08,678   adding 'colossalai/fx/profiler/constants.py'
2023-02-15T09:03:08,681   adding 'colossalai/fx/profiler/dataflow.py'
2023-02-15T09:03:08,684   adding 'colossalai/fx/profiler/memory_utils.py'
2023-02-15T09:03:08,688   adding 'colossalai/fx/profiler/opcount.py'
2023-02-15T09:03:08,693   adding 'colossalai/fx/profiler/profiler.py'
2023-02-15T09:03:08,696   adding 'colossalai/fx/profiler/shard_utils.py'
2023-02-15T09:03:08,699   adding 'colossalai/fx/profiler/tensor.py'
2023-02-15T09:03:08,702   adding 'colossalai/fx/profiler/experimental/__init__.py'
2023-02-15T09:03:08,705   adding 'colossalai/fx/profiler/experimental/constants.py'
2023-02-15T09:03:08,708   adding 'colossalai/fx/profiler/experimental/profiler.py'
2023-02-15T09:03:08,710   adding 'colossalai/fx/profiler/experimental/registry.py'
2023-02-15T09:03:08,712   adding 'colossalai/fx/profiler/experimental/shard_utils.py'
2023-02-15T09:03:08,716   adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py'
2023-02-15T09:03:08,718   adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py'
2023-02-15T09:03:08,721   adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py'
2023-02-15T09:03:08,723   adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py'
2023-02-15T09:03:08,725   adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py'
2023-02-15T09:03:08,727   adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py'
2023-02-15T09:03:08,730   adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py'
2023-02-15T09:03:08,732   adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py'
2023-02-15T09:03:08,734   adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py'
2023-02-15T09:03:08,738   adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py'
2023-02-15T09:03:08,740   adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py'
2023-02-15T09:03:08,743   adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py'
2023-02-15T09:03:08,746   adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py'
2023-02-15T09:03:08,748   adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py'
2023-02-15T09:03:08,750   adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py'
2023-02-15T09:03:08,752   adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py'
2023-02-15T09:03:08,755   adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py'
2023-02-15T09:03:08,757   adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py'
2023-02-15T09:03:08,759   adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py'
2023-02-15T09:03:08,761   adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py'
2023-02-15T09:03:08,765   adding 'colossalai/fx/tracer/__init__.py'
2023-02-15T09:03:08,768   adding 'colossalai/fx/tracer/_meta_trace.py'
2023-02-15T09:03:08,770   adding 'colossalai/fx/tracer/_symbolic_trace.py'
2023-02-15T09:03:08,773   adding 'colossalai/fx/tracer/_tracer_utils.py'
2023-02-15T09:03:08,780   adding 'colossalai/fx/tracer/experimental.py'
2023-02-15T09:03:08,783   adding 'colossalai/fx/tracer/registry.py'
2023-02-15T09:03:08,790   adding 'colossalai/fx/tracer/tracer.py'
2023-02-15T09:03:08,794   adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py'
2023-02-15T09:03:08,797   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py'
2023-02-15T09:03:08,800   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py'
2023-02-15T09:03:08,802   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py'
2023-02-15T09:03:08,805   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py'
2023-02-15T09:03:08,808   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py'
2023-02-15T09:03:08,811   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py'
2023-02-15T09:03:08,814   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py'
2023-02-15T09:03:08,816   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py'
2023-02-15T09:03:08,818   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py'
2023-02-15T09:03:08,822   adding 'colossalai/fx/tracer/meta_patch/__init__.py'
2023-02-15T09:03:08,825   adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py'
2023-02-15T09:03:08,827   adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py'
2023-02-15T09:03:08,830   adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py'
2023-02-15T09:03:08,833   adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py'
2023-02-15T09:03:08,835   adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py'
2023-02-15T09:03:08,837   adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py'
2023-02-15T09:03:08,840   adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py'
2023-02-15T09:03:08,843   adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py'
2023-02-15T09:03:08,846   adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py'
2023-02-15T09:03:08,848   adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py'
2023-02-15T09:03:08,851   adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py'
2023-02-15T09:03:08,853   adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py'
2023-02-15T09:03:08,856   adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py'
2023-02-15T09:03:08,858   adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py'
2023-02-15T09:03:08,860   adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py'
2023-02-15T09:03:08,863   adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py'
2023-02-15T09:03:08,866   adding 'colossalai/gemini/__init__.py'
2023-02-15T09:03:08,869   adding 'colossalai/gemini/gemini_context.py'
2023-02-15T09:03:08,872   adding 'colossalai/gemini/gemini_mgr.py'
2023-02-15T09:03:08,876   adding 'colossalai/gemini/placement_policy.py'
2023-02-15T09:03:08,880   adding 'colossalai/gemini/stateful_tensor.py'
2023-02-15T09:03:08,882   adding 'colossalai/gemini/stateful_tensor_mgr.py'
2023-02-15T09:03:08,886   adding 'colossalai/gemini/tensor_placement_policy.py'
2023-02-15T09:03:08,888   adding 'colossalai/gemini/tensor_utils.py'
2023-02-15T09:03:08,892   adding 'colossalai/gemini/chunk/__init__.py'
2023-02-15T09:03:08,898   adding 'colossalai/gemini/chunk/chunk.py'
2023-02-15T09:03:08,902   adding 'colossalai/gemini/chunk/manager.py'
2023-02-15T09:03:08,905   adding 'colossalai/gemini/chunk/search_utils.py'
2023-02-15T09:03:08,908   adding 'colossalai/gemini/chunk/utils.py'
2023-02-15T09:03:08,911   adding 'colossalai/gemini/memory_tracer/__init__.py'
2023-02-15T09:03:08,914   adding 'colossalai/gemini/memory_tracer/chunk_memstats_collector.py'
2023-02-15T09:03:08,917   adding 'colossalai/gemini/memory_tracer/memory_monitor.py'
2023-02-15T09:03:08,920   adding 'colossalai/gemini/memory_tracer/memory_stats.py'
2023-02-15T09:03:08,923   adding 'colossalai/gemini/memory_tracer/memstats_collector.py'
2023-02-15T09:03:08,926   adding 'colossalai/gemini/memory_tracer/param_runtime_order.py'
2023-02-15T09:03:08,928   adding 'colossalai/gemini/memory_tracer/runtime_mem_tracer.py'
2023-02-15T09:03:08,931   adding 'colossalai/gemini/memory_tracer/static_memstats_collector.py'
2023-02-15T09:03:08,933   adding 'colossalai/gemini/memory_tracer/utils.py'
2023-02-15T09:03:08,937   adding 'colossalai/gemini/ophooks/__init__.py'
2023-02-15T09:03:08,939   adding 'colossalai/gemini/ophooks/_shard_grad_ophook.py'
2023-02-15T09:03:08,941   adding 'colossalai/gemini/ophooks/_shard_param_ophook.py'
2023-02-15T09:03:08,944   adding 'colossalai/gemini/ophooks/runtime_mem_tracer_hook.py'
2023-02-15T09:03:08,947   adding 'colossalai/gemini/ophooks/utils.py'
2023-02-15T09:03:08,950   adding 'colossalai/gemini/paramhooks/__init__.py'
2023-02-15T09:03:08,952   adding 'colossalai/gemini/paramhooks/_param_hookmgr.py'
2023-02-15T09:03:08,956   adding 'colossalai/kernel/__init__.py'
2023-02-15T09:03:08,959   adding 'colossalai/kernel/cuda_native/__init__.py'
2023-02-15T09:03:08,964   adding 'colossalai/kernel/cuda_native/flash_attention.py'
2023-02-15T09:03:08,967   adding 'colossalai/kernel/cuda_native/layer_norm.py'
2023-02-15T09:03:08,971   adding 'colossalai/kernel/cuda_native/multihead_attention.py'
2023-02-15T09:03:08,974   adding 'colossalai/kernel/cuda_native/scaled_softmax.py'
2023-02-15T09:03:08,979   adding 'colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp'
2023-02-15T09:03:08,981   adding 'colossalai/kernel/cuda_native/csrc/compat.h'
2023-02-15T09:03:08,985   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.cpp'
2023-02-15T09:03:08,988   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.h'
2023-02-15T09:03:08,991   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp'
2023-02-15T09:03:08,998   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu'
2023-02-15T09:03:09,001   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda.cpp'
2023-02-15T09:03:09,007   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu'
2023-02-15T09:03:09,010   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu'
2023-02-15T09:03:09,014   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh'
2023-02-15T09:03:09,018   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu'
2023-02-15T09:03:09,022   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu'
2023-02-15T09:03:09,025   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu'
2023-02-15T09:03:09,028   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu'
2023-02-15T09:03:09,033   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp'
2023-02-15T09:03:09,036   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h'
2023-02-15T09:03:09,039   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp'
2023-02-15T09:03:09,043   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h'
2023-02-15T09:03:09,047   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu'
2023-02-15T09:03:09,049   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp'
2023-02-15T09:03:09,054   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h'
2023-02-15T09:03:09,057   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu'
2023-02-15T09:03:09,060   adding 'colossalai/kernel/cuda_native/csrc/type_shim.h'
2023-02-15T09:03:09,066   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h'
2023-02-15T09:03:09,069   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/context.h'
2023-02-15T09:03:09,071   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h'
2023-02-15T09:03:09,074   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h'
2023-02-15T09:03:09,076   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h'
2023-02-15T09:03:09,078   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h'
2023-02-15T09:03:09,081   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h'
2023-02-15T09:03:09,084   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h'
2023-02-15T09:03:09,087   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh'
2023-02-15T09:03:09,089   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h'
2023-02-15T09:03:09,091   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h'
2023-02-15T09:03:09,094   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h'
2023-02-15T09:03:09,098   adding 'colossalai/kernel/jit/__init__.py'
2023-02-15T09:03:09,100   adding 'colossalai/kernel/jit/bias_dropout_add.py'
2023-02-15T09:03:09,102   adding 'colossalai/kernel/jit/bias_gelu.py'
2023-02-15T09:03:09,105   adding 'colossalai/kernel/jit/option.py'
2023-02-15T09:03:09,108   adding 'colossalai/kernel/op_builder/__init__.py'
2023-02-15T09:03:09,112   adding 'colossalai/kernel/op_builder/builder.py'
2023-02-15T09:03:09,114   adding 'colossalai/kernel/op_builder/cpu_adam.py'
2023-02-15T09:03:09,116   adding 'colossalai/kernel/op_builder/fused_optim.py'
2023-02-15T09:03:09,119   adding 'colossalai/kernel/op_builder/layernorm.py'
2023-02-15T09:03:09,121   adding 'colossalai/kernel/op_builder/moe.py'
2023-02-15T09:03:09,123   adding 'colossalai/kernel/op_builder/multi_head_attn.py'
2023-02-15T09:03:09,126   adding 'colossalai/kernel/op_builder/scaled_masked_softmax.py'
2023-02-15T09:03:09,128   adding 'colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py'
2023-02-15T09:03:09,130   adding 'colossalai/kernel/op_builder/utils.py'
2023-02-15T09:03:09,134   adding 'colossalai/logging/__init__.py'
2023-02-15T09:03:09,137   adding 'colossalai/logging/logger.py'
2023-02-15T09:03:09,141   adding 'colossalai/nn/__init__.py'
2023-02-15T09:03:09,144   adding 'colossalai/nn/init.py'
2023-02-15T09:03:09,148   adding 'colossalai/nn/_ops/__init__.py'
2023-02-15T09:03:09,151   adding 'colossalai/nn/_ops/_utils.py'
2023-02-15T09:03:09,154   adding 'colossalai/nn/_ops/addmm.py'
2023-02-15T09:03:09,156   adding 'colossalai/nn/_ops/batch_norm.py'
2023-02-15T09:03:09,159   adding 'colossalai/nn/_ops/element_wise.py'
2023-02-15T09:03:09,162   adding 'colossalai/nn/_ops/embedding.py'
2023-02-15T09:03:09,165   adding 'colossalai/nn/_ops/embedding_bag.py'
2023-02-15T09:03:09,168   adding 'colossalai/nn/_ops/layernorm.py'
2023-02-15T09:03:09,171   adding 'colossalai/nn/_ops/linear.py'
2023-02-15T09:03:09,174   adding 'colossalai/nn/_ops/loss.py'
2023-02-15T09:03:09,176   adding 'colossalai/nn/_ops/view.py'
2023-02-15T09:03:09,180   adding 'colossalai/nn/layer/__init__.py'
2023-02-15T09:03:09,182   adding 'colossalai/nn/layer/base_layer.py'
2023-02-15T09:03:09,186   adding 'colossalai/nn/layer/colossalai_layer/__init__.py'
2023-02-15T09:03:09,188   adding 'colossalai/nn/layer/colossalai_layer/_utils.py'
2023-02-15T09:03:09,190   adding 'colossalai/nn/layer/colossalai_layer/dropout.py'
2023-02-15T09:03:09,194   adding 'colossalai/nn/layer/colossalai_layer/embedding.py'
2023-02-15T09:03:09,196   adding 'colossalai/nn/layer/colossalai_layer/linear.py'
2023-02-15T09:03:09,199   adding 'colossalai/nn/layer/colossalai_layer/normalization.py'
2023-02-15T09:03:09,202   adding 'colossalai/nn/layer/moe/__init__.py'
2023-02-15T09:03:09,205   adding 'colossalai/nn/layer/moe/_operation.py'
2023-02-15T09:03:09,208   adding 'colossalai/nn/layer/moe/experts.py'
2023-02-15T09:03:09,212   adding 'colossalai/nn/layer/moe/layers.py'
2023-02-15T09:03:09,216   adding 'colossalai/nn/layer/moe/routers.py'
2023-02-15T09:03:09,219   adding 'colossalai/nn/layer/moe/utils.py'
2023-02-15T09:03:09,222   adding 'colossalai/nn/layer/parallel_1d/__init__.py'
2023-02-15T09:03:09,225   adding 'colossalai/nn/layer/parallel_1d/_operation.py'
2023-02-15T09:03:09,227   adding 'colossalai/nn/layer/parallel_1d/_utils.py'
2023-02-15T09:03:09,236   adding 'colossalai/nn/layer/parallel_1d/layers.py'
2023-02-15T09:03:09,240   adding 'colossalai/nn/layer/parallel_2d/__init__.py'
2023-02-15T09:03:09,246   adding 'colossalai/nn/layer/parallel_2d/_operation.py'
2023-02-15T09:03:09,249   adding 'colossalai/nn/layer/parallel_2d/_utils.py'
2023-02-15T09:03:09,257   adding 'colossalai/nn/layer/parallel_2d/layers.py'
2023-02-15T09:03:09,262   adding 'colossalai/nn/layer/parallel_2p5d/__init__.py'
2023-02-15T09:03:09,269   adding 'colossalai/nn/layer/parallel_2p5d/_operation.py'
2023-02-15T09:03:09,272   adding 'colossalai/nn/layer/parallel_2p5d/_utils.py'
2023-02-15T09:03:09,280   adding 'colossalai/nn/layer/parallel_2p5d/layers.py'
2023-02-15T09:03:09,285   adding 'colossalai/nn/layer/parallel_3d/__init__.py'
2023-02-15T09:03:09,290   adding 'colossalai/nn/layer/parallel_3d/_operation.py'
2023-02-15T09:03:09,293   adding 'colossalai/nn/layer/parallel_3d/_utils.py'
2023-02-15T09:03:09,301   adding 'colossalai/nn/layer/parallel_3d/layers.py'
2023-02-15T09:03:09,305   adding 'colossalai/nn/layer/parallel_sequence/__init__.py'
2023-02-15T09:03:09,308   adding 'colossalai/nn/layer/parallel_sequence/_operation.py'
2023-02-15T09:03:09,311   adding 'colossalai/nn/layer/parallel_sequence/_utils.py'
2023-02-15T09:03:09,314   adding 'colossalai/nn/layer/parallel_sequence/layers.py'
2023-02-15T09:03:09,318   adding 'colossalai/nn/layer/utils/__init__.py'
2023-02-15T09:03:09,320   adding 'colossalai/nn/layer/utils/common.py'
2023-02-15T09:03:09,323   adding 'colossalai/nn/layer/vanilla/__init__.py'
2023-02-15T09:03:09,328   adding 'colossalai/nn/layer/vanilla/layers.py'
2023-02-15T09:03:09,331   adding 'colossalai/nn/layer/wrapper/__init__.py'
2023-02-15T09:03:09,333   adding 'colossalai/nn/layer/wrapper/pipeline_wrapper.py'
2023-02-15T09:03:09,337   adding 'colossalai/nn/loss/__init__.py'
2023-02-15T09:03:09,340   adding 'colossalai/nn/loss/loss_1d.py'
2023-02-15T09:03:09,343   adding 'colossalai/nn/loss/loss_2d.py'
2023-02-15T09:03:09,346   adding 'colossalai/nn/loss/loss_2p5d.py'
2023-02-15T09:03:09,350   adding 'colossalai/nn/loss/loss_3d.py'
2023-02-15T09:03:09,352   adding 'colossalai/nn/loss/loss_moe.py'
2023-02-15T09:03:09,357   adding 'colossalai/nn/lr_scheduler/__init__.py'
2023-02-15T09:03:09,360   adding 'colossalai/nn/lr_scheduler/cosine.py'
2023-02-15T09:03:09,364   adding 'colossalai/nn/lr_scheduler/delayed.py'
2023-02-15T09:03:09,367   adding 'colossalai/nn/lr_scheduler/linear.py'
2023-02-15T09:03:09,370   adding 'colossalai/nn/lr_scheduler/multistep.py'
2023-02-15T09:03:09,374   adding 'colossalai/nn/lr_scheduler/onecycle.py'
2023-02-15T09:03:09,377   adding 'colossalai/nn/lr_scheduler/poly.py'
2023-02-15T09:03:09,380   adding 'colossalai/nn/lr_scheduler/torch.py'
2023-02-15T09:03:09,384   adding 'colossalai/nn/metric/__init__.py'
2023-02-15T09:03:09,387   adding 'colossalai/nn/metric/_utils.py'
2023-02-15T09:03:09,390   adding 'colossalai/nn/metric/accuracy_2d.py'
2023-02-15T09:03:09,392   adding 'colossalai/nn/metric/accuracy_2p5d.py'
2023-02-15T09:03:09,395   adding 'colossalai/nn/metric/accuracy_3d.py'
2023-02-15T09:03:09,399   adding 'colossalai/nn/optimizer/__init__.py'
2023-02-15T09:03:09,402   adding 'colossalai/nn/optimizer/colossalai_optimizer.py'
2023-02-15T09:03:09,406   adding 'colossalai/nn/optimizer/cpu_adam.py'
2023-02-15T09:03:09,410   adding 'colossalai/nn/optimizer/fused_adam.py'
2023-02-15T09:03:09,414   adding 'colossalai/nn/optimizer/fused_lamb.py'
2023-02-15T09:03:09,419   adding 'colossalai/nn/optimizer/fused_sgd.py'
2023-02-15T09:03:09,421   adding 'colossalai/nn/optimizer/gemini_optimizer.py'
2023-02-15T09:03:09,425   adding 'colossalai/nn/optimizer/hybrid_adam.py'
2023-02-15T09:03:09,429   adding 'colossalai/nn/optimizer/lamb.py'
2023-02-15T09:03:09,432   adding 'colossalai/nn/optimizer/lars.py'
2023-02-15T09:03:09,436   adding 'colossalai/nn/optimizer/nvme_optimizer.py'
2023-02-15T09:03:09,441   adding 'colossalai/nn/optimizer/zero_optimizer.py'
2023-02-15T09:03:09,445   adding 'colossalai/nn/parallel/__init__.py'
2023-02-15T09:03:09,455   adding 'colossalai/nn/parallel/data_parallel.py'
2023-02-15T09:03:09,458   adding 'colossalai/nn/parallel/gemini_parallel.py'
2023-02-15T09:03:09,462   adding 'colossalai/nn/parallel/reducer.py'
2023-02-15T09:03:09,466   adding 'colossalai/nn/parallel/utils.py'
2023-02-15T09:03:09,469   adding 'colossalai/nn/parallel/zero_wrapper.py'
2023-02-15T09:03:09,473   adding 'colossalai/nn/parallel/layers/__init__.py'
2023-02-15T09:03:09,476   adding 'colossalai/nn/parallel/layers/colo_module.py'
2023-02-15T09:03:09,479   adding 'colossalai/nn/parallel/layers/embedding.py'
2023-02-15T09:03:09,482   adding 'colossalai/nn/parallel/layers/linear.py'
2023-02-15T09:03:09,486   adding 'colossalai/nn/parallel/layers/module_utils.py'
2023-02-15T09:03:09,490   adding 'colossalai/nn/parallel/layers/cache_embedding/__init__.py'
2023-02-15T09:03:09,493   adding 'colossalai/nn/parallel/layers/cache_embedding/base_embedding.py'
2023-02-15T09:03:09,501   adding 'colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py'
2023-02-15T09:03:09,506   adding 'colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py'
2023-02-15T09:03:09,509   adding 'colossalai/nn/parallel/layers/cache_embedding/copyer.py'
2023-02-15T09:03:09,512   adding 'colossalai/nn/parallel/layers/cache_embedding/embedding_config.py'
2023-02-15T09:03:09,516   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py'
2023-02-15T09:03:09,520   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py'
2023-02-15T09:03:09,524   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py'
2023-02-15T09:03:09,528   adding 'colossalai/pipeline/__init__.py'
2023-02-15T09:03:09,531   adding 'colossalai/pipeline/layer_spec.py'
2023-02-15T09:03:09,536   adding 'colossalai/pipeline/pipelinable.py'
2023-02-15T09:03:09,539   adding 'colossalai/pipeline/pipeline_process_group.py'
2023-02-15T09:03:09,544   adding 'colossalai/pipeline/utils.py'
2023-02-15T09:03:09,548   adding 'colossalai/pipeline/middleware/__init__.py'
2023-02-15T09:03:09,551   adding 'colossalai/pipeline/middleware/topo.py'
2023-02-15T09:03:09,555   adding 'colossalai/pipeline/middleware/adaptor/__init__.py'
2023-02-15T09:03:09,559   adding 'colossalai/pipeline/middleware/adaptor/fx.py'
2023-02-15T09:03:09,563   adding 'colossalai/pipeline/rpc/__init__.py'
2023-02-15T09:03:09,578   adding 'colossalai/pipeline/rpc/_pipeline_base.py'
2023-02-15T09:03:09,585   adding 'colossalai/pipeline/rpc/_pipeline_schedule.py'
2023-02-15T09:03:09,589   adding 'colossalai/pipeline/rpc/utils.py'
2023-02-15T09:03:09,593   adding 'colossalai/registry/__init__.py'
2023-02-15T09:03:09,597   adding 'colossalai/registry/registry.py'
2023-02-15T09:03:09,601   adding 'colossalai/tensor/__init__.py'
2023-02-15T09:03:09,604   adding 'colossalai/tensor/colo_parameter.py'
2023-02-15T09:03:09,610   adding 'colossalai/tensor/colo_tensor.py'
2023-02-15T09:03:09,616   adding 'colossalai/tensor/comm_spec.py'
2023-02-15T09:03:09,619   adding 'colossalai/tensor/compute_spec.py'
2023-02-15T09:03:09,622   adding 'colossalai/tensor/const.py'
2023-02-15T09:03:09,626   adding 'colossalai/tensor/dist_spec_mgr.py'
2023-02-15T09:03:09,629   adding 'colossalai/tensor/distspec.py'
2023-02-15T09:03:09,632   adding 'colossalai/tensor/op_wrapper.py'
2023-02-15T09:03:09,636   adding 'colossalai/tensor/param_op_hook.py'
2023-02-15T09:03:09,640   adding 'colossalai/tensor/process_group.py'
2023-02-15T09:03:09,649   adding 'colossalai/tensor/shape_consistency.py'
2023-02-15T09:03:09,655   adding 'colossalai/tensor/sharding_spec.py'
2023-02-15T09:03:09,658   adding 'colossalai/tensor/tensor_spec.py'
2023-02-15T09:03:09,662   adding 'colossalai/tensor/utils.py'
2023-02-15T09:03:09,666   adding 'colossalai/testing/__init__.py'
2023-02-15T09:03:09,669   adding 'colossalai/testing/comparison.py'
2023-02-15T09:03:09,672   adding 'colossalai/testing/pytest_wrapper.py'
2023-02-15T09:03:09,675   adding 'colossalai/testing/random.py'
2023-02-15T09:03:09,679   adding 'colossalai/testing/utils.py'
2023-02-15T09:03:09,683   adding 'colossalai/trainer/__init__.py'
2023-02-15T09:03:09,688   adding 'colossalai/trainer/_trainer.py'
2023-02-15T09:03:09,692   adding 'colossalai/trainer/hooks/__init__.py'
2023-02-15T09:03:09,696   adding 'colossalai/trainer/hooks/_base_hook.py'
2023-02-15T09:03:09,699   adding 'colossalai/trainer/hooks/_checkpoint_hook.py'
2023-02-15T09:03:09,702   adding 'colossalai/trainer/hooks/_commons_.py'
2023-02-15T09:03:09,706   adding 'colossalai/trainer/hooks/_log_hook.py'
2023-02-15T09:03:09,709   adding 'colossalai/trainer/hooks/_lr_scheduler_hook.py'
2023-02-15T09:03:09,714   adding 'colossalai/trainer/hooks/_metric_hook.py'
2023-02-15T09:03:09,720   adding 'colossalai/utils/__init__.py'
2023-02-15T09:03:09,724   adding 'colossalai/utils/activation_checkpoint.py'
2023-02-15T09:03:09,729   adding 'colossalai/utils/checkpointing.py'
2023-02-15T09:03:09,735   adding 'colossalai/utils/common.py'
2023-02-15T09:03:09,738   adding 'colossalai/utils/cuda.py'
2023-02-15T09:03:09,742   adding 'colossalai/utils/memory.py'
2023-02-15T09:03:09,746   adding 'colossalai/utils/moe.py'
2023-02-15T09:03:09,749   adding 'colossalai/utils/timer.py'
2023-02-15T09:03:09,753   adding 'colossalai/utils/checkpoint/__init__.py'
2023-02-15T09:03:09,757   adding 'colossalai/utils/checkpoint/module_checkpoint.py'
2023-02-15T09:03:09,760   adding 'colossalai/utils/checkpoint/utils.py'
2023-02-15T09:03:09,764   adding 'colossalai/utils/checkpoint_io/__init__.py'
2023-02-15T09:03:09,767   adding 'colossalai/utils/checkpoint_io/backend.py'
2023-02-15T09:03:09,770   adding 'colossalai/utils/checkpoint_io/constant.py'
2023-02-15T09:03:09,774   adding 'colossalai/utils/checkpoint_io/convertor.py'
2023-02-15T09:03:09,778   adding 'colossalai/utils/checkpoint_io/distributed.py'
2023-02-15T09:03:09,782   adding 'colossalai/utils/checkpoint_io/io.py'
2023-02-15T09:03:09,785   adding 'colossalai/utils/checkpoint_io/meta.py'
2023-02-15T09:03:09,788   adding 'colossalai/utils/checkpoint_io/reader.py'
2023-02-15T09:03:09,793   adding 'colossalai/utils/checkpoint_io/utils.py'
2023-02-15T09:03:09,796   adding 'colossalai/utils/checkpoint_io/writer.py'
2023-02-15T09:03:09,800   adding 'colossalai/utils/data_sampler/__init__.py'
2023-02-15T09:03:09,803   adding 'colossalai/utils/data_sampler/base_sampler.py'
2023-02-15T09:03:09,807   adding 'colossalai/utils/data_sampler/data_parallel_sampler.py'
2023-02-15T09:03:09,811   adding 'colossalai/utils/model/__init__.py'
2023-02-15T09:03:09,815   adding 'colossalai/utils/model/colo_init_context.py'
2023-02-15T09:03:09,821   adding 'colossalai/utils/model/experimental.py'
2023-02-15T09:03:09,825   adding 'colossalai/utils/model/lazy_init_context.py'
2023-02-15T09:03:09,829   adding 'colossalai/utils/model/utils.py'
2023-02-15T09:03:09,833   adding 'colossalai/utils/multi_tensor_apply/__init__.py'
2023-02-15T09:03:09,835   adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py'
2023-02-15T09:03:09,840   adding 'colossalai/utils/profiler/__init__.py'
2023-02-15T09:03:09,843   adding 'colossalai/utils/profiler/extention.py'
2023-02-15T09:03:09,848   adding 'colossalai/utils/profiler/profiler.py'
2023-02-15T09:03:09,851   adding 'colossalai/utils/profiler/stateful_tensor_mem_extention.py'
2023-02-15T09:03:09,855   adding 'colossalai/utils/profiler/legacy/__init__.py'
2023-02-15T09:03:09,860   adding 'colossalai/utils/profiler/legacy/comm_profiler.py'
2023-02-15T09:03:09,864   adding 'colossalai/utils/profiler/legacy/pcie_profiler.py'
2023-02-15T09:03:09,867   adding 'colossalai/utils/profiler/legacy/prof_utils.py'
2023-02-15T09:03:09,871   adding 'colossalai/utils/rank_recorder/__init__.py'
2023-02-15T09:03:09,875   adding 'colossalai/utils/rank_recorder/rank_recorder.py'
2023-02-15T09:03:09,879   adding 'colossalai/utils/tensor_detector/__init__.py'
2023-02-15T09:03:09,883   adding 'colossalai/utils/tensor_detector/tensor_detector.py'
2023-02-15T09:03:09,888   adding 'colossalai/zero/__init__.py'
2023-02-15T09:03:09,891   adding 'colossalai/zero/init_ctx/__init__.py'
2023-02-15T09:03:09,896   adding 'colossalai/zero/init_ctx/init_context.py'
2023-02-15T09:03:09,900   adding 'colossalai/zero/shard_utils/__init__.py'
2023-02-15T09:03:09,903   adding 'colossalai/zero/shard_utils/base_shard_strategy.py'
2023-02-15T09:03:09,906   adding 'colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py'
2023-02-15T09:03:09,909   adding 'colossalai/zero/shard_utils/commons.py'
2023-02-15T09:03:09,912   adding 'colossalai/zero/shard_utils/tensor_shard_strategy.py'
2023-02-15T09:03:09,916   adding 'colossalai/zero/sharded_model/__init__.py'
2023-02-15T09:03:09,919   adding 'colossalai/zero/sharded_model/_utils.py'
2023-02-15T09:03:09,923   adding 'colossalai/zero/sharded_model/reduce_scatter.py'
2023-02-15T09:03:09,931   adding 'colossalai/zero/sharded_model/sharded_model_v2.py'
2023-02-15T09:03:09,934   adding 'colossalai/zero/sharded_model/utils.py'
2023-02-15T09:03:09,937   adding 'colossalai/zero/sharded_optim/__init__.py'
2023-02-15T09:03:09,941   adding 'colossalai/zero/sharded_optim/_utils.py'
2023-02-15T09:03:09,948   adding 'colossalai/zero/sharded_optim/low_level_optim.py'
2023-02-15T09:03:09,954   adding 'colossalai/zero/sharded_optim/sharded_optim_v2.py'
2023-02-15T09:03:09,958   adding 'colossalai/zero/sharded_optim/bookkeeping/__init__.py'
2023-02-15T09:03:09,960   adding 'colossalai/zero/sharded_optim/bookkeeping/base_store.py'
2023-02-15T09:03:09,962   adding 'colossalai/zero/sharded_optim/bookkeeping/bucket_store.py'
2023-02-15T09:03:09,965   adding 'colossalai/zero/sharded_optim/bookkeeping/gradient_store.py'
2023-02-15T09:03:09,967   adding 'colossalai/zero/sharded_optim/bookkeeping/parameter_store.py'
2023-02-15T09:03:09,970   adding 'colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py'
2023-02-15T09:03:09,973   adding 'colossalai/zero/sharded_param/__init__.py'
2023-02-15T09:03:09,976   adding 'colossalai/zero/sharded_param/sharded_param.py'
2023-02-15T09:03:09,978   adding 'colossalai/zero/sharded_param/sharded_tensor.py'
2023-02-15T09:03:09,981   adding 'colossalai/zero/utils/__init__.py'
2023-02-15T09:03:09,984   adding 'colossalai/zero/utils/gemini_hook.py'
2023-02-15T09:03:09,987   adding 'colossalai/zero/utils/zero_hook.py'
2023-02-15T09:03:09,993   adding 'op_builder/__init__.py'
2023-02-15T09:03:09,996   adding 'op_builder/builder.py'
2023-02-15T09:03:09,999   adding 'op_builder/cpu_adam.py'
2023-02-15T09:03:10,001   adding 'op_builder/fused_optim.py'
2023-02-15T09:03:10,003   adding 'op_builder/layernorm.py'
2023-02-15T09:03:10,006   adding 'op_builder/moe.py'
2023-02-15T09:03:10,008   adding 'op_builder/multi_head_attn.py'
2023-02-15T09:03:10,010   adding 'op_builder/scaled_masked_softmax.py'
2023-02-15T09:03:10,013   adding 'op_builder/scaled_upper_triangle_masked_softmax.py'
2023-02-15T09:03:10,015   adding 'op_builder/utils.py'
2023-02-15T09:03:10,019   adding 'colossalai-0.2.5.dist-info/LICENSE'
2023-02-15T09:03:10,024   adding 'colossalai-0.2.5.dist-info/METADATA'
2023-02-15T09:03:10,026   adding 'colossalai-0.2.5.dist-info/WHEEL'
2023-02-15T09:03:10,028   adding 'colossalai-0.2.5.dist-info/entry_points.txt'
2023-02-15T09:03:10,030   adding 'colossalai-0.2.5.dist-info/top_level.txt'
2023-02-15T09:03:10,055   adding 'colossalai-0.2.5.dist-info/RECORD'
2023-02-15T09:03:10,107   removing build/bdist.linux-armv7l/wheel
2023-02-15T09:03:10,701   Building wheel for colossalai (setup.py): finished with status 'done'
2023-02-15T09:03:10,746   Created wheel for colossalai: filename=colossalai-0.2.5-py3-none-any.whl size=879273 sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff
2023-02-15T09:03:10,748   Stored in directory: /tmp/pip-ephem-wheel-cache-4f5jlg0n/wheels/47/b6/82/95cc8ae1d9f26974be3beda3702bae2c79bf9a55a5933b46b9
2023-02-15T09:03:10,828 Successfully built colossalai
2023-02-15T09:03:10,899 Removed build tracker: '/tmp/pip-build-tracker-wqq850vi'