2023-02-06T13:17:35,325 Created temporary directory: /tmp/pip-ephem-wheel-cache-pg59lxgg
2023-02-06T13:17:35,330 Created temporary directory: /tmp/pip-build-tracker-qvutrwiy
2023-02-06T13:17:35,330 Initialized build tracking at /tmp/pip-build-tracker-qvutrwiy
2023-02-06T13:17:35,331 Created build tracker: /tmp/pip-build-tracker-qvutrwiy
2023-02-06T13:17:35,331 Entered build tracker: /tmp/pip-build-tracker-qvutrwiy
2023-02-06T13:17:35,332 Created temporary directory: /tmp/pip-wheel-n85garrw
2023-02-06T13:17:35,340 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453
2023-02-06T13:17:35,346 Created temporary directory: /tmp/pip-ephem-wheel-cache-7fsgugpz
2023-02-06T13:17:35,397 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-02-06T13:17:35,404 2 location(s) to search for versions of colossalai:
2023-02-06T13:17:35,404 * https://pypi.org/simple/colossalai/
2023-02-06T13:17:35,404 * https://www.piwheels.org/simple/colossalai/
2023-02-06T13:17:35,405 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/
2023-02-06T13:17:35,406 Getting page https://pypi.org/simple/colossalai/
2023-02-06T13:17:35,409 Found index url https://pypi.org/simple
2023-02-06T13:17:35,600 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json
2023-02-06T13:17:35,604   Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0
2023-02-06T13:17:35,606   Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1
2023-02-06T13:17:35,606 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/
2023-02-06T13:17:35,607 Getting page https://www.piwheels.org/simple/colossalai/
2023-02-06T13:17:35,609 Found index url https://www.piwheels.org/simple
2023-02-06T13:17:35,816 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html
2023-02-06T13:17:35,819   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-02-06T13:17:35,820 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/
2023-02-06T13:17:35,820 Skipping link: not a file: https://pypi.org/simple/colossalai/
2023-02-06T13:17:35,853 Given no hashes to check 1 links for project 'colossalai': discarding no candidates
2023-02-06T13:17:35,883 Collecting colossalai==0.2.1
2023-02-06T13:17:35,887   Created temporary directory: /tmp/pip-unpack-skr_8g2r
2023-02-06T13:17:36,150   Downloading colossalai-0.2.1.tar.gz (709 kB)
2023-02-06T13:17:39,459   Added colossalai==0.2.1 from https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz to build tracker '/tmp/pip-build-tracker-qvutrwiy'
2023-02-06T13:17:39,461   Running setup.py (path:/tmp/pip-wheel-n85garrw/colossalai_88b125173e614642a0782b69e56e6e12/setup.py) egg_info for package colossalai
2023-02-06T13:17:39,463   Created temporary directory: /tmp/pip-pip-egg-info-ho_vkg56
2023-02-06T13:17:39,463   Preparing metadata (setup.py): started
2023-02-06T13:17:39,465   Running command python setup.py egg_info
2023-02-06T13:17:42,200   running egg_info
2023-02-06T13:17:42,204   creating /tmp/pip-pip-egg-info-ho_vkg56/colossalai.egg-info
2023-02-06T13:17:42,267   writing /tmp/pip-pip-egg-info-ho_vkg56/colossalai.egg-info/PKG-INFO
2023-02-06T13:17:42,273   writing dependency_links to /tmp/pip-pip-egg-info-ho_vkg56/colossalai.egg-info/dependency_links.txt
2023-02-06T13:17:42,276   writing entry points to /tmp/pip-pip-egg-info-ho_vkg56/colossalai.egg-info/entry_points.txt
2023-02-06T13:17:42,279   writing requirements to /tmp/pip-pip-egg-info-ho_vkg56/colossalai.egg-info/requires.txt
2023-02-06T13:17:42,281   writing top-level names to /tmp/pip-pip-egg-info-ho_vkg56/colossalai.egg-info/top_level.txt
2023-02-06T13:17:42,284   writing manifest file '/tmp/pip-pip-egg-info-ho_vkg56/colossalai.egg-info/SOURCES.txt'
2023-02-06T13:17:42,687   reading manifest file '/tmp/pip-pip-egg-info-ho_vkg56/colossalai.egg-info/SOURCES.txt'
2023-02-06T13:17:42,690   reading manifest template 'MANIFEST.in'
2023-02-06T13:17:44,774   warning: no files found matching '*.tr' under directory 'colossalai'
2023-02-06T13:17:45,792   warning: no files found matching '*.cc' under directory 'colossalai'
2023-02-06T13:17:46,308   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-02-06T13:17:46,327   adding license file 'LICENSE'
2023-02-06T13:17:46,396   writing manifest file '/tmp/pip-pip-egg-info-ho_vkg56/colossalai.egg-info/SOURCES.txt'
2023-02-06T13:17:46,604   Preparing metadata (setup.py): finished with status 'done'
2023-02-06T13:17:46,619   Source in /tmp/pip-wheel-n85garrw/colossalai_88b125173e614642a0782b69e56e6e12 has version 0.2.1, which satisfies requirement colossalai==0.2.1 from https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz
2023-02-06T13:17:46,621   Removed colossalai==0.2.1 from https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz from build tracker '/tmp/pip-build-tracker-qvutrwiy'
2023-02-06T13:17:46,639 Created temporary directory: /tmp/pip-unpack-8q0ficb6
2023-02-06T13:17:46,641 Building wheels for collected packages: colossalai
2023-02-06T13:17:46,650   Created temporary directory: /tmp/pip-wheel-umy62h33
2023-02-06T13:17:46,651   Building wheel for colossalai (setup.py): started
2023-02-06T13:17:46,653   Destination directory: /tmp/pip-wheel-umy62h33
2023-02-06T13:17:46,653   Running command python setup.py bdist_wheel
2023-02-06T13:17:49,375   running bdist_wheel
2023-02-06T13:17:50,136   running build
2023-02-06T13:17:50,137   running build_py
2023-02-06T13:17:50,209   creating build
2023-02-06T13:17:50,209   creating build/lib
2023-02-06T13:17:50,211   creating build/lib/op_builder
2023-02-06T13:17:50,213   copying op_builder/__init__.py -> build/lib/op_builder
2023-02-06T13:17:50,217   copying op_builder/scaled_masked_softmax.py -> build/lib/op_builder
2023-02-06T13:17:50,219   copying op_builder/layernorm.py -> build/lib/op_builder
2023-02-06T13:17:50,222   copying op_builder/fused_optim.py -> build/lib/op_builder
2023-02-06T13:17:50,225   copying op_builder/utils.py -> build/lib/op_builder
2023-02-06T13:17:50,228   copying op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/op_builder
2023-02-06T13:17:50,231   copying op_builder/builder.py -> build/lib/op_builder
2023-02-06T13:17:50,235   copying op_builder/moe.py -> build/lib/op_builder
2023-02-06T13:17:50,239   copying op_builder/multi_head_attn.py -> build/lib/op_builder
2023-02-06T13:17:50,242   copying op_builder/cpu_adam.py -> build/lib/op_builder
2023-02-06T13:17:50,247   creating build/lib/colossalai
2023-02-06T13:17:50,249   copying colossalai/__init__.py -> build/lib/colossalai
2023-02-06T13:17:50,253   copying colossalai/initialize.py -> build/lib/colossalai
2023-02-06T13:17:50,258   copying colossalai/core.py -> build/lib/colossalai
2023-02-06T13:17:50,262   copying colossalai/global_variables.py -> build/lib/colossalai
2023-02-06T13:17:50,266   copying colossalai/constants.py -> build/lib/colossalai
2023-02-06T13:17:50,270   copying colossalai/version.py -> build/lib/colossalai
2023-02-06T13:17:50,274   creating build/lib/colossalai/_C
2023-02-06T13:17:50,276   copying colossalai/_C/__init__.py -> build/lib/colossalai/_C
2023-02-06T13:17:50,281   creating build/lib/colossalai/logging
2023-02-06T13:17:50,283   copying colossalai/logging/__init__.py -> build/lib/colossalai/logging
2023-02-06T13:17:50,287   copying colossalai/logging/logger.py -> build/lib/colossalai/logging
2023-02-06T13:17:50,294   creating build/lib/colossalai/tensor
2023-02-06T13:17:50,296   copying colossalai/tensor/dist_spec_mgr.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,302   copying colossalai/tensor/tensor_spec.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,305   copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,309   copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,314   copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,318   copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,322   copying colossalai/tensor/const.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,326   copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,330   copying colossalai/tensor/compute_spec.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,333   copying colossalai/tensor/op_wrapper.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,336   copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,341   copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,344   copying colossalai/tensor/process_group.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,349   copying colossalai/tensor/distspec.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,352   copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor
2023-02-06T13:17:50,359   creating build/lib/colossalai/zero
2023-02-06T13:17:50,360   copying colossalai/zero/__init__.py -> build/lib/colossalai/zero
2023-02-06T13:17:50,365   creating build/lib/colossalai/auto_parallel
2023-02-06T13:17:50,366   copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel
2023-02-06T13:17:50,370   creating build/lib/colossalai/amp
2023-02-06T13:17:50,371   copying colossalai/amp/__init__.py -> build/lib/colossalai/amp
2023-02-06T13:17:50,374   copying colossalai/amp/amp_type.py -> build/lib/colossalai/amp
2023-02-06T13:17:50,379   creating build/lib/colossalai/nn
2023-02-06T13:17:50,380   copying colossalai/nn/__init__.py -> build/lib/colossalai/nn
2023-02-06T13:17:50,384   copying colossalai/nn/init.py -> build/lib/colossalai/nn
2023-02-06T13:17:50,389   creating build/lib/colossalai/fx
2023-02-06T13:17:50,390   copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx
2023-02-06T13:17:50,394   copying colossalai/fx/__init__.py -> build/lib/colossalai/fx
2023-02-06T13:17:50,397   copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx
2023-02-06T13:17:50,400   copying colossalai/fx/_meta_registrations.py -> build/lib/colossalai/fx
2023-02-06T13:17:50,405   copying colossalai/fx/proxy.py -> build/lib/colossalai/fx
2023-02-06T13:17:50,410   creating build/lib/colossalai/utils
2023-02-06T13:17:50,412   copying colossalai/utils/__init__.py -> build/lib/colossalai/utils
2023-02-06T13:17:50,415   copying colossalai/utils/cuda.py -> build/lib/colossalai/utils
2023-02-06T13:17:50,418   copying colossalai/utils/common.py -> build/lib/colossalai/utils
2023-02-06T13:17:50,423   copying colossalai/utils/checkpointing.py -> build/lib/colossalai/utils
2023-02-06T13:17:50,427   copying colossalai/utils/activation_checkpoint.py -> build/lib/colossalai/utils
2023-02-06T13:17:50,431   copying colossalai/utils/moe.py -> build/lib/colossalai/utils
2023-02-06T13:17:50,435   copying colossalai/utils/memory.py -> build/lib/colossalai/utils
2023-02-06T13:17:50,439   copying colossalai/utils/timer.py -> build/lib/colossalai/utils
2023-02-06T13:17:50,443   creating build/lib/colossalai/kernel
2023-02-06T13:17:50,444   copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel
2023-02-06T13:17:50,449   creating build/lib/colossalai/builder
2023-02-06T13:17:50,450   copying colossalai/builder/__init__.py -> build/lib/colossalai/builder
2023-02-06T13:17:50,454   copying colossalai/builder/builder.py -> build/lib/colossalai/builder
2023-02-06T13:17:50,458   creating build/lib/colossalai/cli
2023-02-06T13:17:50,459   copying colossalai/cli/__init__.py -> build/lib/colossalai/cli
2023-02-06T13:17:50,463   copying colossalai/cli/cli.py -> build/lib/colossalai/cli
2023-02-06T13:17:50,467   creating build/lib/colossalai/context
2023-02-06T13:17:50,468   copying colossalai/context/__init__.py -> build/lib/colossalai/context
2023-02-06T13:17:50,472   copying colossalai/context/parallel_mode.py -> build/lib/colossalai/context
2023-02-06T13:17:50,475   copying colossalai/context/parallel_context.py -> build/lib/colossalai/context
2023-02-06T13:17:50,480   copying colossalai/context/moe_context.py -> build/lib/colossalai/context
2023-02-06T13:17:50,484   copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context
2023-02-06T13:17:50,487   copying colossalai/context/config.py -> build/lib/colossalai/context
2023-02-06T13:17:50,492   creating build/lib/colossalai/communication
2023-02-06T13:17:50,493   copying colossalai/communication/__init__.py -> build/lib/colossalai/communication
2023-02-06T13:17:50,496   copying colossalai/communication/p2p_v2.py -> build/lib/colossalai/communication
2023-02-06T13:17:50,500   copying colossalai/communication/collective.py -> build/lib/colossalai/communication
2023-02-06T13:17:50,505   copying colossalai/communication/ring.py -> build/lib/colossalai/communication
2023-02-06T13:17:50,508   copying colossalai/communication/p2p.py -> build/lib/colossalai/communication
2023-02-06T13:17:50,512   copying colossalai/communication/utils.py -> build/lib/colossalai/communication
2023-02-06T13:17:50,517   creating build/lib/colossalai/engine
2023-02-06T13:17:50,518   copying colossalai/engine/__init__.py -> build/lib/colossalai/engine
2023-02-06T13:17:50,522   copying colossalai/engine/_base_engine.py -> build/lib/colossalai/engine
2023-02-06T13:17:50,527   creating build/lib/colossalai/device
2023-02-06T13:17:50,528   copying colossalai/device/__init__.py -> build/lib/colossalai/device
2023-02-06T13:17:50,532   copying colossalai/device/device_mesh.py -> build/lib/colossalai/device
2023-02-06T13:17:50,535   copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device
2023-02-06T13:17:50,540   copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device
2023-02-06T13:17:50,545   creating build/lib/colossalai/registry
2023-02-06T13:17:50,546   copying colossalai/registry/__init__.py -> build/lib/colossalai/registry
2023-02-06T13:17:50,550   copying colossalai/registry/registry.py -> build/lib/colossalai/registry
2023-02-06T13:17:50,555   creating build/lib/colossalai/pipeline
2023-02-06T13:17:50,556   copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline
2023-02-06T13:17:50,560   copying colossalai/pipeline/utils.py -> build/lib/colossalai/pipeline
2023-02-06T13:17:50,564   copying colossalai/pipeline/layer_spec.py -> build/lib/colossalai/pipeline
2023-02-06T13:17:50,567   copying colossalai/pipeline/pipelinable.py -> build/lib/colossalai/pipeline
2023-02-06T13:17:50,571   copying colossalai/pipeline/pipeline_process_group.py -> build/lib/colossalai/pipeline
2023-02-06T13:17:50,577   creating build/lib/colossalai/gemini
2023-02-06T13:17:50,579   copying colossalai/gemini/__init__.py -> build/lib/colossalai/gemini
2023-02-06T13:17:50,582   copying colossalai/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/gemini
2023-02-06T13:17:50,586   copying colossalai/gemini/placement_policy.py -> build/lib/colossalai/gemini
2023-02-06T13:17:50,590   copying colossalai/gemini/gemini_mgr.py -> build/lib/colossalai/gemini
2023-02-06T13:17:50,594   copying colossalai/gemini/stateful_tensor.py -> build/lib/colossalai/gemini
2023-02-06T13:17:50,597   copying colossalai/gemini/tensor_placement_policy.py -> build/lib/colossalai/gemini
2023-02-06T13:17:50,601   copying colossalai/gemini/gemini_context.py -> build/lib/colossalai/gemini
2023-02-06T13:17:50,604   copying colossalai/gemini/tensor_utils.py -> build/lib/colossalai/gemini
2023-02-06T13:17:50,609   creating build/lib/colossalai/testing
2023-02-06T13:17:50,611   copying colossalai/testing/comparison.py -> build/lib/colossalai/testing
2023-02-06T13:17:50,614   copying colossalai/testing/__init__.py -> build/lib/colossalai/testing
2023-02-06T13:17:50,617   copying colossalai/testing/utils.py -> build/lib/colossalai/testing
2023-02-06T13:17:50,621   copying colossalai/testing/random.py -> build/lib/colossalai/testing
2023-02-06T13:17:50,625   copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing
2023-02-06T13:17:50,629   creating build/lib/colossalai/trainer
2023-02-06T13:17:50,630   copying colossalai/trainer/__init__.py -> build/lib/colossalai/trainer
2023-02-06T13:17:50,634   copying colossalai/trainer/_trainer.py -> build/lib/colossalai/trainer
2023-02-06T13:17:50,639   creating build/lib/colossalai/zero/sharded_optim
2023-02-06T13:17:50,641   copying colossalai/zero/sharded_optim/__init__.py -> build/lib/colossalai/zero/sharded_optim
2023-02-06T13:17:50,644   copying colossalai/zero/sharded_optim/_utils.py -> build/lib/colossalai/zero/sharded_optim
2023-02-06T13:17:50,648   copying colossalai/zero/sharded_optim/low_level_optim.py -> build/lib/colossalai/zero/sharded_optim
2023-02-06T13:17:50,653   copying colossalai/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/zero/sharded_optim
2023-02-06T13:17:50,659   creating build/lib/colossalai/zero/utils
2023-02-06T13:17:50,661   copying colossalai/zero/utils/__init__.py -> build/lib/colossalai/zero/utils
2023-02-06T13:17:50,664   copying colossalai/zero/utils/gemini_hook.py -> build/lib/colossalai/zero/utils
2023-02-06T13:17:50,667   copying colossalai/zero/utils/zero_hook.py -> build/lib/colossalai/zero/utils
2023-02-06T13:17:50,672   creating build/lib/colossalai/zero/sharded_param
2023-02-06T13:17:50,674   copying colossalai/zero/sharded_param/__init__.py -> build/lib/colossalai/zero/sharded_param
2023-02-06T13:17:50,677   copying colossalai/zero/sharded_param/sharded_param.py -> build/lib/colossalai/zero/sharded_param
2023-02-06T13:17:50,681   copying colossalai/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/zero/sharded_param
2023-02-06T13:17:50,686   creating build/lib/colossalai/zero/shard_utils
2023-02-06T13:17:50,687   copying colossalai/zero/shard_utils/__init__.py -> build/lib/colossalai/zero/shard_utils
2023-02-06T13:17:50,691   copying colossalai/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-02-06T13:17:50,694   copying colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-02-06T13:17:50,698   copying colossalai/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-02-06T13:17:50,701   copying colossalai/zero/shard_utils/commons.py -> build/lib/colossalai/zero/shard_utils
2023-02-06T13:17:50,706   creating build/lib/colossalai/zero/sharded_model
2023-02-06T13:17:50,707   copying colossalai/zero/sharded_model/__init__.py -> build/lib/colossalai/zero/sharded_model
2023-02-06T13:17:50,711   copying colossalai/zero/sharded_model/_utils.py -> build/lib/colossalai/zero/sharded_model
2023-02-06T13:17:50,714   copying colossalai/zero/sharded_model/utils.py -> build/lib/colossalai/zero/sharded_model
2023-02-06T13:17:50,717   copying colossalai/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/zero/sharded_model
2023-02-06T13:17:50,722   copying colossalai/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/zero/sharded_model
2023-02-06T13:17:50,727   creating build/lib/colossalai/zero/init_ctx
2023-02-06T13:17:50,729   copying colossalai/zero/init_ctx/__init__.py -> build/lib/colossalai/zero/init_ctx
2023-02-06T13:17:50,732   copying colossalai/zero/init_ctx/init_context.py -> build/lib/colossalai/zero/init_ctx
2023-02-06T13:17:50,738   creating build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:50,739   copying colossalai/zero/sharded_optim/bookkeeping/__init__.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:50,744   copying colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:50,747   copying colossalai/zero/sharded_optim/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:50,751   copying colossalai/zero/sharded_optim/bookkeeping/base_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:50,754   copying colossalai/zero/sharded_optim/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:50,757   copying colossalai/zero/sharded_optim/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:50,762   creating build/lib/colossalai/auto_parallel/meta_profiler
2023-02-06T13:17:50,763   copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-06T13:17:50,766   copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-06T13:17:50,770   copying colossalai/auto_parallel/meta_profiler/metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-06T13:17:50,773   copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-06T13:17:50,777   creating build/lib/colossalai/auto_parallel/pipeline_shard
2023-02-06T13:17:50,778   copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard
2023-02-06T13:17:50,783   creating build/lib/colossalai/auto_parallel/passes
2023-02-06T13:17:50,784   copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes
2023-02-06T13:17:50,787   copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes
2023-02-06T13:17:50,790   copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-02-06T13:17:50,794   copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-02-06T13:17:50,798   copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-02-06T13:17:50,803   copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes
2023-02-06T13:17:50,807   creating build/lib/colossalai/auto_parallel/tensor_shard
2023-02-06T13:17:50,809   copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-06T13:17:50,812   copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-06T13:17:50,816   copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-06T13:17:50,820   copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-06T13:17:50,825   creating build/lib/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:50,826   copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:50,830   copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:50,833   copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:50,837   copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:50,842   copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:50,845   copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:50,850   creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:50,852   copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:50,855   copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:50,858   copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:50,862   copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:50,867   copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:50,871   copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:50,876   copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:50,883   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,886   copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,890   copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,894   copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,898   copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,901   copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,904   copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,909   copying colossalai/auto_parallel/tensor_shard/node_handler/option.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,912   copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,916   copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,920   copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,923   copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,927   copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,930   copying colossalai/auto_parallel/tensor_shard/node_handler/reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,934   copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,937   copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,940   copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,943   copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,946   copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,950   copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,954   copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,958   copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,962   copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,966   copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,970   copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:50,976   creating build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:50,978   copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:50,982   copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:50,986   copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:50,991   copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:50,995   copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:50,999   copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:51,006   creating build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:51,008   copying colossalai/auto_parallel/tensor_shard/deprecated/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:51,013   copying colossalai/auto_parallel/tensor_shard/deprecated/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:51,017   copying colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:51,021   copying colossalai/auto_parallel/tensor_shard/deprecated/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:51,027   copying colossalai/auto_parallel/tensor_shard/deprecated/_utils.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:51,031   copying colossalai/auto_parallel/tensor_shard/deprecated/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:51,036   copying colossalai/auto_parallel/tensor_shard/deprecated/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:51,039   copying colossalai/auto_parallel/tensor_shard/deprecated/options.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:51,043   copying colossalai/auto_parallel/tensor_shard/deprecated/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:51,050   creating build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:51,052   copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:51,056   copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:51,059   copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:51,063   copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:51,067   copying colossalai/auto_parallel/tensor_shard/solver/options.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:51,071   copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:51,079   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,081   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,085   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,089   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,093   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,098   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,102   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,107   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,110   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,115   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,118   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,123   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,127   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,131   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,136   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,143   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,147   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,152   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,157   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,160   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:51,166   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:51,168   copying colossalai/auto_parallel/tensor_shard/node_handler/experimental/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:51,172   copying colossalai/auto_parallel/tensor_shard/node_handler/experimental/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:51,176   copying colossalai/auto_parallel/tensor_shard/node_handler/experimental/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:51,179   copying colossalai/auto_parallel/tensor_shard/node_handler/experimental/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:51,183   copying colossalai/auto_parallel/tensor_shard/node_handler/experimental/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:51,188   copying colossalai/auto_parallel/tensor_shard/node_handler/experimental/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:51,194   creating build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,196   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,200   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,204   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,208   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,213   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,217   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/bcast_op_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,223   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/dot_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,229   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,235   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,239   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,245   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,251   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:51,256   creating build/lib/colossalai/amp/naive_amp
2023-02-06T13:17:51,258   copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp
2023-02-06T13:17:51,262   copying colossalai/amp/naive_amp/_utils.py -> build/lib/colossalai/amp/naive_amp
2023-02-06T13:17:51,265   copying colossalai/amp/naive_amp/naive_amp.py -> build/lib/colossalai/amp/naive_amp
2023-02-06T13:17:51,270   copying colossalai/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/amp/naive_amp
2023-02-06T13:17:51,276   creating build/lib/colossalai/amp/apex_amp
2023-02-06T13:17:51,278   copying colossalai/amp/apex_amp/__init__.py -> build/lib/colossalai/amp/apex_amp
2023-02-06T13:17:51,282   copying colossalai/amp/apex_amp/apex_amp.py -> build/lib/colossalai/amp/apex_amp
2023-02-06T13:17:51,287   creating build/lib/colossalai/amp/torch_amp
2023-02-06T13:17:51,289   copying colossalai/amp/torch_amp/__init__.py -> build/lib/colossalai/amp/torch_amp
2023-02-06T13:17:51,293   copying colossalai/amp/torch_amp/torch_amp.py -> build/lib/colossalai/amp/torch_amp
2023-02-06T13:17:51,296   copying colossalai/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/amp/torch_amp
2023-02-06T13:17:51,304   creating build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-06T13:17:51,306   copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-06T13:17:51,310   copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-06T13:17:51,314   copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-06T13:17:51,317   copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-06T13:17:51,322   creating build/lib/colossalai/nn/loss
2023-02-06T13:17:51,323   copying colossalai/nn/loss/loss_moe.py -> build/lib/colossalai/nn/loss
2023-02-06T13:17:51,327   copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss
2023-02-06T13:17:51,331   copying colossalai/nn/loss/loss_2p5d.py -> build/lib/colossalai/nn/loss
2023-02-06T13:17:51,334   copying colossalai/nn/loss/loss_2d.py -> build/lib/colossalai/nn/loss
2023-02-06T13:17:51,339   copying colossalai/nn/loss/loss_3d.py -> build/lib/colossalai/nn/loss
2023-02-06T13:17:51,343   copying colossalai/nn/loss/loss_1d.py -> build/lib/colossalai/nn/loss
2023-02-06T13:17:51,348   creating build/lib/colossalai/nn/layer
2023-02-06T13:17:51,349   copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer
2023-02-06T13:17:51,353   copying colossalai/nn/layer/base_layer.py -> build/lib/colossalai/nn/layer
2023-02-06T13:17:51,358   creating build/lib/colossalai/nn/lr_scheduler
2023-02-06T13:17:51,359   copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-06T13:17:51,363   copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-06T13:17:51,367   copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-06T13:17:51,370   copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-06T13:17:51,374   copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-06T13:17:51,378   copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-06T13:17:51,381   copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-06T13:17:51,385   copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-06T13:17:51,390   creating build/lib/colossalai/nn/parallel
2023-02-06T13:17:51,392   copying colossalai/nn/parallel/__init__.py -> build/lib/colossalai/nn/parallel
2023-02-06T13:17:51,396   copying colossalai/nn/parallel/utils.py -> build/lib/colossalai/nn/parallel
2023-02-06T13:17:51,399   copying colossalai/nn/parallel/reducer.py -> build/lib/colossalai/nn/parallel
2023-02-06T13:17:51,403   copying colossalai/nn/parallel/gemini_parallel.py -> build/lib/colossalai/nn/parallel
2023-02-06T13:17:51,406   copying colossalai/nn/parallel/zero_wrapper.py -> build/lib/colossalai/nn/parallel
2023-02-06T13:17:51,410   copying colossalai/nn/parallel/data_parallel.py -> build/lib/colossalai/nn/parallel
2023-02-06T13:17:51,417   creating build/lib/colossalai/nn/metric
2023-02-06T13:17:51,419   copying colossalai/nn/metric/accuracy_2d.py -> build/lib/colossalai/nn/metric
2023-02-06T13:17:51,423   copying colossalai/nn/metric/__init__.py -> build/lib/colossalai/nn/metric
2023-02-06T13:17:51,426   copying colossalai/nn/metric/_utils.py -> build/lib/colossalai/nn/metric
2023-02-06T13:17:51,429   copying colossalai/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/nn/metric
2023-02-06T13:17:51,433   copying colossalai/nn/metric/accuracy_3d.py -> build/lib/colossalai/nn/metric
2023-02-06T13:17:51,438   creating build/lib/colossalai/nn/_ops
2023-02-06T13:17:51,439   copying colossalai/nn/_ops/addmm.py -> build/lib/colossalai/nn/_ops
2023-02-06T13:17:51,443   copying colossalai/nn/_ops/__init__.py -> build/lib/colossalai/nn/_ops
2023-02-06T13:17:51,446   copying colossalai/nn/_ops/loss.py -> build/lib/colossalai/nn/_ops
2023-02-06T13:17:51,449   copying colossalai/nn/_ops/_utils.py -> build/lib/colossalai/nn/_ops
2023-02-06T13:17:51,453   copying colossalai/nn/_ops/view.py -> build/lib/colossalai/nn/_ops
2023-02-06T13:17:51,456   copying colossalai/nn/_ops/layernorm.py -> build/lib/colossalai/nn/_ops
2023-02-06T13:17:51,460   copying colossalai/nn/_ops/linear.py -> build/lib/colossalai/nn/_ops
2023-02-06T13:17:51,463   copying colossalai/nn/_ops/batch_norm.py -> build/lib/colossalai/nn/_ops
2023-02-06T13:17:51,467   copying colossalai/nn/_ops/embedding.py -> build/lib/colossalai/nn/_ops
2023-02-06T13:17:51,471   copying colossalai/nn/_ops/element_wise.py -> build/lib/colossalai/nn/_ops
2023-02-06T13:17:51,475   copying colossalai/nn/_ops/embedding_bag.py -> build/lib/colossalai/nn/_ops
2023-02-06T13:17:51,481   creating build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,483   copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,486   copying colossalai/nn/optimizer/zero_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,492   copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,495   copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,500   copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,504   copying colossalai/nn/optimizer/colossalai_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,508   copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,513   copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,518   copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,523   copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,527   copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,532   copying colossalai/nn/optimizer/gemini_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-06T13:17:51,537   creating build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-06T13:17:51,539   copying colossalai/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-06T13:17:51,546   copying colossalai/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-06T13:17:51,550   copying colossalai/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-06T13:17:51,554   copying colossalai/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-06T13:17:51,563   creating build/lib/colossalai/nn/layer/wrapper
2023-02-06T13:17:51,564   copying colossalai/nn/layer/wrapper/__init__.py -> build/lib/colossalai/nn/layer/wrapper
2023-02-06T13:17:51,568   copying colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/nn/layer/wrapper
2023-02-06T13:17:51,572   creating build/lib/colossalai/nn/layer/utils
2023-02-06T13:17:51,574   copying colossalai/nn/layer/utils/__init__.py -> build/lib/colossalai/nn/layer/utils
2023-02-06T13:17:51,577   copying colossalai/nn/layer/utils/common.py -> build/lib/colossalai/nn/layer/utils
2023-02-06T13:17:51,582   creating build/lib/colossalai/nn/layer/parallel_3d
2023-02-06T13:17:51,583   copying colossalai/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-06T13:17:51,589   copying colossalai/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-06T13:17:51,592   copying colossalai/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-06T13:17:51,596   copying colossalai/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-06T13:17:51,605   creating build/lib/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:51,607   copying colossalai/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:51,610   copying colossalai/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:51,613   copying colossalai/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:51,617   copying colossalai/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:51,620   copying colossalai/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:51,623   copying colossalai/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:51,629   creating build/lib/colossalai/nn/layer/parallel_sequence
2023-02-06T13:17:51,630   copying colossalai/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-06T13:17:51,635   copying colossalai/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-06T13:17:51,638   copying colossalai/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-06T13:17:51,641   copying colossalai/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-06T13:17:51,647   creating build/lib/colossalai/nn/layer/moe
2023-02-06T13:17:51,648   copying colossalai/nn/layer/moe/_operation.py -> build/lib/colossalai/nn/layer/moe
2023-02-06T13:17:51,653   copying colossalai/nn/layer/moe/__init__.py -> build/lib/colossalai/nn/layer/moe
2023-02-06T13:17:51,656   copying colossalai/nn/layer/moe/utils.py -> build/lib/colossalai/nn/layer/moe
2023-02-06T13:17:51,659   copying colossalai/nn/layer/moe/experts.py -> build/lib/colossalai/nn/layer/moe
2023-02-06T13:17:51,663   copying colossalai/nn/layer/moe/routers.py -> build/lib/colossalai/nn/layer/moe
2023-02-06T13:17:51,667   copying colossalai/nn/layer/moe/layers.py -> build/lib/colossalai/nn/layer/moe
2023-02-06T13:17:51,673   creating build/lib/colossalai/nn/layer/parallel_1d
2023-02-06T13:17:51,674   copying colossalai/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-06T13:17:51,677   copying colossalai/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-06T13:17:51,681   copying colossalai/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-06T13:17:51,684   copying colossalai/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-06T13:17:51,693   creating build/lib/colossalai/nn/layer/parallel_2d
2023-02-06T13:17:51,694   copying colossalai/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-06T13:17:51,699   copying colossalai/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-06T13:17:51,703   copying colossalai/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-06T13:17:51,706   copying colossalai/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-06T13:17:51,713   creating build/lib/colossalai/nn/layer/vanilla
2023-02-06T13:17:51,715   copying colossalai/nn/layer/vanilla/__init__.py -> build/lib/colossalai/nn/layer/vanilla
2023-02-06T13:17:51,718   copying colossalai/nn/layer/vanilla/layers.py -> build/lib/colossalai/nn/layer/vanilla
2023-02-06T13:17:51,727   creating build/lib/colossalai/nn/parallel/layers
2023-02-06T13:17:51,728   copying colossalai/nn/parallel/layers/__init__.py -> build/lib/colossalai/nn/parallel/layers
2023-02-06T13:17:51,732   copying colossalai/nn/parallel/layers/colo_module.py -> build/lib/colossalai/nn/parallel/layers
2023-02-06T13:17:51,736   copying colossalai/nn/parallel/layers/linear.py -> build/lib/colossalai/nn/parallel/layers
2023-02-06T13:17:51,739   copying colossalai/nn/parallel/layers/module_utils.py -> build/lib/colossalai/nn/parallel/layers
2023-02-06T13:17:51,743   copying colossalai/nn/parallel/layers/embedding.py -> build/lib/colossalai/nn/parallel/layers
2023-02-06T13:17:51,749   creating build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:51,751   copying colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:51,755   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:51,759   copying colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:51,764   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:51,769   copying colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:51,775   copying colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:51,779   copying colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:51,783   copying colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:51,787   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:51,793   creating build/lib/colossalai/fx/codegen
2023-02-06T13:17:51,795   copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen
2023-02-06T13:17:51,799   copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen
2023-02-06T13:17:51,807   creating build/lib/colossalai/fx/tracer
2023-02-06T13:17:51,809   copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer
2023-02-06T13:17:51,813   copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer
2023-02-06T13:17:51,818   copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer
2023-02-06T13:17:51,822   copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer
2023-02-06T13:17:51,827   copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer
2023-02-06T13:17:51,831   copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer
2023-02-06T13:17:51,835   copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer
2023-02-06T13:17:51,843   creating build/lib/colossalai/fx/passes
2023-02-06T13:17:51,845   copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes
2023-02-06T13:17:51,849   copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes
2023-02-06T13:17:51,853   copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes
2023-02-06T13:17:51,858   copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes
2023-02-06T13:17:51,863   copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes
2023-02-06T13:17:51,867   copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes
2023-02-06T13:17:51,872   copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes
2023-02-06T13:17:51,876   copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes
2023-02-06T13:17:51,883   creating build/lib/colossalai/fx/profiler
2023-02-06T13:17:51,884   copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler
2023-02-06T13:17:51,887   copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler
2023-02-06T13:17:51,892   copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler
2023-02-06T13:17:51,896   copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler
2023-02-06T13:17:51,900   copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler
2023-02-06T13:17:51,904   copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler
2023-02-06T13:17:51,907   copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler
2023-02-06T13:17:51,911   copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler
2023-02-06T13:17:51,916   creating build/lib/colossalai/fx/tracer/bias_addition_patch
2023-02-06T13:17:51,917   copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch
2023-02-06T13:17:51,922   creating build/lib/colossalai/fx/tracer/meta_patch
2023-02-06T13:17:51,923   copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch
2023-02-06T13:17:51,928   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-06T13:17:51,929   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-06T13:17:51,933   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-06T13:17:51,936   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-06T13:17:51,940   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-06T13:17:51,943   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-06T13:17:51,948   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-06T13:17:51,949   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-06T13:17:51,953   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-06T13:17:51,956   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-06T13:17:51,960   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-06T13:17:51,965   creating build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:51,966   copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:51,970   copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:51,973   copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:51,977   copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:51,981   copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:51,984   copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:51,987   copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:51,990   copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:51,996   creating build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:51,997   copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:52,001   copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:52,004   copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:52,007   copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:52,011   copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:52,014   copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:52,017   copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:52,021   copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:52,026   creating build/lib/colossalai/fx/passes/algorithms
2023-02-06T13:17:52,028   copying colossalai/fx/passes/algorithms/__init__.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-06T13:17:52,031   copying colossalai/fx/passes/algorithms/build_c_ext.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-06T13:17:52,034   copying colossalai/fx/passes/algorithms/ckpt_solver_pofo.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-06T13:17:52,039   copying colossalai/fx/passes/algorithms/operation.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-06T13:17:52,043   copying colossalai/fx/passes/algorithms/ckpt_solver_rotor.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-06T13:17:52,048   copying colossalai/fx/passes/algorithms/ckpt_solver_chen.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-06T13:17:52,051   copying colossalai/fx/passes/algorithms/linearize.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-06T13:17:52,056   creating build/lib/colossalai/fx/profiler/experimental
2023-02-06T13:17:52,057   copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-06T13:17:52,061   copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-06T13:17:52,064   copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-06T13:17:52,067   copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-06T13:17:52,071   copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-06T13:17:52,076   creating build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:52,077   copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:52,081   copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:52,084   copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:52,087   copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:52,090   copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:52,093   copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:52,097   copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:52,100   copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:52,103   copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:52,106   copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:52,110   copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:52,116   creating build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:52,117   copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:52,121   copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:52,124   copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:52,127   copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:52,131   copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:52,134   copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:52,137   copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:52,140   copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:52,143   copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:52,149   creating build/lib/colossalai/utils/checkpoint_io
2023-02-06T13:17:52,150   copying colossalai/utils/checkpoint_io/__init__.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-06T13:17:52,154   copying colossalai/utils/checkpoint_io/backend.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-06T13:17:52,157   copying colossalai/utils/checkpoint_io/utils.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-06T13:17:52,161   copying colossalai/utils/checkpoint_io/writer.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-06T13:17:52,165   copying colossalai/utils/checkpoint_io/convertor.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-06T13:17:52,169   copying colossalai/utils/checkpoint_io/reader.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-06T13:17:52,173   copying colossalai/utils/checkpoint_io/io.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-06T13:17:52,177   copying colossalai/utils/checkpoint_io/meta.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-06T13:17:52,180   copying colossalai/utils/checkpoint_io/constant.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-06T13:17:52,184   copying colossalai/utils/checkpoint_io/distributed.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-06T13:17:52,189   creating build/lib/colossalai/utils/multi_tensor_apply
2023-02-06T13:17:52,190   copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-02-06T13:17:52,194   copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-02-06T13:17:52,199   creating build/lib/colossalai/utils/rank_recorder
2023-02-06T13:17:52,200   copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder
2023-02-06T13:17:52,204   copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder
2023-02-06T13:17:52,209   creating build/lib/colossalai/utils/data_sampler
2023-02-06T13:17:52,210   copying colossalai/utils/data_sampler/__init__.py -> build/lib/colossalai/utils/data_sampler
2023-02-06T13:17:52,214   copying colossalai/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/utils/data_sampler
2023-02-06T13:17:52,218   copying colossalai/utils/data_sampler/base_sampler.py -> build/lib/colossalai/utils/data_sampler
2023-02-06T13:17:52,223   creating build/lib/colossalai/utils/model
2023-02-06T13:17:52,225   copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model
2023-02-06T13:17:52,228   copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model
2023-02-06T13:17:52,231   copying colossalai/utils/model/experimental.py -> build/lib/colossalai/utils/model
2023-02-06T13:17:52,236   copying colossalai/utils/model/lazy_init_context.py -> build/lib/colossalai/utils/model
2023-02-06T13:17:52,242   copying colossalai/utils/model/colo_init_context.py -> build/lib/colossalai/utils/model
2023-02-06T13:17:52,248   creating build/lib/colossalai/utils/checkpoint
2023-02-06T13:17:52,249   copying colossalai/utils/checkpoint/__init__.py -> build/lib/colossalai/utils/checkpoint
2023-02-06T13:17:52,253   copying colossalai/utils/checkpoint/utils.py -> build/lib/colossalai/utils/checkpoint
2023-02-06T13:17:52,256   copying colossalai/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/utils/checkpoint
2023-02-06T13:17:52,262   creating build/lib/colossalai/utils/profiler
2023-02-06T13:17:52,263   copying colossalai/utils/profiler/__init__.py -> build/lib/colossalai/utils/profiler
2023-02-06T13:17:52,267   copying colossalai/utils/profiler/extention.py -> build/lib/colossalai/utils/profiler
2023-02-06T13:17:52,270   copying colossalai/utils/profiler/profiler.py -> build/lib/colossalai/utils/profiler
2023-02-06T13:17:52,275   copying colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/utils/profiler
2023-02-06T13:17:52,279   creating build/lib/colossalai/utils/tensor_detector
2023-02-06T13:17:52,281   copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector
2023-02-06T13:17:52,285   copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector
2023-02-06T13:17:52,291   creating build/lib/colossalai/utils/profiler/legacy
2023-02-06T13:17:52,292   copying colossalai/utils/profiler/legacy/__init__.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-06T13:17:52,296   copying colossalai/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-06T13:17:52,299   copying colossalai/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-06T13:17:52,303   copying colossalai/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-06T13:17:52,310   creating build/lib/colossalai/kernel/cuda_native
2023-02-06T13:17:52,311   copying colossalai/kernel/cuda_native/__init__.py -> build/lib/colossalai/kernel/cuda_native
2023-02-06T13:17:52,315   copying colossalai/kernel/cuda_native/multihead_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-02-06T13:17:52,319   copying colossalai/kernel/cuda_native/flash_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-02-06T13:17:52,325   copying colossalai/kernel/cuda_native/layer_norm.py -> build/lib/colossalai/kernel/cuda_native
2023-02-06T13:17:52,328   copying colossalai/kernel/cuda_native/scaled_softmax.py -> build/lib/colossalai/kernel/cuda_native
2023-02-06T13:17:52,334   creating build/lib/colossalai/kernel/op_builder
2023-02-06T13:17:52,336   copying colossalai/kernel/op_builder/__init__.py -> build/lib/colossalai/kernel/op_builder
2023-02-06T13:17:52,339   copying colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-02-06T13:17:52,343   copying colossalai/kernel/op_builder/layernorm.py -> build/lib/colossalai/kernel/op_builder
2023-02-06T13:17:52,347   copying colossalai/kernel/op_builder/fused_optim.py -> build/lib/colossalai/kernel/op_builder
2023-02-06T13:17:52,350   copying colossalai/kernel/op_builder/utils.py -> build/lib/colossalai/kernel/op_builder
2023-02-06T13:17:52,354   copying colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-02-06T13:17:52,357   copying colossalai/kernel/op_builder/builder.py -> build/lib/colossalai/kernel/op_builder
2023-02-06T13:17:52,362   copying colossalai/kernel/op_builder/moe.py -> build/lib/colossalai/kernel/op_builder
2023-02-06T13:17:52,365   copying colossalai/kernel/op_builder/multi_head_attn.py -> build/lib/colossalai/kernel/op_builder
2023-02-06T13:17:52,369   copying colossalai/kernel/op_builder/cpu_adam.py -> build/lib/colossalai/kernel/op_builder
2023-02-06T13:17:52,373   creating build/lib/colossalai/kernel/jit
2023-02-06T13:17:52,375   copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit
2023-02-06T13:17:52,378   copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit
2023-02-06T13:17:52,382   copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit
2023-02-06T13:17:52,385   copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit
2023-02-06T13:17:52,390   creating build/lib/colossalai/cli/benchmark
2023-02-06T13:17:52,391   copying colossalai/cli/benchmark/__init__.py -> build/lib/colossalai/cli/benchmark
2023-02-06T13:17:52,395   copying colossalai/cli/benchmark/models.py -> build/lib/colossalai/cli/benchmark
2023-02-06T13:17:52,398   copying colossalai/cli/benchmark/utils.py -> build/lib/colossalai/cli/benchmark
2023-02-06T13:17:52,402   copying colossalai/cli/benchmark/benchmark.py -> build/lib/colossalai/cli/benchmark
2023-02-06T13:17:52,407   creating build/lib/colossalai/cli/launcher
2023-02-06T13:17:52,409   copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher
2023-02-06T13:17:52,413   copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher
2023-02-06T13:17:52,417   copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher
2023-02-06T13:17:52,421   copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher
2023-02-06T13:17:52,426   creating build/lib/colossalai/cli/check
2023-02-06T13:17:52,427   copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check
2023-02-06T13:17:52,431   copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check
2023-02-06T13:17:52,436   creating build/lib/colossalai/context/random
2023-02-06T13:17:52,438   copying colossalai/context/random/seed_manager.py -> build/lib/colossalai/context/random
2023-02-06T13:17:52,442   copying colossalai/context/random/__init__.py -> build/lib/colossalai/context/random
2023-02-06T13:17:52,445   copying colossalai/context/random/_helper.py -> build/lib/colossalai/context/random
2023-02-06T13:17:52,451   creating build/lib/colossalai/context/process_group_initializer
2023-02-06T13:17:52,453   copying colossalai/context/process_group_initializer/__init__.py -> build/lib/colossalai/context/process_group_initializer
2023-02-06T13:17:52,457   copying colossalai/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/context/process_group_initializer
2023-02-06T13:17:52,460   copying colossalai/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-06T13:17:52,464   copying colossalai/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-06T13:17:52,469   copying colossalai/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/context/process_group_initializer
2023-02-06T13:17:52,472   copying colossalai/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/context/process_group_initializer
2023-02-06T13:17:52,475   copying colossalai/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-06T13:17:52,479   copying colossalai/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/context/process_group_initializer
2023-02-06T13:17:52,482   copying colossalai/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-06T13:17:52,487   copying colossalai/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/context/process_group_initializer
2023-02-06T13:17:52,490   copying colossalai/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/context/process_group_initializer
2023-02-06T13:17:52,496   creating build/lib/colossalai/engine/gradient_handler
2023-02-06T13:17:52,497   copying colossalai/engine/gradient_handler/__init__.py -> build/lib/colossalai/engine/gradient_handler
2023-02-06T13:17:52,501   copying colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-06T13:17:52,505   copying colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-06T13:17:52,508   copying colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-06T13:17:52,512   copying colossalai/engine/gradient_handler/utils.py -> build/lib/colossalai/engine/gradient_handler
2023-02-06T13:17:52,515   copying colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-06T13:17:52,518   copying colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-06T13:17:52,522   copying colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-06T13:17:52,527   creating build/lib/colossalai/engine/schedule
2023-02-06T13:17:52,529   copying colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/engine/schedule
2023-02-06T13:17:52,533   copying colossalai/engine/schedule/__init__.py -> build/lib/colossalai/engine/schedule
2023-02-06T13:17:52,536   copying colossalai/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/engine/schedule
2023-02-06T13:17:52,540   copying colossalai/engine/schedule/_base_schedule.py -> build/lib/colossalai/engine/schedule
2023-02-06T13:17:52,544   copying colossalai/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/engine/schedule
2023-02-06T13:17:52,551   creating build/lib/colossalai/engine/gradient_accumulation
2023-02-06T13:17:52,553   copying colossalai/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/engine/gradient_accumulation
2023-02-06T13:17:52,557   copying colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/engine/gradient_accumulation
2023-02-06T13:17:52,562   creating build/lib/colossalai/pipeline/middleware
2023-02-06T13:17:52,563   copying colossalai/pipeline/middleware/__init__.py -> build/lib/colossalai/pipeline/middleware
2023-02-06T13:17:52,567   copying colossalai/pipeline/middleware/topo.py -> build/lib/colossalai/pipeline/middleware
2023-02-06T13:17:52,573   creating build/lib/colossalai/pipeline/rpc
2023-02-06T13:17:52,574   copying colossalai/pipeline/rpc/__init__.py -> build/lib/colossalai/pipeline/rpc
2023-02-06T13:17:52,578   copying colossalai/pipeline/rpc/utils.py -> build/lib/colossalai/pipeline/rpc
2023-02-06T13:17:52,582   copying colossalai/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/pipeline/rpc
2023-02-06T13:17:52,587   copying colossalai/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/pipeline/rpc
2023-02-06T13:17:52,594   creating build/lib/colossalai/pipeline/middleware/adaptor
2023-02-06T13:17:52,596   copying colossalai/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/pipeline/middleware/adaptor
2023-02-06T13:17:52,600   copying colossalai/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/pipeline/middleware/adaptor
2023-02-06T13:17:52,605   creating build/lib/colossalai/gemini/ophooks
2023-02-06T13:17:52,606   copying colossalai/gemini/ophooks/__init__.py -> build/lib/colossalai/gemini/ophooks
2023-02-06T13:17:52,610   copying colossalai/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/gemini/ophooks
2023-02-06T13:17:52,614   copying colossalai/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/gemini/ophooks
2023-02-06T13:17:52,617   copying colossalai/gemini/ophooks/utils.py -> build/lib/colossalai/gemini/ophooks
2023-02-06T13:17:52,622   copying colossalai/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/gemini/ophooks
2023-02-06T13:17:52,627   creating build/lib/colossalai/gemini/chunk
2023-02-06T13:17:52,628   copying colossalai/gemini/chunk/__init__.py -> build/lib/colossalai/gemini/chunk
2023-02-06T13:17:52,632   copying colossalai/gemini/chunk/chunk.py -> build/lib/colossalai/gemini/chunk
2023-02-06T13:17:52,637   copying colossalai/gemini/chunk/search_utils.py -> build/lib/colossalai/gemini/chunk
2023-02-06T13:17:52,640   copying colossalai/gemini/chunk/utils.py -> build/lib/colossalai/gemini/chunk
2023-02-06T13:17:52,644   copying colossalai/gemini/chunk/manager.py -> build/lib/colossalai/gemini/chunk
2023-02-06T13:17:52,649   creating build/lib/colossalai/gemini/paramhooks
2023-02-06T13:17:52,651   copying colossalai/gemini/paramhooks/__init__.py -> build/lib/colossalai/gemini/paramhooks
2023-02-06T13:17:52,655   copying colossalai/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/gemini/paramhooks
2023-02-06T13:17:52,660   creating build/lib/colossalai/gemini/memory_tracer
2023-02-06T13:17:52,662   copying colossalai/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-06T13:17:52,666   copying colossalai/gemini/memory_tracer/__init__.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-06T13:17:52,669   copying colossalai/gemini/memory_tracer/utils.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-06T13:17:52,673   copying colossalai/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-06T13:17:52,676   copying colossalai/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-06T13:17:52,679   copying colossalai/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-06T13:17:52,683   copying colossalai/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-06T13:17:52,686   copying colossalai/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-06T13:17:52,690   copying colossalai/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-06T13:17:52,696   creating build/lib/colossalai/trainer/hooks
2023-02-06T13:17:52,697   copying colossalai/trainer/hooks/__init__.py -> build/lib/colossalai/trainer/hooks
2023-02-06T13:17:52,701   copying colossalai/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-06T13:17:52,706   copying colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-06T13:17:52,709   copying colossalai/trainer/hooks/_commons_.py -> build/lib/colossalai/trainer/hooks
2023-02-06T13:17:52,713   copying colossalai/trainer/hooks/_log_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-06T13:17:52,717   copying colossalai/trainer/hooks/_metric_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-06T13:17:52,722   copying colossalai/trainer/hooks/_base_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-06T13:17:52,760   creating build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,762   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,768   copying colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,773   copying colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,777   copying colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,782   copying colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,786   copying colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,790   copying colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,795   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,799   copying colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,803   copying colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,807   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,811   copying colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,817   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,823   copying colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,828   copying colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,833   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,837   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,842   copying colossalai/kernel/cuda_native/csrc/compat.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,845   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,850   copying colossalai/kernel/cuda_native/csrc/type_shim.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,855   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,858   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,863   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:52,868   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels
2023-02-06T13:17:52,868   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:52,871   copying colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:52,875   copying colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:52,879   copying colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:52,883   copying colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:52,887   copying colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:52,891   copying colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:52,895   copying colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:52,900   copying colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:52,904   copying colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:52,908   copying colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:52,912   copying colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:52,917   copying colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:53,148   /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
2023-02-06T13:17:53,149     setuptools.SetuptoolsDeprecationWarning,
2023-02-06T13:17:53,214   installing to build/bdist.linux-armv7l/wheel
2023-02-06T13:17:53,215   running install
2023-02-06T13:17:53,277   running install_lib
2023-02-06T13:17:53,351   creating build/bdist.linux-armv7l
2023-02-06T13:17:53,352   creating build/bdist.linux-armv7l/wheel
2023-02-06T13:17:53,355   creating build/bdist.linux-armv7l/wheel/op_builder
2023-02-06T13:17:53,357   copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-06T13:17:53,361   copying build/lib/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-06T13:17:53,365   copying build/lib/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-06T13:17:53,368   copying build/lib/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-06T13:17:53,372   copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-06T13:17:53,375   copying build/lib/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-06T13:17:53,379   copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-06T13:17:53,384   copying build/lib/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-06T13:17:53,387   copying build/lib/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-06T13:17:53,391   copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-06T13:17:53,397   creating build/bdist.linux-armv7l/wheel/colossalai
2023-02-06T13:17:53,399   creating build/bdist.linux-armv7l/wheel/colossalai/_C
2023-02-06T13:17:53,401   copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C
2023-02-06T13:17:53,405   copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-06T13:17:53,409   creating build/bdist.linux-armv7l/wheel/colossalai/logging
2023-02-06T13:17:53,411   copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-02-06T13:17:53,415   copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-02-06T13:17:53,420   creating build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,422   copying build/lib/colossalai/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,427   copying build/lib/colossalai/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,430   copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,433   copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,437   copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,442   copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,446   copying build/lib/colossalai/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,449   copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,454   copying build/lib/colossalai/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,457   copying build/lib/colossalai/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,461   copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,465   copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,469   copying build/lib/colossalai/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,474   copying build/lib/colossalai/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,477   copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-06T13:17:53,484   creating build/bdist.linux-armv7l/wheel/colossalai/zero
2023-02-06T13:17:53,485   copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero
2023-02-06T13:17:53,490   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-06T13:17:53,492   copying build/lib/colossalai/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-06T13:17:53,496   copying build/lib/colossalai/zero/sharded_optim/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-06T13:17:53,502   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:53,504   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:53,508   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:53,513   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:53,517   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:53,521   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:53,525   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-06T13:17:53,530   copying build/lib/colossalai/zero/sharded_optim/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-06T13:17:53,535   copying build/lib/colossalai/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-06T13:17:53,542   creating build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-06T13:17:53,544   copying build/lib/colossalai/zero/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-06T13:17:53,549   copying build/lib/colossalai/zero/utils/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-06T13:17:53,553   copying build/lib/colossalai/zero/utils/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-06T13:17:53,559   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-06T13:17:53,561   copying build/lib/colossalai/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-06T13:17:53,566   copying build/lib/colossalai/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-06T13:17:53,570   copying build/lib/colossalai/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-06T13:17:53,575   creating build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-06T13:17:53,576   copying build/lib/colossalai/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-06T13:17:53,580   copying build/lib/colossalai/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-06T13:17:53,584   copying build/lib/colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-06T13:17:53,587   copying build/lib/colossalai/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-06T13:17:53,591   copying build/lib/colossalai/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-06T13:17:53,595   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-06T13:17:53,597   copying build/lib/colossalai/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-06T13:17:53,601   copying build/lib/colossalai/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-06T13:17:53,604   copying build/lib/colossalai/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-06T13:17:53,608   copying build/lib/colossalai/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-06T13:17:53,614   copying build/lib/colossalai/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-06T13:17:53,619   creating build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-02-06T13:17:53,620   copying build/lib/colossalai/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-02-06T13:17:53,624   copying build/lib/colossalai/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-02-06T13:17:53,629   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-02-06T13:17:53,631   copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-02-06T13:17:53,635   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-06T13:17:53,636   copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-06T13:17:53,640   copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-06T13:17:53,643   copying build/lib/colossalai/auto_parallel/meta_profiler/metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-06T13:17:53,646   copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-06T13:17:53,651   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:53,652   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:53,656   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:53,659   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:53,664   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:53,668   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:53,672   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:53,676   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-06T13:17:53,681   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-02-06T13:17:53,682   copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-02-06T13:17:53,687   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-06T13:17:53,688   copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-06T13:17:53,691   copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-06T13:17:53,695   copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-06T13:17:53,699   copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-06T13:17:53,704   copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-06T13:17:53,708   copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-06T13:17:53,714   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-06T13:17:53,715   copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-06T13:17:53,721   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,724   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,725   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,729   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,733   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,737   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,741   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,745   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,749   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,753   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,757   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,760   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,764   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,768   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,773   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,779   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,785   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,790   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,794   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,798   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,802   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-06T13:17:53,806   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,810   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,813   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,817   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,821   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,824   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,829   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/option.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,832   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,836   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,841   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,844   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,848   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,852   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,855   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,860   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:53,861   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:53,865   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:53,868   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:53,872   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:53,875   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:53,879   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-02-06T13:17:53,883   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,886   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,889   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,893   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,897   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,900   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,904   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,907   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,911   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,914   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-06T13:17:53,918   copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-06T13:17:53,923   copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-06T13:17:53,927   copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-06T13:17:53,932   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:53,933   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:53,937   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:53,941   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:53,945   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:53,948   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:53,952   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-06T13:17:53,958   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:53,959   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:53,963   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:53,967   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:53,971   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:53,976   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:53,980   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:53,984   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:53,987   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:53,992   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:53,993   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:53,997   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:54,002   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:54,006   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:54,010   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:54,014   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/bcast_op_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:54,019   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/dot_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:54,025   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:54,030   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:54,034   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:54,040   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:54,045   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-06T13:17:54,049   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-06T13:17:54,054   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:54,056   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:54,060   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:54,063   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:54,068   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:54,072   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:54,076   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-06T13:17:54,082   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:54,084   copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:54,087   copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:54,091   copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:54,095   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:54,101   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:54,104   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-06T13:17:54,109   creating build/bdist.linux-armv7l/wheel/colossalai/amp
2023-02-06T13:17:54,111   copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-02-06T13:17:54,116   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-06T13:17:54,117   copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-06T13:17:54,121   copying build/lib/colossalai/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-06T13:17:54,125   copying build/lib/colossalai/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-06T13:17:54,131   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-06T13:17:54,132   copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-06T13:17:54,136   copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-06T13:17:54,140   copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-06T13:17:54,143   copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-06T13:17:54,146   copying build/lib/colossalai/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-06T13:17:54,151   copying build/lib/colossalai/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-02-06T13:17:54,155   creating build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-02-06T13:17:54,157   copying build/lib/colossalai/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-02-06T13:17:54,160   copying build/lib/colossalai/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-02-06T13:17:54,165   creating build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-06T13:17:54,166   copying build/lib/colossalai/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-06T13:17:54,170   copying build/lib/colossalai/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-06T13:17:54,174   copying build/lib/colossalai/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-06T13:17:54,180   creating build/bdist.linux-armv7l/wheel/colossalai/nn
2023-02-06T13:17:54,183   copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-02-06T13:17:54,188   creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-06T13:17:54,189   copying build/lib/colossalai/nn/loss/loss_moe.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-06T13:17:54,193   copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-06T13:17:54,196   copying build/lib/colossalai/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-06T13:17:54,200   copying build/lib/colossalai/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-06T13:17:54,205   copying build/lib/colossalai/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-06T13:17:54,209   copying build/lib/colossalai/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-06T13:17:54,214   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-02-06T13:17:54,216   copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-02-06T13:17:54,220   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-06T13:17:54,222   copying build/lib/colossalai/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-06T13:17:54,228   copying build/lib/colossalai/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-06T13:17:54,231   copying build/lib/colossalai/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-06T13:17:54,235   copying build/lib/colossalai/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-06T13:17:54,242   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-02-06T13:17:54,243   copying build/lib/colossalai/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-02-06T13:17:54,247   copying build/lib/colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-02-06T13:17:54,251   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-02-06T13:17:54,253   copying build/lib/colossalai/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-02-06T13:17:54,256   copying build/lib/colossalai/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-02-06T13:17:54,261   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-06T13:17:54,262   copying build/lib/colossalai/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-06T13:17:54,267   copying build/lib/colossalai/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-06T13:17:54,271   copying build/lib/colossalai/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-06T13:17:54,275   copying build/lib/colossalai/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-06T13:17:54,283   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:54,284   copying build/lib/colossalai/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:54,288   copying build/lib/colossalai/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:54,292   copying build/lib/colossalai/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:54,296   copying build/lib/colossalai/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:54,299   copying build/lib/colossalai/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:54,303   copying build/lib/colossalai/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-06T13:17:54,307   copying build/lib/colossalai/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-02-06T13:17:54,311   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-06T13:17:54,313   copying build/lib/colossalai/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-06T13:17:54,317   copying build/lib/colossalai/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-06T13:17:54,321   copying build/lib/colossalai/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-06T13:17:54,324   copying build/lib/colossalai/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-06T13:17:54,330   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-06T13:17:54,331   copying build/lib/colossalai/nn/layer/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-06T13:17:54,336   copying build/lib/colossalai/nn/layer/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-06T13:17:54,339   copying build/lib/colossalai/nn/layer/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-06T13:17:54,342   copying build/lib/colossalai/nn/layer/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-06T13:17:54,346   copying build/lib/colossalai/nn/layer/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-06T13:17:54,351   copying build/lib/colossalai/nn/layer/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-06T13:17:54,356   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-06T13:17:54,357   copying build/lib/colossalai/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-06T13:17:54,361   copying build/lib/colossalai/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-06T13:17:54,365   copying build/lib/colossalai/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-06T13:17:54,369   copying build/lib/colossalai/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-06T13:17:54,376   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-06T13:17:54,378   copying build/lib/colossalai/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-06T13:17:54,384   copying build/lib/colossalai/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-06T13:17:54,387   copying build/lib/colossalai/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-06T13:17:54,391   copying build/lib/colossalai/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-06T13:17:54,399   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-02-06T13:17:54,401   copying build/lib/colossalai/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-02-06T13:17:54,405   copying build/lib/colossalai/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-02-06T13:17:54,409   copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-02-06T13:17:54,415   creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-06T13:17:54,416   copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-06T13:17:54,420   copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-06T13:17:54,423   copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-06T13:17:54,427   copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-06T13:17:54,431   copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-06T13:17:54,435   copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-06T13:17:54,438   copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-06T13:17:54,442   copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-06T13:17:54,447   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-06T13:17:54,448   copying build/lib/colossalai/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-06T13:17:54,453   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-06T13:17:54,454   copying build/lib/colossalai/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-06T13:17:54,458   copying build/lib/colossalai/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-06T13:17:54,461   copying build/lib/colossalai/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-06T13:17:54,465   copying build/lib/colossalai/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-06T13:17:54,469   copying build/lib/colossalai/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-06T13:17:54,473   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:54,475   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:54,479   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:54,483   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:54,487   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:54,491   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:54,496   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:54,500   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:54,503   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:54,507   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-06T13:17:54,511   copying build/lib/colossalai/nn/parallel/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-06T13:17:54,515   copying build/lib/colossalai/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-06T13:17:54,519   copying build/lib/colossalai/nn/parallel/gemini_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-06T13:17:54,522   copying build/lib/colossalai/nn/parallel/zero_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-06T13:17:54,527   copying build/lib/colossalai/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-06T13:17:54,533   creating build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-06T13:17:54,535   copying build/lib/colossalai/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-06T13:17:54,538   copying build/lib/colossalai/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-06T13:17:54,542   copying build/lib/colossalai/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-06T13:17:54,545   copying build/lib/colossalai/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-06T13:17:54,549   copying build/lib/colossalai/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-06T13:17:54,553   creating build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-06T13:17:54,555   copying build/lib/colossalai/nn/_ops/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-06T13:17:54,558   copying build/lib/colossalai/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-06T13:17:54,561   copying build/lib/colossalai/nn/_ops/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-06T13:17:54,565   copying build/lib/colossalai/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-06T13:17:54,569   copying build/lib/colossalai/nn/_ops/view.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-06T13:17:54,573   copying build/lib/colossalai/nn/_ops/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-06T13:17:54,576   copying build/lib/colossalai/nn/_ops/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-06T13:17:54,580   copying build/lib/colossalai/nn/_ops/batch_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-06T13:17:54,584   copying build/lib/colossalai/nn/_ops/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-06T13:17:54,588   copying build/lib/colossalai/nn/_ops/element_wise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-06T13:17:54,592   copying build/lib/colossalai/nn/_ops/embedding_bag.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-06T13:17:54,598   creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,599   copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,603   copying build/lib/colossalai/nn/optimizer/zero_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,607   copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,611   copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,615   copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,619   copying build/lib/colossalai/nn/optimizer/colossalai_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,623   copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,627   copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,631   copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,635   copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,639   copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,643   copying build/lib/colossalai/nn/optimizer/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-06T13:17:54,646   copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-06T13:17:54,652   copying build/lib/colossalai/core.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-06T13:17:54,655   copying build/lib/colossalai/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-06T13:17:54,659   creating build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-06T13:17:54,661   copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-06T13:17:54,665   copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-06T13:17:54,668   copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-06T13:17:54,674   creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-02-06T13:17:54,675   copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-02-06T13:17:54,679   copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-02-06T13:17:54,686   copying build/lib/colossalai/fx/_meta_registrations.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-06T13:17:54,693   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-06T13:17:54,696   copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-06T13:17:54,700   copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-06T13:17:54,706   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-02-06T13:17:54,709   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-06T13:17:54,712   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-06T13:17:54,716   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-06T13:17:54,720   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-06T13:17:54,725   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-06T13:17:54,729   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-06T13:17:54,733   copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-02-06T13:17:54,738   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-06T13:17:54,740   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-06T13:17:54,745   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-06T13:17:54,749   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-06T13:17:54,754   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-06T13:17:54,758   copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-06T13:17:54,762   copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-06T13:17:54,768   copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-06T13:17:54,772   copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-06T13:17:54,777   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-02-06T13:17:54,779   copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-02-06T13:17:54,784   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:54,786   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:54,790   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:54,794   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:54,799   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:54,803   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:54,807   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:54,811   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:54,815   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-06T13:17:54,821   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:54,823   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:54,827   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:54,831   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:54,835   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:54,841   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:54,845   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:54,849   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:54,853   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-06T13:17:54,858   copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-06T13:17:54,865   creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-06T13:17:54,867   copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-06T13:17:54,872   copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-06T13:17:54,876   copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-06T13:17:54,881   copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-06T13:17:54,886   copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-06T13:17:54,891   copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-06T13:17:54,898   creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-06T13:17:54,900   copying build/lib/colossalai/fx/passes/algorithms/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-06T13:17:54,904   copying build/lib/colossalai/fx/passes/algorithms/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-06T13:17:54,908   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_pofo.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-06T13:17:54,914   copying build/lib/colossalai/fx/passes/algorithms/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-06T13:17:54,919   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-06T13:17:54,924   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-06T13:17:54,928   copying build/lib/colossalai/fx/passes/algorithms/linearize.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-06T13:17:54,932   copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-06T13:17:54,937   copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-06T13:17:54,943   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-06T13:17:54,946   copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-06T13:17:54,950   copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-06T13:17:54,955   copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-06T13:17:54,960   copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-06T13:17:54,965   copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-06T13:17:54,969   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-06T13:17:54,971   copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-06T13:17:54,975   copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-06T13:17:54,979   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:54,981   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:54,985   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:54,988   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:54,991   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:54,994   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:54,998   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:55,001   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:55,004   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:55,007   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:55,011   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:55,014   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-06T13:17:55,018   copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-06T13:17:55,023   copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-06T13:17:55,027   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:55,029   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:55,032   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:55,036   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:55,039   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:55,042   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:55,046   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:55,049   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:55,053   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:55,056   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-06T13:17:55,060   copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-06T13:17:55,063   copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-06T13:17:55,067   copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-06T13:17:55,070   copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-06T13:17:55,074   copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-06T13:17:55,078   copying build/lib/colossalai/constants.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-06T13:17:55,083   creating build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-06T13:17:55,084   copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-06T13:17:55,088   copying build/lib/colossalai/utils/cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-06T13:17:55,093   creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-06T13:17:55,094   copying build/lib/colossalai/utils/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-06T13:17:55,098   copying build/lib/colossalai/utils/checkpoint_io/backend.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-06T13:17:55,101   copying build/lib/colossalai/utils/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-06T13:17:55,105   copying build/lib/colossalai/utils/checkpoint_io/writer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-06T13:17:55,109   copying build/lib/colossalai/utils/checkpoint_io/convertor.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-06T13:17:55,114   copying build/lib/colossalai/utils/checkpoint_io/reader.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-06T13:17:55,118   copying build/lib/colossalai/utils/checkpoint_io/io.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-06T13:17:55,123   copying build/lib/colossalai/utils/checkpoint_io/meta.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-06T13:17:55,127   copying build/lib/colossalai/utils/checkpoint_io/constant.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-06T13:17:55,131   copying build/lib/colossalai/utils/checkpoint_io/distributed.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-06T13:17:55,136   copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-06T13:17:55,142   copying build/lib/colossalai/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-06T13:17:55,147   copying build/lib/colossalai/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-06T13:17:55,153   creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-02-06T13:17:55,155   copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-02-06T13:17:55,159   copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-02-06T13:17:55,163   copying build/lib/colossalai/utils/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-06T13:17:55,168   creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-02-06T13:17:55,171   copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-02-06T13:17:55,175   copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-02-06T13:17:55,181   creating build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-06T13:17:55,183   copying build/lib/colossalai/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-06T13:17:55,187   copying build/lib/colossalai/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-06T13:17:55,192   copying build/lib/colossalai/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-06T13:17:55,196   copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-06T13:17:55,201   copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-06T13:17:55,206   creating build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-06T13:17:55,208   copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-06T13:17:55,212   copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-06T13:17:55,216   copying build/lib/colossalai/utils/model/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-06T13:17:55,221   copying build/lib/colossalai/utils/model/lazy_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-06T13:17:55,227   copying build/lib/colossalai/utils/model/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-06T13:17:55,232   creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-06T13:17:55,234   copying build/lib/colossalai/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-06T13:17:55,239   copying build/lib/colossalai/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-06T13:17:55,243   copying build/lib/colossalai/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-06T13:17:55,248   creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-06T13:17:55,250   copying build/lib/colossalai/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-06T13:17:55,253   copying build/lib/colossalai/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-06T13:17:55,256   copying build/lib/colossalai/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-06T13:17:55,262   creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-06T13:17:55,263   copying build/lib/colossalai/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-06T13:17:55,266   copying build/lib/colossalai/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-06T13:17:55,270   copying build/lib/colossalai/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-06T13:17:55,274   copying build/lib/colossalai/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-06T13:17:55,278   copying build/lib/colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-06T13:17:55,282   creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-02-06T13:17:55,284   copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-02-06T13:17:55,287   copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-02-06T13:17:55,293   creating build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-02-06T13:17:55,294   copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-02-06T13:17:55,298   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-06T13:17:55,300   copying build/lib/colossalai/kernel/cuda_native/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-06T13:17:55,303   copying build/lib/colossalai/kernel/cuda_native/multihead_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-06T13:17:55,307   copying build/lib/colossalai/kernel/cuda_native/flash_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-06T13:17:55,312   copying build/lib/colossalai/kernel/cuda_native/layer_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-06T13:17:55,317   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,318   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,324   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,329   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels
2023-02-06T13:17:55,332   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,333   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,337   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,340   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,343   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,347   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,350   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,353   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,357   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,360   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,363   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,367   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,371   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-06T13:17:55,374   copying build/lib/colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,377   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,381   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,385   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,388   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,392   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,395   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,398   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,402   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,405   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,410   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,415   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,419   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,423   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,426   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,431   copying build/lib/colossalai/kernel/cuda_native/csrc/compat.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,434   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,438   copying build/lib/colossalai/kernel/cuda_native/csrc/type_shim.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,442   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,445   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,449   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-06T13:17:55,454   copying build/lib/colossalai/kernel/cuda_native/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-06T13:17:55,459   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-06T13:17:55,460   copying build/lib/colossalai/kernel/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-06T13:17:55,463   copying build/lib/colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-06T13:17:55,466   copying build/lib/colossalai/kernel/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-06T13:17:55,469   copying build/lib/colossalai/kernel/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-06T13:17:55,473   copying build/lib/colossalai/kernel/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-06T13:17:55,476   copying build/lib/colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-06T13:17:55,479   copying build/lib/colossalai/kernel/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-06T13:17:55,482   copying build/lib/colossalai/kernel/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-06T13:17:55,485   copying build/lib/colossalai/kernel/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-06T13:17:55,488   copying build/lib/colossalai/kernel/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-06T13:17:55,492   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-06T13:17:55,494   copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-06T13:17:55,497   copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-06T13:17:55,500   copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-06T13:17:55,503   copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-06T13:17:55,507   creating build/bdist.linux-armv7l/wheel/colossalai/builder
2023-02-06T13:17:55,508   copying build/lib/colossalai/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/builder
2023-02-06T13:17:55,512   copying build/lib/colossalai/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/builder
2023-02-06T13:17:55,516   creating build/bdist.linux-armv7l/wheel/colossalai/cli
2023-02-06T13:17:55,517   copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-02-06T13:17:55,522   creating build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-06T13:17:55,523   copying build/lib/colossalai/cli/benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-06T13:17:55,526   copying build/lib/colossalai/cli/benchmark/models.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-06T13:17:55,529   copying build/lib/colossalai/cli/benchmark/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-06T13:17:55,533   copying build/lib/colossalai/cli/benchmark/benchmark.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-06T13:17:55,537   creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-06T13:17:55,539   copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-06T13:17:55,543   copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-06T13:17:55,547   copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-06T13:17:55,550   copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-06T13:17:55,555   creating build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-02-06T13:17:55,556   copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-02-06T13:17:55,559   copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-02-06T13:17:55,563   copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-02-06T13:17:55,566   copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-06T13:17:55,571   creating build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-06T13:17:55,572   copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-06T13:17:55,577   creating build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-06T13:17:55,578   copying build/lib/colossalai/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-06T13:17:55,581   copying build/lib/colossalai/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-06T13:17:55,584   copying build/lib/colossalai/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-06T13:17:55,588   copying build/lib/colossalai/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-06T13:17:55,592   copying build/lib/colossalai/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-06T13:17:55,598   creating build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-06T13:17:55,599   copying build/lib/colossalai/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-06T13:17:55,603   copying build/lib/colossalai/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-06T13:17:55,606   copying build/lib/colossalai/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-06T13:17:55,610   copying build/lib/colossalai/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-06T13:17:55,614   copying build/lib/colossalai/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-06T13:17:55,617   copying build/lib/colossalai/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-06T13:17:55,620   copying build/lib/colossalai/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-06T13:17:55,624   copying build/lib/colossalai/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-06T13:17:55,627   copying build/lib/colossalai/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-06T13:17:55,631   copying build/lib/colossalai/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-06T13:17:55,635   copying build/lib/colossalai/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-06T13:17:55,638   copying build/lib/colossalai/context/moe_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-06T13:17:55,642   copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-06T13:17:55,645   copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-06T13:17:55,650   creating build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-06T13:17:55,651   copying build/lib/colossalai/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-06T13:17:55,654   copying build/lib/colossalai/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-06T13:17:55,659   copying build/lib/colossalai/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-06T13:17:55,663   copying build/lib/colossalai/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-06T13:17:55,666   copying build/lib/colossalai/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-06T13:17:55,670   copying build/lib/colossalai/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-06T13:17:55,675   creating build/bdist.linux-armv7l/wheel/colossalai/engine
2023-02-06T13:17:55,676   copying build/lib/colossalai/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine
2023-02-06T13:17:55,681   creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-06T13:17:55,683   copying build/lib/colossalai/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-06T13:17:55,686   copying build/lib/colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-06T13:17:55,690   copying build/lib/colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-06T13:17:55,693   copying build/lib/colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-06T13:17:55,696   copying build/lib/colossalai/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-06T13:17:55,699   copying build/lib/colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-06T13:17:55,702   copying build/lib/colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-06T13:17:55,706   copying build/lib/colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-06T13:17:55,710   creating build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-06T13:17:55,711   copying build/lib/colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-06T13:17:55,716   copying build/lib/colossalai/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-06T13:17:55,719   copying build/lib/colossalai/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-06T13:17:55,722   copying build/lib/colossalai/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-06T13:17:55,726   copying build/lib/colossalai/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-06T13:17:55,732   copying build/lib/colossalai/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/engine
2023-02-06T13:17:55,737   creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-02-06T13:17:55,738   copying build/lib/colossalai/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-02-06T13:17:55,742   copying build/lib/colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-02-06T13:17:55,747   creating build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-06T13:17:55,749   copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-06T13:17:55,753   copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-06T13:17:55,757   copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-06T13:17:55,761   copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-06T13:17:55,766   creating build/bdist.linux-armv7l/wheel/colossalai/registry
2023-02-06T13:17:55,767   copying build/lib/colossalai/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/registry
2023-02-06T13:17:55,771   copying build/lib/colossalai/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/registry
2023-02-06T13:17:55,775   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-06T13:17:55,777   copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-06T13:17:55,781   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-02-06T13:17:55,783   copying build/lib/colossalai/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-02-06T13:17:55,786   copying build/lib/colossalai/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-02-06T13:17:55,792   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-02-06T13:17:55,793   copying build/lib/colossalai/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-02-06T13:17:55,797   copying build/lib/colossalai/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-02-06T13:17:55,801   copying build/lib/colossalai/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-06T13:17:55,805   copying build/lib/colossalai/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-06T13:17:55,808   copying build/lib/colossalai/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-06T13:17:55,812   copying build/lib/colossalai/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-06T13:17:55,817   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-06T13:17:55,819   copying build/lib/colossalai/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-06T13:17:55,823   copying build/lib/colossalai/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-06T13:17:55,827   copying build/lib/colossalai/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-06T13:17:55,831   copying build/lib/colossalai/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-06T13:17:55,839   creating build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-06T13:17:55,841   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-06T13:17:55,843   copying build/lib/colossalai/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-06T13:17:55,846   copying build/lib/colossalai/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-06T13:17:55,850   copying build/lib/colossalai/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-06T13:17:55,853   copying build/lib/colossalai/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-06T13:17:55,857   copying build/lib/colossalai/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-06T13:17:55,860   copying build/lib/colossalai/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-06T13:17:55,864   copying build/lib/colossalai/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-06T13:17:55,867   copying build/lib/colossalai/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-06T13:17:55,872   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-06T13:17:55,874   copying build/lib/colossalai/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-06T13:17:55,877   copying build/lib/colossalai/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-06T13:17:55,882   copying build/lib/colossalai/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-06T13:17:55,886   copying build/lib/colossalai/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-06T13:17:55,889   copying build/lib/colossalai/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-06T13:17:55,893   copying build/lib/colossalai/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-06T13:17:55,897   copying build/lib/colossalai/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-06T13:17:55,903   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-02-06T13:17:55,904   copying build/lib/colossalai/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-02-06T13:17:55,908   copying build/lib/colossalai/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-02-06T13:17:55,911   copying build/lib/colossalai/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-06T13:17:55,916   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-06T13:17:55,918   copying build/lib/colossalai/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-06T13:17:55,922   copying build/lib/colossalai/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-06T13:17:55,926   copying build/lib/colossalai/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-06T13:17:55,929   copying build/lib/colossalai/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-06T13:17:55,932   copying build/lib/colossalai/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-06T13:17:55,936   copying build/lib/colossalai/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-06T13:17:55,939   copying build/lib/colossalai/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-06T13:17:55,942   copying build/lib/colossalai/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-06T13:17:55,946   copying build/lib/colossalai/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-06T13:17:55,949   copying build/lib/colossalai/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-06T13:17:55,953   copying build/lib/colossalai/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-06T13:17:55,957   creating build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-06T13:17:55,959   copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-06T13:17:55,962   copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-06T13:17:55,966   copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-06T13:17:55,970   copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-06T13:17:55,973   copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-06T13:17:55,978   creating build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-02-06T13:17:55,979   copying build/lib/colossalai/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-02-06T13:17:55,984   creating build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-06T13:17:55,985   copying build/lib/colossalai/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-06T13:17:55,989   copying build/lib/colossalai/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-06T13:17:55,993   copying build/lib/colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-06T13:17:55,996   copying build/lib/colossalai/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-06T13:17:55,999   copying build/lib/colossalai/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-06T13:17:56,003   copying build/lib/colossalai/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-06T13:17:56,008   copying build/lib/colossalai/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-06T13:17:56,011   copying build/lib/colossalai/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-02-06T13:17:56,015   running install_egg_info
2023-02-06T13:17:56,225   running egg_info
2023-02-06T13:17:56,288   writing colossalai.egg-info/PKG-INFO
2023-02-06T13:17:56,293   writing dependency_links to colossalai.egg-info/dependency_links.txt
2023-02-06T13:17:56,296   writing entry points to colossalai.egg-info/entry_points.txt
2023-02-06T13:17:56,299   writing requirements to colossalai.egg-info/requires.txt
2023-02-06T13:17:56,301   writing top-level names to colossalai.egg-info/top_level.txt
2023-02-06T13:17:56,587   reading manifest file 'colossalai.egg-info/SOURCES.txt'
2023-02-06T13:17:56,666   reading manifest template 'MANIFEST.in'
2023-02-06T13:17:58,737   warning: no files found matching '*.tr' under directory 'colossalai'
2023-02-06T13:17:59,771   warning: no files found matching '*.cc' under directory 'colossalai'
2023-02-06T13:18:00,303   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-02-06T13:18:00,320   adding license file 'LICENSE'
2023-02-06T13:18:00,418   writing manifest file 'colossalai.egg-info/SOURCES.txt'
2023-02-06T13:18:00,423   Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.2.1-py3.7.egg-info
2023-02-06T13:18:00,448   running install_scripts
2023-02-06T13:18:00,621   adding license file "LICENSE" (matched pattern "LICEN[CS]E*")
2023-02-06T13:18:00,630   creating build/bdist.linux-armv7l/wheel/colossalai-0.2.1.dist-info/WHEEL
2023-02-06T13:18:00,634   creating '/tmp/pip-wheel-umy62h33/colossalai-0.2.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2023-02-06T13:18:00,639   adding 'colossalai/__init__.py'
2023-02-06T13:18:00,641   adding 'colossalai/constants.py'
2023-02-06T13:18:00,643   adding 'colossalai/core.py'
2023-02-06T13:18:00,646   adding 'colossalai/global_variables.py'
2023-02-06T13:18:00,651   adding 'colossalai/initialize.py'
2023-02-06T13:18:00,654   adding 'colossalai/version.py'
2023-02-06T13:18:00,657   adding 'colossalai/_C/__init__.py'
2023-02-06T13:18:00,662   adding 'colossalai/amp/__init__.py'
2023-02-06T13:18:00,664   adding 'colossalai/amp/amp_type.py'
2023-02-06T13:18:00,667   adding 'colossalai/amp/apex_amp/__init__.py'
2023-02-06T13:18:00,670   adding 'colossalai/amp/apex_amp/apex_amp.py'
2023-02-06T13:18:00,673   adding 'colossalai/amp/naive_amp/__init__.py'
2023-02-06T13:18:00,678   adding 'colossalai/amp/naive_amp/_fp16_optimizer.py'
2023-02-06T13:18:00,681   adding 'colossalai/amp/naive_amp/_utils.py'
2023-02-06T13:18:00,684   adding 'colossalai/amp/naive_amp/naive_amp.py'
2023-02-06T13:18:00,687   adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py'
2023-02-06T13:18:00,689   adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py'
2023-02-06T13:18:00,692   adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py'
2023-02-06T13:18:00,695   adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py'
2023-02-06T13:18:00,698   adding 'colossalai/amp/torch_amp/__init__.py'
2023-02-06T13:18:00,706   adding 'colossalai/amp/torch_amp/_grad_scaler.py'
2023-02-06T13:18:00,709   adding 'colossalai/amp/torch_amp/torch_amp.py'
2023-02-06T13:18:00,713   adding 'colossalai/auto_parallel/__init__.py'
2023-02-06T13:18:00,716   adding 'colossalai/auto_parallel/checkpoint/__init__.py'
2023-02-06T13:18:00,718   adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py'
2023-02-06T13:18:00,721   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py'
2023-02-06T13:18:00,724   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py'
2023-02-06T13:18:00,729   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py'
2023-02-06T13:18:00,733   adding 'colossalai/auto_parallel/checkpoint/operation.py'
2023-02-06T13:18:00,736   adding 'colossalai/auto_parallel/meta_profiler/__init__.py'
2023-02-06T13:18:00,738   adding 'colossalai/auto_parallel/meta_profiler/constants.py'
2023-02-06T13:18:00,741   adding 'colossalai/auto_parallel/meta_profiler/metainfo.py'
2023-02-06T13:18:00,743   adding 'colossalai/auto_parallel/meta_profiler/registry.py'
2023-02-06T13:18:00,746   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py'
2023-02-06T13:18:00,749   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py'
2023-02-06T13:18:00,752   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py'
2023-02-06T13:18:00,755   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py'
2023-02-06T13:18:00,758   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py'
2023-02-06T13:18:00,761   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py'
2023-02-06T13:18:00,764   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py'
2023-02-06T13:18:00,768   adding 'colossalai/auto_parallel/passes/__init__.py'
2023-02-06T13:18:00,771   adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py'
2023-02-06T13:18:00,773   adding 'colossalai/auto_parallel/passes/constants.py'
2023-02-06T13:18:00,776   adding 'colossalai/auto_parallel/passes/meta_info_prop.py'
2023-02-06T13:18:00,779   adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py'
2023-02-06T13:18:00,786   adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py'
2023-02-06T13:18:00,789   adding 'colossalai/auto_parallel/pipeline_shard/__init__.py'
2023-02-06T13:18:00,793   adding 'colossalai/auto_parallel/tensor_shard/__init__.py'
2023-02-06T13:18:00,795   adding 'colossalai/auto_parallel/tensor_shard/constants.py'
2023-02-06T13:18:00,799   adding 'colossalai/auto_parallel/tensor_shard/initialize.py'
2023-02-06T13:18:00,803   adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py'
2023-02-06T13:18:00,807   adding 'colossalai/auto_parallel/tensor_shard/deprecated/__init__.py'
2023-02-06T13:18:00,810   adding 'colossalai/auto_parallel/tensor_shard/deprecated/_utils.py'
2023-02-06T13:18:00,812   adding 'colossalai/auto_parallel/tensor_shard/deprecated/constants.py'
2023-02-06T13:18:00,816   adding 'colossalai/auto_parallel/tensor_shard/deprecated/cost_graph.py'
2023-02-06T13:18:00,819   adding 'colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py'
2023-02-06T13:18:00,821   adding 'colossalai/auto_parallel/tensor_shard/deprecated/options.py'
2023-02-06T13:18:00,824   adding 'colossalai/auto_parallel/tensor_shard/deprecated/sharding_strategy.py'
2023-02-06T13:18:00,829   adding 'colossalai/auto_parallel/tensor_shard/deprecated/solver.py'
2023-02-06T13:18:00,835   adding 'colossalai/auto_parallel/tensor_shard/deprecated/strategies_constructor.py'
2023-02-06T13:18:00,839   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/__init__.py'
2023-02-06T13:18:00,845   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/batch_norm_handler.py'
2023-02-06T13:18:00,851   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/bcast_op_handler.py'
2023-02-06T13:18:00,857   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py'
2023-02-06T13:18:00,864   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/dot_handler.py'
2023-02-06T13:18:00,868   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py'
2023-02-06T13:18:00,872   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py'
2023-02-06T13:18:00,875   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py'
2023-02-06T13:18:00,878   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py'
2023-02-06T13:18:00,881   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/strategy_generator.py'
2023-02-06T13:18:00,883   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py'
2023-02-06T13:18:00,887   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/where_handler.py'
2023-02-06T13:18:00,892   adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py'
2023-02-06T13:18:00,895   adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py'
2023-02-06T13:18:00,898   adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py'
2023-02-06T13:18:00,901   adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py'
2023-02-06T13:18:00,904   adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py'
2023-02-06T13:18:00,907   adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py'
2023-02-06T13:18:00,910   adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py'
2023-02-06T13:18:00,913   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py'
2023-02-06T13:18:00,915   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py'
2023-02-06T13:18:00,918   adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py'
2023-02-06T13:18:00,922   adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py'
2023-02-06T13:18:00,928   adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py'
2023-02-06T13:18:00,933   adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py'
2023-02-06T13:18:00,935   adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py'
2023-02-06T13:18:00,938   adding 'colossalai/auto_parallel/tensor_shard/node_handler/option.py'
2023-02-06T13:18:00,940   adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py'
2023-02-06T13:18:00,943   adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py'
2023-02-06T13:18:00,945   adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py'
2023-02-06T13:18:00,947   adding 'colossalai/auto_parallel/tensor_shard/node_handler/reshape_handler.py'
2023-02-06T13:18:00,950   adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py'
2023-02-06T13:18:00,953   adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py'
2023-02-06T13:18:00,955   adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py'
2023-02-06T13:18:00,957   adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py'
2023-02-06T13:18:00,960   adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py'
2023-02-06T13:18:00,964   adding 'colossalai/auto_parallel/tensor_shard/node_handler/experimental/__init__.py'
2023-02-06T13:18:00,966   adding 'colossalai/auto_parallel/tensor_shard/node_handler/experimental/permute_handler.py'
2023-02-06T13:18:00,970   adding 'colossalai/auto_parallel/tensor_shard/node_handler/experimental/reshape_generator.py'
2023-02-06T13:18:00,973   adding 'colossalai/auto_parallel/tensor_shard/node_handler/experimental/split_handler.py'
2023-02-06T13:18:00,975   adding 'colossalai/auto_parallel/tensor_shard/node_handler/experimental/transpose_handler.py'
2023-02-06T13:18:00,978   adding 'colossalai/auto_parallel/tensor_shard/node_handler/experimental/view_handler.py'
2023-02-06T13:18:00,982   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py'
2023-02-06T13:18:00,986   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py'
2023-02-06T13:18:00,989   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py'
2023-02-06T13:18:00,993   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py'
2023-02-06T13:18:00,997   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py'
2023-02-06T13:18:01,000   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py'
2023-02-06T13:18:01,003   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py'
2023-02-06T13:18:01,007   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py'
2023-02-06T13:18:01,013   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py'
2023-02-06T13:18:01,017   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py'
2023-02-06T13:18:01,020   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py'
2023-02-06T13:18:01,023   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py'
2023-02-06T13:18:01,026   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py'
2023-02-06T13:18:01,029   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py'
2023-02-06T13:18:01,033   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py'
2023-02-06T13:18:01,036   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py'
2023-02-06T13:18:01,038   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py'
2023-02-06T13:18:01,041   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py'
2023-02-06T13:18:01,044   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py'
2023-02-06T13:18:01,047   adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py'
2023-02-06T13:18:01,051   adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py'
2023-02-06T13:18:01,054   adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py'
2023-02-06T13:18:01,056   adding 'colossalai/auto_parallel/tensor_shard/solver/options.py'
2023-02-06T13:18:01,062   adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py'
2023-02-06T13:18:01,065   adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py'
2023-02-06T13:18:01,069   adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py'
2023-02-06T13:18:01,072   adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py'
2023-02-06T13:18:01,075   adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py'
2023-02-06T13:18:01,077   adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py'
2023-02-06T13:18:01,081   adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py'
2023-02-06T13:18:01,084   adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py'
2023-02-06T13:18:01,087   adding 'colossalai/builder/__init__.py'
2023-02-06T13:18:01,089   adding 'colossalai/builder/builder.py'
2023-02-06T13:18:01,093   adding 'colossalai/cli/__init__.py'
2023-02-06T13:18:01,095   adding 'colossalai/cli/cli.py'
2023-02-06T13:18:01,098   adding 'colossalai/cli/benchmark/__init__.py'
2023-02-06T13:18:01,101   adding 'colossalai/cli/benchmark/benchmark.py'
2023-02-06T13:18:01,103   adding 'colossalai/cli/benchmark/models.py'
2023-02-06T13:18:01,106   adding 'colossalai/cli/benchmark/utils.py'
2023-02-06T13:18:01,109   adding 'colossalai/cli/check/__init__.py'
2023-02-06T13:18:01,112   adding 'colossalai/cli/check/check_installation.py'
2023-02-06T13:18:01,116   adding 'colossalai/cli/launcher/__init__.py'
2023-02-06T13:18:01,119   adding 'colossalai/cli/launcher/hostinfo.py'
2023-02-06T13:18:01,122   adding 'colossalai/cli/launcher/multinode_runner.py'
2023-02-06T13:18:01,125   adding 'colossalai/cli/launcher/run.py'
2023-02-06T13:18:01,129   adding 'colossalai/communication/__init__.py'
2023-02-06T13:18:01,132   adding 'colossalai/communication/collective.py'
2023-02-06T13:18:01,137   adding 'colossalai/communication/p2p.py'
2023-02-06T13:18:01,141   adding 'colossalai/communication/p2p_v2.py'
2023-02-06T13:18:01,143   adding 'colossalai/communication/ring.py'
2023-02-06T13:18:01,146   adding 'colossalai/communication/utils.py'
2023-02-06T13:18:01,149   adding 'colossalai/context/__init__.py'
2023-02-06T13:18:01,152   adding 'colossalai/context/config.py'
2023-02-06T13:18:01,155   adding 'colossalai/context/moe_context.py'
2023-02-06T13:18:01,161   adding 'colossalai/context/parallel_context.py'
2023-02-06T13:18:01,164   adding 'colossalai/context/parallel_mode.py'
2023-02-06T13:18:01,166   adding 'colossalai/context/singleton_meta.py'
2023-02-06T13:18:01,169   adding 'colossalai/context/process_group_initializer/__init__.py'
2023-02-06T13:18:01,172   adding 'colossalai/context/process_group_initializer/initializer_1d.py'
2023-02-06T13:18:01,174   adding 'colossalai/context/process_group_initializer/initializer_2d.py'
2023-02-06T13:18:01,178   adding 'colossalai/context/process_group_initializer/initializer_2p5d.py'
2023-02-06T13:18:01,181   adding 'colossalai/context/process_group_initializer/initializer_3d.py'
2023-02-06T13:18:01,184   adding 'colossalai/context/process_group_initializer/initializer_data.py'
2023-02-06T13:18:01,186   adding 'colossalai/context/process_group_initializer/initializer_model.py'
2023-02-06T13:18:01,188   adding 'colossalai/context/process_group_initializer/initializer_pipeline.py'
2023-02-06T13:18:01,191   adding 'colossalai/context/process_group_initializer/initializer_sequence.py'
2023-02-06T13:18:01,194   adding 'colossalai/context/process_group_initializer/initializer_tensor.py'
2023-02-06T13:18:01,196   adding 'colossalai/context/process_group_initializer/process_group_initializer.py'
2023-02-06T13:18:01,199   adding 'colossalai/context/random/__init__.py'
2023-02-06T13:18:01,202   adding 'colossalai/context/random/_helper.py'
2023-02-06T13:18:01,204   adding 'colossalai/context/random/seed_manager.py'
2023-02-06T13:18:01,207   adding 'colossalai/device/__init__.py'
2023-02-06T13:18:01,212   adding 'colossalai/device/alpha_beta_profiler.py'
2023-02-06T13:18:01,215   adding 'colossalai/device/calc_pipeline_strategy.py'
2023-02-06T13:18:01,219   adding 'colossalai/device/device_mesh.py'
2023-02-06T13:18:01,222   adding 'colossalai/engine/__init__.py'
2023-02-06T13:18:01,226   adding 'colossalai/engine/_base_engine.py'
2023-02-06T13:18:01,229   adding 'colossalai/engine/gradient_accumulation/__init__.py'
2023-02-06T13:18:01,232   adding 'colossalai/engine/gradient_accumulation/_gradient_accumulation.py'
2023-02-06T13:18:01,236   adding 'colossalai/engine/gradient_handler/__init__.py'
2023-02-06T13:18:01,238   adding 'colossalai/engine/gradient_handler/_base_gradient_handler.py'
2023-02-06T13:18:01,240   adding 'colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py'
2023-02-06T13:18:01,243   adding 'colossalai/engine/gradient_handler/_moe_gradient_handler.py'
2023-02-06T13:18:01,245   adding 'colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py'
2023-02-06T13:18:01,247   adding 'colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py'
2023-02-06T13:18:01,250   adding 'colossalai/engine/gradient_handler/_zero_gradient_handler.py'
2023-02-06T13:18:01,252   adding 'colossalai/engine/gradient_handler/utils.py'
2023-02-06T13:18:01,255   adding 'colossalai/engine/schedule/__init__.py'
2023-02-06T13:18:01,258   adding 'colossalai/engine/schedule/_base_schedule.py'
2023-02-06T13:18:01,261   adding 'colossalai/engine/schedule/_non_pipeline_schedule.py'
2023-02-06T13:18:01,269   adding 'colossalai/engine/schedule/_pipeline_schedule.py'
2023-02-06T13:18:01,274   adding 'colossalai/engine/schedule/_pipeline_schedule_v2.py'
2023-02-06T13:18:01,277   adding 'colossalai/fx/__init__.py'
2023-02-06T13:18:01,279   adding 'colossalai/fx/_compatibility.py'
2023-02-06T13:18:01,285   adding 'colossalai/fx/_meta_registrations.py'
2023-02-06T13:18:01,288   adding 'colossalai/fx/graph_module.py'
2023-02-06T13:18:01,291   adding 'colossalai/fx/proxy.py'
2023-02-06T13:18:01,294   adding 'colossalai/fx/codegen/__init__.py'
2023-02-06T13:18:01,304   adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py'
2023-02-06T13:18:01,308   adding 'colossalai/fx/passes/__init__.py'
2023-02-06T13:18:01,312   adding 'colossalai/fx/passes/adding_split_node_pass.py'
2023-02-06T13:18:01,316   adding 'colossalai/fx/passes/concrete_info_prop.py'
2023-02-06T13:18:01,320   adding 'colossalai/fx/passes/meta_info_prop.py'
2023-02-06T13:18:01,325   adding 'colossalai/fx/passes/passes_for_gpt2_test.py'
2023-02-06T13:18:01,329   adding 'colossalai/fx/passes/shard_1d_pass.py'
2023-02-06T13:18:01,333   adding 'colossalai/fx/passes/split_module.py'
2023-02-06T13:18:01,336   adding 'colossalai/fx/passes/utils.py'
2023-02-06T13:18:01,340   adding 'colossalai/fx/passes/algorithms/__init__.py'
2023-02-06T13:18:01,342   adding 'colossalai/fx/passes/algorithms/build_c_ext.py'
2023-02-06T13:18:01,344   adding 'colossalai/fx/passes/algorithms/ckpt_solver_chen.py'
2023-02-06T13:18:01,350   adding 'colossalai/fx/passes/algorithms/ckpt_solver_pofo.py'
2023-02-06T13:18:01,355   adding 'colossalai/fx/passes/algorithms/ckpt_solver_rotor.py'
2023-02-06T13:18:01,358   adding 'colossalai/fx/passes/algorithms/linearize.py'
2023-02-06T13:18:01,361   adding 'colossalai/fx/passes/algorithms/operation.py'
2023-02-06T13:18:01,365   adding 'colossalai/fx/profiler/__init__.py'
2023-02-06T13:18:01,367   adding 'colossalai/fx/profiler/constants.py'
2023-02-06T13:18:01,370   adding 'colossalai/fx/profiler/dataflow.py'
2023-02-06T13:18:01,373   adding 'colossalai/fx/profiler/memory_utils.py'
2023-02-06T13:18:01,376   adding 'colossalai/fx/profiler/opcount.py'
2023-02-06T13:18:01,381   adding 'colossalai/fx/profiler/profiler.py'
2023-02-06T13:18:01,384   adding 'colossalai/fx/profiler/shard_utils.py'
2023-02-06T13:18:01,387   adding 'colossalai/fx/profiler/tensor.py'
2023-02-06T13:18:01,390   adding 'colossalai/fx/profiler/experimental/__init__.py'
2023-02-06T13:18:01,392   adding 'colossalai/fx/profiler/experimental/constants.py'
2023-02-06T13:18:01,395   adding 'colossalai/fx/profiler/experimental/profiler.py'
2023-02-06T13:18:01,398   adding 'colossalai/fx/profiler/experimental/registry.py'
2023-02-06T13:18:01,400   adding 'colossalai/fx/profiler/experimental/shard_utils.py'
2023-02-06T13:18:01,403   adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py'
2023-02-06T13:18:01,405   adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py'
2023-02-06T13:18:01,408   adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py'
2023-02-06T13:18:01,410   adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py'
2023-02-06T13:18:01,412   adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py'
2023-02-06T13:18:01,414   adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py'
2023-02-06T13:18:01,416   adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py'
2023-02-06T13:18:01,418   adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py'
2023-02-06T13:18:01,421   adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py'
2023-02-06T13:18:01,424   adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py'
2023-02-06T13:18:01,426   adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py'
2023-02-06T13:18:01,429   adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py'
2023-02-06T13:18:01,431   adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py'
2023-02-06T13:18:01,434   adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py'
2023-02-06T13:18:01,436   adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py'
2023-02-06T13:18:01,438   adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py'
2023-02-06T13:18:01,440   adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py'
2023-02-06T13:18:01,442   adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py'
2023-02-06T13:18:01,444   adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py'
2023-02-06T13:18:01,446   adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py'
2023-02-06T13:18:01,450   adding 'colossalai/fx/tracer/__init__.py'
2023-02-06T13:18:01,452   adding 'colossalai/fx/tracer/_meta_trace.py'
2023-02-06T13:18:01,455   adding 'colossalai/fx/tracer/_symbolic_trace.py'
2023-02-06T13:18:01,457   adding 'colossalai/fx/tracer/_tracer_utils.py'
2023-02-06T13:18:01,465   adding 'colossalai/fx/tracer/experimental.py'
2023-02-06T13:18:01,467   adding 'colossalai/fx/tracer/registry.py'
2023-02-06T13:18:01,474   adding 'colossalai/fx/tracer/tracer.py'
2023-02-06T13:18:01,478   adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py'
2023-02-06T13:18:01,481   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py'
2023-02-06T13:18:01,483   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py'
2023-02-06T13:18:01,486   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py'
2023-02-06T13:18:01,488   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py'
2023-02-06T13:18:01,491   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py'
2023-02-06T13:18:01,494   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py'
2023-02-06T13:18:01,496   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py'
2023-02-06T13:18:01,499   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py'
2023-02-06T13:18:01,501   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py'
2023-02-06T13:18:01,504   adding 'colossalai/fx/tracer/meta_patch/__init__.py'
2023-02-06T13:18:01,507   adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py'
2023-02-06T13:18:01,510   adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py'
2023-02-06T13:18:01,512   adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py'
2023-02-06T13:18:01,515   adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py'
2023-02-06T13:18:01,517   adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py'
2023-02-06T13:18:01,519   adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py'
2023-02-06T13:18:01,522   adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py'
2023-02-06T13:18:01,524   adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py'
2023-02-06T13:18:01,528   adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py'
2023-02-06T13:18:01,530   adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py'
2023-02-06T13:18:01,532   adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py'
2023-02-06T13:18:01,534   adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py'
2023-02-06T13:18:01,536   adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py'
2023-02-06T13:18:01,539   adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py'
2023-02-06T13:18:01,541   adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py'
2023-02-06T13:18:01,544   adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py'
2023-02-06T13:18:01,547   adding 'colossalai/gemini/__init__.py'
2023-02-06T13:18:01,549   adding 'colossalai/gemini/gemini_context.py'
2023-02-06T13:18:01,552   adding 'colossalai/gemini/gemini_mgr.py'
2023-02-06T13:18:01,556   adding 'colossalai/gemini/placement_policy.py'
2023-02-06T13:18:01,559   adding 'colossalai/gemini/stateful_tensor.py'
2023-02-06T13:18:01,562   adding 'colossalai/gemini/stateful_tensor_mgr.py'
2023-02-06T13:18:01,565   adding 'colossalai/gemini/tensor_placement_policy.py'
2023-02-06T13:18:01,567   adding 'colossalai/gemini/tensor_utils.py'
2023-02-06T13:18:01,571   adding 'colossalai/gemini/chunk/__init__.py'
2023-02-06T13:18:01,577   adding 'colossalai/gemini/chunk/chunk.py'
2023-02-06T13:18:01,581   adding 'colossalai/gemini/chunk/manager.py'
2023-02-06T13:18:01,584   adding 'colossalai/gemini/chunk/search_utils.py'
2023-02-06T13:18:01,586   adding 'colossalai/gemini/chunk/utils.py'
2023-02-06T13:18:01,589   adding 'colossalai/gemini/memory_tracer/__init__.py'
2023-02-06T13:18:01,592   adding 'colossalai/gemini/memory_tracer/chunk_memstats_collector.py'
2023-02-06T13:18:01,594   adding 'colossalai/gemini/memory_tracer/memory_monitor.py'
2023-02-06T13:18:01,597   adding 'colossalai/gemini/memory_tracer/memory_stats.py'
2023-02-06T13:18:01,599   adding 'colossalai/gemini/memory_tracer/memstats_collector.py'
2023-02-06T13:18:01,602   adding 'colossalai/gemini/memory_tracer/param_runtime_order.py'
2023-02-06T13:18:01,604   adding 'colossalai/gemini/memory_tracer/runtime_mem_tracer.py'
2023-02-06T13:18:01,607   adding 'colossalai/gemini/memory_tracer/static_memstats_collector.py'
2023-02-06T13:18:01,609   adding 'colossalai/gemini/memory_tracer/utils.py'
2023-02-06T13:18:01,613   adding 'colossalai/gemini/ophooks/__init__.py'
2023-02-06T13:18:01,615   adding 'colossalai/gemini/ophooks/_shard_grad_ophook.py'
2023-02-06T13:18:01,617   adding 'colossalai/gemini/ophooks/_shard_param_ophook.py'
2023-02-06T13:18:01,619   adding 'colossalai/gemini/ophooks/runtime_mem_tracer_hook.py'
2023-02-06T13:18:01,622   adding 'colossalai/gemini/ophooks/utils.py'
2023-02-06T13:18:01,625   adding 'colossalai/gemini/paramhooks/__init__.py'
2023-02-06T13:18:01,627   adding 'colossalai/gemini/paramhooks/_param_hookmgr.py'
2023-02-06T13:18:01,631   adding 'colossalai/kernel/__init__.py'
2023-02-06T13:18:01,634   adding 'colossalai/kernel/cuda_native/__init__.py'
2023-02-06T13:18:01,639   adding 'colossalai/kernel/cuda_native/flash_attention.py'
2023-02-06T13:18:01,642   adding 'colossalai/kernel/cuda_native/layer_norm.py'
2023-02-06T13:18:01,645   adding 'colossalai/kernel/cuda_native/multihead_attention.py'
2023-02-06T13:18:01,648   adding 'colossalai/kernel/cuda_native/scaled_softmax.py'
2023-02-06T13:18:01,653   adding 'colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp'
2023-02-06T13:18:01,655   adding 'colossalai/kernel/cuda_native/csrc/compat.h'
2023-02-06T13:18:01,659   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.cpp'
2023-02-06T13:18:01,662   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.h'
2023-02-06T13:18:01,665   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp'
2023-02-06T13:18:01,672   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu'
2023-02-06T13:18:01,675   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda.cpp'
2023-02-06T13:18:01,680   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu'
2023-02-06T13:18:01,683   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu'
2023-02-06T13:18:01,686   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh'
2023-02-06T13:18:01,690   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu'
2023-02-06T13:18:01,696   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu'
2023-02-06T13:18:01,698   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu'
2023-02-06T13:18:01,702   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu'
2023-02-06T13:18:01,707   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp'
2023-02-06T13:18:01,710   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h'
2023-02-06T13:18:01,714   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp'
2023-02-06T13:18:01,719   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h'
2023-02-06T13:18:01,722   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu'
2023-02-06T13:18:01,725   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp'
2023-02-06T13:18:01,730   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h'
2023-02-06T13:18:01,734   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu'
2023-02-06T13:18:01,738   adding 'colossalai/kernel/cuda_native/csrc/type_shim.h'
2023-02-06T13:18:01,744   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h'
2023-02-06T13:18:01,747   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/context.h'
2023-02-06T13:18:01,750   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h'
2023-02-06T13:18:01,753   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h'
2023-02-06T13:18:01,756   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h'
2023-02-06T13:18:01,759   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h'
2023-02-06T13:18:01,762   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h'
2023-02-06T13:18:01,766   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h'
2023-02-06T13:18:01,769   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh'
2023-02-06T13:18:01,772   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h'
2023-02-06T13:18:01,775   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h'
2023-02-06T13:18:01,778   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h'
2023-02-06T13:18:01,782   adding 'colossalai/kernel/jit/__init__.py'
2023-02-06T13:18:01,784   adding 'colossalai/kernel/jit/bias_dropout_add.py'
2023-02-06T13:18:01,787   adding 'colossalai/kernel/jit/bias_gelu.py'
2023-02-06T13:18:01,790   adding 'colossalai/kernel/jit/option.py'
2023-02-06T13:18:01,794   adding 'colossalai/kernel/op_builder/__init__.py'
2023-02-06T13:18:01,798   adding 'colossalai/kernel/op_builder/builder.py'
2023-02-06T13:18:01,801   adding 'colossalai/kernel/op_builder/cpu_adam.py'
2023-02-06T13:18:01,803   adding 'colossalai/kernel/op_builder/fused_optim.py'
2023-02-06T13:18:01,806   adding 'colossalai/kernel/op_builder/layernorm.py'
2023-02-06T13:18:01,809   adding 'colossalai/kernel/op_builder/moe.py'
2023-02-06T13:18:01,812   adding 'colossalai/kernel/op_builder/multi_head_attn.py'
2023-02-06T13:18:01,815   adding 'colossalai/kernel/op_builder/scaled_masked_softmax.py'
2023-02-06T13:18:01,818   adding 'colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py'
2023-02-06T13:18:01,821   adding 'colossalai/kernel/op_builder/utils.py'
2023-02-06T13:18:01,825   adding 'colossalai/logging/__init__.py'
2023-02-06T13:18:01,828   adding 'colossalai/logging/logger.py'
2023-02-06T13:18:01,833   adding 'colossalai/nn/__init__.py'
2023-02-06T13:18:01,836   adding 'colossalai/nn/init.py'
2023-02-06T13:18:01,840   adding 'colossalai/nn/_ops/__init__.py'
2023-02-06T13:18:01,844   adding 'colossalai/nn/_ops/_utils.py'
2023-02-06T13:18:01,848   adding 'colossalai/nn/_ops/addmm.py'
2023-02-06T13:18:01,850   adding 'colossalai/nn/_ops/batch_norm.py'
2023-02-06T13:18:01,854   adding 'colossalai/nn/_ops/element_wise.py'
2023-02-06T13:18:01,858   adding 'colossalai/nn/_ops/embedding.py'
2023-02-06T13:18:01,861   adding 'colossalai/nn/_ops/embedding_bag.py'
2023-02-06T13:18:01,864   adding 'colossalai/nn/_ops/layernorm.py'
2023-02-06T13:18:01,868   adding 'colossalai/nn/_ops/linear.py'
2023-02-06T13:18:01,871   adding 'colossalai/nn/_ops/loss.py'
2023-02-06T13:18:01,874   adding 'colossalai/nn/_ops/view.py'
2023-02-06T13:18:01,878   adding 'colossalai/nn/layer/__init__.py'
2023-02-06T13:18:01,881   adding 'colossalai/nn/layer/base_layer.py'
2023-02-06T13:18:01,885   adding 'colossalai/nn/layer/colossalai_layer/__init__.py'
2023-02-06T13:18:01,888   adding 'colossalai/nn/layer/colossalai_layer/_utils.py'
2023-02-06T13:18:01,891   adding 'colossalai/nn/layer/colossalai_layer/dropout.py'
2023-02-06T13:18:01,894   adding 'colossalai/nn/layer/colossalai_layer/embedding.py'
2023-02-06T13:18:01,898   adding 'colossalai/nn/layer/colossalai_layer/linear.py'
2023-02-06T13:18:01,901   adding 'colossalai/nn/layer/colossalai_layer/normalization.py'
2023-02-06T13:18:01,905   adding 'colossalai/nn/layer/moe/__init__.py'
2023-02-06T13:18:01,908   adding 'colossalai/nn/layer/moe/_operation.py'
2023-02-06T13:18:01,912   adding 'colossalai/nn/layer/moe/experts.py'
2023-02-06T13:18:01,916   adding 'colossalai/nn/layer/moe/layers.py'
2023-02-06T13:18:01,920   adding 'colossalai/nn/layer/moe/routers.py'
2023-02-06T13:18:01,923   adding 'colossalai/nn/layer/moe/utils.py'
2023-02-06T13:18:01,927   adding 'colossalai/nn/layer/parallel_1d/__init__.py'
2023-02-06T13:18:01,931   adding 'colossalai/nn/layer/parallel_1d/_operation.py'
2023-02-06T13:18:01,934   adding 'colossalai/nn/layer/parallel_1d/_utils.py'
2023-02-06T13:18:01,943   adding 'colossalai/nn/layer/parallel_1d/layers.py'
2023-02-06T13:18:01,948   adding 'colossalai/nn/layer/parallel_2d/__init__.py'
2023-02-06T13:18:01,955   adding 'colossalai/nn/layer/parallel_2d/_operation.py'
2023-02-06T13:18:01,958   adding 'colossalai/nn/layer/parallel_2d/_utils.py'
2023-02-06T13:18:01,967   adding 'colossalai/nn/layer/parallel_2d/layers.py'
2023-02-06T13:18:01,972   adding 'colossalai/nn/layer/parallel_2p5d/__init__.py'
2023-02-06T13:18:01,979   adding 'colossalai/nn/layer/parallel_2p5d/_operation.py'
2023-02-06T13:18:01,983   adding 'colossalai/nn/layer/parallel_2p5d/_utils.py'
2023-02-06T13:18:01,993   adding 'colossalai/nn/layer/parallel_2p5d/layers.py'
2023-02-06T13:18:01,997   adding 'colossalai/nn/layer/parallel_3d/__init__.py'
2023-02-06T13:18:02,003   adding 'colossalai/nn/layer/parallel_3d/_operation.py'
2023-02-06T13:18:02,007   adding 'colossalai/nn/layer/parallel_3d/_utils.py'
2023-02-06T13:18:02,016   adding 'colossalai/nn/layer/parallel_3d/layers.py'
2023-02-06T13:18:02,021   adding 'colossalai/nn/layer/parallel_sequence/__init__.py'
2023-02-06T13:18:02,024   adding 'colossalai/nn/layer/parallel_sequence/_operation.py'
2023-02-06T13:18:02,027   adding 'colossalai/nn/layer/parallel_sequence/_utils.py'
2023-02-06T13:18:02,032   adding 'colossalai/nn/layer/parallel_sequence/layers.py'
2023-02-06T13:18:02,036   adding 'colossalai/nn/layer/utils/__init__.py'
2023-02-06T13:18:02,039   adding 'colossalai/nn/layer/utils/common.py'
2023-02-06T13:18:02,043   adding 'colossalai/nn/layer/vanilla/__init__.py'
2023-02-06T13:18:02,047   adding 'colossalai/nn/layer/vanilla/layers.py'
2023-02-06T13:18:02,051   adding 'colossalai/nn/layer/wrapper/__init__.py'
2023-02-06T13:18:02,054   adding 'colossalai/nn/layer/wrapper/pipeline_wrapper.py'
2023-02-06T13:18:02,058   adding 'colossalai/nn/loss/__init__.py'
2023-02-06T13:18:02,062   adding 'colossalai/nn/loss/loss_1d.py'
2023-02-06T13:18:02,066   adding 'colossalai/nn/loss/loss_2d.py'
2023-02-06T13:18:02,069   adding 'colossalai/nn/loss/loss_2p5d.py'
2023-02-06T13:18:02,073   adding 'colossalai/nn/loss/loss_3d.py'
2023-02-06T13:18:02,076   adding 'colossalai/nn/loss/loss_moe.py'
2023-02-06T13:18:02,081   adding 'colossalai/nn/lr_scheduler/__init__.py'
2023-02-06T13:18:02,084   adding 'colossalai/nn/lr_scheduler/cosine.py'
2023-02-06T13:18:02,087   adding 'colossalai/nn/lr_scheduler/delayed.py'
2023-02-06T13:18:02,090   adding 'colossalai/nn/lr_scheduler/linear.py'
2023-02-06T13:18:02,094   adding 'colossalai/nn/lr_scheduler/multistep.py'
2023-02-06T13:18:02,097   adding 'colossalai/nn/lr_scheduler/onecycle.py'
2023-02-06T13:18:02,100   adding 'colossalai/nn/lr_scheduler/poly.py'
2023-02-06T13:18:02,104   adding 'colossalai/nn/lr_scheduler/torch.py'
2023-02-06T13:18:02,107   adding 'colossalai/nn/metric/__init__.py'
2023-02-06T13:18:02,110   adding 'colossalai/nn/metric/_utils.py'
2023-02-06T13:18:02,113   adding 'colossalai/nn/metric/accuracy_2d.py'
2023-02-06T13:18:02,116   adding 'colossalai/nn/metric/accuracy_2p5d.py'
2023-02-06T13:18:02,119   adding 'colossalai/nn/metric/accuracy_3d.py'
2023-02-06T13:18:02,123   adding 'colossalai/nn/optimizer/__init__.py'
2023-02-06T13:18:02,126   adding 'colossalai/nn/optimizer/colossalai_optimizer.py'
2023-02-06T13:18:02,130   adding 'colossalai/nn/optimizer/cpu_adam.py'
2023-02-06T13:18:02,134   adding 'colossalai/nn/optimizer/fused_adam.py'
2023-02-06T13:18:02,137   adding 'colossalai/nn/optimizer/fused_lamb.py'
2023-02-06T13:18:02,141   adding 'colossalai/nn/optimizer/fused_sgd.py'
2023-02-06T13:18:02,143   adding 'colossalai/nn/optimizer/gemini_optimizer.py'
2023-02-06T13:18:02,146   adding 'colossalai/nn/optimizer/hybrid_adam.py'
2023-02-06T13:18:02,149   adding 'colossalai/nn/optimizer/lamb.py'
2023-02-06T13:18:02,152   adding 'colossalai/nn/optimizer/lars.py'
2023-02-06T13:18:02,155   adding 'colossalai/nn/optimizer/nvme_optimizer.py'
2023-02-06T13:18:02,159   adding 'colossalai/nn/optimizer/zero_optimizer.py'
2023-02-06T13:18:02,163   adding 'colossalai/nn/parallel/__init__.py'
2023-02-06T13:18:02,172   adding 'colossalai/nn/parallel/data_parallel.py'
2023-02-06T13:18:02,175   adding 'colossalai/nn/parallel/gemini_parallel.py'
2023-02-06T13:18:02,177   adding 'colossalai/nn/parallel/reducer.py'
2023-02-06T13:18:02,180   adding 'colossalai/nn/parallel/utils.py'
2023-02-06T13:18:02,183   adding 'colossalai/nn/parallel/zero_wrapper.py'
2023-02-06T13:18:02,187   adding 'colossalai/nn/parallel/layers/__init__.py'
2023-02-06T13:18:02,189   adding 'colossalai/nn/parallel/layers/colo_module.py'
2023-02-06T13:18:02,191   adding 'colossalai/nn/parallel/layers/embedding.py'
2023-02-06T13:18:02,194   adding 'colossalai/nn/parallel/layers/linear.py'
2023-02-06T13:18:02,196   adding 'colossalai/nn/parallel/layers/module_utils.py'
2023-02-06T13:18:02,200   adding 'colossalai/nn/parallel/layers/cache_embedding/__init__.py'
2023-02-06T13:18:02,202   adding 'colossalai/nn/parallel/layers/cache_embedding/base_embedding.py'
2023-02-06T13:18:02,210   adding 'colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py'
2023-02-06T13:18:02,214   adding 'colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py'
2023-02-06T13:18:02,216   adding 'colossalai/nn/parallel/layers/cache_embedding/copyer.py'
2023-02-06T13:18:02,218   adding 'colossalai/nn/parallel/layers/cache_embedding/embedding_config.py'
2023-02-06T13:18:02,222   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py'
2023-02-06T13:18:02,225   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py'
2023-02-06T13:18:02,228   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py'
2023-02-06T13:18:02,232   adding 'colossalai/pipeline/__init__.py'
2023-02-06T13:18:02,234   adding 'colossalai/pipeline/layer_spec.py'
2023-02-06T13:18:02,238   adding 'colossalai/pipeline/pipelinable.py'
2023-02-06T13:18:02,241   adding 'colossalai/pipeline/pipeline_process_group.py'
2023-02-06T13:18:02,245   adding 'colossalai/pipeline/utils.py'
2023-02-06T13:18:02,248   adding 'colossalai/pipeline/middleware/__init__.py'
2023-02-06T13:18:02,251   adding 'colossalai/pipeline/middleware/topo.py'
2023-02-06T13:18:02,254   adding 'colossalai/pipeline/middleware/adaptor/__init__.py'
2023-02-06T13:18:02,257   adding 'colossalai/pipeline/middleware/adaptor/fx.py'
2023-02-06T13:18:02,261   adding 'colossalai/pipeline/rpc/__init__.py'
2023-02-06T13:18:02,275   adding 'colossalai/pipeline/rpc/_pipeline_base.py'
2023-02-06T13:18:02,280   adding 'colossalai/pipeline/rpc/_pipeline_schedule.py'
2023-02-06T13:18:02,284   adding 'colossalai/pipeline/rpc/utils.py'
2023-02-06T13:18:02,287   adding 'colossalai/registry/__init__.py'
2023-02-06T13:18:02,289   adding 'colossalai/registry/registry.py'
2023-02-06T13:18:02,293   adding 'colossalai/tensor/__init__.py'
2023-02-06T13:18:02,296   adding 'colossalai/tensor/colo_parameter.py'
2023-02-06T13:18:02,301   adding 'colossalai/tensor/colo_tensor.py'
2023-02-06T13:18:02,306   adding 'colossalai/tensor/comm_spec.py'
2023-02-06T13:18:02,309   adding 'colossalai/tensor/compute_spec.py'
2023-02-06T13:18:02,311   adding 'colossalai/tensor/const.py'
2023-02-06T13:18:02,315   adding 'colossalai/tensor/dist_spec_mgr.py'
2023-02-06T13:18:02,317   adding 'colossalai/tensor/distspec.py'
2023-02-06T13:18:02,320   adding 'colossalai/tensor/op_wrapper.py'
2023-02-06T13:18:02,323   adding 'colossalai/tensor/param_op_hook.py'
2023-02-06T13:18:02,326   adding 'colossalai/tensor/process_group.py'
2023-02-06T13:18:02,334   adding 'colossalai/tensor/shape_consistency.py'
2023-02-06T13:18:02,340   adding 'colossalai/tensor/sharding_spec.py'
2023-02-06T13:18:02,342   adding 'colossalai/tensor/tensor_spec.py'
2023-02-06T13:18:02,346   adding 'colossalai/tensor/utils.py'
2023-02-06T13:18:02,349   adding 'colossalai/testing/__init__.py'
2023-02-06T13:18:02,351   adding 'colossalai/testing/comparison.py'
2023-02-06T13:18:02,354   adding 'colossalai/testing/pytest_wrapper.py'
2023-02-06T13:18:02,356   adding 'colossalai/testing/random.py'
2023-02-06T13:18:02,359   adding 'colossalai/testing/utils.py'
2023-02-06T13:18:02,362   adding 'colossalai/trainer/__init__.py'
2023-02-06T13:18:02,367   adding 'colossalai/trainer/_trainer.py'
2023-02-06T13:18:02,371   adding 'colossalai/trainer/hooks/__init__.py'
2023-02-06T13:18:02,373   adding 'colossalai/trainer/hooks/_base_hook.py'
2023-02-06T13:18:02,375   adding 'colossalai/trainer/hooks/_checkpoint_hook.py'
2023-02-06T13:18:02,378   adding 'colossalai/trainer/hooks/_commons_.py'
2023-02-06T13:18:02,381   adding 'colossalai/trainer/hooks/_log_hook.py'
2023-02-06T13:18:02,384   adding 'colossalai/trainer/hooks/_lr_scheduler_hook.py'
2023-02-06T13:18:02,388   adding 'colossalai/trainer/hooks/_metric_hook.py'
2023-02-06T13:18:02,392   adding 'colossalai/utils/__init__.py'
2023-02-06T13:18:02,396   adding 'colossalai/utils/activation_checkpoint.py'
2023-02-06T13:18:02,400   adding 'colossalai/utils/checkpointing.py'
2023-02-06T13:18:02,406   adding 'colossalai/utils/common.py'
2023-02-06T13:18:02,409   adding 'colossalai/utils/cuda.py'
2023-02-06T13:18:02,412   adding 'colossalai/utils/memory.py'
2023-02-06T13:18:02,414   adding 'colossalai/utils/moe.py'
2023-02-06T13:18:02,417   adding 'colossalai/utils/timer.py'
2023-02-06T13:18:02,420   adding 'colossalai/utils/checkpoint/__init__.py'
2023-02-06T13:18:02,423   adding 'colossalai/utils/checkpoint/module_checkpoint.py'
2023-02-06T13:18:02,426   adding 'colossalai/utils/checkpoint/utils.py'
2023-02-06T13:18:02,429   adding 'colossalai/utils/checkpoint_io/__init__.py'
2023-02-06T13:18:02,431   adding 'colossalai/utils/checkpoint_io/backend.py'
2023-02-06T13:18:02,434   adding 'colossalai/utils/checkpoint_io/constant.py'
2023-02-06T13:18:02,437   adding 'colossalai/utils/checkpoint_io/convertor.py'
2023-02-06T13:18:02,440   adding 'colossalai/utils/checkpoint_io/distributed.py'
2023-02-06T13:18:02,443   adding 'colossalai/utils/checkpoint_io/io.py'
2023-02-06T13:18:02,445   adding 'colossalai/utils/checkpoint_io/meta.py'
2023-02-06T13:18:02,448   adding 'colossalai/utils/checkpoint_io/reader.py'
2023-02-06T13:18:02,452   adding 'colossalai/utils/checkpoint_io/utils.py'
2023-02-06T13:18:02,455   adding 'colossalai/utils/checkpoint_io/writer.py'
2023-02-06T13:18:02,458   adding 'colossalai/utils/data_sampler/__init__.py'
2023-02-06T13:18:02,460   adding 'colossalai/utils/data_sampler/base_sampler.py'
2023-02-06T13:18:02,463   adding 'colossalai/utils/data_sampler/data_parallel_sampler.py'
2023-02-06T13:18:02,467   adding 'colossalai/utils/model/__init__.py'
2023-02-06T13:18:02,470   adding 'colossalai/utils/model/colo_init_context.py'
2023-02-06T13:18:02,475   adding 'colossalai/utils/model/experimental.py'
2023-02-06T13:18:02,479   adding 'colossalai/utils/model/lazy_init_context.py'
2023-02-06T13:18:02,482   adding 'colossalai/utils/model/utils.py'
2023-02-06T13:18:02,485   adding 'colossalai/utils/multi_tensor_apply/__init__.py'
2023-02-06T13:18:02,487   adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py'
2023-02-06T13:18:02,490   adding 'colossalai/utils/profiler/__init__.py'
2023-02-06T13:18:02,492   adding 'colossalai/utils/profiler/extention.py'
2023-02-06T13:18:02,496   adding 'colossalai/utils/profiler/profiler.py'
2023-02-06T13:18:02,498   adding 'colossalai/utils/profiler/stateful_tensor_mem_extention.py'
2023-02-06T13:18:02,502   adding 'colossalai/utils/profiler/legacy/__init__.py'
2023-02-06T13:18:02,505   adding 'colossalai/utils/profiler/legacy/comm_profiler.py'
2023-02-06T13:18:02,508   adding 'colossalai/utils/profiler/legacy/pcie_profiler.py'
2023-02-06T13:18:02,511   adding 'colossalai/utils/profiler/legacy/prof_utils.py'
2023-02-06T13:18:02,514   adding 'colossalai/utils/rank_recorder/__init__.py'
2023-02-06T13:18:02,517   adding 'colossalai/utils/rank_recorder/rank_recorder.py'
2023-02-06T13:18:02,521   adding 'colossalai/utils/tensor_detector/__init__.py'
2023-02-06T13:18:02,524   adding 'colossalai/utils/tensor_detector/tensor_detector.py'
2023-02-06T13:18:02,528   adding 'colossalai/zero/__init__.py'
2023-02-06T13:18:02,531   adding 'colossalai/zero/init_ctx/__init__.py'
2023-02-06T13:18:02,535   adding 'colossalai/zero/init_ctx/init_context.py'
2023-02-06T13:18:02,538   adding 'colossalai/zero/shard_utils/__init__.py'
2023-02-06T13:18:02,540   adding 'colossalai/zero/shard_utils/base_shard_strategy.py'
2023-02-06T13:18:02,543   adding 'colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py'
2023-02-06T13:18:02,545   adding 'colossalai/zero/shard_utils/commons.py'
2023-02-06T13:18:02,547   adding 'colossalai/zero/shard_utils/tensor_shard_strategy.py'
2023-02-06T13:18:02,551   adding 'colossalai/zero/sharded_model/__init__.py'
2023-02-06T13:18:02,553   adding 'colossalai/zero/sharded_model/_utils.py'
2023-02-06T13:18:02,557   adding 'colossalai/zero/sharded_model/reduce_scatter.py'
2023-02-06T13:18:02,565   adding 'colossalai/zero/sharded_model/sharded_model_v2.py'
2023-02-06T13:18:02,567   adding 'colossalai/zero/sharded_model/utils.py'
2023-02-06T13:18:02,571   adding 'colossalai/zero/sharded_optim/__init__.py'
2023-02-06T13:18:02,575   adding 'colossalai/zero/sharded_optim/_utils.py'
2023-02-06T13:18:02,582   adding 'colossalai/zero/sharded_optim/low_level_optim.py'
2023-02-06T13:18:02,588   adding 'colossalai/zero/sharded_optim/sharded_optim_v2.py'
2023-02-06T13:18:02,591   adding 'colossalai/zero/sharded_optim/bookkeeping/__init__.py'
2023-02-06T13:18:02,593   adding 'colossalai/zero/sharded_optim/bookkeeping/base_store.py'
2023-02-06T13:18:02,596   adding 'colossalai/zero/sharded_optim/bookkeeping/bucket_store.py'
2023-02-06T13:18:02,598   adding 'colossalai/zero/sharded_optim/bookkeeping/gradient_store.py'
2023-02-06T13:18:02,601   adding 'colossalai/zero/sharded_optim/bookkeeping/parameter_store.py'
2023-02-06T13:18:02,603   adding 'colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py'
2023-02-06T13:18:02,606   adding 'colossalai/zero/sharded_param/__init__.py'
2023-02-06T13:18:02,609   adding 'colossalai/zero/sharded_param/sharded_param.py'
2023-02-06T13:18:02,611   adding 'colossalai/zero/sharded_param/sharded_tensor.py'
2023-02-06T13:18:02,614   adding 'colossalai/zero/utils/__init__.py'
2023-02-06T13:18:02,617   adding 'colossalai/zero/utils/gemini_hook.py'
2023-02-06T13:18:02,619   adding 'colossalai/zero/utils/zero_hook.py'
2023-02-06T13:18:02,625   adding 'op_builder/__init__.py'
2023-02-06T13:18:02,628   adding 'op_builder/builder.py'
2023-02-06T13:18:02,631   adding 'op_builder/cpu_adam.py'
2023-02-06T13:18:02,633   adding 'op_builder/fused_optim.py'
2023-02-06T13:18:02,635   adding 'op_builder/layernorm.py'
2023-02-06T13:18:02,637   adding 'op_builder/moe.py'
2023-02-06T13:18:02,640   adding 'op_builder/multi_head_attn.py'
2023-02-06T13:18:02,642   adding 'op_builder/scaled_masked_softmax.py'
2023-02-06T13:18:02,644   adding 'op_builder/scaled_upper_triangle_masked_softmax.py'
2023-02-06T13:18:02,646   adding 'op_builder/utils.py'
2023-02-06T13:18:02,651   adding 'colossalai-0.2.1.dist-info/LICENSE'
2023-02-06T13:18:02,656   adding 'colossalai-0.2.1.dist-info/METADATA'
2023-02-06T13:18:02,658   adding 'colossalai-0.2.1.dist-info/WHEEL'
2023-02-06T13:18:02,659   adding 'colossalai-0.2.1.dist-info/entry_points.txt'
2023-02-06T13:18:02,661   adding 'colossalai-0.2.1.dist-info/top_level.txt'
2023-02-06T13:18:02,688   adding 'colossalai-0.2.1.dist-info/RECORD'
2023-02-06T13:18:02,744   removing build/bdist.linux-armv7l/wheel
2023-02-06T13:18:03,322   Building wheel for colossalai (setup.py): finished with status 'done'
2023-02-06T13:18:03,356   Created wheel for colossalai: filename=colossalai-0.2.1-py3-none-any.whl size=925820 sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0
2023-02-06T13:18:03,358   Stored in directory: /tmp/pip-ephem-wheel-cache-7fsgugpz/wheels/ab/b1/5b/46f13048a7c0755d427f5131005ddeacdfeb16d40ebab2d7c1
2023-02-06T13:18:03,438 Successfully built colossalai
2023-02-06T13:18:03,524 Removed build tracker: '/tmp/pip-build-tracker-qvutrwiy'