2023-02-10T03:15:43,501 Created temporary directory: /tmp/pip-ephem-wheel-cache-gzjfm2po
2023-02-10T03:15:43,506 Created temporary directory: /tmp/pip-build-tracker-le9dvp8o
2023-02-10T03:15:43,507 Initialized build tracking at /tmp/pip-build-tracker-le9dvp8o
2023-02-10T03:15:43,507 Created build tracker: /tmp/pip-build-tracker-le9dvp8o
2023-02-10T03:15:43,507 Entered build tracker: /tmp/pip-build-tracker-le9dvp8o
2023-02-10T03:15:43,509 Created temporary directory: /tmp/pip-wheel-66p9ywi1
2023-02-10T03:15:43,517 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453
2023-02-10T03:15:43,522 Created temporary directory: /tmp/pip-ephem-wheel-cache-bif6x16g
2023-02-10T03:15:43,572 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-02-10T03:15:43,579 2 location(s) to search for versions of colossalai:
2023-02-10T03:15:43,579 * https://pypi.org/simple/colossalai/
2023-02-10T03:15:43,579 * https://www.piwheels.org/simple/colossalai/
2023-02-10T03:15:43,580 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/
2023-02-10T03:15:43,581 Getting page https://pypi.org/simple/colossalai/
2023-02-10T03:15:43,584 Found index url https://pypi.org/simple
2023-02-10T03:15:43,771 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json
2023-02-10T03:15:43,774   Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0
2023-02-10T03:15:43,776   Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1
2023-02-10T03:15:43,777   Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2
2023-02-10T03:15:43,778 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/
2023-02-10T03:15:43,779 Getting page https://www.piwheels.org/simple/colossalai/
2023-02-10T03:15:43,781 Found index url https://www.piwheels.org/simple
2023-02-10T03:15:44,028 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html
2023-02-10T03:15:44,031   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-02-10T03:15:44,032   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-02-10T03:15:44,033 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/
2023-02-10T03:15:44,033 Skipping link: not a file: https://pypi.org/simple/colossalai/
2023-02-10T03:15:44,066 Given no hashes to check 1 links for project 'colossalai': discarding no candidates
2023-02-10T03:15:44,096 Collecting colossalai==0.2.2
2023-02-10T03:15:44,100   Created temporary directory: /tmp/pip-unpack-5l_x7jxc
2023-02-10T03:15:44,356   Downloading colossalai-0.2.2.tar.gz (705 kB)
2023-02-10T03:15:47,612   Added colossalai==0.2.2 from https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz to build tracker '/tmp/pip-build-tracker-le9dvp8o'
2023-02-10T03:15:47,615   Running setup.py (path:/tmp/pip-wheel-66p9ywi1/colossalai_308fd67c53ca45fa81a21c21d689066f/setup.py) egg_info for package colossalai
2023-02-10T03:15:47,616   Created temporary directory: /tmp/pip-pip-egg-info-1pz61g2m
2023-02-10T03:15:47,617   Preparing metadata (setup.py): started
2023-02-10T03:15:47,619   Running command python setup.py egg_info
2023-02-10T03:15:50,710   running egg_info
2023-02-10T03:15:50,714   creating /tmp/pip-pip-egg-info-1pz61g2m/colossalai.egg-info
2023-02-10T03:15:50,809   writing /tmp/pip-pip-egg-info-1pz61g2m/colossalai.egg-info/PKG-INFO
2023-02-10T03:15:50,814   writing dependency_links to /tmp/pip-pip-egg-info-1pz61g2m/colossalai.egg-info/dependency_links.txt
2023-02-10T03:15:50,817   writing entry points to /tmp/pip-pip-egg-info-1pz61g2m/colossalai.egg-info/entry_points.txt
2023-02-10T03:15:50,820   writing requirements to /tmp/pip-pip-egg-info-1pz61g2m/colossalai.egg-info/requires.txt
2023-02-10T03:15:50,822   writing top-level names to /tmp/pip-pip-egg-info-1pz61g2m/colossalai.egg-info/top_level.txt
2023-02-10T03:15:50,825   writing manifest file '/tmp/pip-pip-egg-info-1pz61g2m/colossalai.egg-info/SOURCES.txt'
2023-02-10T03:15:51,324   reading manifest file '/tmp/pip-pip-egg-info-1pz61g2m/colossalai.egg-info/SOURCES.txt'
2023-02-10T03:15:51,327   reading manifest template 'MANIFEST.in'
2023-02-10T03:15:53,324   warning: no files found matching '*.tr' under directory 'colossalai'
2023-02-10T03:15:54,344   warning: no files found matching '*.cc' under directory 'colossalai'
2023-02-10T03:15:54,844   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-02-10T03:15:54,862   adding license file 'LICENSE'
2023-02-10T03:15:54,930   writing manifest file '/tmp/pip-pip-egg-info-1pz61g2m/colossalai.egg-info/SOURCES.txt'
2023-02-10T03:15:55,139   Preparing metadata (setup.py): finished with status 'done'
2023-02-10T03:15:55,156   Source in /tmp/pip-wheel-66p9ywi1/colossalai_308fd67c53ca45fa81a21c21d689066f has version 0.2.2, which satisfies requirement colossalai==0.2.2 from https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz
2023-02-10T03:15:55,158   Removed colossalai==0.2.2 from https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz from build tracker '/tmp/pip-build-tracker-le9dvp8o'
2023-02-10T03:15:55,176 Created temporary directory: /tmp/pip-unpack-58v6se0h
2023-02-10T03:15:55,177 Building wheels for collected packages: colossalai
2023-02-10T03:15:55,187   Created temporary directory: /tmp/pip-wheel-y632_ym_
2023-02-10T03:15:55,187   Building wheel for colossalai (setup.py): started
2023-02-10T03:15:55,189   Destination directory: /tmp/pip-wheel-y632_ym_
2023-02-10T03:15:55,190   Running command python setup.py bdist_wheel
2023-02-10T03:15:58,198   running bdist_wheel
2023-02-10T03:15:59,061   running build
2023-02-10T03:15:59,061   running build_py
2023-02-10T03:15:59,207   creating build
2023-02-10T03:15:59,207   creating build/lib
2023-02-10T03:15:59,208   creating build/lib/colossalai
2023-02-10T03:15:59,210   copying colossalai/core.py -> build/lib/colossalai
2023-02-10T03:15:59,214   copying colossalai/constants.py -> build/lib/colossalai
2023-02-10T03:15:59,218   copying colossalai/global_variables.py -> build/lib/colossalai
2023-02-10T03:15:59,221   copying colossalai/initialize.py -> build/lib/colossalai
2023-02-10T03:15:59,226   copying colossalai/version.py -> build/lib/colossalai
2023-02-10T03:15:59,229   copying colossalai/__init__.py -> build/lib/colossalai
2023-02-10T03:15:59,235   creating build/lib/op_builder
2023-02-10T03:15:59,236   copying op_builder/moe.py -> build/lib/op_builder
2023-02-10T03:15:59,239   copying op_builder/layernorm.py -> build/lib/op_builder
2023-02-10T03:15:59,242   copying op_builder/cpu_adam.py -> build/lib/op_builder
2023-02-10T03:15:59,246   copying op_builder/scaled_masked_softmax.py -> build/lib/op_builder
2023-02-10T03:15:59,249   copying op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/op_builder
2023-02-10T03:15:59,252   copying op_builder/utils.py -> build/lib/op_builder
2023-02-10T03:15:59,255   copying op_builder/multi_head_attn.py -> build/lib/op_builder
2023-02-10T03:15:59,259   copying op_builder/__init__.py -> build/lib/op_builder
2023-02-10T03:15:59,263   copying op_builder/builder.py -> build/lib/op_builder
2023-02-10T03:15:59,267   copying op_builder/fused_optim.py -> build/lib/op_builder
2023-02-10T03:15:59,272   creating build/lib/colossalai/gemini
2023-02-10T03:15:59,274   copying colossalai/gemini/placement_policy.py -> build/lib/colossalai/gemini
2023-02-10T03:15:59,279   copying colossalai/gemini/tensor_utils.py -> build/lib/colossalai/gemini
2023-02-10T03:15:59,282   copying colossalai/gemini/gemini_context.py -> build/lib/colossalai/gemini
2023-02-10T03:15:59,286   copying colossalai/gemini/gemini_mgr.py -> build/lib/colossalai/gemini
2023-02-10T03:15:59,290   copying colossalai/gemini/tensor_placement_policy.py -> build/lib/colossalai/gemini
2023-02-10T03:15:59,293   copying colossalai/gemini/__init__.py -> build/lib/colossalai/gemini
2023-02-10T03:15:59,296   copying colossalai/gemini/stateful_tensor.py -> build/lib/colossalai/gemini
2023-02-10T03:15:59,300   copying colossalai/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/gemini
2023-02-10T03:15:59,306   creating build/lib/colossalai/context
2023-02-10T03:15:59,308   copying colossalai/context/parallel_mode.py -> build/lib/colossalai/context
2023-02-10T03:15:59,311   copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context
2023-02-10T03:15:59,314   copying colossalai/context/config.py -> build/lib/colossalai/context
2023-02-10T03:15:59,318   copying colossalai/context/moe_context.py -> build/lib/colossalai/context
2023-02-10T03:15:59,321   copying colossalai/context/parallel_context.py -> build/lib/colossalai/context
2023-02-10T03:15:59,326   copying colossalai/context/__init__.py -> build/lib/colossalai/context
2023-02-10T03:15:59,330   creating build/lib/colossalai/amp
2023-02-10T03:15:59,331   copying colossalai/amp/amp_type.py -> build/lib/colossalai/amp
2023-02-10T03:15:59,335   copying colossalai/amp/__init__.py -> build/lib/colossalai/amp
2023-02-10T03:15:59,340   creating build/lib/colossalai/pipeline
2023-02-10T03:15:59,341   copying colossalai/pipeline/pipeline_process_group.py -> build/lib/colossalai/pipeline
2023-02-10T03:15:59,346   copying colossalai/pipeline/pipelinable.py -> build/lib/colossalai/pipeline
2023-02-10T03:15:59,350   copying colossalai/pipeline/layer_spec.py -> build/lib/colossalai/pipeline
2023-02-10T03:15:59,354   copying colossalai/pipeline/utils.py -> build/lib/colossalai/pipeline
2023-02-10T03:15:59,358   copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline
2023-02-10T03:15:59,362   creating build/lib/colossalai/engine
2023-02-10T03:15:59,363   copying colossalai/engine/__init__.py -> build/lib/colossalai/engine
2023-02-10T03:15:59,367   copying colossalai/engine/_base_engine.py -> build/lib/colossalai/engine
2023-02-10T03:15:59,372   creating build/lib/colossalai/device
2023-02-10T03:15:59,373   copying colossalai/device/device_mesh.py -> build/lib/colossalai/device
2023-02-10T03:15:59,378   copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device
2023-02-10T03:15:59,382   copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device
2023-02-10T03:15:59,386   copying colossalai/device/__init__.py -> build/lib/colossalai/device
2023-02-10T03:15:59,390   creating build/lib/colossalai/cli
2023-02-10T03:15:59,391   copying colossalai/cli/__init__.py -> build/lib/colossalai/cli
2023-02-10T03:15:59,395   copying colossalai/cli/cli.py -> build/lib/colossalai/cli
2023-02-10T03:15:59,399   creating build/lib/colossalai/fx
2023-02-10T03:15:59,401   copying colossalai/fx/_meta_registrations.py -> build/lib/colossalai/fx
2023-02-10T03:15:59,405   copying colossalai/fx/proxy.py -> build/lib/colossalai/fx
2023-02-10T03:15:59,409   copying colossalai/fx/__init__.py -> build/lib/colossalai/fx
2023-02-10T03:15:59,412   copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx
2023-02-10T03:15:59,416   copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx
2023-02-10T03:15:59,420   creating build/lib/colossalai/builder
2023-02-10T03:15:59,421   copying colossalai/builder/__init__.py -> build/lib/colossalai/builder
2023-02-10T03:15:59,425   copying colossalai/builder/builder.py -> build/lib/colossalai/builder
2023-02-10T03:15:59,429   creating build/lib/colossalai/communication
2023-02-10T03:15:59,431   copying colossalai/communication/p2p_v2.py -> build/lib/colossalai/communication
2023-02-10T03:15:59,435   copying colossalai/communication/p2p.py -> build/lib/colossalai/communication
2023-02-10T03:15:59,440   copying colossalai/communication/utils.py -> build/lib/colossalai/communication
2023-02-10T03:15:59,445   copying colossalai/communication/__init__.py -> build/lib/colossalai/communication
2023-02-10T03:15:59,448   copying colossalai/communication/collective.py -> build/lib/colossalai/communication
2023-02-10T03:15:59,453   copying colossalai/communication/ring.py -> build/lib/colossalai/communication
2023-02-10T03:15:59,458   creating build/lib/colossalai/logging
2023-02-10T03:15:59,460   copying colossalai/logging/logger.py -> build/lib/colossalai/logging
2023-02-10T03:15:59,465   copying colossalai/logging/__init__.py -> build/lib/colossalai/logging
2023-02-10T03:15:59,470   creating build/lib/colossalai/nn
2023-02-10T03:15:59,472   copying colossalai/nn/init.py -> build/lib/colossalai/nn
2023-02-10T03:15:59,477   copying colossalai/nn/__init__.py -> build/lib/colossalai/nn
2023-02-10T03:15:59,482   creating build/lib/colossalai/trainer
2023-02-10T03:15:59,485   copying colossalai/trainer/_trainer.py -> build/lib/colossalai/trainer
2023-02-10T03:15:59,491   copying colossalai/trainer/__init__.py -> build/lib/colossalai/trainer
2023-02-10T03:15:59,496   creating build/lib/colossalai/_C
2023-02-10T03:15:59,498   copying colossalai/_C/__init__.py -> build/lib/colossalai/_C
2023-02-10T03:15:59,502   creating build/lib/colossalai/zero
2023-02-10T03:15:59,504   copying colossalai/zero/__init__.py -> build/lib/colossalai/zero
2023-02-10T03:15:59,508   creating build/lib/colossalai/auto_parallel
2023-02-10T03:15:59,510   copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel
2023-02-10T03:15:59,515   creating build/lib/colossalai/tensor
2023-02-10T03:15:59,517   copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,521   copying colossalai/tensor/compute_spec.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,524   copying colossalai/tensor/dist_spec_mgr.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,528   copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,532   copying colossalai/tensor/distspec.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,535   copying colossalai/tensor/process_group.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,540   copying colossalai/tensor/op_wrapper.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,543   copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,548   copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,551   copying colossalai/tensor/const.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,555   copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,559   copying colossalai/tensor/tensor_spec.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,563   copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,568   copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,571   copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor
2023-02-10T03:15:59,578   creating build/lib/colossalai/utils
2023-02-10T03:15:59,580   copying colossalai/utils/timer.py -> build/lib/colossalai/utils
2023-02-10T03:15:59,585   copying colossalai/utils/moe.py -> build/lib/colossalai/utils
2023-02-10T03:15:59,588   copying colossalai/utils/cuda.py -> build/lib/colossalai/utils
2023-02-10T03:15:59,592   copying colossalai/utils/memory.py -> build/lib/colossalai/utils
2023-02-10T03:15:59,596   copying colossalai/utils/common.py -> build/lib/colossalai/utils
2023-02-10T03:15:59,601   copying colossalai/utils/activation_checkpoint.py -> build/lib/colossalai/utils
2023-02-10T03:15:59,605   copying colossalai/utils/__init__.py -> build/lib/colossalai/utils
2023-02-10T03:15:59,608   copying colossalai/utils/checkpointing.py -> build/lib/colossalai/utils
2023-02-10T03:15:59,613   creating build/lib/colossalai/kernel
2023-02-10T03:15:59,615   copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel
2023-02-10T03:15:59,619   creating build/lib/colossalai/registry
2023-02-10T03:15:59,621   copying colossalai/registry/registry.py -> build/lib/colossalai/registry
2023-02-10T03:15:59,624   copying colossalai/registry/__init__.py -> build/lib/colossalai/registry
2023-02-10T03:15:59,629   creating build/lib/colossalai/testing
2023-02-10T03:15:59,631   copying colossalai/testing/random.py -> build/lib/colossalai/testing
2023-02-10T03:15:59,635   copying colossalai/testing/comparison.py -> build/lib/colossalai/testing
2023-02-10T03:15:59,638   copying colossalai/testing/utils.py -> build/lib/colossalai/testing
2023-02-10T03:15:59,642   copying colossalai/testing/__init__.py -> build/lib/colossalai/testing
2023-02-10T03:15:59,645   copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing
2023-02-10T03:15:59,650   creating build/lib/colossalai/gemini/paramhooks
2023-02-10T03:15:59,651   copying colossalai/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/gemini/paramhooks
2023-02-10T03:15:59,655   copying colossalai/gemini/paramhooks/__init__.py -> build/lib/colossalai/gemini/paramhooks
2023-02-10T03:15:59,659   creating build/lib/colossalai/gemini/chunk
2023-02-10T03:15:59,661   copying colossalai/gemini/chunk/manager.py -> build/lib/colossalai/gemini/chunk
2023-02-10T03:15:59,665   copying colossalai/gemini/chunk/chunk.py -> build/lib/colossalai/gemini/chunk
2023-02-10T03:15:59,670   copying colossalai/gemini/chunk/search_utils.py -> build/lib/colossalai/gemini/chunk
2023-02-10T03:15:59,674   copying colossalai/gemini/chunk/utils.py -> build/lib/colossalai/gemini/chunk
2023-02-10T03:15:59,678   copying colossalai/gemini/chunk/__init__.py -> build/lib/colossalai/gemini/chunk
2023-02-10T03:15:59,683   creating build/lib/colossalai/gemini/memory_tracer
2023-02-10T03:15:59,685   copying colossalai/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-10T03:15:59,688   copying colossalai/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-10T03:15:59,692   copying colossalai/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-10T03:15:59,695   copying colossalai/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-10T03:15:59,699   copying colossalai/gemini/memory_tracer/utils.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-10T03:15:59,702   copying colossalai/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-10T03:15:59,705   copying colossalai/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-10T03:15:59,709   copying colossalai/gemini/memory_tracer/__init__.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-10T03:15:59,712   copying colossalai/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-10T03:15:59,717   creating build/lib/colossalai/gemini/ophooks
2023-02-10T03:15:59,719   copying colossalai/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/gemini/ophooks
2023-02-10T03:15:59,722   copying colossalai/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/gemini/ophooks
2023-02-10T03:15:59,726   copying colossalai/gemini/ophooks/utils.py -> build/lib/colossalai/gemini/ophooks
2023-02-10T03:15:59,730   copying colossalai/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/gemini/ophooks
2023-02-10T03:15:59,733   copying colossalai/gemini/ophooks/__init__.py -> build/lib/colossalai/gemini/ophooks
2023-02-10T03:15:59,738   creating build/lib/colossalai/context/process_group_initializer
2023-02-10T03:15:59,740   copying colossalai/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-10T03:15:59,744   copying colossalai/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-10T03:15:59,748   copying colossalai/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/context/process_group_initializer
2023-02-10T03:15:59,752   copying colossalai/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/context/process_group_initializer
2023-02-10T03:15:59,755   copying colossalai/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/context/process_group_initializer
2023-02-10T03:15:59,758   copying colossalai/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-10T03:15:59,761   copying colossalai/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/context/process_group_initializer
2023-02-10T03:15:59,764   copying colossalai/context/process_group_initializer/__init__.py -> build/lib/colossalai/context/process_group_initializer
2023-02-10T03:15:59,767   copying colossalai/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/context/process_group_initializer
2023-02-10T03:15:59,770   copying colossalai/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/context/process_group_initializer
2023-02-10T03:15:59,773   copying colossalai/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-10T03:15:59,778   creating build/lib/colossalai/context/random
2023-02-10T03:15:59,779   copying colossalai/context/random/_helper.py -> build/lib/colossalai/context/random
2023-02-10T03:15:59,783   copying colossalai/context/random/__init__.py -> build/lib/colossalai/context/random
2023-02-10T03:15:59,786   copying colossalai/context/random/seed_manager.py -> build/lib/colossalai/context/random
2023-02-10T03:15:59,790   creating build/lib/colossalai/amp/apex_amp
2023-02-10T03:15:59,792   copying colossalai/amp/apex_amp/apex_amp.py -> build/lib/colossalai/amp/apex_amp
2023-02-10T03:15:59,795   copying colossalai/amp/apex_amp/__init__.py -> build/lib/colossalai/amp/apex_amp
2023-02-10T03:15:59,799   creating build/lib/colossalai/amp/torch_amp
2023-02-10T03:15:59,801   copying colossalai/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/amp/torch_amp
2023-02-10T03:15:59,805   copying colossalai/amp/torch_amp/torch_amp.py -> build/lib/colossalai/amp/torch_amp
2023-02-10T03:15:59,809   copying colossalai/amp/torch_amp/__init__.py -> build/lib/colossalai/amp/torch_amp
2023-02-10T03:15:59,813   creating build/lib/colossalai/amp/naive_amp
2023-02-10T03:15:59,814   copying colossalai/amp/naive_amp/_utils.py -> build/lib/colossalai/amp/naive_amp
2023-02-10T03:15:59,818   copying colossalai/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/amp/naive_amp
2023-02-10T03:15:59,822   copying colossalai/amp/naive_amp/naive_amp.py -> build/lib/colossalai/amp/naive_amp
2023-02-10T03:15:59,826   copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp
2023-02-10T03:15:59,830   creating build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-10T03:15:59,831   copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-10T03:15:59,835   copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-10T03:15:59,839   copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-10T03:15:59,842   copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-10T03:15:59,846   creating build/lib/colossalai/pipeline/rpc
2023-02-10T03:15:59,848   copying colossalai/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/pipeline/rpc
2023-02-10T03:15:59,855   copying colossalai/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/pipeline/rpc
2023-02-10T03:15:59,860   copying colossalai/pipeline/rpc/utils.py -> build/lib/colossalai/pipeline/rpc
2023-02-10T03:15:59,863   copying colossalai/pipeline/rpc/__init__.py -> build/lib/colossalai/pipeline/rpc
2023-02-10T03:15:59,868   creating build/lib/colossalai/pipeline/middleware
2023-02-10T03:15:59,869   copying colossalai/pipeline/middleware/topo.py -> build/lib/colossalai/pipeline/middleware
2023-02-10T03:15:59,873   copying colossalai/pipeline/middleware/__init__.py -> build/lib/colossalai/pipeline/middleware
2023-02-10T03:15:59,877   creating build/lib/colossalai/pipeline/middleware/adaptor
2023-02-10T03:15:59,879   copying colossalai/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/pipeline/middleware/adaptor
2023-02-10T03:15:59,883   copying colossalai/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/pipeline/middleware/adaptor
2023-02-10T03:15:59,888   creating build/lib/colossalai/engine/schedule
2023-02-10T03:15:59,889   copying colossalai/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/engine/schedule
2023-02-10T03:15:59,892   copying colossalai/engine/schedule/_base_schedule.py -> build/lib/colossalai/engine/schedule
2023-02-10T03:15:59,897   copying colossalai/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/engine/schedule
2023-02-10T03:15:59,903   copying colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/engine/schedule
2023-02-10T03:15:59,907   copying colossalai/engine/schedule/__init__.py -> build/lib/colossalai/engine/schedule
2023-02-10T03:15:59,911   creating build/lib/colossalai/engine/gradient_accumulation
2023-02-10T03:15:59,912   copying colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/engine/gradient_accumulation
2023-02-10T03:15:59,916   copying colossalai/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/engine/gradient_accumulation
2023-02-10T03:15:59,921   creating build/lib/colossalai/engine/gradient_handler
2023-02-10T03:15:59,923   copying colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-10T03:15:59,926   copying colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-10T03:15:59,929   copying colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-10T03:15:59,932   copying colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-10T03:15:59,935   copying colossalai/engine/gradient_handler/utils.py -> build/lib/colossalai/engine/gradient_handler
2023-02-10T03:15:59,938   copying colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-10T03:15:59,941   copying colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-10T03:15:59,945   copying colossalai/engine/gradient_handler/__init__.py -> build/lib/colossalai/engine/gradient_handler
2023-02-10T03:15:59,949   creating build/lib/colossalai/cli/benchmark
2023-02-10T03:15:59,951   copying colossalai/cli/benchmark/benchmark.py -> build/lib/colossalai/cli/benchmark
2023-02-10T03:15:59,954   copying colossalai/cli/benchmark/models.py -> build/lib/colossalai/cli/benchmark
2023-02-10T03:15:59,958   copying colossalai/cli/benchmark/utils.py -> build/lib/colossalai/cli/benchmark
2023-02-10T03:15:59,961   copying colossalai/cli/benchmark/__init__.py -> build/lib/colossalai/cli/benchmark
2023-02-10T03:15:59,965   creating build/lib/colossalai/cli/check
2023-02-10T03:15:59,967   copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check
2023-02-10T03:15:59,971   copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check
2023-02-10T03:15:59,976   creating build/lib/colossalai/cli/launcher
2023-02-10T03:15:59,977   copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher
2023-02-10T03:15:59,981   copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher
2023-02-10T03:15:59,985   copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher
2023-02-10T03:15:59,988   copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher
2023-02-10T03:15:59,992   creating build/lib/colossalai/fx/codegen
2023-02-10T03:15:59,994   copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen
2023-02-10T03:16:00,001   copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen
2023-02-10T03:16:00,005   creating build/lib/colossalai/fx/passes
2023-02-10T03:16:00,007   copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes
2023-02-10T03:16:00,011   copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes
2023-02-10T03:16:00,015   copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes
2023-02-10T03:16:00,019   copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes
2023-02-10T03:16:00,023   copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes
2023-02-10T03:16:00,028   copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes
2023-02-10T03:16:00,031   copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes
2023-02-10T03:16:00,034   copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes
2023-02-10T03:16:00,041   creating build/lib/colossalai/fx/profiler
2023-02-10T03:16:00,042   copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler
2023-02-10T03:16:00,046   copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler
2023-02-10T03:16:00,049   copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler
2023-02-10T03:16:00,054   copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler
2023-02-10T03:16:00,058   copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler
2023-02-10T03:16:00,062   copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler
2023-02-10T03:16:00,066   copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler
2023-02-10T03:16:00,069   copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler
2023-02-10T03:16:00,074   creating build/lib/colossalai/fx/tracer
2023-02-10T03:16:00,075   copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer
2023-02-10T03:16:00,081   copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer
2023-02-10T03:16:00,084   copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer
2023-02-10T03:16:00,087   copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer
2023-02-10T03:16:00,091   copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer
2023-02-10T03:16:00,096   copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer
2023-02-10T03:16:00,100   copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer
2023-02-10T03:16:00,106   creating build/lib/colossalai/fx/passes/algorithms
2023-02-10T03:16:00,108   copying colossalai/fx/passes/algorithms/ckpt_solver_rotor.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-10T03:16:00,114   copying colossalai/fx/passes/algorithms/build_c_ext.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-10T03:16:00,117   copying colossalai/fx/passes/algorithms/linearize.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-10T03:16:00,121   copying colossalai/fx/passes/algorithms/ckpt_solver_pofo.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-10T03:16:00,129   copying colossalai/fx/passes/algorithms/operation.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-10T03:16:00,133   copying colossalai/fx/passes/algorithms/ckpt_solver_chen.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-10T03:16:00,137   copying colossalai/fx/passes/algorithms/__init__.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-10T03:16:00,142   creating build/lib/colossalai/fx/profiler/experimental
2023-02-10T03:16:00,144   copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-10T03:16:00,148   copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-10T03:16:00,152   copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-10T03:16:00,156   copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-10T03:16:00,160   copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-10T03:16:00,166   creating build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:00,168   copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:00,171   copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:00,174   copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:00,177   copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:00,180   copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:00,184   copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:00,187   copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:00,190   copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:00,193   copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:00,199   creating build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:00,200   copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:00,203   copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:00,208   copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:00,211   copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:00,214   copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:00,217   copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:00,220   copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:00,224   copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:00,227   copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:00,230   copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:00,233   copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:00,237   creating build/lib/colossalai/fx/tracer/meta_patch
2023-02-10T03:16:00,239   copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch
2023-02-10T03:16:00,243   creating build/lib/colossalai/fx/tracer/bias_addition_patch
2023-02-10T03:16:00,244   copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch
2023-02-10T03:16:00,250   creating build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:00,251   copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:00,255   copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:00,258   copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:00,262   copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:00,265   copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:00,268   copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:00,272   copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:00,275   copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:00,280   creating build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:00,281   copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:00,285   copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:00,288   copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:00,293   copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:00,296   copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:00,299   copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:00,302   copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:00,305   copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:00,310   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-10T03:16:00,311   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-10T03:16:00,315   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-10T03:16:00,319   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-10T03:16:00,322   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-10T03:16:00,325   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-10T03:16:00,335   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-10T03:16:00,336   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-10T03:16:00,340   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-10T03:16:00,343   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-10T03:16:00,347   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-10T03:16:00,352   creating build/lib/colossalai/nn/lr_scheduler
2023-02-10T03:16:00,354   copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-10T03:16:00,359   copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-10T03:16:00,363   copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-10T03:16:00,367   copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-10T03:16:00,371   copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-10T03:16:00,375   copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-10T03:16:00,379   copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-10T03:16:00,383   copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-10T03:16:00,388   creating build/lib/colossalai/nn/layer
2023-02-10T03:16:00,390   copying colossalai/nn/layer/base_layer.py -> build/lib/colossalai/nn/layer
2023-02-10T03:16:00,404   copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer
2023-02-10T03:16:00,409   creating build/lib/colossalai/nn/metric
2023-02-10T03:16:00,411   copying colossalai/nn/metric/accuracy_2d.py -> build/lib/colossalai/nn/metric
2023-02-10T03:16:00,415   copying colossalai/nn/metric/_utils.py -> build/lib/colossalai/nn/metric
2023-02-10T03:16:00,419   copying colossalai/nn/metric/accuracy_3d.py -> build/lib/colossalai/nn/metric
2023-02-10T03:16:00,423   copying colossalai/nn/metric/__init__.py -> build/lib/colossalai/nn/metric
2023-02-10T03:16:00,426   copying colossalai/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/nn/metric
2023-02-10T03:16:00,432   creating build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,434   copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,439   copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,444   copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,448   copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,453   copying colossalai/nn/optimizer/gemini_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,457   copying colossalai/nn/optimizer/zero_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,462   copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,466   copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,471   copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,476   copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,479   copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,482   copying colossalai/nn/optimizer/colossalai_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-10T03:16:00,487   creating build/lib/colossalai/nn/loss
2023-02-10T03:16:00,488   copying colossalai/nn/loss/loss_2d.py -> build/lib/colossalai/nn/loss
2023-02-10T03:16:00,492   copying colossalai/nn/loss/loss_3d.py -> build/lib/colossalai/nn/loss
2023-02-10T03:16:00,496   copying colossalai/nn/loss/loss_1d.py -> build/lib/colossalai/nn/loss
2023-02-10T03:16:00,500   copying colossalai/nn/loss/loss_moe.py -> build/lib/colossalai/nn/loss
2023-02-10T03:16:00,503   copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss
2023-02-10T03:16:00,506   copying colossalai/nn/loss/loss_2p5d.py -> build/lib/colossalai/nn/loss
2023-02-10T03:16:00,512   creating build/lib/colossalai/nn/_ops
2023-02-10T03:16:00,513   copying colossalai/nn/_ops/element_wise.py -> build/lib/colossalai/nn/_ops
2023-02-10T03:16:00,518   copying colossalai/nn/_ops/layernorm.py -> build/lib/colossalai/nn/_ops
2023-02-10T03:16:00,521   copying colossalai/nn/_ops/batch_norm.py -> build/lib/colossalai/nn/_ops
2023-02-10T03:16:00,524   copying colossalai/nn/_ops/view.py -> build/lib/colossalai/nn/_ops
2023-02-10T03:16:00,527   copying colossalai/nn/_ops/linear.py -> build/lib/colossalai/nn/_ops
2023-02-10T03:16:00,531   copying colossalai/nn/_ops/_utils.py -> build/lib/colossalai/nn/_ops
2023-02-10T03:16:00,535   copying colossalai/nn/_ops/addmm.py -> build/lib/colossalai/nn/_ops
2023-02-10T03:16:00,538   copying colossalai/nn/_ops/loss.py -> build/lib/colossalai/nn/_ops
2023-02-10T03:16:00,542   copying colossalai/nn/_ops/__init__.py -> build/lib/colossalai/nn/_ops
2023-02-10T03:16:00,545   copying colossalai/nn/_ops/embedding.py -> build/lib/colossalai/nn/_ops
2023-02-10T03:16:00,549   copying colossalai/nn/_ops/embedding_bag.py -> build/lib/colossalai/nn/_ops
2023-02-10T03:16:00,554   creating build/lib/colossalai/nn/parallel
2023-02-10T03:16:00,555   copying colossalai/nn/parallel/data_parallel.py -> build/lib/colossalai/nn/parallel
2023-02-10T03:16:00,561   copying colossalai/nn/parallel/utils.py -> build/lib/colossalai/nn/parallel
2023-02-10T03:16:00,565   copying colossalai/nn/parallel/gemini_parallel.py -> build/lib/colossalai/nn/parallel
2023-02-10T03:16:00,568   copying colossalai/nn/parallel/zero_wrapper.py -> build/lib/colossalai/nn/parallel
2023-02-10T03:16:00,572   copying colossalai/nn/parallel/reducer.py -> build/lib/colossalai/nn/parallel
2023-02-10T03:16:00,575   copying colossalai/nn/parallel/__init__.py -> build/lib/colossalai/nn/parallel
2023-02-10T03:16:00,580   creating build/lib/colossalai/nn/layer/parallel_1d
2023-02-10T03:16:00,581   copying colossalai/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-10T03:16:00,586   copying colossalai/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-10T03:16:00,592   copying colossalai/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-10T03:16:00,595   copying colossalai/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-10T03:16:00,600   creating build/lib/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:00,602   copying colossalai/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:00,606   copying colossalai/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:00,609   copying colossalai/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:00,612   copying colossalai/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:00,616   copying colossalai/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:00,620   copying colossalai/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:00,625   creating build/lib/colossalai/nn/layer/vanilla
2023-02-10T03:16:00,628   copying colossalai/nn/layer/vanilla/layers.py -> build/lib/colossalai/nn/layer/vanilla
2023-02-10T03:16:00,633   copying colossalai/nn/layer/vanilla/__init__.py -> build/lib/colossalai/nn/layer/vanilla
2023-02-10T03:16:00,639   creating build/lib/colossalai/nn/layer/moe
2023-02-10T03:16:00,641   copying colossalai/nn/layer/moe/layers.py -> build/lib/colossalai/nn/layer/moe
2023-02-10T03:16:00,646   copying colossalai/nn/layer/moe/experts.py -> build/lib/colossalai/nn/layer/moe
2023-02-10T03:16:00,651   copying colossalai/nn/layer/moe/utils.py -> build/lib/colossalai/nn/layer/moe
2023-02-10T03:16:00,656   copying colossalai/nn/layer/moe/_operation.py -> build/lib/colossalai/nn/layer/moe
2023-02-10T03:16:00,659   copying colossalai/nn/layer/moe/__init__.py -> build/lib/colossalai/nn/layer/moe
2023-02-10T03:16:00,663   copying colossalai/nn/layer/moe/routers.py -> build/lib/colossalai/nn/layer/moe
2023-02-10T03:16:00,668   creating build/lib/colossalai/nn/layer/parallel_2d
2023-02-10T03:16:00,735   copying colossalai/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-10T03:16:00,738   copying colossalai/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-10T03:16:00,745   copying colossalai/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-10T03:16:00,751   copying colossalai/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-10T03:16:00,756   creating build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-10T03:16:00,758   copying colossalai/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-10T03:16:00,763   copying colossalai/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-10T03:16:00,771   copying colossalai/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-10T03:16:00,777   copying colossalai/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-10T03:16:00,783   creating build/lib/colossalai/nn/layer/parallel_3d
2023-02-10T03:16:00,785   copying colossalai/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-10T03:16:00,789   copying colossalai/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-10T03:16:00,796   copying colossalai/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-10T03:16:00,801   copying colossalai/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-10T03:16:00,806   creating build/lib/colossalai/nn/layer/utils
2023-02-10T03:16:00,807   copying colossalai/nn/layer/utils/common.py -> build/lib/colossalai/nn/layer/utils
2023-02-10T03:16:00,811   copying colossalai/nn/layer/utils/__init__.py -> build/lib/colossalai/nn/layer/utils
2023-02-10T03:16:00,815   creating build/lib/colossalai/nn/layer/wrapper
2023-02-10T03:16:00,817   copying colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/nn/layer/wrapper
2023-02-10T03:16:00,820   copying colossalai/nn/layer/wrapper/__init__.py -> build/lib/colossalai/nn/layer/wrapper
2023-02-10T03:16:00,825   creating build/lib/colossalai/nn/layer/parallel_sequence
2023-02-10T03:16:00,827   copying colossalai/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-10T03:16:00,830   copying colossalai/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-10T03:16:00,835   copying colossalai/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-10T03:16:00,838   copying colossalai/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-10T03:16:00,843   creating build/lib/colossalai/nn/parallel/layers
2023-02-10T03:16:00,844   copying colossalai/nn/parallel/layers/linear.py -> build/lib/colossalai/nn/parallel/layers
2023-02-10T03:16:00,848   copying colossalai/nn/parallel/layers/colo_module.py -> build/lib/colossalai/nn/parallel/layers
2023-02-10T03:16:00,851   copying colossalai/nn/parallel/layers/module_utils.py -> build/lib/colossalai/nn/parallel/layers
2023-02-10T03:16:00,855   copying colossalai/nn/parallel/layers/__init__.py -> build/lib/colossalai/nn/parallel/layers
2023-02-10T03:16:00,859   copying colossalai/nn/parallel/layers/embedding.py -> build/lib/colossalai/nn/parallel/layers
2023-02-10T03:16:00,864   creating build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:00,865   copying colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:00,869   copying colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:00,873   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:00,877   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:00,882   copying colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:00,885   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:00,889   copying colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:00,894   copying colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:00,897   copying colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:00,902   creating build/lib/colossalai/trainer/hooks
2023-02-10T03:16:00,904   copying colossalai/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-10T03:16:00,908   copying colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-10T03:16:00,911   copying colossalai/trainer/hooks/_commons_.py -> build/lib/colossalai/trainer/hooks
2023-02-10T03:16:00,915   copying colossalai/trainer/hooks/_metric_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-10T03:16:00,920   copying colossalai/trainer/hooks/_base_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-10T03:16:00,923   copying colossalai/trainer/hooks/__init__.py -> build/lib/colossalai/trainer/hooks
2023-02-10T03:16:00,927   copying colossalai/trainer/hooks/_log_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-10T03:16:00,934   creating build/lib/colossalai/zero/sharded_param
2023-02-10T03:16:00,936   copying colossalai/zero/sharded_param/sharded_param.py -> build/lib/colossalai/zero/sharded_param
2023-02-10T03:16:00,941   copying colossalai/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/zero/sharded_param
2023-02-10T03:16:00,944   copying colossalai/zero/sharded_param/__init__.py -> build/lib/colossalai/zero/sharded_param
2023-02-10T03:16:00,949   creating build/lib/colossalai/zero/init_ctx
2023-02-10T03:16:00,951   copying colossalai/zero/init_ctx/__init__.py -> build/lib/colossalai/zero/init_ctx
2023-02-10T03:16:00,955   copying colossalai/zero/init_ctx/init_context.py -> build/lib/colossalai/zero/init_ctx
2023-02-10T03:16:00,962   creating build/lib/colossalai/zero/sharded_model
2023-02-10T03:16:00,964   copying colossalai/zero/sharded_model/_utils.py -> build/lib/colossalai/zero/sharded_model
2023-02-10T03:16:00,969   copying colossalai/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/zero/sharded_model
2023-02-10T03:16:00,974   copying colossalai/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/zero/sharded_model
2023-02-10T03:16:00,980   copying colossalai/zero/sharded_model/utils.py -> build/lib/colossalai/zero/sharded_model
2023-02-10T03:16:00,984   copying colossalai/zero/sharded_model/__init__.py -> build/lib/colossalai/zero/sharded_model
2023-02-10T03:16:00,989   creating build/lib/colossalai/zero/sharded_optim
2023-02-10T03:16:00,992   copying colossalai/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/zero/sharded_optim
2023-02-10T03:16:00,997   copying colossalai/zero/sharded_optim/_utils.py -> build/lib/colossalai/zero/sharded_optim
2023-02-10T03:16:01,002   copying colossalai/zero/sharded_optim/low_level_optim.py -> build/lib/colossalai/zero/sharded_optim
2023-02-10T03:16:01,008   copying colossalai/zero/sharded_optim/__init__.py -> build/lib/colossalai/zero/sharded_optim
2023-02-10T03:16:01,013   creating build/lib/colossalai/zero/shard_utils
2023-02-10T03:16:01,014   copying colossalai/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-02-10T03:16:01,018   copying colossalai/zero/shard_utils/commons.py -> build/lib/colossalai/zero/shard_utils
2023-02-10T03:16:01,021   copying colossalai/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-02-10T03:16:01,024   copying colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-02-10T03:16:01,027   copying colossalai/zero/shard_utils/__init__.py -> build/lib/colossalai/zero/shard_utils
2023-02-10T03:16:01,032   creating build/lib/colossalai/zero/utils
2023-02-10T03:16:01,033   copying colossalai/zero/utils/zero_hook.py -> build/lib/colossalai/zero/utils
2023-02-10T03:16:01,038   copying colossalai/zero/utils/gemini_hook.py -> build/lib/colossalai/zero/utils
2023-02-10T03:16:01,043   copying colossalai/zero/utils/__init__.py -> build/lib/colossalai/zero/utils
2023-02-10T03:16:01,050   creating build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:01,051   copying colossalai/zero/sharded_optim/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:01,055   copying colossalai/zero/sharded_optim/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:01,058   copying colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:01,062   copying colossalai/zero/sharded_optim/bookkeeping/base_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:01,065   copying colossalai/zero/sharded_optim/bookkeeping/__init__.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:01,068   copying colossalai/zero/sharded_optim/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:01,073   creating build/lib/colossalai/auto_parallel/passes
2023-02-10T03:16:01,075   copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-02-10T03:16:01,079   copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-02-10T03:16:01,084   copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes
2023-02-10T03:16:01,087   copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-02-10T03:16:01,092   copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes
2023-02-10T03:16:01,096   copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes
2023-02-10T03:16:01,100   creating build/lib/colossalai/auto_parallel/tensor_shard
2023-02-10T03:16:01,102   copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-10T03:16:01,106   copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-10T03:16:01,110   copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-10T03:16:01,113   copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-10T03:16:01,119   creating build/lib/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:01,121   copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:01,126   copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:01,129   copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:01,133   copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:01,137   copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:01,142   copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:01,148   creating build/lib/colossalai/auto_parallel/meta_profiler
2023-02-10T03:16:01,150   copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-10T03:16:01,154   copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-10T03:16:01,158   copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-10T03:16:01,162   copying colossalai/auto_parallel/meta_profiler/metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-10T03:16:01,167   creating build/lib/colossalai/auto_parallel/pipeline_shard
2023-02-10T03:16:01,169   copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard
2023-02-10T03:16:01,174   creating build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:01,176   copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:01,181   copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:01,187   copying colossalai/auto_parallel/tensor_shard/solver/options.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:01,190   copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:01,195   copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:01,200   copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:01,206   creating build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:01,208   copying colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:01,213   copying colossalai/auto_parallel/tensor_shard/deprecated/_utils.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:01,218   copying colossalai/auto_parallel/tensor_shard/deprecated/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:01,222   copying colossalai/auto_parallel/tensor_shard/deprecated/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:01,227   copying colossalai/auto_parallel/tensor_shard/deprecated/options.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:01,231   copying colossalai/auto_parallel/tensor_shard/deprecated/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:01,235   copying colossalai/auto_parallel/tensor_shard/deprecated/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:01,239   copying colossalai/auto_parallel/tensor_shard/deprecated/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:01,244   copying colossalai/auto_parallel/tensor_shard/deprecated/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:01,252   creating build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:01,254   copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:01,258   copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:01,263   copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:01,268   copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:01,273   copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:01,277   copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:01,285   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,288   copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,292   copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,296   copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,300   copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,305   copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,309   copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,314   copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,318   copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,322   copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,328   copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,331   copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,337   copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,341   copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,345   copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,349   copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,353   copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,357   copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,361   copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,366   copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,370   copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,374   copying colossalai/auto_parallel/tensor_shard/node_handler/option.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,378   copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,382   copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,386   copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,389   copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,392   copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,395   copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,399   copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:01,404   creating build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,406   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/dot_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,412   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,415   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,420   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/bcast_op_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,426   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,430   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,434   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,439   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,441   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,445   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,449   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,455   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:01,461   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,463   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,468   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,472   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,476   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,479   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,483   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,488   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,492   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,496   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,500   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,504   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,509   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,513   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,517   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,523   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,528   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,533   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,537   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,541   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:01,547   creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:01,549   copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:01,555   copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:01,560   copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:01,564   copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:01,568   copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:01,571   copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:01,575   copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:01,579   creating build/lib/colossalai/utils/data_sampler
2023-02-10T03:16:01,581   copying colossalai/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/utils/data_sampler
2023-02-10T03:16:01,585   copying colossalai/utils/data_sampler/__init__.py -> build/lib/colossalai/utils/data_sampler
2023-02-10T03:16:01,588   copying colossalai/utils/data_sampler/base_sampler.py -> build/lib/colossalai/utils/data_sampler
2023-02-10T03:16:01,592   creating build/lib/colossalai/utils/profiler
2023-02-10T03:16:01,594   copying colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/utils/profiler
2023-02-10T03:16:01,598   copying colossalai/utils/profiler/profiler.py -> build/lib/colossalai/utils/profiler
2023-02-10T03:16:01,602   copying colossalai/utils/profiler/extention.py -> build/lib/colossalai/utils/profiler
2023-02-10T03:16:01,605   copying colossalai/utils/profiler/__init__.py -> build/lib/colossalai/utils/profiler
2023-02-10T03:16:01,610   creating build/lib/colossalai/utils/checkpoint_io
2023-02-10T03:16:01,611   copying colossalai/utils/checkpoint_io/constant.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-10T03:16:01,615   copying colossalai/utils/checkpoint_io/reader.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-10T03:16:01,619   copying colossalai/utils/checkpoint_io/distributed.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-10T03:16:01,624   copying colossalai/utils/checkpoint_io/backend.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-10T03:16:01,627   copying colossalai/utils/checkpoint_io/utils.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-10T03:16:01,633   copying colossalai/utils/checkpoint_io/convertor.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-10T03:16:01,638   copying colossalai/utils/checkpoint_io/io.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-10T03:16:01,642   copying colossalai/utils/checkpoint_io/meta.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-10T03:16:01,645   copying colossalai/utils/checkpoint_io/__init__.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-10T03:16:01,649   copying colossalai/utils/checkpoint_io/writer.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-10T03:16:01,653   creating build/lib/colossalai/utils/checkpoint
2023-02-10T03:16:01,655   copying colossalai/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/utils/checkpoint
2023-02-10T03:16:01,659   copying colossalai/utils/checkpoint/utils.py -> build/lib/colossalai/utils/checkpoint
2023-02-10T03:16:01,662   copying colossalai/utils/checkpoint/__init__.py -> build/lib/colossalai/utils/checkpoint
2023-02-10T03:16:01,667   creating build/lib/colossalai/utils/rank_recorder
2023-02-10T03:16:01,668   copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder
2023-02-10T03:16:01,672   copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder
2023-02-10T03:16:01,676   creating build/lib/colossalai/utils/multi_tensor_apply
2023-02-10T03:16:01,678   copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-02-10T03:16:01,681   copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-02-10T03:16:01,686   creating build/lib/colossalai/utils/tensor_detector
2023-02-10T03:16:01,688   copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector
2023-02-10T03:16:01,692   copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector
2023-02-10T03:16:01,696   creating build/lib/colossalai/utils/model
2023-02-10T03:16:01,698   copying colossalai/utils/model/experimental.py -> build/lib/colossalai/utils/model
2023-02-10T03:16:01,703   copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model
2023-02-10T03:16:01,706   copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model
2023-02-10T03:16:01,708   copying colossalai/utils/model/colo_init_context.py -> build/lib/colossalai/utils/model
2023-02-10T03:16:01,712   copying colossalai/utils/model/lazy_init_context.py -> build/lib/colossalai/utils/model
2023-02-10T03:16:01,718   creating build/lib/colossalai/utils/profiler/legacy
2023-02-10T03:16:01,720   copying colossalai/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-10T03:16:01,725   copying colossalai/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-10T03:16:01,729   copying colossalai/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-10T03:16:01,732   copying colossalai/utils/profiler/legacy/__init__.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-10T03:16:01,737   creating build/lib/colossalai/kernel/cuda_native
2023-02-10T03:16:01,739   copying colossalai/kernel/cuda_native/scaled_softmax.py -> build/lib/colossalai/kernel/cuda_native
2023-02-10T03:16:01,743   copying colossalai/kernel/cuda_native/multihead_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-02-10T03:16:01,747   copying colossalai/kernel/cuda_native/flash_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-02-10T03:16:01,753   copying colossalai/kernel/cuda_native/layer_norm.py -> build/lib/colossalai/kernel/cuda_native
2023-02-10T03:16:01,756   copying colossalai/kernel/cuda_native/__init__.py -> build/lib/colossalai/kernel/cuda_native
2023-02-10T03:16:01,761   creating build/lib/colossalai/kernel/op_builder
2023-02-10T03:16:01,763   copying colossalai/kernel/op_builder/moe.py -> build/lib/colossalai/kernel/op_builder
2023-02-10T03:16:01,767   copying colossalai/kernel/op_builder/layernorm.py -> build/lib/colossalai/kernel/op_builder
2023-02-10T03:16:01,770   copying colossalai/kernel/op_builder/cpu_adam.py -> build/lib/colossalai/kernel/op_builder
2023-02-10T03:16:01,773   copying colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-02-10T03:16:01,777   copying colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-02-10T03:16:01,780   copying colossalai/kernel/op_builder/utils.py -> build/lib/colossalai/kernel/op_builder
2023-02-10T03:16:01,783   copying colossalai/kernel/op_builder/multi_head_attn.py -> build/lib/colossalai/kernel/op_builder
2023-02-10T03:16:01,787   copying colossalai/kernel/op_builder/__init__.py -> build/lib/colossalai/kernel/op_builder
2023-02-10T03:16:01,790   copying colossalai/kernel/op_builder/builder.py -> build/lib/colossalai/kernel/op_builder
2023-02-10T03:16:01,794   copying colossalai/kernel/op_builder/fused_optim.py -> build/lib/colossalai/kernel/op_builder
2023-02-10T03:16:01,799   creating build/lib/colossalai/kernel/jit
2023-02-10T03:16:01,800   copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit
2023-02-10T03:16:01,804   copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit
2023-02-10T03:16:01,807   copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit
2023-02-10T03:16:01,810   copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit
2023-02-10T03:16:01,847   creating build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,848   copying colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,853   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,857   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,860   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,865   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,871   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,875   copying colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,879   copying colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,883   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,888   copying colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,893   copying colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,897   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,901   copying colossalai/kernel/cuda_native/csrc/compat.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,904   copying colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,909   copying colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,915   copying colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,919   copying colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,923   copying colossalai/kernel/cuda_native/csrc/type_shim.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,928   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,933   copying colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,938   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,944   copying colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,949   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:01,955   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels
2023-02-10T03:16:01,956   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:01,958   copying colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:01,962   copying colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:01,966   copying colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:01,969   copying colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:01,974   copying colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:01,978   copying colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:01,981   copying colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:01,986   copying colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:01,989   copying colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:01,993   copying colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:01,996   copying colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:02,000   copying colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:02,250   /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
2023-02-10T03:16:02,251     setuptools.SetuptoolsDeprecationWarning,
2023-02-10T03:16:02,344   installing to build/bdist.linux-armv7l/wheel
2023-02-10T03:16:02,344   running install
2023-02-10T03:16:02,405   running install_lib
2023-02-10T03:16:02,501   creating build/bdist.linux-armv7l
2023-02-10T03:16:02,502   creating build/bdist.linux-armv7l/wheel
2023-02-10T03:16:02,506   creating build/bdist.linux-armv7l/wheel/colossalai
2023-02-10T03:16:02,509   creating build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-10T03:16:02,511   copying build/lib/colossalai/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-10T03:16:02,515   copying build/lib/colossalai/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-10T03:16:02,520   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-02-10T03:16:02,521   copying build/lib/colossalai/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-02-10T03:16:02,525   copying build/lib/colossalai/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-02-10T03:16:02,528   copying build/lib/colossalai/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-10T03:16:02,531   copying build/lib/colossalai/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-10T03:16:02,535   copying build/lib/colossalai/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-10T03:16:02,540   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-10T03:16:02,542   copying build/lib/colossalai/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-10T03:16:02,546   copying build/lib/colossalai/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-10T03:16:02,551   copying build/lib/colossalai/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-10T03:16:02,555   copying build/lib/colossalai/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-10T03:16:02,559   copying build/lib/colossalai/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-10T03:16:02,562   copying build/lib/colossalai/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-10T03:16:02,565   copying build/lib/colossalai/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-10T03:16:02,569   copying build/lib/colossalai/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-10T03:16:02,574   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-10T03:16:02,575   copying build/lib/colossalai/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-10T03:16:02,579   copying build/lib/colossalai/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-10T03:16:02,583   copying build/lib/colossalai/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-10T03:16:02,586   copying build/lib/colossalai/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-10T03:16:02,589   copying build/lib/colossalai/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-10T03:16:02,593   copying build/lib/colossalai/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-10T03:16:02,596   copying build/lib/colossalai/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-10T03:16:02,600   copying build/lib/colossalai/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-10T03:16:02,603   copying build/lib/colossalai/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-10T03:16:02,608   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-10T03:16:02,609   copying build/lib/colossalai/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-10T03:16:02,612   copying build/lib/colossalai/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-10T03:16:02,617   copying build/lib/colossalai/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-10T03:16:02,621   copying build/lib/colossalai/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-10T03:16:02,624   copying build/lib/colossalai/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-10T03:16:02,628   creating build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-10T03:16:02,630   copying build/lib/colossalai/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-10T03:16:02,633   copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-10T03:16:02,636   copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-10T03:16:02,639   copying build/lib/colossalai/context/moe_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-10T03:16:02,644   creating build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-10T03:16:02,646   copying build/lib/colossalai/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-10T03:16:02,650   copying build/lib/colossalai/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-10T03:16:02,654   copying build/lib/colossalai/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-10T03:16:02,658   copying build/lib/colossalai/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-10T03:16:02,661   copying build/lib/colossalai/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-10T03:16:02,664   copying build/lib/colossalai/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-10T03:16:02,668   copying build/lib/colossalai/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-10T03:16:02,671   copying build/lib/colossalai/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-10T03:16:02,674   copying build/lib/colossalai/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-10T03:16:02,678   copying build/lib/colossalai/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-10T03:16:02,681   copying build/lib/colossalai/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-10T03:16:02,684   copying build/lib/colossalai/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-10T03:16:02,689   copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-10T03:16:02,693   creating build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-10T03:16:02,695   copying build/lib/colossalai/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-10T03:16:02,699   copying build/lib/colossalai/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-10T03:16:02,704   copying build/lib/colossalai/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-10T03:16:02,708   creating build/bdist.linux-armv7l/wheel/colossalai/amp
2023-02-10T03:16:02,710   creating build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-02-10T03:16:02,712   copying build/lib/colossalai/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-02-10T03:16:02,715   copying build/lib/colossalai/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-02-10T03:16:02,720   creating build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-10T03:16:02,721   copying build/lib/colossalai/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-10T03:16:02,727   copying build/lib/colossalai/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-10T03:16:02,730   copying build/lib/colossalai/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-10T03:16:02,733   copying build/lib/colossalai/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-02-10T03:16:02,737   copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-02-10T03:16:02,741   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-10T03:16:02,742   copying build/lib/colossalai/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-10T03:16:02,746   copying build/lib/colossalai/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-10T03:16:02,750   copying build/lib/colossalai/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-10T03:16:02,755   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-10T03:16:02,757   copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-10T03:16:02,761   copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-10T03:16:02,764   copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-10T03:16:02,767   copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-10T03:16:02,770   copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-10T03:16:02,774   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-10T03:16:02,775   copying build/lib/colossalai/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-10T03:16:02,781   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-10T03:16:02,782   copying build/lib/colossalai/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-10T03:16:02,790   copying build/lib/colossalai/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-10T03:16:02,795   copying build/lib/colossalai/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-10T03:16:02,800   copying build/lib/colossalai/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-10T03:16:02,805   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-02-10T03:16:02,807   copying build/lib/colossalai/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-02-10T03:16:02,812   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-02-10T03:16:02,814   copying build/lib/colossalai/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-02-10T03:16:02,819   copying build/lib/colossalai/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-02-10T03:16:02,823   copying build/lib/colossalai/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-02-10T03:16:02,827   copying build/lib/colossalai/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-10T03:16:02,832   copying build/lib/colossalai/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-10T03:16:02,836   copying build/lib/colossalai/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-10T03:16:02,840   copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-10T03:16:02,843   copying build/lib/colossalai/core.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-10T03:16:02,848   creating build/bdist.linux-armv7l/wheel/colossalai/engine
2023-02-10T03:16:02,850   creating build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-10T03:16:02,852   copying build/lib/colossalai/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-10T03:16:02,855   copying build/lib/colossalai/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-10T03:16:02,859   copying build/lib/colossalai/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-10T03:16:02,865   copying build/lib/colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-10T03:16:02,869   copying build/lib/colossalai/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-10T03:16:02,873   creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-02-10T03:16:02,875   copying build/lib/colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-02-10T03:16:02,879   copying build/lib/colossalai/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-02-10T03:16:02,882   copying build/lib/colossalai/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine
2023-02-10T03:16:02,886   creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-10T03:16:02,887   copying build/lib/colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-10T03:16:02,891   copying build/lib/colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-10T03:16:02,894   copying build/lib/colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-10T03:16:02,897   copying build/lib/colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-10T03:16:02,900   copying build/lib/colossalai/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-10T03:16:02,904   copying build/lib/colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-10T03:16:02,907   copying build/lib/colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-10T03:16:02,910   copying build/lib/colossalai/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-10T03:16:02,913   copying build/lib/colossalai/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/engine
2023-02-10T03:16:02,918   creating build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-10T03:16:02,920   copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-10T03:16:02,924   copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-10T03:16:02,928   copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-10T03:16:02,932   copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-10T03:16:02,935   copying build/lib/colossalai/constants.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-10T03:16:02,939   creating build/bdist.linux-armv7l/wheel/colossalai/cli
2023-02-10T03:16:02,942   creating build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-10T03:16:02,943   copying build/lib/colossalai/cli/benchmark/benchmark.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-10T03:16:02,947   copying build/lib/colossalai/cli/benchmark/models.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-10T03:16:02,950   copying build/lib/colossalai/cli/benchmark/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-10T03:16:02,954   copying build/lib/colossalai/cli/benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-10T03:16:02,958   creating build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-02-10T03:16:02,959   copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-02-10T03:16:02,963   copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-02-10T03:16:02,966   copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-02-10T03:16:02,970   creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-10T03:16:02,972   copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-10T03:16:02,975   copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-10T03:16:02,979   copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-10T03:16:02,983   copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-10T03:16:02,986   copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-02-10T03:16:02,990   creating build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-10T03:16:02,993   creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-02-10T03:16:02,994   copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-02-10T03:16:03,000   copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-02-10T03:16:03,005   creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-10T03:16:03,006   copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-10T03:16:03,011   copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-10T03:16:03,016   creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-10T03:16:03,017   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-10T03:16:03,022   copying build/lib/colossalai/fx/passes/algorithms/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-10T03:16:03,025   copying build/lib/colossalai/fx/passes/algorithms/linearize.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-10T03:16:03,028   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_pofo.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-10T03:16:03,033   copying build/lib/colossalai/fx/passes/algorithms/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-10T03:16:03,037   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-10T03:16:03,040   copying build/lib/colossalai/fx/passes/algorithms/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-10T03:16:03,043   copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-10T03:16:03,047   copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-10T03:16:03,052   copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-10T03:16:03,055   copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-10T03:16:03,059   copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-10T03:16:03,062   copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-10T03:16:03,067   copying build/lib/colossalai/fx/_meta_registrations.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-10T03:16:03,072   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-10T03:16:03,074   copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-10T03:16:03,077   copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-10T03:16:03,081   copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-10T03:16:03,085   copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-10T03:16:03,089   copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-10T03:16:03,094   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-10T03:16:03,095   copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-10T03:16:03,099   copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-10T03:16:03,103   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:03,104   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:03,108   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:03,111   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:03,114   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:03,118   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:03,121   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:03,124   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:03,127   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:03,130   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-10T03:16:03,133   copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-10T03:16:03,137   copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-10T03:16:03,142   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:03,143   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:03,147   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:03,151   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:03,154   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:03,157   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:03,160   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:03,163   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:03,167   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:03,170   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:03,173   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:03,176   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-10T03:16:03,179   copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-10T03:16:03,182   copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-10T03:16:03,187   copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-10T03:16:03,190   copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-10T03:16:03,194   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-10T03:16:03,195   copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-10T03:16:03,201   copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-10T03:16:03,204   copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-10T03:16:03,207   copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-10T03:16:03,211   copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-10T03:16:03,217   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-02-10T03:16:03,220   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:03,222   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:03,226   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:03,230   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:03,233   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:03,237   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:03,240   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:03,243   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:03,246   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-10T03:16:03,250   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:03,252   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:03,256   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:03,259   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:03,263   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:03,267   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:03,270   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:03,273   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:03,276   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-10T03:16:03,279   copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-02-10T03:16:03,283   copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-10T03:16:03,287   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-02-10T03:16:03,289   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-10T03:16:03,291   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-10T03:16:03,294   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-10T03:16:03,297   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-10T03:16:03,301   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-10T03:16:03,304   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-10T03:16:03,309   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-10T03:16:03,310   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-10T03:16:03,314   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-10T03:16:03,318   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-10T03:16:03,321   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-10T03:16:03,324   copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-02-10T03:16:03,328   copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-10T03:16:03,331   copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-10T03:16:03,334   copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-10T03:16:03,337   copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-10T03:16:03,341   copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-10T03:16:03,345   creating build/bdist.linux-armv7l/wheel/colossalai/builder
2023-02-10T03:16:03,347   copying build/lib/colossalai/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/builder
2023-02-10T03:16:03,350   copying build/lib/colossalai/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/builder
2023-02-10T03:16:03,354   creating build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-10T03:16:03,356   copying build/lib/colossalai/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-10T03:16:03,360   copying build/lib/colossalai/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-10T03:16:03,365   copying build/lib/colossalai/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-10T03:16:03,369   copying build/lib/colossalai/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-10T03:16:03,372   copying build/lib/colossalai/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-10T03:16:03,376   copying build/lib/colossalai/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-10T03:16:03,380   creating build/bdist.linux-armv7l/wheel/colossalai/logging
2023-02-10T03:16:03,382   copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-02-10T03:16:03,386   copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-02-10T03:16:03,391   creating build/bdist.linux-armv7l/wheel/colossalai/nn
2023-02-10T03:16:03,394   creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-10T03:16:03,396   copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-10T03:16:03,401   copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-10T03:16:03,405   copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-10T03:16:03,409   copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-10T03:16:03,414   copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-10T03:16:03,418   copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-10T03:16:03,422   copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-10T03:16:03,425   copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-10T03:16:03,429   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-02-10T03:16:03,432   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-10T03:16:03,433   copying build/lib/colossalai/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-10T03:16:03,437   copying build/lib/colossalai/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-10T03:16:03,444   copying build/lib/colossalai/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-10T03:16:03,448   copying build/lib/colossalai/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-10T03:16:03,452   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:03,453   copying build/lib/colossalai/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:03,457   copying build/lib/colossalai/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:03,460   copying build/lib/colossalai/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:03,464   copying build/lib/colossalai/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:03,467   copying build/lib/colossalai/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:03,470   copying build/lib/colossalai/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-10T03:16:03,475   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-02-10T03:16:03,476   copying build/lib/colossalai/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-02-10T03:16:03,481   copying build/lib/colossalai/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-02-10T03:16:03,485   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-10T03:16:03,486   copying build/lib/colossalai/nn/layer/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-10T03:16:03,491   copying build/lib/colossalai/nn/layer/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-10T03:16:03,495   copying build/lib/colossalai/nn/layer/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-10T03:16:03,498   copying build/lib/colossalai/nn/layer/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-10T03:16:03,502   copying build/lib/colossalai/nn/layer/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-10T03:16:03,505   copying build/lib/colossalai/nn/layer/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-10T03:16:03,510   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-10T03:16:03,511   copying build/lib/colossalai/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-10T03:16:03,515   copying build/lib/colossalai/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-10T03:16:03,521   copying build/lib/colossalai/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-10T03:16:03,527   copying build/lib/colossalai/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-10T03:16:03,531   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-10T03:16:03,532   copying build/lib/colossalai/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-10T03:16:03,536   copying build/lib/colossalai/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-10T03:16:03,544   copying build/lib/colossalai/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-10T03:16:03,551   copying build/lib/colossalai/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-10T03:16:03,555   copying build/lib/colossalai/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-02-10T03:16:03,560   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-10T03:16:03,562   copying build/lib/colossalai/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-10T03:16:03,566   copying build/lib/colossalai/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-10T03:16:03,575   copying build/lib/colossalai/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-10T03:16:03,581   copying build/lib/colossalai/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-10T03:16:03,585   copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-02-10T03:16:03,590   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-02-10T03:16:03,592   copying build/lib/colossalai/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-02-10T03:16:03,596   copying build/lib/colossalai/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-02-10T03:16:03,600   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-02-10T03:16:03,602   copying build/lib/colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-02-10T03:16:03,605   copying build/lib/colossalai/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-02-10T03:16:03,609   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-10T03:16:03,611   copying build/lib/colossalai/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-10T03:16:03,614   copying build/lib/colossalai/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-10T03:16:03,618   copying build/lib/colossalai/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-10T03:16:03,622   copying build/lib/colossalai/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-10T03:16:03,627   creating build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-10T03:16:03,628   copying build/lib/colossalai/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-10T03:16:03,631   copying build/lib/colossalai/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-10T03:16:03,634   copying build/lib/colossalai/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-10T03:16:03,637   copying build/lib/colossalai/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-10T03:16:03,640   copying build/lib/colossalai/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-10T03:16:03,644   copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-02-10T03:16:03,649   creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,650   copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,655   copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,658   copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,662   copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,666   copying build/lib/colossalai/nn/optimizer/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,669   copying build/lib/colossalai/nn/optimizer/zero_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,673   copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,677   copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,681   copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,685   copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,688   copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,691   copying build/lib/colossalai/nn/optimizer/colossalai_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-10T03:16:03,695   creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-10T03:16:03,697   copying build/lib/colossalai/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-10T03:16:03,701   copying build/lib/colossalai/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-10T03:16:03,705   copying build/lib/colossalai/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-10T03:16:03,709   copying build/lib/colossalai/nn/loss/loss_moe.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-10T03:16:03,712   copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-10T03:16:03,715   copying build/lib/colossalai/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-10T03:16:03,720   creating build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-10T03:16:03,722   copying build/lib/colossalai/nn/_ops/element_wise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-10T03:16:03,726   copying build/lib/colossalai/nn/_ops/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-10T03:16:03,729   copying build/lib/colossalai/nn/_ops/batch_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-10T03:16:03,732   copying build/lib/colossalai/nn/_ops/view.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-10T03:16:03,735   copying build/lib/colossalai/nn/_ops/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-10T03:16:03,739   copying build/lib/colossalai/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-10T03:16:03,743   copying build/lib/colossalai/nn/_ops/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-10T03:16:03,746   copying build/lib/colossalai/nn/_ops/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-10T03:16:03,749   copying build/lib/colossalai/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-10T03:16:03,752   copying build/lib/colossalai/nn/_ops/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-10T03:16:03,756   copying build/lib/colossalai/nn/_ops/embedding_bag.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-10T03:16:03,759   copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-02-10T03:16:03,763   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-10T03:16:03,765   copying build/lib/colossalai/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-10T03:16:03,771   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-10T03:16:03,772   copying build/lib/colossalai/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-10T03:16:03,776   copying build/lib/colossalai/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-10T03:16:03,780   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:03,781   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:03,785   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:03,788   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:03,792   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:03,796   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:03,800   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:03,803   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:03,809   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:03,812   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-10T03:16:03,815   copying build/lib/colossalai/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-10T03:16:03,818   copying build/lib/colossalai/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-10T03:16:03,821   copying build/lib/colossalai/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-10T03:16:03,824   copying build/lib/colossalai/nn/parallel/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-10T03:16:03,828   copying build/lib/colossalai/nn/parallel/gemini_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-10T03:16:03,831   copying build/lib/colossalai/nn/parallel/zero_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-10T03:16:03,835   copying build/lib/colossalai/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-10T03:16:03,838   copying build/lib/colossalai/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-10T03:16:03,842   creating build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-02-10T03:16:03,844   creating build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-10T03:16:03,846   copying build/lib/colossalai/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-10T03:16:03,850   copying build/lib/colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-10T03:16:03,853   copying build/lib/colossalai/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-10T03:16:03,856   copying build/lib/colossalai/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-10T03:16:03,860   copying build/lib/colossalai/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-10T03:16:03,864   copying build/lib/colossalai/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-10T03:16:03,866   copying build/lib/colossalai/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-10T03:16:03,871   copying build/lib/colossalai/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-02-10T03:16:03,875   copying build/lib/colossalai/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-02-10T03:16:03,879   creating build/bdist.linux-armv7l/wheel/colossalai/_C
2023-02-10T03:16:03,881   copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C
2023-02-10T03:16:03,885   creating build/bdist.linux-armv7l/wheel/colossalai/zero
2023-02-10T03:16:03,888   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-10T03:16:03,890   copying build/lib/colossalai/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-10T03:16:03,894   copying build/lib/colossalai/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-10T03:16:03,898   copying build/lib/colossalai/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-10T03:16:03,903   creating build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-02-10T03:16:03,905   copying build/lib/colossalai/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-02-10T03:16:03,909   copying build/lib/colossalai/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-02-10T03:16:03,915   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-10T03:16:03,917   copying build/lib/colossalai/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-10T03:16:03,921   copying build/lib/colossalai/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-10T03:16:03,926   copying build/lib/colossalai/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-10T03:16:03,932   copying build/lib/colossalai/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-10T03:16:03,936   copying build/lib/colossalai/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-10T03:16:03,941   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-10T03:16:03,943   copying build/lib/colossalai/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-10T03:16:03,949   copying build/lib/colossalai/zero/sharded_optim/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-10T03:16:03,953   copying build/lib/colossalai/zero/sharded_optim/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-10T03:16:03,958   copying build/lib/colossalai/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-10T03:16:03,962   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:03,964   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:03,967   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:03,970   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:03,974   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:03,977   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:03,980   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-10T03:16:03,984   creating build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-10T03:16:03,986   copying build/lib/colossalai/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-10T03:16:03,989   copying build/lib/colossalai/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-10T03:16:03,992   copying build/lib/colossalai/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-10T03:16:03,996   copying build/lib/colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-10T03:16:03,999   copying build/lib/colossalai/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-10T03:16:04,002   copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero
2023-02-10T03:16:04,006   creating build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-10T03:16:04,008   copying build/lib/colossalai/zero/utils/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-10T03:16:04,012   copying build/lib/colossalai/zero/utils/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-10T03:16:04,015   copying build/lib/colossalai/zero/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-10T03:16:04,019   copying build/lib/colossalai/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-10T03:16:04,022   copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-10T03:16:04,028   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-02-10T03:16:04,030   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-10T03:16:04,032   copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-10T03:16:04,036   copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-10T03:16:04,040   copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-10T03:16:04,043   copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-10T03:16:04,048   copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-10T03:16:04,052   copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-10T03:16:04,056   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-10T03:16:04,059   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:04,060   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:04,065   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:04,070   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:04,073   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:04,076   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:04,081   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-10T03:16:04,085   copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-10T03:16:04,089   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:04,091   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:04,095   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:04,099   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:04,103   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,105   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/dot_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,112   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,115   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,122   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/bcast_op_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,128   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,132   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,136   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,140   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,143   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,147   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,151   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,156   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-10T03:16:04,160   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:04,165   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:04,169   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:04,172   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:04,175   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:04,179   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-10T03:16:04,185   copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-10T03:16:04,189   copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-10T03:16:04,192   copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-10T03:16:04,197   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:04,199   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:04,202   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:04,206   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:04,210   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:04,214   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:04,217   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-10T03:16:04,223   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,224   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,228   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,231   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,235   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,240   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,241   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,246   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,250   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,254   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,258   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,261   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,266   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,270   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,274   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,278   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,281   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,288   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,291   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,294   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,299   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,304   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,307   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,311   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,315   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-10T03:16:04,318   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,321   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,326   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,329   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,333   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,337   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,340   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,345   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,348   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,351   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,355   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,358   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,362   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,365   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,369   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,372   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,375   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/option.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,378   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,382   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,385   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,389   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,392   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,395   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,399   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-10T03:16:04,403   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:04,404   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:04,410   copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:04,413   copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:04,417   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:04,420   copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:04,423   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-10T03:16:04,428   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-10T03:16:04,430   copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-10T03:16:04,433   copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-10T03:16:04,438   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:04,439   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:04,444   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:04,448   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:04,452   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:04,456   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:04,460   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:04,463   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-10T03:16:04,466   copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-10T03:16:04,470   copying build/lib/colossalai/auto_parallel/meta_profiler/metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-10T03:16:04,473   copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-02-10T03:16:04,477   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-02-10T03:16:04,479   copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-02-10T03:16:04,482   copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-10T03:16:04,486   creating build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,487   copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,492   copying build/lib/colossalai/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,495   copying build/lib/colossalai/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,499   copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,503   copying build/lib/colossalai/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,506   copying build/lib/colossalai/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,510   copying build/lib/colossalai/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,513   copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,518   copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,522   copying build/lib/colossalai/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,525   copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,530   copying build/lib/colossalai/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,533   copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,539   copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,542   copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-10T03:16:04,545   copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-10T03:16:04,550   creating build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-10T03:16:04,552   creating build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-10T03:16:04,554   copying build/lib/colossalai/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-10T03:16:04,558   copying build/lib/colossalai/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-10T03:16:04,561   copying build/lib/colossalai/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-10T03:16:04,564   copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-10T03:16:04,568   copying build/lib/colossalai/utils/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-10T03:16:04,571   copying build/lib/colossalai/utils/cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-10T03:16:04,574   copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-10T03:16:04,579   creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-10T03:16:04,581   copying build/lib/colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-10T03:16:04,584   copying build/lib/colossalai/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-10T03:16:04,588   copying build/lib/colossalai/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-10T03:16:04,592   creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-10T03:16:04,594   copying build/lib/colossalai/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-10T03:16:04,598   copying build/lib/colossalai/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-10T03:16:04,601   copying build/lib/colossalai/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-10T03:16:04,605   copying build/lib/colossalai/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-10T03:16:04,608   copying build/lib/colossalai/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-10T03:16:04,611   copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-10T03:16:04,617   creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-10T03:16:04,619   copying build/lib/colossalai/utils/checkpoint_io/constant.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-10T03:16:04,622   copying build/lib/colossalai/utils/checkpoint_io/reader.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-10T03:16:04,626   copying build/lib/colossalai/utils/checkpoint_io/distributed.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-10T03:16:04,630   copying build/lib/colossalai/utils/checkpoint_io/backend.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-10T03:16:04,633   copying build/lib/colossalai/utils/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-10T03:16:04,637   copying build/lib/colossalai/utils/checkpoint_io/convertor.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-10T03:16:04,641   copying build/lib/colossalai/utils/checkpoint_io/io.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-10T03:16:04,645   copying build/lib/colossalai/utils/checkpoint_io/meta.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-10T03:16:04,648   copying build/lib/colossalai/utils/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-10T03:16:04,652   copying build/lib/colossalai/utils/checkpoint_io/writer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-10T03:16:04,656   creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-10T03:16:04,657   copying build/lib/colossalai/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-10T03:16:04,661   copying build/lib/colossalai/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-10T03:16:04,665   copying build/lib/colossalai/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-10T03:16:04,669   creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-02-10T03:16:04,670   copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-02-10T03:16:04,674   copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-02-10T03:16:04,679   creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-02-10T03:16:04,680   copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-02-10T03:16:04,684   copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-02-10T03:16:04,687   copying build/lib/colossalai/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-10T03:16:04,691   copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-10T03:16:04,696   creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-02-10T03:16:04,697   copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-02-10T03:16:04,701   copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-02-10T03:16:04,706   creating build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-10T03:16:04,707   copying build/lib/colossalai/utils/model/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-10T03:16:04,712   copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-10T03:16:04,715   copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-10T03:16:04,718   copying build/lib/colossalai/utils/model/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-10T03:16:04,722   copying build/lib/colossalai/utils/model/lazy_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-10T03:16:04,726   copying build/lib/colossalai/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-10T03:16:04,732   creating build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-02-10T03:16:04,735   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-10T03:16:04,739   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,741   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels
2023-02-10T03:16:04,744   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,746   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,750   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,754   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,757   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,761   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,765   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,769   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,773   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,777   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,780   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,783   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,787   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-10T03:16:04,790   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,795   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,798   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,801   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,805   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,810   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,814   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,818   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,822   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,826   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,830   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,834   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,837   copying build/lib/colossalai/kernel/cuda_native/csrc/compat.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,841   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,845   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,850   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,853   copying build/lib/colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,857   copying build/lib/colossalai/kernel/cuda_native/csrc/type_shim.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,861   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,866   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,870   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,876   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,882   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-10T03:16:04,887   copying build/lib/colossalai/kernel/cuda_native/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-10T03:16:04,891   copying build/lib/colossalai/kernel/cuda_native/multihead_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-10T03:16:04,895   copying build/lib/colossalai/kernel/cuda_native/flash_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-10T03:16:04,900   copying build/lib/colossalai/kernel/cuda_native/layer_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-10T03:16:04,903   copying build/lib/colossalai/kernel/cuda_native/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-10T03:16:04,907   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-10T03:16:04,909   copying build/lib/colossalai/kernel/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-10T03:16:04,913   copying build/lib/colossalai/kernel/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-10T03:16:04,917   copying build/lib/colossalai/kernel/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-10T03:16:04,920   copying build/lib/colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-10T03:16:04,923   copying build/lib/colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-10T03:16:04,926   copying build/lib/colossalai/kernel/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-10T03:16:04,929   copying build/lib/colossalai/kernel/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-10T03:16:04,934   copying build/lib/colossalai/kernel/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-10T03:16:04,938   copying build/lib/colossalai/kernel/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-10T03:16:04,941   copying build/lib/colossalai/kernel/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-10T03:16:04,945   copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-02-10T03:16:04,949   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-10T03:16:04,950   copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-10T03:16:04,954   copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-10T03:16:04,958   copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-10T03:16:04,961   copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-10T03:16:04,965   creating build/bdist.linux-armv7l/wheel/colossalai/registry
2023-02-10T03:16:04,967   copying build/lib/colossalai/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/registry
2023-02-10T03:16:04,970   copying build/lib/colossalai/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/registry
2023-02-10T03:16:04,975   creating build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-10T03:16:04,976   copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-10T03:16:04,980   copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-10T03:16:04,983   copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-10T03:16:04,987   copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-10T03:16:04,990   copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-10T03:16:04,996   creating build/bdist.linux-armv7l/wheel/op_builder
2023-02-10T03:16:04,997   copying build/lib/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-10T03:16:05,001   copying build/lib/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-10T03:16:05,004   copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-10T03:16:05,007   copying build/lib/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-10T03:16:05,010   copying build/lib/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-10T03:16:05,013   copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-10T03:16:05,017   copying build/lib/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-10T03:16:05,020   copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-10T03:16:05,023   copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-10T03:16:05,027   copying build/lib/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-10T03:16:05,030   running install_egg_info
2023-02-10T03:16:05,249   running egg_info
2023-02-10T03:16:05,341   writing colossalai.egg-info/PKG-INFO
2023-02-10T03:16:05,346   writing dependency_links to colossalai.egg-info/dependency_links.txt
2023-02-10T03:16:05,349   writing entry points to colossalai.egg-info/entry_points.txt
2023-02-10T03:16:05,352   writing requirements to colossalai.egg-info/requires.txt
2023-02-10T03:16:05,354   writing top-level names to colossalai.egg-info/top_level.txt
2023-02-10T03:16:05,649   reading manifest file 'colossalai.egg-info/SOURCES.txt'
2023-02-10T03:16:05,740   reading manifest template 'MANIFEST.in'
2023-02-10T03:16:07,781   warning: no files found matching '*.tr' under directory 'colossalai'
2023-02-10T03:16:08,792   warning: no files found matching '*.cc' under directory 'colossalai'
2023-02-10T03:16:09,302   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-02-10T03:16:09,318   adding license file 'LICENSE'
2023-02-10T03:16:09,415   writing manifest file 'colossalai.egg-info/SOURCES.txt'
2023-02-10T03:16:09,420   Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.2.2-py3.7.egg-info
2023-02-10T03:16:09,446   running install_scripts
2023-02-10T03:16:09,619   adding license file "LICENSE" (matched pattern "LICEN[CS]E*")
2023-02-10T03:16:09,628   creating build/bdist.linux-armv7l/wheel/colossalai-0.2.2.dist-info/WHEEL
2023-02-10T03:16:09,633   creating '/tmp/pip-wheel-y632_ym_/colossalai-0.2.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2023-02-10T03:16:09,638   adding 'colossalai/__init__.py'
2023-02-10T03:16:09,640   adding 'colossalai/constants.py'
2023-02-10T03:16:09,643   adding 'colossalai/core.py'
2023-02-10T03:16:09,645   adding 'colossalai/global_variables.py'
2023-02-10T03:16:09,651   adding 'colossalai/initialize.py'
2023-02-10T03:16:09,653   adding 'colossalai/version.py'
2023-02-10T03:16:09,657   adding 'colossalai/_C/__init__.py'
2023-02-10T03:16:09,660   adding 'colossalai/amp/__init__.py'
2023-02-10T03:16:09,662   adding 'colossalai/amp/amp_type.py'
2023-02-10T03:16:09,666   adding 'colossalai/amp/apex_amp/__init__.py'
2023-02-10T03:16:09,668   adding 'colossalai/amp/apex_amp/apex_amp.py'
2023-02-10T03:16:09,672   adding 'colossalai/amp/naive_amp/__init__.py'
2023-02-10T03:16:09,676   adding 'colossalai/amp/naive_amp/_fp16_optimizer.py'
2023-02-10T03:16:09,679   adding 'colossalai/amp/naive_amp/_utils.py'
2023-02-10T03:16:09,682   adding 'colossalai/amp/naive_amp/naive_amp.py'
2023-02-10T03:16:09,685   adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py'
2023-02-10T03:16:09,688   adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py'
2023-02-10T03:16:09,690   adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py'
2023-02-10T03:16:09,693   adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py'
2023-02-10T03:16:09,697   adding 'colossalai/amp/torch_amp/__init__.py'
2023-02-10T03:16:09,705   adding 'colossalai/amp/torch_amp/_grad_scaler.py'
2023-02-10T03:16:09,708   adding 'colossalai/amp/torch_amp/torch_amp.py'
2023-02-10T03:16:09,711   adding 'colossalai/auto_parallel/__init__.py'
2023-02-10T03:16:09,714   adding 'colossalai/auto_parallel/checkpoint/__init__.py'
2023-02-10T03:16:09,716   adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py'
2023-02-10T03:16:09,720   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py'
2023-02-10T03:16:09,723   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py'
2023-02-10T03:16:09,728   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py'
2023-02-10T03:16:09,731   adding 'colossalai/auto_parallel/checkpoint/operation.py'
2023-02-10T03:16:09,734   adding 'colossalai/auto_parallel/meta_profiler/__init__.py'
2023-02-10T03:16:09,737   adding 'colossalai/auto_parallel/meta_profiler/constants.py'
2023-02-10T03:16:09,739   adding 'colossalai/auto_parallel/meta_profiler/metainfo.py'
2023-02-10T03:16:09,742   adding 'colossalai/auto_parallel/meta_profiler/registry.py'
2023-02-10T03:16:09,745   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py'
2023-02-10T03:16:09,747   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py'
2023-02-10T03:16:09,750   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py'
2023-02-10T03:16:09,753   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py'
2023-02-10T03:16:09,758   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py'
2023-02-10T03:16:09,762   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py'
2023-02-10T03:16:09,765   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py'
2023-02-10T03:16:09,768   adding 'colossalai/auto_parallel/passes/__init__.py'
2023-02-10T03:16:09,771   adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py'
2023-02-10T03:16:09,774   adding 'colossalai/auto_parallel/passes/constants.py'
2023-02-10T03:16:09,777   adding 'colossalai/auto_parallel/passes/meta_info_prop.py'
2023-02-10T03:16:09,780   adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py'
2023-02-10T03:16:09,787   adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py'
2023-02-10T03:16:09,790   adding 'colossalai/auto_parallel/pipeline_shard/__init__.py'
2023-02-10T03:16:09,794   adding 'colossalai/auto_parallel/tensor_shard/__init__.py'
2023-02-10T03:16:09,796   adding 'colossalai/auto_parallel/tensor_shard/constants.py'
2023-02-10T03:16:09,800   adding 'colossalai/auto_parallel/tensor_shard/initialize.py'
2023-02-10T03:16:09,805   adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py'
2023-02-10T03:16:09,808   adding 'colossalai/auto_parallel/tensor_shard/deprecated/__init__.py'
2023-02-10T03:16:09,811   adding 'colossalai/auto_parallel/tensor_shard/deprecated/_utils.py'
2023-02-10T03:16:09,814   adding 'colossalai/auto_parallel/tensor_shard/deprecated/constants.py'
2023-02-10T03:16:09,818   adding 'colossalai/auto_parallel/tensor_shard/deprecated/cost_graph.py'
2023-02-10T03:16:09,821   adding 'colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py'
2023-02-10T03:16:09,823   adding 'colossalai/auto_parallel/tensor_shard/deprecated/options.py'
2023-02-10T03:16:09,826   adding 'colossalai/auto_parallel/tensor_shard/deprecated/sharding_strategy.py'
2023-02-10T03:16:09,831   adding 'colossalai/auto_parallel/tensor_shard/deprecated/solver.py'
2023-02-10T03:16:09,837   adding 'colossalai/auto_parallel/tensor_shard/deprecated/strategies_constructor.py'
2023-02-10T03:16:09,841   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/__init__.py'
2023-02-10T03:16:09,846   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/batch_norm_handler.py'
2023-02-10T03:16:09,852   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/bcast_op_handler.py'
2023-02-10T03:16:09,859   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py'
2023-02-10T03:16:09,865   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/dot_handler.py'
2023-02-10T03:16:09,869   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py'
2023-02-10T03:16:09,873   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py'
2023-02-10T03:16:09,876   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py'
2023-02-10T03:16:09,879   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py'
2023-02-10T03:16:09,882   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/strategy_generator.py'
2023-02-10T03:16:09,885   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py'
2023-02-10T03:16:09,888   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/where_handler.py'
2023-02-10T03:16:09,893   adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py'
2023-02-10T03:16:09,896   adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py'
2023-02-10T03:16:09,899   adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py'
2023-02-10T03:16:09,902   adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py'
2023-02-10T03:16:09,905   adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py'
2023-02-10T03:16:09,908   adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py'
2023-02-10T03:16:09,910   adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py'
2023-02-10T03:16:09,914   adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py'
2023-02-10T03:16:09,917   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py'
2023-02-10T03:16:09,919   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py'
2023-02-10T03:16:09,922   adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py'
2023-02-10T03:16:09,926   adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py'
2023-02-10T03:16:09,932   adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py'
2023-02-10T03:16:09,937   adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py'
2023-02-10T03:16:09,940   adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py'
2023-02-10T03:16:09,942   adding 'colossalai/auto_parallel/tensor_shard/node_handler/option.py'
2023-02-10T03:16:09,944   adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py'
2023-02-10T03:16:09,947   adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py'
2023-02-10T03:16:09,950   adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py'
2023-02-10T03:16:09,952   adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py'
2023-02-10T03:16:09,954   adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py'
2023-02-10T03:16:09,957   adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py'
2023-02-10T03:16:09,959   adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py'
2023-02-10T03:16:09,962   adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py'
2023-02-10T03:16:09,964   adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py'
2023-02-10T03:16:09,967   adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py'
2023-02-10T03:16:09,969   adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py'
2023-02-10T03:16:09,972   adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py'
2023-02-10T03:16:09,976   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py'
2023-02-10T03:16:09,980   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py'
2023-02-10T03:16:09,983   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py'
2023-02-10T03:16:09,987   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py'
2023-02-10T03:16:09,991   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py'
2023-02-10T03:16:09,994   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py'
2023-02-10T03:16:09,997   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py'
2023-02-10T03:16:10,001   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py'
2023-02-10T03:16:10,008   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py'
2023-02-10T03:16:10,012   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py'
2023-02-10T03:16:10,014   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py'
2023-02-10T03:16:10,017   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py'
2023-02-10T03:16:10,021   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py'
2023-02-10T03:16:10,025   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py'
2023-02-10T03:16:10,029   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py'
2023-02-10T03:16:10,032   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py'
2023-02-10T03:16:10,035   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py'
2023-02-10T03:16:10,038   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py'
2023-02-10T03:16:10,040   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py'
2023-02-10T03:16:10,044   adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py'
2023-02-10T03:16:10,048   adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py'
2023-02-10T03:16:10,051   adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py'
2023-02-10T03:16:10,053   adding 'colossalai/auto_parallel/tensor_shard/solver/options.py'
2023-02-10T03:16:10,059   adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py'
2023-02-10T03:16:10,062   adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py'
2023-02-10T03:16:10,066   adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py'
2023-02-10T03:16:10,069   adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py'
2023-02-10T03:16:10,072   adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py'
2023-02-10T03:16:10,074   adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py'
2023-02-10T03:16:10,078   adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py'
2023-02-10T03:16:10,081   adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py'
2023-02-10T03:16:10,084   adding 'colossalai/builder/__init__.py'
2023-02-10T03:16:10,087   adding 'colossalai/builder/builder.py'
2023-02-10T03:16:10,090   adding 'colossalai/cli/__init__.py'
2023-02-10T03:16:10,092   adding 'colossalai/cli/cli.py'
2023-02-10T03:16:10,095   adding 'colossalai/cli/benchmark/__init__.py'
2023-02-10T03:16:10,098   adding 'colossalai/cli/benchmark/benchmark.py'
2023-02-10T03:16:10,100   adding 'colossalai/cli/benchmark/models.py'
2023-02-10T03:16:10,103   adding 'colossalai/cli/benchmark/utils.py'
2023-02-10T03:16:10,106   adding 'colossalai/cli/check/__init__.py'
2023-02-10T03:16:10,109   adding 'colossalai/cli/check/check_installation.py'
2023-02-10T03:16:10,113   adding 'colossalai/cli/launcher/__init__.py'
2023-02-10T03:16:10,116   adding 'colossalai/cli/launcher/hostinfo.py'
2023-02-10T03:16:10,119   adding 'colossalai/cli/launcher/multinode_runner.py'
2023-02-10T03:16:10,123   adding 'colossalai/cli/launcher/run.py'
2023-02-10T03:16:10,126   adding 'colossalai/communication/__init__.py'
2023-02-10T03:16:10,130   adding 'colossalai/communication/collective.py'
2023-02-10T03:16:10,134   adding 'colossalai/communication/p2p.py'
2023-02-10T03:16:10,139   adding 'colossalai/communication/p2p_v2.py'
2023-02-10T03:16:10,141   adding 'colossalai/communication/ring.py'
2023-02-10T03:16:10,144   adding 'colossalai/communication/utils.py'
2023-02-10T03:16:10,147   adding 'colossalai/context/__init__.py'
2023-02-10T03:16:10,150   adding 'colossalai/context/config.py'
2023-02-10T03:16:10,153   adding 'colossalai/context/moe_context.py'
2023-02-10T03:16:10,159   adding 'colossalai/context/parallel_context.py'
2023-02-10T03:16:10,162   adding 'colossalai/context/parallel_mode.py'
2023-02-10T03:16:10,164   adding 'colossalai/context/singleton_meta.py'
2023-02-10T03:16:10,168   adding 'colossalai/context/process_group_initializer/__init__.py'
2023-02-10T03:16:10,170   adding 'colossalai/context/process_group_initializer/initializer_1d.py'
2023-02-10T03:16:10,173   adding 'colossalai/context/process_group_initializer/initializer_2d.py'
2023-02-10T03:16:10,176   adding 'colossalai/context/process_group_initializer/initializer_2p5d.py'
2023-02-10T03:16:10,180   adding 'colossalai/context/process_group_initializer/initializer_3d.py'
2023-02-10T03:16:10,182   adding 'colossalai/context/process_group_initializer/initializer_data.py'
2023-02-10T03:16:10,186   adding 'colossalai/context/process_group_initializer/initializer_model.py'
2023-02-10T03:16:10,189   adding 'colossalai/context/process_group_initializer/initializer_pipeline.py'
2023-02-10T03:16:10,191   adding 'colossalai/context/process_group_initializer/initializer_sequence.py'
2023-02-10T03:16:10,194   adding 'colossalai/context/process_group_initializer/initializer_tensor.py'
2023-02-10T03:16:10,196   adding 'colossalai/context/process_group_initializer/process_group_initializer.py'
2023-02-10T03:16:10,199   adding 'colossalai/context/random/__init__.py'
2023-02-10T03:16:10,202   adding 'colossalai/context/random/_helper.py'
2023-02-10T03:16:10,204   adding 'colossalai/context/random/seed_manager.py'
2023-02-10T03:16:10,208   adding 'colossalai/device/__init__.py'
2023-02-10T03:16:10,213   adding 'colossalai/device/alpha_beta_profiler.py'
2023-02-10T03:16:10,216   adding 'colossalai/device/calc_pipeline_strategy.py'
2023-02-10T03:16:10,220   adding 'colossalai/device/device_mesh.py'
2023-02-10T03:16:10,223   adding 'colossalai/engine/__init__.py'
2023-02-10T03:16:10,226   adding 'colossalai/engine/_base_engine.py'
2023-02-10T03:16:10,230   adding 'colossalai/engine/gradient_accumulation/__init__.py'
2023-02-10T03:16:10,234   adding 'colossalai/engine/gradient_accumulation/_gradient_accumulation.py'
2023-02-10T03:16:10,237   adding 'colossalai/engine/gradient_handler/__init__.py'
2023-02-10T03:16:10,239   adding 'colossalai/engine/gradient_handler/_base_gradient_handler.py'
2023-02-10T03:16:10,242   adding 'colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py'
2023-02-10T03:16:10,244   adding 'colossalai/engine/gradient_handler/_moe_gradient_handler.py'
2023-02-10T03:16:10,247   adding 'colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py'
2023-02-10T03:16:10,249   adding 'colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py'
2023-02-10T03:16:10,251   adding 'colossalai/engine/gradient_handler/_zero_gradient_handler.py'
2023-02-10T03:16:10,254   adding 'colossalai/engine/gradient_handler/utils.py'
2023-02-10T03:16:10,257   adding 'colossalai/engine/schedule/__init__.py'
2023-02-10T03:16:10,260   adding 'colossalai/engine/schedule/_base_schedule.py'
2023-02-10T03:16:10,263   adding 'colossalai/engine/schedule/_non_pipeline_schedule.py'
2023-02-10T03:16:10,272   adding 'colossalai/engine/schedule/_pipeline_schedule.py'
2023-02-10T03:16:10,276   adding 'colossalai/engine/schedule/_pipeline_schedule_v2.py'
2023-02-10T03:16:10,280   adding 'colossalai/fx/__init__.py'
2023-02-10T03:16:10,282   adding 'colossalai/fx/_compatibility.py'
2023-02-10T03:16:10,287   adding 'colossalai/fx/_meta_registrations.py'
2023-02-10T03:16:10,291   adding 'colossalai/fx/graph_module.py'
2023-02-10T03:16:10,293   adding 'colossalai/fx/proxy.py'
2023-02-10T03:16:10,297   adding 'colossalai/fx/codegen/__init__.py'
2023-02-10T03:16:10,307   adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py'
2023-02-10T03:16:10,311   adding 'colossalai/fx/passes/__init__.py'
2023-02-10T03:16:10,314   adding 'colossalai/fx/passes/adding_split_node_pass.py'
2023-02-10T03:16:10,318   adding 'colossalai/fx/passes/concrete_info_prop.py'
2023-02-10T03:16:10,322   adding 'colossalai/fx/passes/meta_info_prop.py'
2023-02-10T03:16:10,328   adding 'colossalai/fx/passes/passes_for_gpt2_test.py'
2023-02-10T03:16:10,331   adding 'colossalai/fx/passes/shard_1d_pass.py'
2023-02-10T03:16:10,335   adding 'colossalai/fx/passes/split_module.py'
2023-02-10T03:16:10,339   adding 'colossalai/fx/passes/utils.py'
2023-02-10T03:16:10,342   adding 'colossalai/fx/passes/algorithms/__init__.py'
2023-02-10T03:16:10,344   adding 'colossalai/fx/passes/algorithms/build_c_ext.py'
2023-02-10T03:16:10,347   adding 'colossalai/fx/passes/algorithms/ckpt_solver_chen.py'
2023-02-10T03:16:10,353   adding 'colossalai/fx/passes/algorithms/ckpt_solver_pofo.py'
2023-02-10T03:16:10,358   adding 'colossalai/fx/passes/algorithms/ckpt_solver_rotor.py'
2023-02-10T03:16:10,361   adding 'colossalai/fx/passes/algorithms/linearize.py'
2023-02-10T03:16:10,364   adding 'colossalai/fx/passes/algorithms/operation.py'
2023-02-10T03:16:10,368   adding 'colossalai/fx/profiler/__init__.py'
2023-02-10T03:16:10,370   adding 'colossalai/fx/profiler/constants.py'
2023-02-10T03:16:10,373   adding 'colossalai/fx/profiler/dataflow.py'
2023-02-10T03:16:10,376   adding 'colossalai/fx/profiler/memory_utils.py'
2023-02-10T03:16:10,380   adding 'colossalai/fx/profiler/opcount.py'
2023-02-10T03:16:10,384   adding 'colossalai/fx/profiler/profiler.py'
2023-02-10T03:16:10,387   adding 'colossalai/fx/profiler/shard_utils.py'
2023-02-10T03:16:10,390   adding 'colossalai/fx/profiler/tensor.py'
2023-02-10T03:16:10,394   adding 'colossalai/fx/profiler/experimental/__init__.py'
2023-02-10T03:16:10,396   adding 'colossalai/fx/profiler/experimental/constants.py'
2023-02-10T03:16:10,399   adding 'colossalai/fx/profiler/experimental/profiler.py'
2023-02-10T03:16:10,402   adding 'colossalai/fx/profiler/experimental/registry.py'
2023-02-10T03:16:10,404   adding 'colossalai/fx/profiler/experimental/shard_utils.py'
2023-02-10T03:16:10,407   adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py'
2023-02-10T03:16:10,409   adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py'
2023-02-10T03:16:10,412   adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py'
2023-02-10T03:16:10,414   adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py'
2023-02-10T03:16:10,416   adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py'
2023-02-10T03:16:10,419   adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py'
2023-02-10T03:16:10,421   adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py'
2023-02-10T03:16:10,423   adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py'
2023-02-10T03:16:10,425   adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py'
2023-02-10T03:16:10,429   adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py'
2023-02-10T03:16:10,431   adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py'
2023-02-10T03:16:10,433   adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py'
2023-02-10T03:16:10,436   adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py'
2023-02-10T03:16:10,438   adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py'
2023-02-10T03:16:10,440   adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py'
2023-02-10T03:16:10,442   adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py'
2023-02-10T03:16:10,445   adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py'
2023-02-10T03:16:10,447   adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py'
2023-02-10T03:16:10,449   adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py'
2023-02-10T03:16:10,451   adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py'
2023-02-10T03:16:10,455   adding 'colossalai/fx/tracer/__init__.py'
2023-02-10T03:16:10,458   adding 'colossalai/fx/tracer/_meta_trace.py'
2023-02-10T03:16:10,460   adding 'colossalai/fx/tracer/_symbolic_trace.py'
2023-02-10T03:16:10,463   adding 'colossalai/fx/tracer/_tracer_utils.py'
2023-02-10T03:16:10,470   adding 'colossalai/fx/tracer/experimental.py'
2023-02-10T03:16:10,472   adding 'colossalai/fx/tracer/registry.py'
2023-02-10T03:16:10,479   adding 'colossalai/fx/tracer/tracer.py'
2023-02-10T03:16:10,483   adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py'
2023-02-10T03:16:10,486   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py'
2023-02-10T03:16:10,489   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py'
2023-02-10T03:16:10,491   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py'
2023-02-10T03:16:10,494   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py'
2023-02-10T03:16:10,497   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py'
2023-02-10T03:16:10,500   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py'
2023-02-10T03:16:10,503   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py'
2023-02-10T03:16:10,505   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py'
2023-02-10T03:16:10,508   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py'
2023-02-10T03:16:10,511   adding 'colossalai/fx/tracer/meta_patch/__init__.py'
2023-02-10T03:16:10,514   adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py'
2023-02-10T03:16:10,516   adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py'
2023-02-10T03:16:10,519   adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py'
2023-02-10T03:16:10,521   adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py'
2023-02-10T03:16:10,523   adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py'
2023-02-10T03:16:10,526   adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py'
2023-02-10T03:16:10,528   adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py'
2023-02-10T03:16:10,531   adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py'
2023-02-10T03:16:10,534   adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py'
2023-02-10T03:16:10,537   adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py'
2023-02-10T03:16:10,539   adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py'
2023-02-10T03:16:10,541   adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py'
2023-02-10T03:16:10,543   adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py'
2023-02-10T03:16:10,545   adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py'
2023-02-10T03:16:10,548   adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py'
2023-02-10T03:16:10,550   adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py'
2023-02-10T03:16:10,554   adding 'colossalai/gemini/__init__.py'
2023-02-10T03:16:10,556   adding 'colossalai/gemini/gemini_context.py'
2023-02-10T03:16:10,559   adding 'colossalai/gemini/gemini_mgr.py'
2023-02-10T03:16:10,562   adding 'colossalai/gemini/placement_policy.py'
2023-02-10T03:16:10,566   adding 'colossalai/gemini/stateful_tensor.py'
2023-02-10T03:16:10,569   adding 'colossalai/gemini/stateful_tensor_mgr.py'
2023-02-10T03:16:10,572   adding 'colossalai/gemini/tensor_placement_policy.py'
2023-02-10T03:16:10,574   adding 'colossalai/gemini/tensor_utils.py'
2023-02-10T03:16:10,578   adding 'colossalai/gemini/chunk/__init__.py'
2023-02-10T03:16:10,584   adding 'colossalai/gemini/chunk/chunk.py'
2023-02-10T03:16:10,588   adding 'colossalai/gemini/chunk/manager.py'
2023-02-10T03:16:10,591   adding 'colossalai/gemini/chunk/search_utils.py'
2023-02-10T03:16:10,593   adding 'colossalai/gemini/chunk/utils.py'
2023-02-10T03:16:10,597   adding 'colossalai/gemini/memory_tracer/__init__.py'
2023-02-10T03:16:10,599   adding 'colossalai/gemini/memory_tracer/chunk_memstats_collector.py'
2023-02-10T03:16:10,602   adding 'colossalai/gemini/memory_tracer/memory_monitor.py'
2023-02-10T03:16:10,604   adding 'colossalai/gemini/memory_tracer/memory_stats.py'
2023-02-10T03:16:10,607   adding 'colossalai/gemini/memory_tracer/memstats_collector.py'
2023-02-10T03:16:10,609   adding 'colossalai/gemini/memory_tracer/param_runtime_order.py'
2023-02-10T03:16:10,612   adding 'colossalai/gemini/memory_tracer/runtime_mem_tracer.py'
2023-02-10T03:16:10,615   adding 'colossalai/gemini/memory_tracer/static_memstats_collector.py'
2023-02-10T03:16:10,617   adding 'colossalai/gemini/memory_tracer/utils.py'
2023-02-10T03:16:10,620   adding 'colossalai/gemini/ophooks/__init__.py'
2023-02-10T03:16:10,622   adding 'colossalai/gemini/ophooks/_shard_grad_ophook.py'
2023-02-10T03:16:10,625   adding 'colossalai/gemini/ophooks/_shard_param_ophook.py'
2023-02-10T03:16:10,627   adding 'colossalai/gemini/ophooks/runtime_mem_tracer_hook.py'
2023-02-10T03:16:10,630   adding 'colossalai/gemini/ophooks/utils.py'
2023-02-10T03:16:10,633   adding 'colossalai/gemini/paramhooks/__init__.py'
2023-02-10T03:16:10,635   adding 'colossalai/gemini/paramhooks/_param_hookmgr.py'
2023-02-10T03:16:10,639   adding 'colossalai/kernel/__init__.py'
2023-02-10T03:16:10,642   adding 'colossalai/kernel/cuda_native/__init__.py'
2023-02-10T03:16:10,647   adding 'colossalai/kernel/cuda_native/flash_attention.py'
2023-02-10T03:16:10,650   adding 'colossalai/kernel/cuda_native/layer_norm.py'
2023-02-10T03:16:10,654   adding 'colossalai/kernel/cuda_native/multihead_attention.py'
2023-02-10T03:16:10,657   adding 'colossalai/kernel/cuda_native/scaled_softmax.py'
2023-02-10T03:16:10,662   adding 'colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp'
2023-02-10T03:16:10,664   adding 'colossalai/kernel/cuda_native/csrc/compat.h'
2023-02-10T03:16:10,668   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.cpp'
2023-02-10T03:16:10,671   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.h'
2023-02-10T03:16:10,674   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp'
2023-02-10T03:16:10,681   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu'
2023-02-10T03:16:10,684   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda.cpp'
2023-02-10T03:16:10,690   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu'
2023-02-10T03:16:10,693   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu'
2023-02-10T03:16:10,696   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh'
2023-02-10T03:16:10,700   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu'
2023-02-10T03:16:10,704   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu'
2023-02-10T03:16:10,707   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu'
2023-02-10T03:16:10,711   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu'
2023-02-10T03:16:10,715   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp'
2023-02-10T03:16:10,719   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h'
2023-02-10T03:16:10,721   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp'
2023-02-10T03:16:10,725   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h'
2023-02-10T03:16:10,728   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu'
2023-02-10T03:16:10,731   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp'
2023-02-10T03:16:10,735   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h'
2023-02-10T03:16:10,738   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu'
2023-02-10T03:16:10,742   adding 'colossalai/kernel/cuda_native/csrc/type_shim.h'
2023-02-10T03:16:10,747   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h'
2023-02-10T03:16:10,750   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/context.h'
2023-02-10T03:16:10,752   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h'
2023-02-10T03:16:10,754   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h'
2023-02-10T03:16:10,757   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h'
2023-02-10T03:16:10,759   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h'
2023-02-10T03:16:10,762   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h'
2023-02-10T03:16:10,765   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h'
2023-02-10T03:16:10,768   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh'
2023-02-10T03:16:10,770   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h'
2023-02-10T03:16:10,772   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h'
2023-02-10T03:16:10,775   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h'
2023-02-10T03:16:10,778   adding 'colossalai/kernel/jit/__init__.py'
2023-02-10T03:16:10,780   adding 'colossalai/kernel/jit/bias_dropout_add.py'
2023-02-10T03:16:10,783   adding 'colossalai/kernel/jit/bias_gelu.py'
2023-02-10T03:16:10,785   adding 'colossalai/kernel/jit/option.py'
2023-02-10T03:16:10,789   adding 'colossalai/kernel/op_builder/__init__.py'
2023-02-10T03:16:10,792   adding 'colossalai/kernel/op_builder/builder.py'
2023-02-10T03:16:10,795   adding 'colossalai/kernel/op_builder/cpu_adam.py'
2023-02-10T03:16:10,797   adding 'colossalai/kernel/op_builder/fused_optim.py'
2023-02-10T03:16:10,799   adding 'colossalai/kernel/op_builder/layernorm.py'
2023-02-10T03:16:10,801   adding 'colossalai/kernel/op_builder/moe.py'
2023-02-10T03:16:10,804   adding 'colossalai/kernel/op_builder/multi_head_attn.py'
2023-02-10T03:16:10,806   adding 'colossalai/kernel/op_builder/scaled_masked_softmax.py'
2023-02-10T03:16:10,808   adding 'colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py'
2023-02-10T03:16:10,811   adding 'colossalai/kernel/op_builder/utils.py'
2023-02-10T03:16:10,814   adding 'colossalai/logging/__init__.py'
2023-02-10T03:16:10,817   adding 'colossalai/logging/logger.py'
2023-02-10T03:16:10,821   adding 'colossalai/nn/__init__.py'
2023-02-10T03:16:10,824   adding 'colossalai/nn/init.py'
2023-02-10T03:16:10,828   adding 'colossalai/nn/_ops/__init__.py'
2023-02-10T03:16:10,831   adding 'colossalai/nn/_ops/_utils.py'
2023-02-10T03:16:10,833   adding 'colossalai/nn/_ops/addmm.py'
2023-02-10T03:16:10,836   adding 'colossalai/nn/_ops/batch_norm.py'
2023-02-10T03:16:10,839   adding 'colossalai/nn/_ops/element_wise.py'
2023-02-10T03:16:10,842   adding 'colossalai/nn/_ops/embedding.py'
2023-02-10T03:16:10,845   adding 'colossalai/nn/_ops/embedding_bag.py'
2023-02-10T03:16:10,847   adding 'colossalai/nn/_ops/layernorm.py'
2023-02-10T03:16:10,850   adding 'colossalai/nn/_ops/linear.py'
2023-02-10T03:16:10,853   adding 'colossalai/nn/_ops/loss.py'
2023-02-10T03:16:10,856   adding 'colossalai/nn/_ops/view.py'
2023-02-10T03:16:10,859   adding 'colossalai/nn/layer/__init__.py'
2023-02-10T03:16:10,862   adding 'colossalai/nn/layer/base_layer.py'
2023-02-10T03:16:10,865   adding 'colossalai/nn/layer/colossalai_layer/__init__.py'
2023-02-10T03:16:10,868   adding 'colossalai/nn/layer/colossalai_layer/_utils.py'
2023-02-10T03:16:10,870   adding 'colossalai/nn/layer/colossalai_layer/dropout.py'
2023-02-10T03:16:10,873   adding 'colossalai/nn/layer/colossalai_layer/embedding.py'
2023-02-10T03:16:10,876   adding 'colossalai/nn/layer/colossalai_layer/linear.py'
2023-02-10T03:16:10,878   adding 'colossalai/nn/layer/colossalai_layer/normalization.py'
2023-02-10T03:16:10,882   adding 'colossalai/nn/layer/moe/__init__.py'
2023-02-10T03:16:10,884   adding 'colossalai/nn/layer/moe/_operation.py'
2023-02-10T03:16:10,888   adding 'colossalai/nn/layer/moe/experts.py'
2023-02-10T03:16:10,891   adding 'colossalai/nn/layer/moe/layers.py'
2023-02-10T03:16:10,895   adding 'colossalai/nn/layer/moe/routers.py'
2023-02-10T03:16:10,898   adding 'colossalai/nn/layer/moe/utils.py'
2023-02-10T03:16:10,901   adding 'colossalai/nn/layer/parallel_1d/__init__.py'
2023-02-10T03:16:10,904   adding 'colossalai/nn/layer/parallel_1d/_operation.py'
2023-02-10T03:16:10,907   adding 'colossalai/nn/layer/parallel_1d/_utils.py'
2023-02-10T03:16:10,915   adding 'colossalai/nn/layer/parallel_1d/layers.py'
2023-02-10T03:16:10,920   adding 'colossalai/nn/layer/parallel_2d/__init__.py'
2023-02-10T03:16:10,926   adding 'colossalai/nn/layer/parallel_2d/_operation.py'
2023-02-10T03:16:10,929   adding 'colossalai/nn/layer/parallel_2d/_utils.py'
2023-02-10T03:16:10,937   adding 'colossalai/nn/layer/parallel_2d/layers.py'
2023-02-10T03:16:10,941   adding 'colossalai/nn/layer/parallel_2p5d/__init__.py'
2023-02-10T03:16:10,948   adding 'colossalai/nn/layer/parallel_2p5d/_operation.py'
2023-02-10T03:16:10,951   adding 'colossalai/nn/layer/parallel_2p5d/_utils.py'
2023-02-10T03:16:10,959   adding 'colossalai/nn/layer/parallel_2p5d/layers.py'
2023-02-10T03:16:10,964   adding 'colossalai/nn/layer/parallel_3d/__init__.py'
2023-02-10T03:16:10,969   adding 'colossalai/nn/layer/parallel_3d/_operation.py'
2023-02-10T03:16:10,972   adding 'colossalai/nn/layer/parallel_3d/_utils.py'
2023-02-10T03:16:10,980   adding 'colossalai/nn/layer/parallel_3d/layers.py'
2023-02-10T03:16:10,984   adding 'colossalai/nn/layer/parallel_sequence/__init__.py'
2023-02-10T03:16:10,987   adding 'colossalai/nn/layer/parallel_sequence/_operation.py'
2023-02-10T03:16:10,989   adding 'colossalai/nn/layer/parallel_sequence/_utils.py'
2023-02-10T03:16:10,993   adding 'colossalai/nn/layer/parallel_sequence/layers.py'
2023-02-10T03:16:10,996   adding 'colossalai/nn/layer/utils/__init__.py'
2023-02-10T03:16:10,999   adding 'colossalai/nn/layer/utils/common.py'
2023-02-10T03:16:11,002   adding 'colossalai/nn/layer/vanilla/__init__.py'
2023-02-10T03:16:11,007   adding 'colossalai/nn/layer/vanilla/layers.py'
2023-02-10T03:16:11,010   adding 'colossalai/nn/layer/wrapper/__init__.py'
2023-02-10T03:16:11,012   adding 'colossalai/nn/layer/wrapper/pipeline_wrapper.py'
2023-02-10T03:16:11,016   adding 'colossalai/nn/loss/__init__.py'
2023-02-10T03:16:11,019   adding 'colossalai/nn/loss/loss_1d.py'
2023-02-10T03:16:11,022   adding 'colossalai/nn/loss/loss_2d.py'
2023-02-10T03:16:11,025   adding 'colossalai/nn/loss/loss_2p5d.py'
2023-02-10T03:16:11,028   adding 'colossalai/nn/loss/loss_3d.py'
2023-02-10T03:16:11,031   adding 'colossalai/nn/loss/loss_moe.py'
2023-02-10T03:16:11,034   adding 'colossalai/nn/lr_scheduler/__init__.py'
2023-02-10T03:16:11,037   adding 'colossalai/nn/lr_scheduler/cosine.py'
2023-02-10T03:16:11,040   adding 'colossalai/nn/lr_scheduler/delayed.py'
2023-02-10T03:16:11,042   adding 'colossalai/nn/lr_scheduler/linear.py'
2023-02-10T03:16:11,045   adding 'colossalai/nn/lr_scheduler/multistep.py'
2023-02-10T03:16:11,048   adding 'colossalai/nn/lr_scheduler/onecycle.py'
2023-02-10T03:16:11,050   adding 'colossalai/nn/lr_scheduler/poly.py'
2023-02-10T03:16:11,053   adding 'colossalai/nn/lr_scheduler/torch.py'
2023-02-10T03:16:11,056   adding 'colossalai/nn/metric/__init__.py'
2023-02-10T03:16:11,058   adding 'colossalai/nn/metric/_utils.py'
2023-02-10T03:16:11,061   adding 'colossalai/nn/metric/accuracy_2d.py'
2023-02-10T03:16:11,063   adding 'colossalai/nn/metric/accuracy_2p5d.py'
2023-02-10T03:16:11,065   adding 'colossalai/nn/metric/accuracy_3d.py'
2023-02-10T03:16:11,069   adding 'colossalai/nn/optimizer/__init__.py'
2023-02-10T03:16:11,071   adding 'colossalai/nn/optimizer/colossalai_optimizer.py'
2023-02-10T03:16:11,074   adding 'colossalai/nn/optimizer/cpu_adam.py'
2023-02-10T03:16:11,078   adding 'colossalai/nn/optimizer/fused_adam.py'
2023-02-10T03:16:11,081   adding 'colossalai/nn/optimizer/fused_lamb.py'
2023-02-10T03:16:11,084   adding 'colossalai/nn/optimizer/fused_sgd.py'
2023-02-10T03:16:11,087   adding 'colossalai/nn/optimizer/gemini_optimizer.py'
2023-02-10T03:16:11,090   adding 'colossalai/nn/optimizer/hybrid_adam.py'
2023-02-10T03:16:11,093   adding 'colossalai/nn/optimizer/lamb.py'
2023-02-10T03:16:11,095   adding 'colossalai/nn/optimizer/lars.py'
2023-02-10T03:16:11,099   adding 'colossalai/nn/optimizer/nvme_optimizer.py'
2023-02-10T03:16:11,103   adding 'colossalai/nn/optimizer/zero_optimizer.py'
2023-02-10T03:16:11,107   adding 'colossalai/nn/parallel/__init__.py'
2023-02-10T03:16:11,115   adding 'colossalai/nn/parallel/data_parallel.py'
2023-02-10T03:16:11,118   adding 'colossalai/nn/parallel/gemini_parallel.py'
2023-02-10T03:16:11,121   adding 'colossalai/nn/parallel/reducer.py'
2023-02-10T03:16:11,124   adding 'colossalai/nn/parallel/utils.py'
2023-02-10T03:16:11,127   adding 'colossalai/nn/parallel/zero_wrapper.py'
2023-02-10T03:16:11,130   adding 'colossalai/nn/parallel/layers/__init__.py'
2023-02-10T03:16:11,133   adding 'colossalai/nn/parallel/layers/colo_module.py'
2023-02-10T03:16:11,135   adding 'colossalai/nn/parallel/layers/embedding.py'
2023-02-10T03:16:11,137   adding 'colossalai/nn/parallel/layers/linear.py'
2023-02-10T03:16:11,140   adding 'colossalai/nn/parallel/layers/module_utils.py'
2023-02-10T03:16:11,144   adding 'colossalai/nn/parallel/layers/cache_embedding/__init__.py'
2023-02-10T03:16:11,146   adding 'colossalai/nn/parallel/layers/cache_embedding/base_embedding.py'
2023-02-10T03:16:11,153   adding 'colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py'
2023-02-10T03:16:11,157   adding 'colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py'
2023-02-10T03:16:11,160   adding 'colossalai/nn/parallel/layers/cache_embedding/copyer.py'
2023-02-10T03:16:11,162   adding 'colossalai/nn/parallel/layers/cache_embedding/embedding_config.py'
2023-02-10T03:16:11,165   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py'
2023-02-10T03:16:11,169   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py'
2023-02-10T03:16:11,172   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py'
2023-02-10T03:16:11,175   adding 'colossalai/pipeline/__init__.py'
2023-02-10T03:16:11,178   adding 'colossalai/pipeline/layer_spec.py'
2023-02-10T03:16:11,182   adding 'colossalai/pipeline/pipelinable.py'
2023-02-10T03:16:11,185   adding 'colossalai/pipeline/pipeline_process_group.py'
2023-02-10T03:16:11,189   adding 'colossalai/pipeline/utils.py'
2023-02-10T03:16:11,192   adding 'colossalai/pipeline/middleware/__init__.py'
2023-02-10T03:16:11,195   adding 'colossalai/pipeline/middleware/topo.py'
2023-02-10T03:16:11,198   adding 'colossalai/pipeline/middleware/adaptor/__init__.py'
2023-02-10T03:16:11,201   adding 'colossalai/pipeline/middleware/adaptor/fx.py'
2023-02-10T03:16:11,205   adding 'colossalai/pipeline/rpc/__init__.py'
2023-02-10T03:16:11,219   adding 'colossalai/pipeline/rpc/_pipeline_base.py'
2023-02-10T03:16:11,224   adding 'colossalai/pipeline/rpc/_pipeline_schedule.py'
2023-02-10T03:16:11,228   adding 'colossalai/pipeline/rpc/utils.py'
2023-02-10T03:16:11,231   adding 'colossalai/registry/__init__.py'
2023-02-10T03:16:11,234   adding 'colossalai/registry/registry.py'
2023-02-10T03:16:11,237   adding 'colossalai/tensor/__init__.py'
2023-02-10T03:16:11,240   adding 'colossalai/tensor/colo_parameter.py'
2023-02-10T03:16:11,244   adding 'colossalai/tensor/colo_tensor.py'
2023-02-10T03:16:11,250   adding 'colossalai/tensor/comm_spec.py'
2023-02-10T03:16:11,253   adding 'colossalai/tensor/compute_spec.py'
2023-02-10T03:16:11,255   adding 'colossalai/tensor/const.py'
2023-02-10T03:16:11,258   adding 'colossalai/tensor/dist_spec_mgr.py'
2023-02-10T03:16:11,261   adding 'colossalai/tensor/distspec.py'
2023-02-10T03:16:11,263   adding 'colossalai/tensor/op_wrapper.py'
2023-02-10T03:16:11,266   adding 'colossalai/tensor/param_op_hook.py'
2023-02-10T03:16:11,270   adding 'colossalai/tensor/process_group.py'
2023-02-10T03:16:11,278   adding 'colossalai/tensor/shape_consistency.py'
2023-02-10T03:16:11,283   adding 'colossalai/tensor/sharding_spec.py'
2023-02-10T03:16:11,285   adding 'colossalai/tensor/tensor_spec.py'
2023-02-10T03:16:11,289   adding 'colossalai/tensor/utils.py'
2023-02-10T03:16:11,292   adding 'colossalai/testing/__init__.py'
2023-02-10T03:16:11,294   adding 'colossalai/testing/comparison.py'
2023-02-10T03:16:11,297   adding 'colossalai/testing/pytest_wrapper.py'
2023-02-10T03:16:11,299   adding 'colossalai/testing/random.py'
2023-02-10T03:16:11,302   adding 'colossalai/testing/utils.py'
2023-02-10T03:16:11,305   adding 'colossalai/trainer/__init__.py'
2023-02-10T03:16:11,309   adding 'colossalai/trainer/_trainer.py'
2023-02-10T03:16:11,313   adding 'colossalai/trainer/hooks/__init__.py'
2023-02-10T03:16:11,315   adding 'colossalai/trainer/hooks/_base_hook.py'
2023-02-10T03:16:11,318   adding 'colossalai/trainer/hooks/_checkpoint_hook.py'
2023-02-10T03:16:11,321   adding 'colossalai/trainer/hooks/_commons_.py'
2023-02-10T03:16:11,325   adding 'colossalai/trainer/hooks/_log_hook.py'
2023-02-10T03:16:11,327   adding 'colossalai/trainer/hooks/_lr_scheduler_hook.py'
2023-02-10T03:16:11,332   adding 'colossalai/trainer/hooks/_metric_hook.py'
2023-02-10T03:16:11,336   adding 'colossalai/utils/__init__.py'
2023-02-10T03:16:11,339   adding 'colossalai/utils/activation_checkpoint.py'
2023-02-10T03:16:11,343   adding 'colossalai/utils/checkpointing.py'
2023-02-10T03:16:11,349   adding 'colossalai/utils/common.py'
2023-02-10T03:16:11,351   adding 'colossalai/utils/cuda.py'
2023-02-10T03:16:11,355   adding 'colossalai/utils/memory.py'
2023-02-10T03:16:11,357   adding 'colossalai/utils/moe.py'
2023-02-10T03:16:11,360   adding 'colossalai/utils/timer.py'
2023-02-10T03:16:11,363   adding 'colossalai/utils/checkpoint/__init__.py'
2023-02-10T03:16:11,366   adding 'colossalai/utils/checkpoint/module_checkpoint.py'
2023-02-10T03:16:11,369   adding 'colossalai/utils/checkpoint/utils.py'
2023-02-10T03:16:11,372   adding 'colossalai/utils/checkpoint_io/__init__.py'
2023-02-10T03:16:11,374   adding 'colossalai/utils/checkpoint_io/backend.py'
2023-02-10T03:16:11,377   adding 'colossalai/utils/checkpoint_io/constant.py'
2023-02-10T03:16:11,380   adding 'colossalai/utils/checkpoint_io/convertor.py'
2023-02-10T03:16:11,383   adding 'colossalai/utils/checkpoint_io/distributed.py'
2023-02-10T03:16:11,386   adding 'colossalai/utils/checkpoint_io/io.py'
2023-02-10T03:16:11,389   adding 'colossalai/utils/checkpoint_io/meta.py'
2023-02-10T03:16:11,391   adding 'colossalai/utils/checkpoint_io/reader.py'
2023-02-10T03:16:11,395   adding 'colossalai/utils/checkpoint_io/utils.py'
2023-02-10T03:16:11,398   adding 'colossalai/utils/checkpoint_io/writer.py'
2023-02-10T03:16:11,401   adding 'colossalai/utils/data_sampler/__init__.py'
2023-02-10T03:16:11,403   adding 'colossalai/utils/data_sampler/base_sampler.py'
2023-02-10T03:16:11,406   adding 'colossalai/utils/data_sampler/data_parallel_sampler.py'
2023-02-10T03:16:11,409   adding 'colossalai/utils/model/__init__.py'
2023-02-10T03:16:11,413   adding 'colossalai/utils/model/colo_init_context.py'
2023-02-10T03:16:11,418   adding 'colossalai/utils/model/experimental.py'
2023-02-10T03:16:11,422   adding 'colossalai/utils/model/lazy_init_context.py'
2023-02-10T03:16:11,424   adding 'colossalai/utils/model/utils.py'
2023-02-10T03:16:11,428   adding 'colossalai/utils/multi_tensor_apply/__init__.py'
2023-02-10T03:16:11,430   adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py'
2023-02-10T03:16:11,433   adding 'colossalai/utils/profiler/__init__.py'
2023-02-10T03:16:11,435   adding 'colossalai/utils/profiler/extention.py'
2023-02-10T03:16:11,439   adding 'colossalai/utils/profiler/profiler.py'
2023-02-10T03:16:11,441   adding 'colossalai/utils/profiler/stateful_tensor_mem_extention.py'
2023-02-10T03:16:11,445   adding 'colossalai/utils/profiler/legacy/__init__.py'
2023-02-10T03:16:11,448   adding 'colossalai/utils/profiler/legacy/comm_profiler.py'
2023-02-10T03:16:11,451   adding 'colossalai/utils/profiler/legacy/pcie_profiler.py'
2023-02-10T03:16:11,454   adding 'colossalai/utils/profiler/legacy/prof_utils.py'
2023-02-10T03:16:11,457   adding 'colossalai/utils/rank_recorder/__init__.py'
2023-02-10T03:16:11,460   adding 'colossalai/utils/rank_recorder/rank_recorder.py'
2023-02-10T03:16:11,464   adding 'colossalai/utils/tensor_detector/__init__.py'
2023-02-10T03:16:11,467   adding 'colossalai/utils/tensor_detector/tensor_detector.py'
2023-02-10T03:16:11,471   adding 'colossalai/zero/__init__.py'
2023-02-10T03:16:11,474   adding 'colossalai/zero/init_ctx/__init__.py'
2023-02-10T03:16:11,478   adding 'colossalai/zero/init_ctx/init_context.py'
2023-02-10T03:16:11,482   adding 'colossalai/zero/shard_utils/__init__.py'
2023-02-10T03:16:11,484   adding 'colossalai/zero/shard_utils/base_shard_strategy.py'
2023-02-10T03:16:11,486   adding 'colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py'
2023-02-10T03:16:11,488   adding 'colossalai/zero/shard_utils/commons.py'
2023-02-10T03:16:11,491   adding 'colossalai/zero/shard_utils/tensor_shard_strategy.py'
2023-02-10T03:16:11,494   adding 'colossalai/zero/sharded_model/__init__.py'
2023-02-10T03:16:11,497   adding 'colossalai/zero/sharded_model/_utils.py'
2023-02-10T03:16:11,500   adding 'colossalai/zero/sharded_model/reduce_scatter.py'
2023-02-10T03:16:11,508   adding 'colossalai/zero/sharded_model/sharded_model_v2.py'
2023-02-10T03:16:11,511   adding 'colossalai/zero/sharded_model/utils.py'
2023-02-10T03:16:11,514   adding 'colossalai/zero/sharded_optim/__init__.py'
2023-02-10T03:16:11,519   adding 'colossalai/zero/sharded_optim/_utils.py'
2023-02-10T03:16:11,526   adding 'colossalai/zero/sharded_optim/low_level_optim.py'
2023-02-10T03:16:11,531   adding 'colossalai/zero/sharded_optim/sharded_optim_v2.py'
2023-02-10T03:16:11,535   adding 'colossalai/zero/sharded_optim/bookkeeping/__init__.py'
2023-02-10T03:16:11,537   adding 'colossalai/zero/sharded_optim/bookkeeping/base_store.py'
2023-02-10T03:16:11,540   adding 'colossalai/zero/sharded_optim/bookkeeping/bucket_store.py'
2023-02-10T03:16:11,542   adding 'colossalai/zero/sharded_optim/bookkeeping/gradient_store.py'
2023-02-10T03:16:11,545   adding 'colossalai/zero/sharded_optim/bookkeeping/parameter_store.py'
2023-02-10T03:16:11,547   adding 'colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py'
2023-02-10T03:16:11,550   adding 'colossalai/zero/sharded_param/__init__.py'
2023-02-10T03:16:11,553   adding 'colossalai/zero/sharded_param/sharded_param.py'
2023-02-10T03:16:11,555   adding 'colossalai/zero/sharded_param/sharded_tensor.py'
2023-02-10T03:16:11,559   adding 'colossalai/zero/utils/__init__.py'
2023-02-10T03:16:11,561   adding 'colossalai/zero/utils/gemini_hook.py'
2023-02-10T03:16:11,564   adding 'colossalai/zero/utils/zero_hook.py'
2023-02-10T03:16:11,570   adding 'op_builder/__init__.py'
2023-02-10T03:16:11,574   adding 'op_builder/builder.py'
2023-02-10T03:16:11,576   adding 'op_builder/cpu_adam.py'
2023-02-10T03:16:11,578   adding 'op_builder/fused_optim.py'
2023-02-10T03:16:11,580   adding 'op_builder/layernorm.py'
2023-02-10T03:16:11,583   adding 'op_builder/moe.py'
2023-02-10T03:16:11,585   adding 'op_builder/multi_head_attn.py'
2023-02-10T03:16:11,587   adding 'op_builder/scaled_masked_softmax.py'
2023-02-10T03:16:11,590   adding 'op_builder/scaled_upper_triangle_masked_softmax.py'
2023-02-10T03:16:11,592   adding 'op_builder/utils.py'
2023-02-10T03:16:11,596   adding 'colossalai-0.2.2.dist-info/LICENSE'
2023-02-10T03:16:11,601   adding 'colossalai-0.2.2.dist-info/METADATA'
2023-02-10T03:16:11,603   adding 'colossalai-0.2.2.dist-info/WHEEL'
2023-02-10T03:16:11,605   adding 'colossalai-0.2.2.dist-info/entry_points.txt'
2023-02-10T03:16:11,606   adding 'colossalai-0.2.2.dist-info/top_level.txt'
2023-02-10T03:16:11,633   adding 'colossalai-0.2.2.dist-info/RECORD'
2023-02-10T03:16:11,689   removing build/bdist.linux-armv7l/wheel
2023-02-10T03:16:12,301   Building wheel for colossalai (setup.py): finished with status 'done'
2023-02-10T03:16:12,334   Created wheel for colossalai: filename=colossalai-0.2.2-py3-none-any.whl size=925866 sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122
2023-02-10T03:16:12,337   Stored in directory: /tmp/pip-ephem-wheel-cache-bif6x16g/wheels/49/2f/9c/2422b591b716c6f00e162a5cff5454d34526350b4ac379bc05
2023-02-10T03:16:12,420 Successfully built colossalai
2023-02-10T03:16:12,494 Removed build tracker: '/tmp/pip-build-tracker-le9dvp8o'