2023-01-09T03:22:33,448 Created temporary directory: /tmp/pip-ephem-wheel-cache-f2dbwue7
2023-01-09T03:22:33,453 Created temporary directory: /tmp/pip-build-tracker-8426srfw
2023-01-09T03:22:33,453 Initialized build tracking at /tmp/pip-build-tracker-8426srfw
2023-01-09T03:22:33,454 Created build tracker: /tmp/pip-build-tracker-8426srfw
2023-01-09T03:22:33,454 Entered build tracker: /tmp/pip-build-tracker-8426srfw
2023-01-09T03:22:33,455 Created temporary directory: /tmp/pip-wheel-cx3vterq
2023-01-09T03:22:33,463 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453
2023-01-09T03:22:33,469 Created temporary directory: /tmp/pip-ephem-wheel-cache-8hp6p28g
2023-01-09T03:22:33,526 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-01-09T03:22:33,533 2 location(s) to search for versions of colossalai:
2023-01-09T03:22:33,533 * https://pypi.org/simple/colossalai/
2023-01-09T03:22:33,533 * https://www.piwheels.org/simple/colossalai/
2023-01-09T03:22:33,534 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/
2023-01-09T03:22:33,535 Getting page https://pypi.org/simple/colossalai/
2023-01-09T03:22:33,538 Found index url https://pypi.org/simple
2023-01-09T03:22:33,756 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json
2023-01-09T03:22:33,760   Found link https://files.pythonhosted.org/packages/d0/77/7860ff89379bc071dd9b5e6df1ac6b6ab6b1cc3b5a0d3406ed64b6063861/colossalai-0.1.11rc4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.1.11rc4
2023-01-09T03:22:33,761   Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0
2023-01-09T03:22:33,762 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/
2023-01-09T03:22:33,763 Getting page https://www.piwheels.org/simple/colossalai/
2023-01-09T03:22:33,765 Found index url https://www.piwheels.org/simple
2023-01-09T03:22:33,998 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html
2023-01-09T03:22:34,001   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.1.11rc4-py3-none-any.whl#sha256=e0a05468e2a880440410a44124be138d40348423bdd1e988eda8220620f0b943 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-01-09T03:22:34,002 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/
2023-01-09T03:22:34,002 Skipping link: not a file: https://pypi.org/simple/colossalai/
2023-01-09T03:22:34,035 Given no hashes to check 1 links for project 'colossalai': discarding no candidates
2023-01-09T03:22:34,065 Collecting colossalai==0.2.0
2023-01-09T03:22:34,069   Created temporary directory: /tmp/pip-unpack-i9wi49g9
2023-01-09T03:22:34,746   Downloading colossalai-0.2.0.tar.gz (697 kB)
2023-01-09T03:22:38,032   Added colossalai==0.2.0 from https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz to build tracker '/tmp/pip-build-tracker-8426srfw'
2023-01-09T03:22:38,035   Running setup.py (path:/tmp/pip-wheel-cx3vterq/colossalai_7e2d20d4f67141ff892fa082714fba20/setup.py) egg_info for package colossalai
2023-01-09T03:22:38,036   Created temporary directory: /tmp/pip-pip-egg-info-3xkytzv0
2023-01-09T03:22:38,037   Preparing metadata (setup.py): started
2023-01-09T03:22:38,039   Running command python setup.py egg_info
2023-01-09T03:22:41,278   running egg_info
2023-01-09T03:22:41,283   creating /tmp/pip-pip-egg-info-3xkytzv0/colossalai.egg-info
2023-01-09T03:22:41,375   writing /tmp/pip-pip-egg-info-3xkytzv0/colossalai.egg-info/PKG-INFO
2023-01-09T03:22:41,381   writing dependency_links to /tmp/pip-pip-egg-info-3xkytzv0/colossalai.egg-info/dependency_links.txt
2023-01-09T03:22:41,385   writing entry points to /tmp/pip-pip-egg-info-3xkytzv0/colossalai.egg-info/entry_points.txt
2023-01-09T03:22:41,388   writing requirements to /tmp/pip-pip-egg-info-3xkytzv0/colossalai.egg-info/requires.txt
2023-01-09T03:22:41,391   writing top-level names to /tmp/pip-pip-egg-info-3xkytzv0/colossalai.egg-info/top_level.txt
2023-01-09T03:22:41,394   writing manifest file '/tmp/pip-pip-egg-info-3xkytzv0/colossalai.egg-info/SOURCES.txt'
2023-01-09T03:22:41,887   reading manifest file '/tmp/pip-pip-egg-info-3xkytzv0/colossalai.egg-info/SOURCES.txt'
2023-01-09T03:22:41,891   reading manifest template 'MANIFEST.in'
2023-01-09T03:22:43,972   warning: no files found matching '*.tr' under directory 'colossalai'
2023-01-09T03:22:45,000   warning: no files found matching '*.cc' under directory 'colossalai'
2023-01-09T03:22:45,506   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-01-09T03:22:45,524   adding license file 'LICENSE'
2023-01-09T03:22:45,592   writing manifest file '/tmp/pip-pip-egg-info-3xkytzv0/colossalai.egg-info/SOURCES.txt'
2023-01-09T03:22:45,799   Preparing metadata (setup.py): finished with status 'done'
2023-01-09T03:22:45,815   Source in /tmp/pip-wheel-cx3vterq/colossalai_7e2d20d4f67141ff892fa082714fba20 has version 0.2.0, which satisfies requirement colossalai==0.2.0 from https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz
2023-01-09T03:22:45,817   Removed colossalai==0.2.0 from https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz from build tracker '/tmp/pip-build-tracker-8426srfw'
2023-01-09T03:22:45,834 Created temporary directory: /tmp/pip-unpack-sx6ckmax
2023-01-09T03:22:45,835 Building wheels for collected packages: colossalai
2023-01-09T03:22:45,845   Created temporary directory: /tmp/pip-wheel-z917ezed
2023-01-09T03:22:45,845   Building wheel for colossalai (setup.py): started
2023-01-09T03:22:45,847   Destination directory: /tmp/pip-wheel-z917ezed
2023-01-09T03:22:45,848   Running command python setup.py bdist_wheel
2023-01-09T03:22:48,892   running bdist_wheel
2023-01-09T03:22:49,768   running build
2023-01-09T03:22:49,769   running build_py
2023-01-09T03:22:49,881   creating build
2023-01-09T03:22:49,882   creating build/lib
2023-01-09T03:22:49,883   creating build/lib/colossalai
2023-01-09T03:22:49,885   copying colossalai/core.py -> build/lib/colossalai
2023-01-09T03:22:49,889   copying colossalai/constants.py -> build/lib/colossalai
2023-01-09T03:22:49,892   copying colossalai/global_variables.py -> build/lib/colossalai
2023-01-09T03:22:49,895   copying colossalai/initialize.py -> build/lib/colossalai
2023-01-09T03:22:49,900   copying colossalai/version.py -> build/lib/colossalai
2023-01-09T03:22:49,903   copying colossalai/__init__.py -> build/lib/colossalai
2023-01-09T03:22:49,907   creating build/lib/op_builder
2023-01-09T03:22:49,909   copying op_builder/moe.py -> build/lib/op_builder
2023-01-09T03:22:49,912   copying op_builder/layernorm.py -> build/lib/op_builder
2023-01-09T03:22:49,915   copying op_builder/cpu_adam.py -> build/lib/op_builder
2023-01-09T03:22:49,918   copying op_builder/scaled_masked_softmax.py -> build/lib/op_builder
2023-01-09T03:22:49,920   copying op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/op_builder
2023-01-09T03:22:49,923   copying op_builder/utils.py -> build/lib/op_builder
2023-01-09T03:22:49,926   copying op_builder/multi_head_attn.py -> build/lib/op_builder
2023-01-09T03:22:49,929   copying op_builder/__init__.py -> build/lib/op_builder
2023-01-09T03:22:49,932   copying op_builder/builder.py -> build/lib/op_builder
2023-01-09T03:22:49,935   copying op_builder/fused_optim.py -> build/lib/op_builder
2023-01-09T03:22:49,940   creating build/lib/colossalai/gemini
2023-01-09T03:22:49,942   copying colossalai/gemini/placement_policy.py -> build/lib/colossalai/gemini
2023-01-09T03:22:49,946   copying colossalai/gemini/tensor_utils.py -> build/lib/colossalai/gemini
2023-01-09T03:22:49,949   copying colossalai/gemini/gemini_context.py -> build/lib/colossalai/gemini
2023-01-09T03:22:49,952   copying colossalai/gemini/gemini_mgr.py -> build/lib/colossalai/gemini
2023-01-09T03:22:49,956   copying colossalai/gemini/tensor_placement_policy.py -> build/lib/colossalai/gemini
2023-01-09T03:22:49,960   copying colossalai/gemini/__init__.py -> build/lib/colossalai/gemini
2023-01-09T03:22:49,963   copying colossalai/gemini/stateful_tensor.py -> build/lib/colossalai/gemini
2023-01-09T03:22:49,967   copying colossalai/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/gemini
2023-01-09T03:22:49,972   creating build/lib/colossalai/context
2023-01-09T03:22:49,974   copying colossalai/context/parallel_mode.py -> build/lib/colossalai/context
2023-01-09T03:22:49,977   copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context
2023-01-09T03:22:49,980   copying colossalai/context/config.py -> build/lib/colossalai/context
2023-01-09T03:22:49,984   copying colossalai/context/moe_context.py -> build/lib/colossalai/context
2023-01-09T03:22:49,987   copying colossalai/context/parallel_context.py -> build/lib/colossalai/context
2023-01-09T03:22:49,992   copying colossalai/context/__init__.py -> build/lib/colossalai/context
2023-01-09T03:22:49,997   creating build/lib/colossalai/amp
2023-01-09T03:22:49,998   copying colossalai/amp/amp_type.py -> build/lib/colossalai/amp
2023-01-09T03:22:50,001   copying colossalai/amp/__init__.py -> build/lib/colossalai/amp
2023-01-09T03:22:50,006   creating build/lib/colossalai/pipeline
2023-01-09T03:22:50,007   copying colossalai/pipeline/pipeline_process_group.py -> build/lib/colossalai/pipeline
2023-01-09T03:22:50,011   copying colossalai/pipeline/pipelinable.py -> build/lib/colossalai/pipeline
2023-01-09T03:22:50,015   copying colossalai/pipeline/layer_spec.py -> build/lib/colossalai/pipeline
2023-01-09T03:22:50,018   copying colossalai/pipeline/utils.py -> build/lib/colossalai/pipeline
2023-01-09T03:22:50,022   copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline
2023-01-09T03:22:50,026   creating build/lib/colossalai/engine
2023-01-09T03:22:50,028   copying colossalai/engine/__init__.py -> build/lib/colossalai/engine
2023-01-09T03:22:50,031   copying colossalai/engine/_base_engine.py -> build/lib/colossalai/engine
2023-01-09T03:22:50,036   creating build/lib/colossalai/device
2023-01-09T03:22:50,037   copying colossalai/device/device_mesh.py -> build/lib/colossalai/device
2023-01-09T03:22:50,042   copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device
2023-01-09T03:22:50,046   copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device
2023-01-09T03:22:50,050   copying colossalai/device/__init__.py -> build/lib/colossalai/device
2023-01-09T03:22:50,054   creating build/lib/colossalai/cli
2023-01-09T03:22:50,055   copying colossalai/cli/__init__.py -> build/lib/colossalai/cli
2023-01-09T03:22:50,059   copying colossalai/cli/cli.py -> build/lib/colossalai/cli
2023-01-09T03:22:50,064   creating build/lib/colossalai/fx
2023-01-09T03:22:50,065   copying colossalai/fx/_meta_registrations.py -> build/lib/colossalai/fx
2023-01-09T03:22:50,070   copying colossalai/fx/proxy.py -> build/lib/colossalai/fx
2023-01-09T03:22:50,073   copying colossalai/fx/__init__.py -> build/lib/colossalai/fx
2023-01-09T03:22:50,077   copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx
2023-01-09T03:22:50,080   copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx
2023-01-09T03:22:50,085   creating build/lib/colossalai/builder
2023-01-09T03:22:50,086   copying colossalai/builder/__init__.py -> build/lib/colossalai/builder
2023-01-09T03:22:50,089   copying colossalai/builder/builder.py -> build/lib/colossalai/builder
2023-01-09T03:22:50,094   creating build/lib/colossalai/communication
2023-01-09T03:22:50,095   copying colossalai/communication/p2p_v2.py -> build/lib/colossalai/communication
2023-01-09T03:22:50,099   copying colossalai/communication/p2p.py -> build/lib/colossalai/communication
2023-01-09T03:22:50,104   copying colossalai/communication/utils.py -> build/lib/colossalai/communication
2023-01-09T03:22:50,108   copying colossalai/communication/__init__.py -> build/lib/colossalai/communication
2023-01-09T03:22:50,111   copying colossalai/communication/collective.py -> build/lib/colossalai/communication
2023-01-09T03:22:50,115   copying colossalai/communication/ring.py -> build/lib/colossalai/communication
2023-01-09T03:22:50,119   creating build/lib/colossalai/logging
2023-01-09T03:22:50,120   copying colossalai/logging/logger.py -> build/lib/colossalai/logging
2023-01-09T03:22:50,124   copying colossalai/logging/__init__.py -> build/lib/colossalai/logging
2023-01-09T03:22:50,129   creating build/lib/colossalai/nn
2023-01-09T03:22:50,130   copying colossalai/nn/init.py -> build/lib/colossalai/nn
2023-01-09T03:22:50,134   copying colossalai/nn/__init__.py -> build/lib/colossalai/nn
2023-01-09T03:22:50,139   creating build/lib/colossalai/trainer
2023-01-09T03:22:50,140   copying colossalai/trainer/_trainer.py -> build/lib/colossalai/trainer
2023-01-09T03:22:50,144   copying colossalai/trainer/__init__.py -> build/lib/colossalai/trainer
2023-01-09T03:22:50,148   creating build/lib/colossalai/_C
2023-01-09T03:22:50,150   copying colossalai/_C/__init__.py -> build/lib/colossalai/_C
2023-01-09T03:22:50,154   creating build/lib/colossalai/zero
2023-01-09T03:22:50,155   copying colossalai/zero/__init__.py -> build/lib/colossalai/zero
2023-01-09T03:22:50,160   creating build/lib/colossalai/auto_parallel
2023-01-09T03:22:50,161   copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel
2023-01-09T03:22:50,166   creating build/lib/colossalai/tensor
2023-01-09T03:22:50,167   copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,171   copying colossalai/tensor/compute_spec.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,174   copying colossalai/tensor/dist_spec_mgr.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,178   copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,182   copying colossalai/tensor/distspec.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,185   copying colossalai/tensor/process_group.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,189   copying colossalai/tensor/op_wrapper.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,192   copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,197   copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,201   copying colossalai/tensor/const.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,203   copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,208   copying colossalai/tensor/tensor_spec.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,211   copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,216   copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,219   copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor
2023-01-09T03:22:50,225   creating build/lib/colossalai/utils
2023-01-09T03:22:50,226   copying colossalai/utils/timer.py -> build/lib/colossalai/utils
2023-01-09T03:22:50,230   copying colossalai/utils/moe.py -> build/lib/colossalai/utils
2023-01-09T03:22:50,233   copying colossalai/utils/cuda.py -> build/lib/colossalai/utils
2023-01-09T03:22:50,236   copying colossalai/utils/memory.py -> build/lib/colossalai/utils
2023-01-09T03:22:50,240   copying colossalai/utils/common.py -> build/lib/colossalai/utils
2023-01-09T03:22:50,244   copying colossalai/utils/activation_checkpoint.py -> build/lib/colossalai/utils
2023-01-09T03:22:50,248   copying colossalai/utils/__init__.py -> build/lib/colossalai/utils
2023-01-09T03:22:50,251   copying colossalai/utils/checkpointing.py -> build/lib/colossalai/utils
2023-01-09T03:22:50,256   creating build/lib/colossalai/kernel
2023-01-09T03:22:50,257   copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel
2023-01-09T03:22:50,261   creating build/lib/colossalai/registry
2023-01-09T03:22:50,263   copying colossalai/registry/registry.py -> build/lib/colossalai/registry
2023-01-09T03:22:50,266   copying colossalai/registry/__init__.py -> build/lib/colossalai/registry
2023-01-09T03:22:50,270   creating build/lib/colossalai/testing
2023-01-09T03:22:50,272   copying colossalai/testing/random.py -> build/lib/colossalai/testing
2023-01-09T03:22:50,275   copying colossalai/testing/comparison.py -> build/lib/colossalai/testing
2023-01-09T03:22:50,278   copying colossalai/testing/utils.py -> build/lib/colossalai/testing
2023-01-09T03:22:50,281   copying colossalai/testing/__init__.py -> build/lib/colossalai/testing
2023-01-09T03:22:50,284   copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing
2023-01-09T03:22:50,289   creating build/lib/colossalai/gemini/paramhooks
2023-01-09T03:22:50,290   copying colossalai/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/gemini/paramhooks
2023-01-09T03:22:50,293   copying colossalai/gemini/paramhooks/__init__.py -> build/lib/colossalai/gemini/paramhooks
2023-01-09T03:22:50,297   creating build/lib/colossalai/gemini/chunk
2023-01-09T03:22:50,298   copying colossalai/gemini/chunk/manager.py -> build/lib/colossalai/gemini/chunk
2023-01-09T03:22:50,303   copying colossalai/gemini/chunk/chunk.py -> build/lib/colossalai/gemini/chunk
2023-01-09T03:22:50,307   copying colossalai/gemini/chunk/search_utils.py -> build/lib/colossalai/gemini/chunk
2023-01-09T03:22:50,311   copying colossalai/gemini/chunk/utils.py -> build/lib/colossalai/gemini/chunk
2023-01-09T03:22:50,314   copying colossalai/gemini/chunk/__init__.py -> build/lib/colossalai/gemini/chunk
2023-01-09T03:22:50,319   creating build/lib/colossalai/gemini/memory_tracer
2023-01-09T03:22:50,320   copying colossalai/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/gemini/memory_tracer
2023-01-09T03:22:50,324   copying colossalai/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-01-09T03:22:50,327   copying colossalai/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-01-09T03:22:50,330   copying colossalai/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/gemini/memory_tracer
2023-01-09T03:22:50,333   copying colossalai/gemini/memory_tracer/utils.py -> build/lib/colossalai/gemini/memory_tracer
2023-01-09T03:22:50,336   copying colossalai/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/gemini/memory_tracer
2023-01-09T03:22:50,339   copying colossalai/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-01-09T03:22:50,342   copying colossalai/gemini/memory_tracer/__init__.py -> build/lib/colossalai/gemini/memory_tracer
2023-01-09T03:22:50,345   copying colossalai/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/gemini/memory_tracer
2023-01-09T03:22:50,350   creating build/lib/colossalai/gemini/ophooks
2023-01-09T03:22:50,351   copying colossalai/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/gemini/ophooks
2023-01-09T03:22:50,354   copying colossalai/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/gemini/ophooks
2023-01-09T03:22:50,358   copying colossalai/gemini/ophooks/utils.py -> build/lib/colossalai/gemini/ophooks
2023-01-09T03:22:50,361   copying colossalai/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/gemini/ophooks
2023-01-09T03:22:50,364   copying colossalai/gemini/ophooks/__init__.py -> build/lib/colossalai/gemini/ophooks
2023-01-09T03:22:50,369   creating build/lib/colossalai/context/process_group_initializer
2023-01-09T03:22:50,371   copying colossalai/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/context/process_group_initializer
2023-01-09T03:22:50,375   copying colossalai/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/context/process_group_initializer
2023-01-09T03:22:50,379   copying colossalai/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/context/process_group_initializer
2023-01-09T03:22:50,382   copying colossalai/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/context/process_group_initializer
2023-01-09T03:22:50,385   copying colossalai/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/context/process_group_initializer
2023-01-09T03:22:50,389   copying colossalai/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/context/process_group_initializer
2023-01-09T03:22:50,392   copying colossalai/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/context/process_group_initializer
2023-01-09T03:22:50,395   copying colossalai/context/process_group_initializer/__init__.py -> build/lib/colossalai/context/process_group_initializer
2023-01-09T03:22:50,398   copying colossalai/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/context/process_group_initializer
2023-01-09T03:22:50,401   copying colossalai/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/context/process_group_initializer
2023-01-09T03:22:50,404   copying colossalai/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/context/process_group_initializer
2023-01-09T03:22:50,409   creating build/lib/colossalai/context/random
2023-01-09T03:22:50,410   copying colossalai/context/random/_helper.py -> build/lib/colossalai/context/random
2023-01-09T03:22:50,414   copying colossalai/context/random/__init__.py -> build/lib/colossalai/context/random
2023-01-09T03:22:50,417   copying colossalai/context/random/seed_manager.py -> build/lib/colossalai/context/random
2023-01-09T03:22:50,421   creating build/lib/colossalai/amp/apex_amp
2023-01-09T03:22:50,430   copying colossalai/amp/apex_amp/apex_amp.py -> build/lib/colossalai/amp/apex_amp
2023-01-09T03:22:50,433   copying colossalai/amp/apex_amp/__init__.py -> build/lib/colossalai/amp/apex_amp
2023-01-09T03:22:50,438   creating build/lib/colossalai/amp/torch_amp
2023-01-09T03:22:50,439   copying colossalai/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/amp/torch_amp
2023-01-09T03:22:50,444   copying colossalai/amp/torch_amp/torch_amp.py -> build/lib/colossalai/amp/torch_amp
2023-01-09T03:22:50,447   copying colossalai/amp/torch_amp/__init__.py -> build/lib/colossalai/amp/torch_amp
2023-01-09T03:22:50,451   creating build/lib/colossalai/amp/naive_amp
2023-01-09T03:22:50,453   copying colossalai/amp/naive_amp/_utils.py -> build/lib/colossalai/amp/naive_amp
2023-01-09T03:22:50,456   copying colossalai/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/amp/naive_amp
2023-01-09T03:22:50,460   copying colossalai/amp/naive_amp/naive_amp.py -> build/lib/colossalai/amp/naive_amp
2023-01-09T03:22:50,463   copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp
2023-01-09T03:22:50,468   creating build/lib/colossalai/amp/naive_amp/grad_scaler
2023-01-09T03:22:50,470   copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-01-09T03:22:50,474   copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-01-09T03:22:50,477   copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-01-09T03:22:50,480   copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-01-09T03:22:50,484   creating build/lib/colossalai/pipeline/rpc
2023-01-09T03:22:50,486   copying colossalai/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/pipeline/rpc
2023-01-09T03:22:50,493   copying colossalai/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/pipeline/rpc
2023-01-09T03:22:50,498   copying colossalai/pipeline/rpc/utils.py -> build/lib/colossalai/pipeline/rpc
2023-01-09T03:22:50,501   copying colossalai/pipeline/rpc/__init__.py -> build/lib/colossalai/pipeline/rpc
2023-01-09T03:22:50,505   creating build/lib/colossalai/pipeline/middleware
2023-01-09T03:22:50,507   copying colossalai/pipeline/middleware/topo.py -> build/lib/colossalai/pipeline/middleware
2023-01-09T03:22:50,511   copying colossalai/pipeline/middleware/__init__.py -> build/lib/colossalai/pipeline/middleware
2023-01-09T03:22:50,515   creating build/lib/colossalai/pipeline/middleware/adaptor
2023-01-09T03:22:50,517   copying colossalai/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/pipeline/middleware/adaptor
2023-01-09T03:22:50,521   copying colossalai/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/pipeline/middleware/adaptor
2023-01-09T03:22:50,525   creating build/lib/colossalai/engine/schedule
2023-01-09T03:22:50,527   copying colossalai/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/engine/schedule
2023-01-09T03:22:50,530   copying colossalai/engine/schedule/_base_schedule.py -> build/lib/colossalai/engine/schedule
2023-01-09T03:22:50,534   copying colossalai/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/engine/schedule
2023-01-09T03:22:50,540   copying colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/engine/schedule
2023-01-09T03:22:50,543   copying colossalai/engine/schedule/__init__.py -> build/lib/colossalai/engine/schedule
2023-01-09T03:22:50,548   creating build/lib/colossalai/engine/gradient_accumulation
2023-01-09T03:22:50,549   copying colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/engine/gradient_accumulation
2023-01-09T03:22:50,553   copying colossalai/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/engine/gradient_accumulation
2023-01-09T03:22:50,558   creating build/lib/colossalai/engine/gradient_handler
2023-01-09T03:22:50,560   copying colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-01-09T03:22:50,563   copying colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-01-09T03:22:50,566   copying colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-01-09T03:22:50,569   copying colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-01-09T03:22:50,572   copying colossalai/engine/gradient_handler/utils.py -> build/lib/colossalai/engine/gradient_handler
2023-01-09T03:22:50,575   copying colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-01-09T03:22:50,579   copying colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-01-09T03:22:50,582   copying colossalai/engine/gradient_handler/__init__.py -> build/lib/colossalai/engine/gradient_handler
2023-01-09T03:22:50,587   creating build/lib/colossalai/cli/benchmark
2023-01-09T03:22:50,588   copying colossalai/cli/benchmark/benchmark.py -> build/lib/colossalai/cli/benchmark
2023-01-09T03:22:50,592   copying colossalai/cli/benchmark/models.py -> build/lib/colossalai/cli/benchmark
2023-01-09T03:22:50,595   copying colossalai/cli/benchmark/utils.py -> build/lib/colossalai/cli/benchmark
2023-01-09T03:22:50,599   copying colossalai/cli/benchmark/__init__.py -> build/lib/colossalai/cli/benchmark
2023-01-09T03:22:50,603   creating build/lib/colossalai/cli/check
2023-01-09T03:22:50,605   copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check
2023-01-09T03:22:50,609   copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check
2023-01-09T03:22:50,613   creating build/lib/colossalai/cli/launcher
2023-01-09T03:22:50,615   copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher
2023-01-09T03:22:50,618   copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher
2023-01-09T03:22:50,622   copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher
2023-01-09T03:22:50,626   copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher
2023-01-09T03:22:50,631   creating build/lib/colossalai/fx/codegen
2023-01-09T03:22:50,632   copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen
2023-01-09T03:22:50,638   copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen
2023-01-09T03:22:50,643   creating build/lib/colossalai/fx/passes
2023-01-09T03:22:50,644   copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes
2023-01-09T03:22:50,649   copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes
2023-01-09T03:22:50,652   copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes
2023-01-09T03:22:50,656   copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes
2023-01-09T03:22:50,661   copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes
2023-01-09T03:22:50,664   copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes
2023-01-09T03:22:50,668   copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes
2023-01-09T03:22:50,671   copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes
2023-01-09T03:22:50,677   creating build/lib/colossalai/fx/profiler
2023-01-09T03:22:50,678   copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler
2023-01-09T03:22:50,682   copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler
2023-01-09T03:22:50,685   copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler
2023-01-09T03:22:50,689   copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler
2023-01-09T03:22:50,693   copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler
2023-01-09T03:22:50,697   copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler
2023-01-09T03:22:50,702   copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler
2023-01-09T03:22:50,705   copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler
2023-01-09T03:22:50,710   creating build/lib/colossalai/fx/tracer
2023-01-09T03:22:50,711   copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer
2023-01-09T03:22:50,716   copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer
2023-01-09T03:22:50,719   copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer
2023-01-09T03:22:50,723   copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer
2023-01-09T03:22:50,727   copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer
2023-01-09T03:22:50,732   copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer
2023-01-09T03:22:50,735   copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer
2023-01-09T03:22:50,740   creating build/lib/colossalai/fx/passes/algorithms
2023-01-09T03:22:50,742   copying colossalai/fx/passes/algorithms/ckpt_solver_rotor.py -> build/lib/colossalai/fx/passes/algorithms
2023-01-09T03:22:50,746   copying colossalai/fx/passes/algorithms/build_c_ext.py -> build/lib/colossalai/fx/passes/algorithms
2023-01-09T03:22:50,749   copying colossalai/fx/passes/algorithms/linearize.py -> build/lib/colossalai/fx/passes/algorithms
2023-01-09T03:22:50,752   copying colossalai/fx/passes/algorithms/ckpt_solver_pofo.py -> build/lib/colossalai/fx/passes/algorithms
2023-01-09T03:22:50,756   copying colossalai/fx/passes/algorithms/operation.py -> build/lib/colossalai/fx/passes/algorithms
2023-01-09T03:22:50,760   copying colossalai/fx/passes/algorithms/ckpt_solver_chen.py -> build/lib/colossalai/fx/passes/algorithms
2023-01-09T03:22:50,763   copying colossalai/fx/passes/algorithms/__init__.py -> build/lib/colossalai/fx/passes/algorithms
2023-01-09T03:22:50,768   creating build/lib/colossalai/fx/profiler/experimental
2023-01-09T03:22:50,769   copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental
2023-01-09T03:22:50,773   copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental
2023-01-09T03:22:50,776   copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental
2023-01-09T03:22:50,780   copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental
2023-01-09T03:22:50,783   copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental
2023-01-09T03:22:50,788   creating build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:50,790   copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:50,793   copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:50,796   copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:50,799   copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:50,802   copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:50,806   copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:50,809   copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:50,812   copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:50,815   copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:50,820   creating build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:50,822   copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:50,825   copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:50,829   copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:50,832   copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:50,835   copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:50,838   copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:50,842   copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:50,845   copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:50,848   copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:50,851   copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:50,854   copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:50,858   creating build/lib/colossalai/fx/tracer/meta_patch
2023-01-09T03:22:50,860   copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch
2023-01-09T03:22:50,864   creating build/lib/colossalai/fx/tracer/bias_addition_patch
2023-01-09T03:22:50,865   copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch
2023-01-09T03:22:50,871   creating build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:50,872   copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:50,876   copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:50,880   copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:50,884   copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:50,887   copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:50,890   copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:50,893   copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:50,896   copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:50,901   creating build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:50,902   copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:50,907   copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:50,910   copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:50,913   copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:50,917   copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:50,920   copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:50,923   copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:50,927   copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:50,932   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-01-09T03:22:50,933   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-01-09T03:22:50,937   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-01-09T03:22:50,940   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-01-09T03:22:50,943   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-01-09T03:22:50,946   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-01-09T03:22:50,951   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-01-09T03:22:50,953   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-01-09T03:22:50,957   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-01-09T03:22:50,961   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-01-09T03:22:50,964   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-01-09T03:22:50,969   creating build/lib/colossalai/nn/lr_scheduler
2023-01-09T03:22:50,970   copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler
2023-01-09T03:22:50,975   copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler
2023-01-09T03:22:50,978   copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler
2023-01-09T03:22:50,981   copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler
2023-01-09T03:22:50,985   copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler
2023-01-09T03:22:50,989   copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler
2023-01-09T03:22:50,992   copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler
2023-01-09T03:22:50,995   copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler
2023-01-09T03:22:51,000   creating build/lib/colossalai/nn/layer
2023-01-09T03:22:51,001   copying colossalai/nn/layer/base_layer.py -> build/lib/colossalai/nn/layer
2023-01-09T03:22:51,005   copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer
2023-01-09T03:22:51,009   creating build/lib/colossalai/nn/metric
2023-01-09T03:22:51,010   copying colossalai/nn/metric/accuracy_2d.py -> build/lib/colossalai/nn/metric
2023-01-09T03:22:51,014   copying colossalai/nn/metric/_utils.py -> build/lib/colossalai/nn/metric
2023-01-09T03:22:51,017   copying colossalai/nn/metric/accuracy_3d.py -> build/lib/colossalai/nn/metric
2023-01-09T03:22:51,020   copying colossalai/nn/metric/__init__.py -> build/lib/colossalai/nn/metric
2023-01-09T03:22:51,023   copying colossalai/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/nn/metric
2023-01-09T03:22:51,028   creating build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,030   copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,033   copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,037   copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,041   copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,045   copying colossalai/nn/optimizer/gemini_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,049   copying colossalai/nn/optimizer/zero_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,054   copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,058   copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,062   copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,067   copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,071   copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,074   copying colossalai/nn/optimizer/colossalai_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-01-09T03:22:51,079   creating build/lib/colossalai/nn/loss
2023-01-09T03:22:51,080   copying colossalai/nn/loss/loss_2d.py -> build/lib/colossalai/nn/loss
2023-01-09T03:22:51,084   copying colossalai/nn/loss/loss_3d.py -> build/lib/colossalai/nn/loss
2023-01-09T03:22:51,088   copying colossalai/nn/loss/loss_1d.py -> build/lib/colossalai/nn/loss
2023-01-09T03:22:51,092   copying colossalai/nn/loss/loss_moe.py -> build/lib/colossalai/nn/loss
2023-01-09T03:22:51,095   copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss
2023-01-09T03:22:51,098   copying colossalai/nn/loss/loss_2p5d.py -> build/lib/colossalai/nn/loss
2023-01-09T03:22:51,104   creating build/lib/colossalai/nn/_ops
2023-01-09T03:22:51,105   copying colossalai/nn/_ops/element_wise.py -> build/lib/colossalai/nn/_ops
2023-01-09T03:22:51,109   copying colossalai/nn/_ops/layernorm.py -> build/lib/colossalai/nn/_ops
2023-01-09T03:22:51,112   copying colossalai/nn/_ops/batch_norm.py -> build/lib/colossalai/nn/_ops
2023-01-09T03:22:51,115   copying colossalai/nn/_ops/view.py -> build/lib/colossalai/nn/_ops
2023-01-09T03:22:51,119   copying colossalai/nn/_ops/linear.py -> build/lib/colossalai/nn/_ops
2023-01-09T03:22:51,122   copying colossalai/nn/_ops/_utils.py -> build/lib/colossalai/nn/_ops
2023-01-09T03:22:51,126   copying colossalai/nn/_ops/addmm.py -> build/lib/colossalai/nn/_ops
2023-01-09T03:22:51,129   copying colossalai/nn/_ops/loss.py -> build/lib/colossalai/nn/_ops
2023-01-09T03:22:51,132   copying colossalai/nn/_ops/__init__.py -> build/lib/colossalai/nn/_ops
2023-01-09T03:22:51,135   copying colossalai/nn/_ops/embedding.py -> build/lib/colossalai/nn/_ops
2023-01-09T03:22:51,139   copying colossalai/nn/_ops/embedding_bag.py -> build/lib/colossalai/nn/_ops
2023-01-09T03:22:51,144   creating build/lib/colossalai/nn/parallel
2023-01-09T03:22:51,146   copying colossalai/nn/parallel/data_parallel.py -> build/lib/colossalai/nn/parallel
2023-01-09T03:22:51,151   copying colossalai/nn/parallel/utils.py -> build/lib/colossalai/nn/parallel
2023-01-09T03:22:51,154   copying colossalai/nn/parallel/gemini_parallel.py -> build/lib/colossalai/nn/parallel
2023-01-09T03:22:51,157   copying colossalai/nn/parallel/reducer.py -> build/lib/colossalai/nn/parallel
2023-01-09T03:22:51,160   copying colossalai/nn/parallel/__init__.py -> build/lib/colossalai/nn/parallel
2023-01-09T03:22:51,165   creating build/lib/colossalai/nn/layer/parallel_1d
2023-01-09T03:22:51,166   copying colossalai/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-01-09T03:22:51,170   copying colossalai/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-01-09T03:22:51,177   copying colossalai/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-01-09T03:22:51,180   copying colossalai/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-01-09T03:22:51,184   creating build/lib/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:51,186   copying colossalai/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:51,190   copying colossalai/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:51,193   copying colossalai/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:51,197   copying colossalai/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:51,200   copying colossalai/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:51,203   copying colossalai/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:51,208   creating build/lib/colossalai/nn/layer/vanilla
2023-01-09T03:22:51,210   copying colossalai/nn/layer/vanilla/layers.py -> build/lib/colossalai/nn/layer/vanilla
2023-01-09T03:22:51,215   copying colossalai/nn/layer/vanilla/__init__.py -> build/lib/colossalai/nn/layer/vanilla
2023-01-09T03:22:51,220   creating build/lib/colossalai/nn/layer/moe
2023-01-09T03:22:51,221   copying colossalai/nn/layer/moe/layers.py -> build/lib/colossalai/nn/layer/moe
2023-01-09T03:22:51,226   copying colossalai/nn/layer/moe/experts.py -> build/lib/colossalai/nn/layer/moe
2023-01-09T03:22:51,230   copying colossalai/nn/layer/moe/utils.py -> build/lib/colossalai/nn/layer/moe
2023-01-09T03:22:51,233   copying colossalai/nn/layer/moe/_operation.py -> build/lib/colossalai/nn/layer/moe
2023-01-09T03:22:51,237   copying colossalai/nn/layer/moe/__init__.py -> build/lib/colossalai/nn/layer/moe
2023-01-09T03:22:51,240   copying colossalai/nn/layer/moe/routers.py -> build/lib/colossalai/nn/layer/moe
2023-01-09T03:22:51,245   creating build/lib/colossalai/nn/layer/parallel_2d
2023-01-09T03:22:51,247   copying colossalai/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-01-09T03:22:51,250   copying colossalai/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-01-09T03:22:51,257   copying colossalai/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-01-09T03:22:51,262   copying colossalai/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-01-09T03:22:51,266   creating build/lib/colossalai/nn/layer/parallel_2p5d
2023-01-09T03:22:51,268   copying colossalai/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-01-09T03:22:51,272   copying colossalai/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-01-09T03:22:51,278   copying colossalai/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-01-09T03:22:51,283   copying colossalai/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-01-09T03:22:51,288   creating build/lib/colossalai/nn/layer/parallel_3d
2023-01-09T03:22:51,289   copying colossalai/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-01-09T03:22:51,293   copying colossalai/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-01-09T03:22:51,299   copying colossalai/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-01-09T03:22:51,304   copying colossalai/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-01-09T03:22:51,308   creating build/lib/colossalai/nn/layer/utils
2023-01-09T03:22:51,310   copying colossalai/nn/layer/utils/common.py -> build/lib/colossalai/nn/layer/utils
2023-01-09T03:22:51,313   copying colossalai/nn/layer/utils/__init__.py -> build/lib/colossalai/nn/layer/utils
2023-01-09T03:22:51,318   creating build/lib/colossalai/nn/layer/wrapper
2023-01-09T03:22:51,319   copying colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/nn/layer/wrapper
2023-01-09T03:22:51,323   copying colossalai/nn/layer/wrapper/__init__.py -> build/lib/colossalai/nn/layer/wrapper
2023-01-09T03:22:51,327   creating build/lib/colossalai/nn/layer/parallel_sequence
2023-01-09T03:22:51,329   copying colossalai/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-01-09T03:22:51,332   copying colossalai/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-01-09T03:22:51,337   copying colossalai/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-01-09T03:22:51,341   copying colossalai/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-01-09T03:22:51,345   creating build/lib/colossalai/nn/parallel/layers
2023-01-09T03:22:51,347   copying colossalai/nn/parallel/layers/linear.py -> build/lib/colossalai/nn/parallel/layers
2023-01-09T03:22:51,350   copying colossalai/nn/parallel/layers/colo_module.py -> build/lib/colossalai/nn/parallel/layers
2023-01-09T03:22:51,354   copying colossalai/nn/parallel/layers/module_utils.py -> build/lib/colossalai/nn/parallel/layers
2023-01-09T03:22:51,357   copying colossalai/nn/parallel/layers/__init__.py -> build/lib/colossalai/nn/parallel/layers
2023-01-09T03:22:51,361   copying colossalai/nn/parallel/layers/embedding.py -> build/lib/colossalai/nn/parallel/layers
2023-01-09T03:22:51,366   creating build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:51,368   copying colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:51,371   copying colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:51,375   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:51,379   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:51,384   copying colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:51,387   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:51,391   copying colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:51,396   copying colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:51,399   copying colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:51,404   creating build/lib/colossalai/trainer/hooks
2023-01-09T03:22:51,405   copying colossalai/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/trainer/hooks
2023-01-09T03:22:51,409   copying colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/trainer/hooks
2023-01-09T03:22:51,412   copying colossalai/trainer/hooks/_commons_.py -> build/lib/colossalai/trainer/hooks
2023-01-09T03:22:51,416   copying colossalai/trainer/hooks/_metric_hook.py -> build/lib/colossalai/trainer/hooks
2023-01-09T03:22:51,420   copying colossalai/trainer/hooks/_base_hook.py -> build/lib/colossalai/trainer/hooks
2023-01-09T03:22:51,423   copying colossalai/trainer/hooks/__init__.py -> build/lib/colossalai/trainer/hooks
2023-01-09T03:22:51,427   copying colossalai/trainer/hooks/_log_hook.py -> build/lib/colossalai/trainer/hooks
2023-01-09T03:22:51,432   creating build/lib/colossalai/zero/sharded_param
2023-01-09T03:22:51,434   copying colossalai/zero/sharded_param/sharded_param.py -> build/lib/colossalai/zero/sharded_param
2023-01-09T03:22:51,438   copying colossalai/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/zero/sharded_param
2023-01-09T03:22:51,441   copying colossalai/zero/sharded_param/__init__.py -> build/lib/colossalai/zero/sharded_param
2023-01-09T03:22:51,445   creating build/lib/colossalai/zero/init_ctx
2023-01-09T03:22:51,447   copying colossalai/zero/init_ctx/__init__.py -> build/lib/colossalai/zero/init_ctx
2023-01-09T03:22:51,451   copying colossalai/zero/init_ctx/init_context.py -> build/lib/colossalai/zero/init_ctx
2023-01-09T03:22:51,457   creating build/lib/colossalai/zero/sharded_model
2023-01-09T03:22:51,459   copying colossalai/zero/sharded_model/_utils.py -> build/lib/colossalai/zero/sharded_model
2023-01-09T03:22:51,462   copying colossalai/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/zero/sharded_model
2023-01-09T03:22:51,467   copying colossalai/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/zero/sharded_model
2023-01-09T03:22:51,472   copying colossalai/zero/sharded_model/utils.py -> build/lib/colossalai/zero/sharded_model
2023-01-09T03:22:51,475   copying colossalai/zero/sharded_model/__init__.py -> build/lib/colossalai/zero/sharded_model
2023-01-09T03:22:51,480   creating build/lib/colossalai/zero/sharded_optim
2023-01-09T03:22:51,481   copying colossalai/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/zero/sharded_optim
2023-01-09T03:22:51,487   copying colossalai/zero/sharded_optim/_utils.py -> build/lib/colossalai/zero/sharded_optim
2023-01-09T03:22:51,491   copying colossalai/zero/sharded_optim/low_level_optim.py -> build/lib/colossalai/zero/sharded_optim
2023-01-09T03:22:51,496   copying colossalai/zero/sharded_optim/__init__.py -> build/lib/colossalai/zero/sharded_optim
2023-01-09T03:22:51,500   creating build/lib/colossalai/zero/shard_utils
2023-01-09T03:22:51,502   copying colossalai/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-01-09T03:22:51,506   copying colossalai/zero/shard_utils/commons.py -> build/lib/colossalai/zero/shard_utils
2023-01-09T03:22:51,509   copying colossalai/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-01-09T03:22:51,513   copying colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-01-09T03:22:51,516   copying colossalai/zero/shard_utils/__init__.py -> build/lib/colossalai/zero/shard_utils
2023-01-09T03:22:51,520   creating build/lib/colossalai/zero/utils
2023-01-09T03:22:51,522   copying colossalai/zero/utils/zero_hook.py -> build/lib/colossalai/zero/utils
2023-01-09T03:22:51,526   copying colossalai/zero/utils/gemini_hook.py -> build/lib/colossalai/zero/utils
2023-01-09T03:22:51,530   copying colossalai/zero/utils/__init__.py -> build/lib/colossalai/zero/utils
2023-01-09T03:22:51,534   creating build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:51,536   copying colossalai/zero/sharded_optim/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:51,539   copying colossalai/zero/sharded_optim/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:51,543   copying colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:51,546   copying colossalai/zero/sharded_optim/bookkeeping/base_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:51,549   copying colossalai/zero/sharded_optim/bookkeeping/__init__.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:51,553   copying colossalai/zero/sharded_optim/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:51,558   creating build/lib/colossalai/auto_parallel/passes
2023-01-09T03:22:51,559   copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-01-09T03:22:51,563   copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-01-09T03:22:51,567   copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes
2023-01-09T03:22:51,571   copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-01-09T03:22:51,575   copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes
2023-01-09T03:22:51,580   copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes
2023-01-09T03:22:51,584   creating build/lib/colossalai/auto_parallel/tensor_shard
2023-01-09T03:22:51,585   copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-01-09T03:22:51,589   copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-01-09T03:22:51,593   copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-01-09T03:22:51,596   copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-01-09T03:22:51,601   creating build/lib/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:51,603   copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:51,608   copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:51,611   copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:51,615   copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:51,618   copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:51,621   copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:51,627   creating build/lib/colossalai/auto_parallel/meta_profiler
2023-01-09T03:22:51,628   copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-01-09T03:22:51,632   copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-01-09T03:22:51,635   copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-01-09T03:22:51,639   copying colossalai/auto_parallel/meta_profiler/metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-01-09T03:22:51,643   creating build/lib/colossalai/auto_parallel/pipeline_shard
2023-01-09T03:22:51,644   copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard
2023-01-09T03:22:51,649   creating build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:51,651   copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:51,655   copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:51,659   copying colossalai/auto_parallel/tensor_shard/solver/options.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:51,662   copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:51,666   copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:51,670   copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:51,676   creating build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:51,678   copying colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:51,682   copying colossalai/auto_parallel/tensor_shard/deprecated/_utils.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:51,687   copying colossalai/auto_parallel/tensor_shard/deprecated/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:51,690   copying colossalai/auto_parallel/tensor_shard/deprecated/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:51,695   copying colossalai/auto_parallel/tensor_shard/deprecated/options.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:51,698   copying colossalai/auto_parallel/tensor_shard/deprecated/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:51,701   copying colossalai/auto_parallel/tensor_shard/deprecated/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:51,705   copying colossalai/auto_parallel/tensor_shard/deprecated/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:51,709   copying colossalai/auto_parallel/tensor_shard/deprecated/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:51,716   creating build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:51,717   copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:51,721   copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:51,725   copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:51,729   copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:51,733   copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:51,736   copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:51,743   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,745   copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,749   copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,752   copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,756   copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,760   copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,764   copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,768   copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,772   copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,775   copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,780   copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,783   copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,787   copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,791   copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,794   copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,799   copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,802   copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,806   copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,810   copying colossalai/auto_parallel/tensor_shard/node_handler/reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,813   copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,816   copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,820   copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,823   copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,827   copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:51,833   creating build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,834   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/dot_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,840   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,844   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,849   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/bcast_op_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,855   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,859   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,864   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,868   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,871   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,875   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,880   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,886   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:51,892   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:51,894   copying colossalai/auto_parallel/tensor_shard/node_handler/experimental/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:51,899   copying colossalai/auto_parallel/tensor_shard/node_handler/experimental/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:51,902   copying colossalai/auto_parallel/tensor_shard/node_handler/experimental/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:51,905   copying colossalai/auto_parallel/tensor_shard/node_handler/experimental/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:51,909   copying colossalai/auto_parallel/tensor_shard/node_handler/experimental/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:51,912   copying colossalai/auto_parallel/tensor_shard/node_handler/experimental/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:51,918   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,920   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,925   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,930   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,934   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,938   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,941   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,945   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,949   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,953   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,958   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,962   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,969   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,973   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,978   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,984   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,990   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:51,995   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:52,000   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:52,004   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:52,012   creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:52,014   copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:52,019   copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:52,024   copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:52,029   copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:52,034   copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:52,038   copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:52,042   copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:52,048   creating build/lib/colossalai/utils/data_sampler
2023-01-09T03:22:52,050   copying colossalai/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/utils/data_sampler
2023-01-09T03:22:52,055   copying colossalai/utils/data_sampler/__init__.py -> build/lib/colossalai/utils/data_sampler
2023-01-09T03:22:52,059   copying colossalai/utils/data_sampler/base_sampler.py -> build/lib/colossalai/utils/data_sampler
2023-01-09T03:22:52,064   creating build/lib/colossalai/utils/profiler
2023-01-09T03:22:52,067   copying colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/utils/profiler
2023-01-09T03:22:52,071   copying colossalai/utils/profiler/profiler.py -> build/lib/colossalai/utils/profiler
2023-01-09T03:22:52,077   copying colossalai/utils/profiler/extention.py -> build/lib/colossalai/utils/profiler
2023-01-09T03:22:52,081   copying colossalai/utils/profiler/__init__.py -> build/lib/colossalai/utils/profiler
2023-01-09T03:22:52,089   creating build/lib/colossalai/utils/checkpoint_io
2023-01-09T03:22:52,092   copying colossalai/utils/checkpoint_io/constant.py -> build/lib/colossalai/utils/checkpoint_io
2023-01-09T03:22:52,096   copying colossalai/utils/checkpoint_io/reader.py -> build/lib/colossalai/utils/checkpoint_io
2023-01-09T03:22:52,101   copying colossalai/utils/checkpoint_io/distributed.py -> build/lib/colossalai/utils/checkpoint_io
2023-01-09T03:22:52,106   copying colossalai/utils/checkpoint_io/backend.py -> build/lib/colossalai/utils/checkpoint_io
2023-01-09T03:22:52,110   copying colossalai/utils/checkpoint_io/utils.py -> build/lib/colossalai/utils/checkpoint_io
2023-01-09T03:22:52,114   copying colossalai/utils/checkpoint_io/convertor.py -> build/lib/colossalai/utils/checkpoint_io
2023-01-09T03:22:52,119   copying colossalai/utils/checkpoint_io/io.py -> build/lib/colossalai/utils/checkpoint_io
2023-01-09T03:22:52,124   copying colossalai/utils/checkpoint_io/meta.py -> build/lib/colossalai/utils/checkpoint_io
2023-01-09T03:22:52,128   copying colossalai/utils/checkpoint_io/__init__.py -> build/lib/colossalai/utils/checkpoint_io
2023-01-09T03:22:52,131   copying colossalai/utils/checkpoint_io/writer.py -> build/lib/colossalai/utils/checkpoint_io
2023-01-09T03:22:52,137   creating build/lib/colossalai/utils/checkpoint
2023-01-09T03:22:52,138   copying colossalai/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/utils/checkpoint
2023-01-09T03:22:52,143   copying colossalai/utils/checkpoint/utils.py -> build/lib/colossalai/utils/checkpoint
2023-01-09T03:22:52,146   copying colossalai/utils/checkpoint/__init__.py -> build/lib/colossalai/utils/checkpoint
2023-01-09T03:22:52,151   creating build/lib/colossalai/utils/rank_recorder
2023-01-09T03:22:52,153   copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder
2023-01-09T03:22:52,157   copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder
2023-01-09T03:22:52,161   creating build/lib/colossalai/utils/multi_tensor_apply
2023-01-09T03:22:52,163   copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-01-09T03:22:52,167   copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-01-09T03:22:52,171   creating build/lib/colossalai/utils/tensor_detector
2023-01-09T03:22:52,173   copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector
2023-01-09T03:22:52,178   copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector
2023-01-09T03:22:52,182   creating build/lib/colossalai/utils/model
2023-01-09T03:22:52,184   copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model
2023-01-09T03:22:52,188   copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model
2023-01-09T03:22:52,191   copying colossalai/utils/model/colo_init_context.py -> build/lib/colossalai/utils/model
2023-01-09T03:22:52,195   copying colossalai/utils/model/lazy_init_context.py -> build/lib/colossalai/utils/model
2023-01-09T03:22:52,201   creating build/lib/colossalai/utils/profiler/legacy
2023-01-09T03:22:52,202   copying colossalai/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/utils/profiler/legacy
2023-01-09T03:22:52,207   copying colossalai/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/utils/profiler/legacy
2023-01-09T03:22:52,211   copying colossalai/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/utils/profiler/legacy
2023-01-09T03:22:52,215   copying colossalai/utils/profiler/legacy/__init__.py -> build/lib/colossalai/utils/profiler/legacy
2023-01-09T03:22:52,220   creating build/lib/colossalai/kernel/cuda_native
2023-01-09T03:22:52,221   copying colossalai/kernel/cuda_native/scaled_softmax.py -> build/lib/colossalai/kernel/cuda_native
2023-01-09T03:22:52,226   copying colossalai/kernel/cuda_native/multihead_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-01-09T03:22:52,231   copying colossalai/kernel/cuda_native/flash_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-01-09T03:22:52,236   copying colossalai/kernel/cuda_native/layer_norm.py -> build/lib/colossalai/kernel/cuda_native
2023-01-09T03:22:52,239   copying colossalai/kernel/cuda_native/__init__.py -> build/lib/colossalai/kernel/cuda_native
2023-01-09T03:22:52,245   creating build/lib/colossalai/kernel/op_builder
2023-01-09T03:22:52,246   copying colossalai/kernel/op_builder/moe.py -> build/lib/colossalai/kernel/op_builder
2023-01-09T03:22:52,250   copying colossalai/kernel/op_builder/layernorm.py -> build/lib/colossalai/kernel/op_builder
2023-01-09T03:22:52,254   copying colossalai/kernel/op_builder/cpu_adam.py -> build/lib/colossalai/kernel/op_builder
2023-01-09T03:22:52,258   copying colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-01-09T03:22:52,261   copying colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-01-09T03:22:52,265   copying colossalai/kernel/op_builder/utils.py -> build/lib/colossalai/kernel/op_builder
2023-01-09T03:22:52,268   copying colossalai/kernel/op_builder/multi_head_attn.py -> build/lib/colossalai/kernel/op_builder
2023-01-09T03:22:52,271   copying colossalai/kernel/op_builder/__init__.py -> build/lib/colossalai/kernel/op_builder
2023-01-09T03:22:52,274   copying colossalai/kernel/op_builder/builder.py -> build/lib/colossalai/kernel/op_builder
2023-01-09T03:22:52,278   copying colossalai/kernel/op_builder/fused_optim.py -> build/lib/colossalai/kernel/op_builder
2023-01-09T03:22:52,283   creating build/lib/colossalai/kernel/jit
2023-01-09T03:22:52,284   copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit
2023-01-09T03:22:52,288   copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit
2023-01-09T03:22:52,291   copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit
2023-01-09T03:22:52,294   copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit
2023-01-09T03:22:52,332   creating build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,334   copying colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,339   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,344   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,348   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,353   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,360   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,365   copying colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,369   copying colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,374   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,379   copying colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,384   copying colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,390   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,394   copying colossalai/kernel/cuda_native/csrc/compat.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,398   copying colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,403   copying colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,408   copying colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,412   copying colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,415   copying colossalai/kernel/cuda_native/csrc/type_shim.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,420   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,427   copying colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,431   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,437   copying colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,443   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:52,449   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels
2023-01-09T03:22:52,450   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,451   copying colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,456   copying colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,460   copying colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,465   copying colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,471   copying colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,475   copying colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,479   copying colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,484   copying colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,488   copying colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,492   copying colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,495   copying colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,499   copying colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:52,804   /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
2023-01-09T03:22:52,805     setuptools.SetuptoolsDeprecationWarning,
2023-01-09T03:22:52,899   installing to build/bdist.linux-armv7l/wheel
2023-01-09T03:22:52,900   running install
2023-01-09T03:22:52,961   running install_lib
2023-01-09T03:22:53,059   creating build/bdist.linux-armv7l
2023-01-09T03:22:53,060   creating build/bdist.linux-armv7l/wheel
2023-01-09T03:22:53,064   creating build/bdist.linux-armv7l/wheel/colossalai
2023-01-09T03:22:53,068   creating build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-01-09T03:22:53,070   copying build/lib/colossalai/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-01-09T03:22:53,075   copying build/lib/colossalai/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-01-09T03:22:53,080   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-01-09T03:22:53,082   copying build/lib/colossalai/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-01-09T03:22:53,085   copying build/lib/colossalai/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-01-09T03:22:53,089   copying build/lib/colossalai/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-01-09T03:22:53,092   copying build/lib/colossalai/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-01-09T03:22:53,096   copying build/lib/colossalai/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-01-09T03:22:53,101   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-01-09T03:22:53,103   copying build/lib/colossalai/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-01-09T03:22:53,107   copying build/lib/colossalai/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-01-09T03:22:53,112   copying build/lib/colossalai/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-01-09T03:22:53,117   copying build/lib/colossalai/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-01-09T03:22:53,121   copying build/lib/colossalai/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-01-09T03:22:53,125   copying build/lib/colossalai/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-01-09T03:22:53,129   copying build/lib/colossalai/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-01-09T03:22:53,134   copying build/lib/colossalai/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-01-09T03:22:53,139   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-01-09T03:22:53,141   copying build/lib/colossalai/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-01-09T03:22:53,146   copying build/lib/colossalai/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-01-09T03:22:53,150   copying build/lib/colossalai/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-01-09T03:22:53,155   copying build/lib/colossalai/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-01-09T03:22:53,159   copying build/lib/colossalai/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-01-09T03:22:53,163   copying build/lib/colossalai/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-01-09T03:22:53,167   copying build/lib/colossalai/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-01-09T03:22:53,172   copying build/lib/colossalai/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-01-09T03:22:53,175   copying build/lib/colossalai/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-01-09T03:22:53,180   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-01-09T03:22:53,183   copying build/lib/colossalai/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-01-09T03:22:53,187   copying build/lib/colossalai/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-01-09T03:22:53,191   copying build/lib/colossalai/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-01-09T03:22:53,196   copying build/lib/colossalai/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-01-09T03:22:53,200   copying build/lib/colossalai/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-01-09T03:22:53,204   creating build/bdist.linux-armv7l/wheel/colossalai/context
2023-01-09T03:22:53,206   copying build/lib/colossalai/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-01-09T03:22:53,209   copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-01-09T03:22:53,212   copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-01-09T03:22:53,216   copying build/lib/colossalai/context/moe_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-01-09T03:22:53,221   creating build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-01-09T03:22:53,222   copying build/lib/colossalai/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-01-09T03:22:53,227   copying build/lib/colossalai/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-01-09T03:22:53,231   copying build/lib/colossalai/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-01-09T03:22:53,235   copying build/lib/colossalai/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-01-09T03:22:53,238   copying build/lib/colossalai/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-01-09T03:22:53,241   copying build/lib/colossalai/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-01-09T03:22:53,244   copying build/lib/colossalai/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-01-09T03:22:53,248   copying build/lib/colossalai/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-01-09T03:22:53,251   copying build/lib/colossalai/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-01-09T03:22:53,254   copying build/lib/colossalai/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-01-09T03:22:53,257   copying build/lib/colossalai/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-01-09T03:22:53,261   copying build/lib/colossalai/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-01-09T03:22:53,266   copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-01-09T03:22:53,270   creating build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-01-09T03:22:53,272   copying build/lib/colossalai/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-01-09T03:22:53,276   copying build/lib/colossalai/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-01-09T03:22:53,279   copying build/lib/colossalai/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-01-09T03:22:53,284   creating build/bdist.linux-armv7l/wheel/colossalai/amp
2023-01-09T03:22:53,287   creating build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-01-09T03:22:53,289   copying build/lib/colossalai/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-01-09T03:22:53,292   copying build/lib/colossalai/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-01-09T03:22:53,297   creating build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-01-09T03:22:53,298   copying build/lib/colossalai/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-01-09T03:22:53,303   copying build/lib/colossalai/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-01-09T03:22:53,306   copying build/lib/colossalai/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-01-09T03:22:53,310   copying build/lib/colossalai/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-01-09T03:22:53,313   copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-01-09T03:22:53,317   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-01-09T03:22:53,318   copying build/lib/colossalai/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-01-09T03:22:53,322   copying build/lib/colossalai/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-01-09T03:22:53,327   copying build/lib/colossalai/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-01-09T03:22:53,332   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-01-09T03:22:53,333   copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-01-09T03:22:53,337   copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-01-09T03:22:53,340   copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-01-09T03:22:53,343   copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-01-09T03:22:53,346   copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-01-09T03:22:53,350   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-01-09T03:22:53,351   copying build/lib/colossalai/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-01-09T03:22:53,356   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-01-09T03:22:53,358   copying build/lib/colossalai/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-01-09T03:22:53,365   copying build/lib/colossalai/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-01-09T03:22:53,370   copying build/lib/colossalai/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-01-09T03:22:53,375   copying build/lib/colossalai/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-01-09T03:22:53,381   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-01-09T03:22:53,382   copying build/lib/colossalai/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-01-09T03:22:53,388   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-01-09T03:22:53,389   copying build/lib/colossalai/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-01-09T03:22:53,393   copying build/lib/colossalai/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-01-09T03:22:53,397   copying build/lib/colossalai/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-01-09T03:22:53,400   copying build/lib/colossalai/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-01-09T03:22:53,404   copying build/lib/colossalai/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-01-09T03:22:53,407   copying build/lib/colossalai/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-01-09T03:22:53,411   copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-01-09T03:22:53,415   copying build/lib/colossalai/core.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-01-09T03:22:53,419   creating build/bdist.linux-armv7l/wheel/colossalai/engine
2023-01-09T03:22:53,421   creating build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-01-09T03:22:53,422   copying build/lib/colossalai/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-01-09T03:22:53,426   copying build/lib/colossalai/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-01-09T03:22:53,430   copying build/lib/colossalai/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-01-09T03:22:53,436   copying build/lib/colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-01-09T03:22:53,440   copying build/lib/colossalai/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-01-09T03:22:53,444   creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-01-09T03:22:53,445   copying build/lib/colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-01-09T03:22:53,450   copying build/lib/colossalai/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-01-09T03:22:53,454   copying build/lib/colossalai/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine
2023-01-09T03:22:53,459   creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-01-09T03:22:53,460   copying build/lib/colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-01-09T03:22:53,465   copying build/lib/colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-01-09T03:22:53,469   copying build/lib/colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-01-09T03:22:53,473   copying build/lib/colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-01-09T03:22:53,476   copying build/lib/colossalai/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-01-09T03:22:53,480   copying build/lib/colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-01-09T03:22:53,484   copying build/lib/colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-01-09T03:22:53,488   copying build/lib/colossalai/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-01-09T03:22:53,492   copying build/lib/colossalai/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/engine
2023-01-09T03:22:53,497   creating build/bdist.linux-armv7l/wheel/colossalai/device
2023-01-09T03:22:53,499   copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-01-09T03:22:53,504   copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-01-09T03:22:53,509   copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-01-09T03:22:53,514   copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-01-09T03:22:53,517   copying build/lib/colossalai/constants.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-01-09T03:22:53,522   creating build/bdist.linux-armv7l/wheel/colossalai/cli
2023-01-09T03:22:53,525   creating build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-01-09T03:22:53,527   copying build/lib/colossalai/cli/benchmark/benchmark.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-01-09T03:22:53,532   copying build/lib/colossalai/cli/benchmark/models.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-01-09T03:22:53,535   copying build/lib/colossalai/cli/benchmark/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-01-09T03:22:53,540   copying build/lib/colossalai/cli/benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-01-09T03:22:53,544   creating build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-01-09T03:22:53,547   copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-01-09T03:22:53,551   copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-01-09T03:22:53,555   copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-01-09T03:22:53,560   creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-01-09T03:22:53,562   copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-01-09T03:22:53,566   copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-01-09T03:22:53,570   copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-01-09T03:22:53,574   copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-01-09T03:22:53,577   copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-01-09T03:22:53,581   creating build/bdist.linux-armv7l/wheel/colossalai/fx
2023-01-09T03:22:53,583   creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-01-09T03:22:53,585   copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-01-09T03:22:53,591   copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-01-09T03:22:53,595   creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-01-09T03:22:53,597   copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-01-09T03:22:53,601   copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-01-09T03:22:53,607   creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-01-09T03:22:53,608   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-01-09T03:22:53,613   copying build/lib/colossalai/fx/passes/algorithms/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-01-09T03:22:53,616   copying build/lib/colossalai/fx/passes/algorithms/linearize.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-01-09T03:22:53,620   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_pofo.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-01-09T03:22:53,625   copying build/lib/colossalai/fx/passes/algorithms/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-01-09T03:22:53,629   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-01-09T03:22:53,633   copying build/lib/colossalai/fx/passes/algorithms/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-01-09T03:22:53,636   copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-01-09T03:22:53,640   copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-01-09T03:22:53,644   copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-01-09T03:22:53,648   copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-01-09T03:22:53,652   copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-01-09T03:22:53,655   copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-01-09T03:22:53,660   copying build/lib/colossalai/fx/_meta_registrations.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-01-09T03:22:53,666   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-01-09T03:22:53,668   copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-01-09T03:22:53,671   copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-01-09T03:22:53,675   copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-01-09T03:22:53,678   copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-01-09T03:22:53,683   copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-01-09T03:22:53,688   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-01-09T03:22:53,689   copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-01-09T03:22:53,693   copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-01-09T03:22:53,697   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:53,698   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:53,702   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:53,706   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:53,709   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:53,712   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:53,716   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:53,719   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:53,722   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:53,725   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-01-09T03:22:53,729   copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-01-09T03:22:53,733   copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-01-09T03:22:53,737   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:53,738   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:53,742   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:53,747   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:53,750   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:53,753   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:53,757   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:53,760   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:53,763   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:53,766   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:53,769   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:53,773   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-01-09T03:22:53,776   copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-01-09T03:22:53,780   copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-01-09T03:22:53,785   copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-01-09T03:22:53,789   copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-01-09T03:22:53,793   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-01-09T03:22:53,794   copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-01-09T03:22:53,800   copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-01-09T03:22:53,803   copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-01-09T03:22:53,807   copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-01-09T03:22:53,811   copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-01-09T03:22:53,817   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-01-09T03:22:53,819   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:53,821   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:53,825   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:53,828   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:53,832   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:53,835   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:53,838   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:53,841   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:53,844   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-01-09T03:22:53,849   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:53,850   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:53,854   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:53,858   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:53,861   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:53,864   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:53,868   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:53,871   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:53,874   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-01-09T03:22:53,878   copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-01-09T03:22:53,881   copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-01-09T03:22:53,885   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-01-09T03:22:53,888   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-01-09T03:22:53,889   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-01-09T03:22:53,893   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-01-09T03:22:53,896   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-01-09T03:22:53,899   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-01-09T03:22:53,902   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-01-09T03:22:53,907   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-01-09T03:22:53,908   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-01-09T03:22:53,912   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-01-09T03:22:53,916   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-01-09T03:22:53,919   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-01-09T03:22:53,922   copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-01-09T03:22:53,925   copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-01-09T03:22:53,928   copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-01-09T03:22:53,932   copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-01-09T03:22:53,935   copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-01-09T03:22:53,939   copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-01-09T03:22:53,943   creating build/bdist.linux-armv7l/wheel/colossalai/builder
2023-01-09T03:22:53,944   copying build/lib/colossalai/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/builder
2023-01-09T03:22:53,947   copying build/lib/colossalai/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/builder
2023-01-09T03:22:53,951   creating build/bdist.linux-armv7l/wheel/colossalai/communication
2023-01-09T03:22:53,953   copying build/lib/colossalai/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-01-09T03:22:53,957   copying build/lib/colossalai/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-01-09T03:22:53,961   copying build/lib/colossalai/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-01-09T03:22:53,965   copying build/lib/colossalai/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-01-09T03:22:53,968   copying build/lib/colossalai/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-01-09T03:22:53,972   copying build/lib/colossalai/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-01-09T03:22:53,976   creating build/bdist.linux-armv7l/wheel/colossalai/logging
2023-01-09T03:22:53,977   copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-01-09T03:22:53,981   copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-01-09T03:22:53,986   creating build/bdist.linux-armv7l/wheel/colossalai/nn
2023-01-09T03:22:53,988   creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-01-09T03:22:53,990   copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-01-09T03:22:53,994   copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-01-09T03:22:53,998   copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-01-09T03:22:54,001   copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-01-09T03:22:54,005   copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-01-09T03:22:54,008   copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-01-09T03:22:54,012   copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-01-09T03:22:54,015   copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-01-09T03:22:54,019   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-01-09T03:22:54,022   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-01-09T03:22:54,023   copying build/lib/colossalai/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-01-09T03:22:54,028   copying build/lib/colossalai/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-01-09T03:22:54,033   copying build/lib/colossalai/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-01-09T03:22:54,037   copying build/lib/colossalai/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-01-09T03:22:54,041   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:54,042   copying build/lib/colossalai/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:54,046   copying build/lib/colossalai/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:54,049   copying build/lib/colossalai/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:54,052   copying build/lib/colossalai/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:54,055   copying build/lib/colossalai/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:54,058   copying build/lib/colossalai/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-01-09T03:22:54,063   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-01-09T03:22:54,065   copying build/lib/colossalai/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-01-09T03:22:54,070   copying build/lib/colossalai/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-01-09T03:22:54,075   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-01-09T03:22:54,076   copying build/lib/colossalai/nn/layer/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-01-09T03:22:54,081   copying build/lib/colossalai/nn/layer/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-01-09T03:22:54,085   copying build/lib/colossalai/nn/layer/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-01-09T03:22:54,089   copying build/lib/colossalai/nn/layer/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-01-09T03:22:54,093   copying build/lib/colossalai/nn/layer/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-01-09T03:22:54,096   copying build/lib/colossalai/nn/layer/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-01-09T03:22:54,102   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-01-09T03:22:54,103   copying build/lib/colossalai/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-01-09T03:22:54,107   copying build/lib/colossalai/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-01-09T03:22:54,113   copying build/lib/colossalai/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-01-09T03:22:54,119   copying build/lib/colossalai/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-01-09T03:22:54,123   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-01-09T03:22:54,125   copying build/lib/colossalai/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-01-09T03:22:54,129   copying build/lib/colossalai/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-01-09T03:22:54,135   copying build/lib/colossalai/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-01-09T03:22:54,141   copying build/lib/colossalai/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-01-09T03:22:54,144   copying build/lib/colossalai/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-01-09T03:22:54,148   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-01-09T03:22:54,150   copying build/lib/colossalai/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-01-09T03:22:54,153   copying build/lib/colossalai/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-01-09T03:22:54,160   copying build/lib/colossalai/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-01-09T03:22:54,165   copying build/lib/colossalai/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-01-09T03:22:54,169   copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-01-09T03:22:54,173   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-01-09T03:22:54,175   copying build/lib/colossalai/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-01-09T03:22:54,179   copying build/lib/colossalai/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-01-09T03:22:54,183   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-01-09T03:22:54,185   copying build/lib/colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-01-09T03:22:54,188   copying build/lib/colossalai/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-01-09T03:22:54,193   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-01-09T03:22:54,194   copying build/lib/colossalai/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-01-09T03:22:54,198   copying build/lib/colossalai/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-01-09T03:22:54,202   copying build/lib/colossalai/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-01-09T03:22:54,206   copying build/lib/colossalai/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-01-09T03:22:54,211   creating build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-01-09T03:22:54,212   copying build/lib/colossalai/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-01-09T03:22:54,216   copying build/lib/colossalai/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-01-09T03:22:54,219   copying build/lib/colossalai/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-01-09T03:22:54,222   copying build/lib/colossalai/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-01-09T03:22:54,226   copying build/lib/colossalai/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-01-09T03:22:54,229   copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-01-09T03:22:54,235   creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,236   copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,240   copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,244   copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,248   copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,251   copying build/lib/colossalai/nn/optimizer/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,255   copying build/lib/colossalai/nn/optimizer/zero_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,259   copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,263   copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,267   copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,271   copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,274   copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,278   copying build/lib/colossalai/nn/optimizer/colossalai_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-01-09T03:22:54,282   creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-01-09T03:22:54,284   copying build/lib/colossalai/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-01-09T03:22:54,288   copying build/lib/colossalai/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-01-09T03:22:54,292   copying build/lib/colossalai/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-01-09T03:22:54,296   copying build/lib/colossalai/nn/loss/loss_moe.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-01-09T03:22:54,300   copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-01-09T03:22:54,303   copying build/lib/colossalai/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-01-09T03:22:54,308   creating build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-01-09T03:22:54,309   copying build/lib/colossalai/nn/_ops/element_wise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-01-09T03:22:54,313   copying build/lib/colossalai/nn/_ops/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-01-09T03:22:54,317   copying build/lib/colossalai/nn/_ops/batch_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-01-09T03:22:54,320   copying build/lib/colossalai/nn/_ops/view.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-01-09T03:22:54,324   copying build/lib/colossalai/nn/_ops/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-01-09T03:22:54,328   copying build/lib/colossalai/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-01-09T03:22:54,331   copying build/lib/colossalai/nn/_ops/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-01-09T03:22:54,335   copying build/lib/colossalai/nn/_ops/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-01-09T03:22:54,338   copying build/lib/colossalai/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-01-09T03:22:54,341   copying build/lib/colossalai/nn/_ops/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-01-09T03:22:54,345   copying build/lib/colossalai/nn/_ops/embedding_bag.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-01-09T03:22:54,349   copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-01-09T03:22:54,352   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-01-09T03:22:54,354   copying build/lib/colossalai/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-01-09T03:22:54,362   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-01-09T03:22:54,363   copying build/lib/colossalai/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-01-09T03:22:54,367   copying build/lib/colossalai/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-01-09T03:22:54,371   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:54,372   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:54,378   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:54,382   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:54,387   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:54,391   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:54,395   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:54,399   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:54,405   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:54,409   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-01-09T03:22:54,413   copying build/lib/colossalai/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-01-09T03:22:54,418   copying build/lib/colossalai/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-01-09T03:22:54,422   copying build/lib/colossalai/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-01-09T03:22:54,427   copying build/lib/colossalai/nn/parallel/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-01-09T03:22:54,431   copying build/lib/colossalai/nn/parallel/gemini_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-01-09T03:22:54,435   copying build/lib/colossalai/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-01-09T03:22:54,440   copying build/lib/colossalai/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-01-09T03:22:54,445   creating build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-01-09T03:22:54,448   creating build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-01-09T03:22:54,450   copying build/lib/colossalai/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-01-09T03:22:54,456   copying build/lib/colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-01-09T03:22:54,459   copying build/lib/colossalai/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-01-09T03:22:54,463   copying build/lib/colossalai/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-01-09T03:22:54,467   copying build/lib/colossalai/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-01-09T03:22:54,471   copying build/lib/colossalai/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-01-09T03:22:54,474   copying build/lib/colossalai/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-01-09T03:22:54,479   copying build/lib/colossalai/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-01-09T03:22:54,483   copying build/lib/colossalai/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-01-09T03:22:54,488   creating build/bdist.linux-armv7l/wheel/colossalai/_C
2023-01-09T03:22:54,490   copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C
2023-01-09T03:22:54,494   creating build/bdist.linux-armv7l/wheel/colossalai/zero
2023-01-09T03:22:54,496   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-01-09T03:22:54,498   copying build/lib/colossalai/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-01-09T03:22:54,502   copying build/lib/colossalai/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-01-09T03:22:54,505   copying build/lib/colossalai/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-01-09T03:22:54,509   creating build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-01-09T03:22:54,511   copying build/lib/colossalai/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-01-09T03:22:54,514   copying build/lib/colossalai/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-01-09T03:22:54,520   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-01-09T03:22:54,522   copying build/lib/colossalai/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-01-09T03:22:54,526   copying build/lib/colossalai/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-01-09T03:22:54,531   copying build/lib/colossalai/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-01-09T03:22:54,537   copying build/lib/colossalai/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-01-09T03:22:54,540   copying build/lib/colossalai/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-01-09T03:22:54,545   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-01-09T03:22:54,546   copying build/lib/colossalai/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-01-09T03:22:54,551   copying build/lib/colossalai/zero/sharded_optim/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-01-09T03:22:54,556   copying build/lib/colossalai/zero/sharded_optim/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-01-09T03:22:54,561   copying build/lib/colossalai/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-01-09T03:22:54,565   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:54,566   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:54,570   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:54,574   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:54,577   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:54,581   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:54,585   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-01-09T03:22:54,589   creating build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-01-09T03:22:54,590   copying build/lib/colossalai/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-01-09T03:22:54,594   copying build/lib/colossalai/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-01-09T03:22:54,598   copying build/lib/colossalai/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-01-09T03:22:54,601   copying build/lib/colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-01-09T03:22:54,604   copying build/lib/colossalai/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-01-09T03:22:54,608   copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero
2023-01-09T03:22:54,613   creating build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-01-09T03:22:54,615   copying build/lib/colossalai/zero/utils/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-01-09T03:22:54,619   copying build/lib/colossalai/zero/utils/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-01-09T03:22:54,623   copying build/lib/colossalai/zero/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-01-09T03:22:54,627   copying build/lib/colossalai/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-01-09T03:22:54,631   copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-01-09T03:22:54,638   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-01-09T03:22:54,641   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-01-09T03:22:54,643   copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-01-09T03:22:54,648   copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-01-09T03:22:54,653   copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-01-09T03:22:54,657   copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-01-09T03:22:54,663   copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-01-09T03:22:54,668   copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-01-09T03:22:54,672   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-01-09T03:22:54,676   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:54,678   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:54,682   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:54,687   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:54,690   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:54,694   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:54,698   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-01-09T03:22:54,702   copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-01-09T03:22:54,706   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:54,707   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:54,712   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:54,716   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:54,720   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,722   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/dot_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,728   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,731   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,737   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/bcast_op_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,743   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,747   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,751   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,755   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,759   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,762   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,766   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,772   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-01-09T03:22:54,776   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:54,781   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:54,785   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:54,788   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:54,792   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:54,796   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-01-09T03:22:54,802   copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-01-09T03:22:54,806   copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-01-09T03:22:54,809   copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-01-09T03:22:54,814   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:54,816   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:54,820   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:54,824   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:54,827   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:54,832   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:54,835   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-01-09T03:22:54,841   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:54,842   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:54,847   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:54,850   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:54,855   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:54,857   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:54,862   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:54,865   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:54,868   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:54,872   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:54,875   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/experimental/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/experimental
2023-01-09T03:22:54,879   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,881   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,885   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,890   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,894   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,897   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,901   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,905   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,908   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,912   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,916   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,920   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,927   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,931   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,935   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,940   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,944   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,949   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,953   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,956   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-01-09T03:22:54,960   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:54,963   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:54,968   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:54,971   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:54,975   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:54,980   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:54,984   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:54,988   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,001   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,004   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,008   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,012   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,015   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,019   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,022   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,026   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,029   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,032   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,036   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,040   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-01-09T03:22:55,044   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:55,045   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:55,050   copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:55,054   copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:55,057   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:55,061   copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:55,064   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-01-09T03:22:55,069   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-01-09T03:22:55,070   copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-01-09T03:22:55,074   copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-01-09T03:22:55,078   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:55,079   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:55,084   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:55,088   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:55,092   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:55,096   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:55,099   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:55,102   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-01-09T03:22:55,106   copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-01-09T03:22:55,110   copying build/lib/colossalai/auto_parallel/meta_profiler/metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-01-09T03:22:55,113   copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-01-09T03:22:55,117   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-01-09T03:22:55,118   copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-01-09T03:22:55,121   copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-01-09T03:22:55,125   creating build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,127   copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,131   copying build/lib/colossalai/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,134   copying build/lib/colossalai/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,138   copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,142   copying build/lib/colossalai/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,145   copying build/lib/colossalai/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,149   copying build/lib/colossalai/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,153   copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,158   copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,161   copying build/lib/colossalai/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,165   copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,169   copying build/lib/colossalai/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,172   copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,177   copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,181   copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-01-09T03:22:55,184   copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-01-09T03:22:55,189   creating build/bdist.linux-armv7l/wheel/colossalai/utils
2023-01-09T03:22:55,191   creating build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-01-09T03:22:55,193   copying build/lib/colossalai/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-01-09T03:22:55,197   copying build/lib/colossalai/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-01-09T03:22:55,201   copying build/lib/colossalai/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-01-09T03:22:55,204   copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-01-09T03:22:55,208   copying build/lib/colossalai/utils/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-01-09T03:22:55,211   copying build/lib/colossalai/utils/cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-01-09T03:22:55,214   copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-01-09T03:22:55,219   creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-01-09T03:22:55,221   copying build/lib/colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-01-09T03:22:55,224   copying build/lib/colossalai/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-01-09T03:22:55,229   copying build/lib/colossalai/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-01-09T03:22:55,233   creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-01-09T03:22:55,234   copying build/lib/colossalai/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-01-09T03:22:55,239   copying build/lib/colossalai/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-01-09T03:22:55,243   copying build/lib/colossalai/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-01-09T03:22:55,247   copying build/lib/colossalai/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-01-09T03:22:55,250   copying build/lib/colossalai/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-01-09T03:22:55,253   copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-01-09T03:22:55,259   creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-01-09T03:22:55,260   copying build/lib/colossalai/utils/checkpoint_io/constant.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-01-09T03:22:55,264   copying build/lib/colossalai/utils/checkpoint_io/reader.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-01-09T03:22:55,268   copying build/lib/colossalai/utils/checkpoint_io/distributed.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-01-09T03:22:55,273   copying build/lib/colossalai/utils/checkpoint_io/backend.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-01-09T03:22:55,277   copying build/lib/colossalai/utils/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-01-09T03:22:55,281   copying build/lib/colossalai/utils/checkpoint_io/convertor.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-01-09T03:22:55,286   copying build/lib/colossalai/utils/checkpoint_io/io.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-01-09T03:22:55,291   copying build/lib/colossalai/utils/checkpoint_io/meta.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-01-09T03:22:55,295   copying build/lib/colossalai/utils/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-01-09T03:22:55,299   copying build/lib/colossalai/utils/checkpoint_io/writer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-01-09T03:22:55,304   creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-01-09T03:22:55,306   copying build/lib/colossalai/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-01-09T03:22:55,310   copying build/lib/colossalai/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-01-09T03:22:55,314   copying build/lib/colossalai/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-01-09T03:22:55,318   creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-01-09T03:22:55,319   copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-01-09T03:22:55,323   copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-01-09T03:22:55,327   creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-01-09T03:22:55,329   copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-01-09T03:22:55,332   copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-01-09T03:22:55,335   copying build/lib/colossalai/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-01-09T03:22:55,339   copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-01-09T03:22:55,343   creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-01-09T03:22:55,345   copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-01-09T03:22:55,349   copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-01-09T03:22:55,353   creating build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-01-09T03:22:55,354   copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-01-09T03:22:55,358   copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-01-09T03:22:55,361   copying build/lib/colossalai/utils/model/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-01-09T03:22:55,365   copying build/lib/colossalai/utils/model/lazy_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-01-09T03:22:55,369   copying build/lib/colossalai/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-01-09T03:22:55,374   creating build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-01-09T03:22:55,376   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-01-09T03:22:55,379   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,382   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels
2023-01-09T03:22:55,385   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,387   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,391   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,394   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,397   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,401   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,405   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,408   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,412   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,416   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,419   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,423   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,426   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-01-09T03:22:55,429   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,434   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,437   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,440   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,444   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,449   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,452   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,456   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,460   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,464   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,469   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,473   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,476   copying build/lib/colossalai/kernel/cuda_native/csrc/compat.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,479   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,484   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,489   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,493   copying build/lib/colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,496   copying build/lib/colossalai/kernel/cuda_native/csrc/type_shim.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,500   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,505   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,510   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,515   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,522   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-01-09T03:22:55,527   copying build/lib/colossalai/kernel/cuda_native/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-01-09T03:22:55,531   copying build/lib/colossalai/kernel/cuda_native/multihead_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-01-09T03:22:55,535   copying build/lib/colossalai/kernel/cuda_native/flash_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-01-09T03:22:55,541   copying build/lib/colossalai/kernel/cuda_native/layer_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-01-09T03:22:55,544   copying build/lib/colossalai/kernel/cuda_native/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-01-09T03:22:55,548   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-01-09T03:22:55,550   copying build/lib/colossalai/kernel/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-01-09T03:22:55,553   copying build/lib/colossalai/kernel/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-01-09T03:22:55,557   copying build/lib/colossalai/kernel/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-01-09T03:22:55,560   copying build/lib/colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-01-09T03:22:55,563   copying build/lib/colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-01-09T03:22:55,567   copying build/lib/colossalai/kernel/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-01-09T03:22:55,570   copying build/lib/colossalai/kernel/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-01-09T03:22:55,573   copying build/lib/colossalai/kernel/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-01-09T03:22:55,577   copying build/lib/colossalai/kernel/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-01-09T03:22:55,581   copying build/lib/colossalai/kernel/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-01-09T03:22:55,584   copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-01-09T03:22:55,588   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-01-09T03:22:55,590   copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-01-09T03:22:55,594   copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-01-09T03:22:55,598   copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-01-09T03:22:55,601   copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-01-09T03:22:55,605   creating build/bdist.linux-armv7l/wheel/colossalai/registry
2023-01-09T03:22:55,606   copying build/lib/colossalai/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/registry
2023-01-09T03:22:55,610   copying build/lib/colossalai/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/registry
2023-01-09T03:22:55,614   creating build/bdist.linux-armv7l/wheel/colossalai/testing
2023-01-09T03:22:55,615   copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-01-09T03:22:55,619   copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-01-09T03:22:55,622   copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-01-09T03:22:55,627   copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-01-09T03:22:55,630   copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-01-09T03:22:55,634   creating build/bdist.linux-armv7l/wheel/op_builder
2023-01-09T03:22:55,636   copying build/lib/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-01-09T03:22:55,639   copying build/lib/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-01-09T03:22:55,643   copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-01-09T03:22:55,646   copying build/lib/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-01-09T03:22:55,649   copying build/lib/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-01-09T03:22:55,653   copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-01-09T03:22:55,656   copying build/lib/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-01-09T03:22:55,659   copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-01-09T03:22:55,663   copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-01-09T03:22:55,667   copying build/lib/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-01-09T03:22:55,670   running install_egg_info
2023-01-09T03:22:55,901   running egg_info
2023-01-09T03:22:55,993   writing colossalai.egg-info/PKG-INFO
2023-01-09T03:22:55,998   writing dependency_links to colossalai.egg-info/dependency_links.txt
2023-01-09T03:22:56,002   writing entry points to colossalai.egg-info/entry_points.txt
2023-01-09T03:22:56,004   writing requirements to colossalai.egg-info/requires.txt
2023-01-09T03:22:56,007   writing top-level names to colossalai.egg-info/top_level.txt
2023-01-09T03:22:56,308   reading manifest file 'colossalai.egg-info/SOURCES.txt'
2023-01-09T03:22:56,381   reading manifest template 'MANIFEST.in'
2023-01-09T03:22:58,469   warning: no files found matching '*.tr' under directory 'colossalai'
2023-01-09T03:22:59,540   warning: no files found matching '*.cc' under directory 'colossalai'
2023-01-09T03:23:00,084   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-01-09T03:23:00,102   adding license file 'LICENSE'
2023-01-09T03:23:00,197   writing manifest file 'colossalai.egg-info/SOURCES.txt'
2023-01-09T03:23:00,203   Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.2.0-py3.7.egg-info
2023-01-09T03:23:00,230   running install_scripts
2023-01-09T03:23:00,417   adding license file "LICENSE" (matched pattern "LICEN[CS]E*")
2023-01-09T03:23:00,426   creating build/bdist.linux-armv7l/wheel/colossalai-0.2.0.dist-info/WHEEL
2023-01-09T03:23:00,431   creating '/tmp/pip-wheel-z917ezed/colossalai-0.2.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2023-01-09T03:23:00,436   adding 'colossalai/__init__.py'
2023-01-09T03:23:00,439   adding 'colossalai/constants.py'
2023-01-09T03:23:00,441   adding 'colossalai/core.py'
2023-01-09T03:23:00,443   adding 'colossalai/global_variables.py'
2023-01-09T03:23:00,449   adding 'colossalai/initialize.py'
2023-01-09T03:23:00,451   adding 'colossalai/version.py'
2023-01-09T03:23:00,454   adding 'colossalai/_C/__init__.py'
2023-01-09T03:23:00,458   adding 'colossalai/amp/__init__.py'
2023-01-09T03:23:00,460   adding 'colossalai/amp/amp_type.py'
2023-01-09T03:23:00,463   adding 'colossalai/amp/apex_amp/__init__.py'
2023-01-09T03:23:00,466   adding 'colossalai/amp/apex_amp/apex_amp.py'
2023-01-09T03:23:00,470   adding 'colossalai/amp/naive_amp/__init__.py'
2023-01-09T03:23:00,474   adding 'colossalai/amp/naive_amp/_fp16_optimizer.py'
2023-01-09T03:23:00,477   adding 'colossalai/amp/naive_amp/_utils.py'
2023-01-09T03:23:00,481   adding 'colossalai/amp/naive_amp/naive_amp.py'
2023-01-09T03:23:00,485   adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py'
2023-01-09T03:23:00,489   adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py'
2023-01-09T03:23:00,491   adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py'
2023-01-09T03:23:00,494   adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py'
2023-01-09T03:23:00,497   adding 'colossalai/amp/torch_amp/__init__.py'
2023-01-09T03:23:00,505   adding 'colossalai/amp/torch_amp/_grad_scaler.py'
2023-01-09T03:23:00,508   adding 'colossalai/amp/torch_amp/torch_amp.py'
2023-01-09T03:23:00,512   adding 'colossalai/auto_parallel/__init__.py'
2023-01-09T03:23:00,515   adding 'colossalai/auto_parallel/checkpoint/__init__.py'
2023-01-09T03:23:00,517   adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py'
2023-01-09T03:23:00,521   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py'
2023-01-09T03:23:00,524   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py'
2023-01-09T03:23:00,532   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py'
2023-01-09T03:23:00,535   adding 'colossalai/auto_parallel/checkpoint/operation.py'
2023-01-09T03:23:00,538   adding 'colossalai/auto_parallel/meta_profiler/__init__.py'
2023-01-09T03:23:00,540   adding 'colossalai/auto_parallel/meta_profiler/constants.py'
2023-01-09T03:23:00,543   adding 'colossalai/auto_parallel/meta_profiler/metainfo.py'
2023-01-09T03:23:00,545   adding 'colossalai/auto_parallel/meta_profiler/registry.py'
2023-01-09T03:23:00,548   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py'
2023-01-09T03:23:00,551   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py'
2023-01-09T03:23:00,554   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py'
2023-01-09T03:23:00,557   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py'
2023-01-09T03:23:00,560   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py'
2023-01-09T03:23:00,563   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py'
2023-01-09T03:23:00,567   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py'
2023-01-09T03:23:00,571   adding 'colossalai/auto_parallel/passes/__init__.py'
2023-01-09T03:23:00,575   adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py'
2023-01-09T03:23:00,578   adding 'colossalai/auto_parallel/passes/constants.py'
2023-01-09T03:23:00,581   adding 'colossalai/auto_parallel/passes/meta_info_prop.py'
2023-01-09T03:23:00,585   adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py'
2023-01-09T03:23:00,591   adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py'
2023-01-09T03:23:00,594   adding 'colossalai/auto_parallel/pipeline_shard/__init__.py'
2023-01-09T03:23:00,598   adding 'colossalai/auto_parallel/tensor_shard/__init__.py'
2023-01-09T03:23:00,600   adding 'colossalai/auto_parallel/tensor_shard/constants.py'
2023-01-09T03:23:00,604   adding 'colossalai/auto_parallel/tensor_shard/initialize.py'
2023-01-09T03:23:00,608   adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py'
2023-01-09T03:23:00,612   adding 'colossalai/auto_parallel/tensor_shard/deprecated/__init__.py'
2023-01-09T03:23:00,615   adding 'colossalai/auto_parallel/tensor_shard/deprecated/_utils.py'
2023-01-09T03:23:00,617   adding 'colossalai/auto_parallel/tensor_shard/deprecated/constants.py'
2023-01-09T03:23:00,621   adding 'colossalai/auto_parallel/tensor_shard/deprecated/cost_graph.py'
2023-01-09T03:23:00,624   adding 'colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py'
2023-01-09T03:23:00,626   adding 'colossalai/auto_parallel/tensor_shard/deprecated/options.py'
2023-01-09T03:23:00,629   adding 'colossalai/auto_parallel/tensor_shard/deprecated/sharding_strategy.py'
2023-01-09T03:23:00,634   adding 'colossalai/auto_parallel/tensor_shard/deprecated/solver.py'
2023-01-09T03:23:00,640   adding 'colossalai/auto_parallel/tensor_shard/deprecated/strategies_constructor.py'
2023-01-09T03:23:00,643   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/__init__.py'
2023-01-09T03:23:00,649   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/batch_norm_handler.py'
2023-01-09T03:23:00,654   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/bcast_op_handler.py'
2023-01-09T03:23:00,661   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py'
2023-01-09T03:23:00,667   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/dot_handler.py'
2023-01-09T03:23:00,671   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py'
2023-01-09T03:23:00,675   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py'
2023-01-09T03:23:00,678   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py'
2023-01-09T03:23:00,681   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py'
2023-01-09T03:23:00,684   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/strategy_generator.py'
2023-01-09T03:23:00,687   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py'
2023-01-09T03:23:00,690   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/where_handler.py'
2023-01-09T03:23:00,694   adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py'
2023-01-09T03:23:00,697   adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py'
2023-01-09T03:23:00,700   adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py'
2023-01-09T03:23:00,702   adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py'
2023-01-09T03:23:00,705   adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py'
2023-01-09T03:23:00,708   adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py'
2023-01-09T03:23:00,712   adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py'
2023-01-09T03:23:00,714   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py'
2023-01-09T03:23:00,717   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py'
2023-01-09T03:23:00,719   adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py'
2023-01-09T03:23:00,723   adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py'
2023-01-09T03:23:00,729   adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py'
2023-01-09T03:23:00,734   adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py'
2023-01-09T03:23:00,736   adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py'
2023-01-09T03:23:00,739   adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py'
2023-01-09T03:23:00,741   adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py'
2023-01-09T03:23:00,744   adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py'
2023-01-09T03:23:00,746   adding 'colossalai/auto_parallel/tensor_shard/node_handler/reshape_handler.py'
2023-01-09T03:23:00,749   adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py'
2023-01-09T03:23:00,751   adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py'
2023-01-09T03:23:00,754   adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py'
2023-01-09T03:23:00,756   adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py'
2023-01-09T03:23:00,759   adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py'
2023-01-09T03:23:00,762   adding 'colossalai/auto_parallel/tensor_shard/node_handler/experimental/__init__.py'
2023-01-09T03:23:00,765   adding 'colossalai/auto_parallel/tensor_shard/node_handler/experimental/permute_handler.py'
2023-01-09T03:23:00,769   adding 'colossalai/auto_parallel/tensor_shard/node_handler/experimental/reshape_generator.py'
2023-01-09T03:23:00,771   adding 'colossalai/auto_parallel/tensor_shard/node_handler/experimental/split_handler.py'
2023-01-09T03:23:00,774   adding 'colossalai/auto_parallel/tensor_shard/node_handler/experimental/transpose_handler.py'
2023-01-09T03:23:00,776   adding 'colossalai/auto_parallel/tensor_shard/node_handler/experimental/view_handler.py'
2023-01-09T03:23:00,780   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py'
2023-01-09T03:23:00,784   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py'
2023-01-09T03:23:00,787   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py'
2023-01-09T03:23:00,792   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py'
2023-01-09T03:23:00,796   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py'
2023-01-09T03:23:00,799   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py'
2023-01-09T03:23:00,802   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py'
2023-01-09T03:23:00,805   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py'
2023-01-09T03:23:00,812   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py'
2023-01-09T03:23:00,816   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py'
2023-01-09T03:23:00,819   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py'
2023-01-09T03:23:00,821   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py'
2023-01-09T03:23:00,824   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py'
2023-01-09T03:23:00,828   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py'
2023-01-09T03:23:00,832   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py'
2023-01-09T03:23:00,835   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py'
2023-01-09T03:23:00,838   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py'
2023-01-09T03:23:00,840   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py'
2023-01-09T03:23:00,843   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py'
2023-01-09T03:23:00,847   adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py'
2023-01-09T03:23:00,850   adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py'
2023-01-09T03:23:00,854   adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py'
2023-01-09T03:23:00,856   adding 'colossalai/auto_parallel/tensor_shard/solver/options.py'
2023-01-09T03:23:00,861   adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py'
2023-01-09T03:23:00,865   adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py'
2023-01-09T03:23:00,869   adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py'
2023-01-09T03:23:00,872   adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py'
2023-01-09T03:23:00,875   adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py'
2023-01-09T03:23:00,878   adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py'
2023-01-09T03:23:00,881   adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py'
2023-01-09T03:23:00,884   adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py'
2023-01-09T03:23:00,887   adding 'colossalai/builder/__init__.py'
2023-01-09T03:23:00,890   adding 'colossalai/builder/builder.py'
2023-01-09T03:23:00,893   adding 'colossalai/cli/__init__.py'
2023-01-09T03:23:00,895   adding 'colossalai/cli/cli.py'
2023-01-09T03:23:00,899   adding 'colossalai/cli/benchmark/__init__.py'
2023-01-09T03:23:00,901   adding 'colossalai/cli/benchmark/benchmark.py'
2023-01-09T03:23:00,904   adding 'colossalai/cli/benchmark/models.py'
2023-01-09T03:23:00,907   adding 'colossalai/cli/benchmark/utils.py'
2023-01-09T03:23:00,910   adding 'colossalai/cli/check/__init__.py'
2023-01-09T03:23:00,913   adding 'colossalai/cli/check/check_installation.py'
2023-01-09T03:23:00,917   adding 'colossalai/cli/launcher/__init__.py'
2023-01-09T03:23:00,920   adding 'colossalai/cli/launcher/hostinfo.py'
2023-01-09T03:23:00,923   adding 'colossalai/cli/launcher/multinode_runner.py'
2023-01-09T03:23:00,927   adding 'colossalai/cli/launcher/run.py'
2023-01-09T03:23:00,930   adding 'colossalai/communication/__init__.py'
2023-01-09T03:23:00,934   adding 'colossalai/communication/collective.py'
2023-01-09T03:23:00,938   adding 'colossalai/communication/p2p.py'
2023-01-09T03:23:00,942   adding 'colossalai/communication/p2p_v2.py'
2023-01-09T03:23:00,945   adding 'colossalai/communication/ring.py'
2023-01-09T03:23:00,948   adding 'colossalai/communication/utils.py'
2023-01-09T03:23:00,952   adding 'colossalai/context/__init__.py'
2023-01-09T03:23:00,954   adding 'colossalai/context/config.py'
2023-01-09T03:23:00,957   adding 'colossalai/context/moe_context.py'
2023-01-09T03:23:00,963   adding 'colossalai/context/parallel_context.py'
2023-01-09T03:23:00,966   adding 'colossalai/context/parallel_mode.py'
2023-01-09T03:23:00,969   adding 'colossalai/context/singleton_meta.py'
2023-01-09T03:23:00,972   adding 'colossalai/context/process_group_initializer/__init__.py'
2023-01-09T03:23:00,975   adding 'colossalai/context/process_group_initializer/initializer_1d.py'
2023-01-09T03:23:00,978   adding 'colossalai/context/process_group_initializer/initializer_2d.py'
2023-01-09T03:23:00,981   adding 'colossalai/context/process_group_initializer/initializer_2p5d.py'
2023-01-09T03:23:00,985   adding 'colossalai/context/process_group_initializer/initializer_3d.py'
2023-01-09T03:23:00,987   adding 'colossalai/context/process_group_initializer/initializer_data.py'
2023-01-09T03:23:00,990   adding 'colossalai/context/process_group_initializer/initializer_model.py'
2023-01-09T03:23:00,992   adding 'colossalai/context/process_group_initializer/initializer_pipeline.py'
2023-01-09T03:23:00,995   adding 'colossalai/context/process_group_initializer/initializer_sequence.py'
2023-01-09T03:23:00,998   adding 'colossalai/context/process_group_initializer/initializer_tensor.py'
2023-01-09T03:23:01,000   adding 'colossalai/context/process_group_initializer/process_group_initializer.py'
2023-01-09T03:23:01,003   adding 'colossalai/context/random/__init__.py'
2023-01-09T03:23:01,006   adding 'colossalai/context/random/_helper.py'
2023-01-09T03:23:01,009   adding 'colossalai/context/random/seed_manager.py'
2023-01-09T03:23:01,012   adding 'colossalai/device/__init__.py'
2023-01-09T03:23:01,017   adding 'colossalai/device/alpha_beta_profiler.py'
2023-01-09T03:23:01,020   adding 'colossalai/device/calc_pipeline_strategy.py'
2023-01-09T03:23:01,024   adding 'colossalai/device/device_mesh.py'
2023-01-09T03:23:01,028   adding 'colossalai/engine/__init__.py'
2023-01-09T03:23:01,031   adding 'colossalai/engine/_base_engine.py'
2023-01-09T03:23:01,035   adding 'colossalai/engine/gradient_accumulation/__init__.py'
2023-01-09T03:23:01,039   adding 'colossalai/engine/gradient_accumulation/_gradient_accumulation.py'
2023-01-09T03:23:01,042   adding 'colossalai/engine/gradient_handler/__init__.py'
2023-01-09T03:23:01,044   adding 'colossalai/engine/gradient_handler/_base_gradient_handler.py'
2023-01-09T03:23:01,047   adding 'colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py'
2023-01-09T03:23:01,049   adding 'colossalai/engine/gradient_handler/_moe_gradient_handler.py'
2023-01-09T03:23:01,052   adding 'colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py'
2023-01-09T03:23:01,054   adding 'colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py'
2023-01-09T03:23:01,057   adding 'colossalai/engine/gradient_handler/_zero_gradient_handler.py'
2023-01-09T03:23:01,059   adding 'colossalai/engine/gradient_handler/utils.py'
2023-01-09T03:23:01,062   adding 'colossalai/engine/schedule/__init__.py'
2023-01-09T03:23:01,065   adding 'colossalai/engine/schedule/_base_schedule.py'
2023-01-09T03:23:01,068   adding 'colossalai/engine/schedule/_non_pipeline_schedule.py'
2023-01-09T03:23:01,077   adding 'colossalai/engine/schedule/_pipeline_schedule.py'
2023-01-09T03:23:01,081   adding 'colossalai/engine/schedule/_pipeline_schedule_v2.py'
2023-01-09T03:23:01,085   adding 'colossalai/fx/__init__.py'
2023-01-09T03:23:01,087   adding 'colossalai/fx/_compatibility.py'
2023-01-09T03:23:01,092   adding 'colossalai/fx/_meta_registrations.py'
2023-01-09T03:23:01,096   adding 'colossalai/fx/graph_module.py'
2023-01-09T03:23:01,099   adding 'colossalai/fx/proxy.py'
2023-01-09T03:23:01,102   adding 'colossalai/fx/codegen/__init__.py'
2023-01-09T03:23:01,112   adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py'
2023-01-09T03:23:01,117   adding 'colossalai/fx/passes/__init__.py'
2023-01-09T03:23:01,120   adding 'colossalai/fx/passes/adding_split_node_pass.py'
2023-01-09T03:23:01,124   adding 'colossalai/fx/passes/concrete_info_prop.py'
2023-01-09T03:23:01,128   adding 'colossalai/fx/passes/meta_info_prop.py'
2023-01-09T03:23:01,133   adding 'colossalai/fx/passes/passes_for_gpt2_test.py'
2023-01-09T03:23:01,137   adding 'colossalai/fx/passes/shard_1d_pass.py'
2023-01-09T03:23:01,141   adding 'colossalai/fx/passes/split_module.py'
2023-01-09T03:23:01,144   adding 'colossalai/fx/passes/utils.py'
2023-01-09T03:23:01,148   adding 'colossalai/fx/passes/algorithms/__init__.py'
2023-01-09T03:23:01,151   adding 'colossalai/fx/passes/algorithms/build_c_ext.py'
2023-01-09T03:23:01,154   adding 'colossalai/fx/passes/algorithms/ckpt_solver_chen.py'
2023-01-09T03:23:01,160   adding 'colossalai/fx/passes/algorithms/ckpt_solver_pofo.py'
2023-01-09T03:23:01,165   adding 'colossalai/fx/passes/algorithms/ckpt_solver_rotor.py'
2023-01-09T03:23:01,170   adding 'colossalai/fx/passes/algorithms/linearize.py'
2023-01-09T03:23:01,174   adding 'colossalai/fx/passes/algorithms/operation.py'
2023-01-09T03:23:01,177   adding 'colossalai/fx/profiler/__init__.py'
2023-01-09T03:23:01,180   adding 'colossalai/fx/profiler/constants.py'
2023-01-09T03:23:01,183   adding 'colossalai/fx/profiler/dataflow.py'
2023-01-09T03:23:01,185   adding 'colossalai/fx/profiler/memory_utils.py'
2023-01-09T03:23:01,189   adding 'colossalai/fx/profiler/opcount.py'
2023-01-09T03:23:01,194   adding 'colossalai/fx/profiler/profiler.py'
2023-01-09T03:23:01,197   adding 'colossalai/fx/profiler/shard_utils.py'
2023-01-09T03:23:01,200   adding 'colossalai/fx/profiler/tensor.py'
2023-01-09T03:23:01,203   adding 'colossalai/fx/profiler/experimental/__init__.py'
2023-01-09T03:23:01,205   adding 'colossalai/fx/profiler/experimental/constants.py'
2023-01-09T03:23:01,209   adding 'colossalai/fx/profiler/experimental/profiler.py'
2023-01-09T03:23:01,211   adding 'colossalai/fx/profiler/experimental/registry.py'
2023-01-09T03:23:01,213   adding 'colossalai/fx/profiler/experimental/shard_utils.py'
2023-01-09T03:23:01,217   adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py'
2023-01-09T03:23:01,219   adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py'
2023-01-09T03:23:01,221   adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py'
2023-01-09T03:23:01,224   adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py'
2023-01-09T03:23:01,226   adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py'
2023-01-09T03:23:01,228   adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py'
2023-01-09T03:23:01,231   adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py'
2023-01-09T03:23:01,233   adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py'
2023-01-09T03:23:01,235   adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py'
2023-01-09T03:23:01,239   adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py'
2023-01-09T03:23:01,241   adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py'
2023-01-09T03:23:01,243   adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py'
2023-01-09T03:23:01,246   adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py'
2023-01-09T03:23:01,248   adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py'
2023-01-09T03:23:01,251   adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py'
2023-01-09T03:23:01,253   adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py'
2023-01-09T03:23:01,255   adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py'
2023-01-09T03:23:01,257   adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py'
2023-01-09T03:23:01,260   adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py'
2023-01-09T03:23:01,262   adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py'
2023-01-09T03:23:01,265   adding 'colossalai/fx/tracer/__init__.py'
2023-01-09T03:23:01,268   adding 'colossalai/fx/tracer/_meta_trace.py'
2023-01-09T03:23:01,271   adding 'colossalai/fx/tracer/_symbolic_trace.py'
2023-01-09T03:23:01,273   adding 'colossalai/fx/tracer/_tracer_utils.py'
2023-01-09T03:23:01,280   adding 'colossalai/fx/tracer/experimental.py'
2023-01-09T03:23:01,283   adding 'colossalai/fx/tracer/registry.py'
2023-01-09T03:23:01,290   adding 'colossalai/fx/tracer/tracer.py'
2023-01-09T03:23:01,294   adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py'
2023-01-09T03:23:01,297   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py'
2023-01-09T03:23:01,299   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py'
2023-01-09T03:23:01,302   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py'
2023-01-09T03:23:01,304   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py'
2023-01-09T03:23:01,307   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py'
2023-01-09T03:23:01,310   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py'
2023-01-09T03:23:01,313   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py'
2023-01-09T03:23:01,315   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py'
2023-01-09T03:23:01,318   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py'
2023-01-09T03:23:01,321   adding 'colossalai/fx/tracer/meta_patch/__init__.py'
2023-01-09T03:23:01,324   adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py'
2023-01-09T03:23:01,326   adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py'
2023-01-09T03:23:01,329   adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py'
2023-01-09T03:23:01,331   adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py'
2023-01-09T03:23:01,334   adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py'
2023-01-09T03:23:01,336   adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py'
2023-01-09T03:23:01,338   adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py'
2023-01-09T03:23:01,341   adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py'
2023-01-09T03:23:01,345   adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py'
2023-01-09T03:23:01,371   adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py'
2023-01-09T03:23:01,373   adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py'
2023-01-09T03:23:01,376   adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py'
2023-01-09T03:23:01,378   adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py'
2023-01-09T03:23:01,380   adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py'
2023-01-09T03:23:01,383   adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py'
2023-01-09T03:23:01,385   adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py'
2023-01-09T03:23:01,388   adding 'colossalai/gemini/__init__.py'
2023-01-09T03:23:01,391   adding 'colossalai/gemini/gemini_context.py'
2023-01-09T03:23:01,394   adding 'colossalai/gemini/gemini_mgr.py'
2023-01-09T03:23:01,397   adding 'colossalai/gemini/placement_policy.py'
2023-01-09T03:23:01,401   adding 'colossalai/gemini/stateful_tensor.py'
2023-01-09T03:23:01,403   adding 'colossalai/gemini/stateful_tensor_mgr.py'
2023-01-09T03:23:01,406   adding 'colossalai/gemini/tensor_placement_policy.py'
2023-01-09T03:23:01,409   adding 'colossalai/gemini/tensor_utils.py'
2023-01-09T03:23:01,412   adding 'colossalai/gemini/chunk/__init__.py'
2023-01-09T03:23:01,418   adding 'colossalai/gemini/chunk/chunk.py'
2023-01-09T03:23:01,422   adding 'colossalai/gemini/chunk/manager.py'
2023-01-09T03:23:01,425   adding 'colossalai/gemini/chunk/search_utils.py'
2023-01-09T03:23:01,428   adding 'colossalai/gemini/chunk/utils.py'
2023-01-09T03:23:01,431   adding 'colossalai/gemini/memory_tracer/__init__.py'
2023-01-09T03:23:01,433   adding 'colossalai/gemini/memory_tracer/chunk_memstats_collector.py'
2023-01-09T03:23:01,436   adding 'colossalai/gemini/memory_tracer/memory_monitor.py'
2023-01-09T03:23:01,439   adding 'colossalai/gemini/memory_tracer/memory_stats.py'
2023-01-09T03:23:01,441   adding 'colossalai/gemini/memory_tracer/memstats_collector.py'
2023-01-09T03:23:01,444   adding 'colossalai/gemini/memory_tracer/param_runtime_order.py'
2023-01-09T03:23:01,446   adding 'colossalai/gemini/memory_tracer/runtime_mem_tracer.py'
2023-01-09T03:23:01,449   adding 'colossalai/gemini/memory_tracer/static_memstats_collector.py'
2023-01-09T03:23:01,451   adding 'colossalai/gemini/memory_tracer/utils.py'
2023-01-09T03:23:01,454   adding 'colossalai/gemini/ophooks/__init__.py'
2023-01-09T03:23:01,457   adding 'colossalai/gemini/ophooks/_shard_grad_ophook.py'
2023-01-09T03:23:01,459   adding 'colossalai/gemini/ophooks/_shard_param_ophook.py'
2023-01-09T03:23:01,462   adding 'colossalai/gemini/ophooks/runtime_mem_tracer_hook.py'
2023-01-09T03:23:01,465   adding 'colossalai/gemini/ophooks/utils.py'
2023-01-09T03:23:01,468   adding 'colossalai/gemini/paramhooks/__init__.py'
2023-01-09T03:23:01,470   adding 'colossalai/gemini/paramhooks/_param_hookmgr.py'
2023-01-09T03:23:01,473   adding 'colossalai/kernel/__init__.py'
2023-01-09T03:23:01,477   adding 'colossalai/kernel/cuda_native/__init__.py'
2023-01-09T03:23:01,482   adding 'colossalai/kernel/cuda_native/flash_attention.py'
2023-01-09T03:23:01,484   adding 'colossalai/kernel/cuda_native/layer_norm.py'
2023-01-09T03:23:01,488   adding 'colossalai/kernel/cuda_native/multihead_attention.py'
2023-01-09T03:23:01,491   adding 'colossalai/kernel/cuda_native/scaled_softmax.py'
2023-01-09T03:23:01,496   adding 'colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp'
2023-01-09T03:23:01,498   adding 'colossalai/kernel/cuda_native/csrc/compat.h'
2023-01-09T03:23:01,502   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.cpp'
2023-01-09T03:23:01,505   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.h'
2023-01-09T03:23:01,508   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp'
2023-01-09T03:23:01,515   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu'
2023-01-09T03:23:01,518   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda.cpp'
2023-01-09T03:23:01,523   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu'
2023-01-09T03:23:01,527   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu'
2023-01-09T03:23:01,530   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh'
2023-01-09T03:23:01,534   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu'
2023-01-09T03:23:01,538   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu'
2023-01-09T03:23:01,541   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu'
2023-01-09T03:23:01,544   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu'
2023-01-09T03:23:01,549   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp'
2023-01-09T03:23:01,552   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h'
2023-01-09T03:23:01,554   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp'
2023-01-09T03:23:01,559   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h'
2023-01-09T03:23:01,562   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu'
2023-01-09T03:23:01,564   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp'
2023-01-09T03:23:01,569   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h'
2023-01-09T03:23:01,572   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu'
2023-01-09T03:23:01,576   adding 'colossalai/kernel/cuda_native/csrc/type_shim.h'
2023-01-09T03:23:01,581   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h'
2023-01-09T03:23:01,584   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/context.h'
2023-01-09T03:23:01,586   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h'
2023-01-09T03:23:01,588   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h'
2023-01-09T03:23:01,590   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h'
2023-01-09T03:23:01,593   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h'
2023-01-09T03:23:01,595   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h'
2023-01-09T03:23:01,599   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h'
2023-01-09T03:23:01,601   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh'
2023-01-09T03:23:01,603   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h'
2023-01-09T03:23:01,606   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h'
2023-01-09T03:23:01,608   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h'
2023-01-09T03:23:01,612   adding 'colossalai/kernel/jit/__init__.py'
2023-01-09T03:23:01,614   adding 'colossalai/kernel/jit/bias_dropout_add.py'
2023-01-09T03:23:01,616   adding 'colossalai/kernel/jit/bias_gelu.py'
2023-01-09T03:23:01,618   adding 'colossalai/kernel/jit/option.py'
2023-01-09T03:23:01,622   adding 'colossalai/kernel/op_builder/__init__.py'
2023-01-09T03:23:01,625   adding 'colossalai/kernel/op_builder/builder.py'
2023-01-09T03:23:01,628   adding 'colossalai/kernel/op_builder/cpu_adam.py'
2023-01-09T03:23:01,630   adding 'colossalai/kernel/op_builder/fused_optim.py'
2023-01-09T03:23:01,632   adding 'colossalai/kernel/op_builder/layernorm.py'
2023-01-09T03:23:01,634   adding 'colossalai/kernel/op_builder/moe.py'
2023-01-09T03:23:01,637   adding 'colossalai/kernel/op_builder/multi_head_attn.py'
2023-01-09T03:23:01,639   adding 'colossalai/kernel/op_builder/scaled_masked_softmax.py'
2023-01-09T03:23:01,641   adding 'colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py'
2023-01-09T03:23:01,643   adding 'colossalai/kernel/op_builder/utils.py'
2023-01-09T03:23:01,647   adding 'colossalai/logging/__init__.py'
2023-01-09T03:23:01,650   adding 'colossalai/logging/logger.py'
2023-01-09T03:23:01,654   adding 'colossalai/nn/__init__.py'
2023-01-09T03:23:01,657   adding 'colossalai/nn/init.py'
2023-01-09T03:23:01,661   adding 'colossalai/nn/_ops/__init__.py'
2023-01-09T03:23:01,664   adding 'colossalai/nn/_ops/_utils.py'
2023-01-09T03:23:01,667   adding 'colossalai/nn/_ops/addmm.py'
2023-01-09T03:23:01,669   adding 'colossalai/nn/_ops/batch_norm.py'
2023-01-09T03:23:01,672   adding 'colossalai/nn/_ops/element_wise.py'
2023-01-09T03:23:01,675   adding 'colossalai/nn/_ops/embedding.py'
2023-01-09T03:23:01,678   adding 'colossalai/nn/_ops/embedding_bag.py'
2023-01-09T03:23:01,681   adding 'colossalai/nn/_ops/layernorm.py'
2023-01-09T03:23:01,684   adding 'colossalai/nn/_ops/linear.py'
2023-01-09T03:23:01,687   adding 'colossalai/nn/_ops/loss.py'
2023-01-09T03:23:01,690   adding 'colossalai/nn/_ops/view.py'
2023-01-09T03:23:01,693   adding 'colossalai/nn/layer/__init__.py'
2023-01-09T03:23:01,695   adding 'colossalai/nn/layer/base_layer.py'
2023-01-09T03:23:01,699   adding 'colossalai/nn/layer/colossalai_layer/__init__.py'
2023-01-09T03:23:01,701   adding 'colossalai/nn/layer/colossalai_layer/_utils.py'
2023-01-09T03:23:01,703   adding 'colossalai/nn/layer/colossalai_layer/dropout.py'
2023-01-09T03:23:01,706   adding 'colossalai/nn/layer/colossalai_layer/embedding.py'
2023-01-09T03:23:01,709   adding 'colossalai/nn/layer/colossalai_layer/linear.py'
2023-01-09T03:23:01,711   adding 'colossalai/nn/layer/colossalai_layer/normalization.py'
2023-01-09T03:23:01,715   adding 'colossalai/nn/layer/moe/__init__.py'
2023-01-09T03:23:01,717   adding 'colossalai/nn/layer/moe/_operation.py'
2023-01-09T03:23:01,720   adding 'colossalai/nn/layer/moe/experts.py'
2023-01-09T03:23:01,724   adding 'colossalai/nn/layer/moe/layers.py'
2023-01-09T03:23:01,728   adding 'colossalai/nn/layer/moe/routers.py'
2023-01-09T03:23:01,731   adding 'colossalai/nn/layer/moe/utils.py'
2023-01-09T03:23:01,734   adding 'colossalai/nn/layer/parallel_1d/__init__.py'
2023-01-09T03:23:01,737   adding 'colossalai/nn/layer/parallel_1d/_operation.py'
2023-01-09T03:23:01,740   adding 'colossalai/nn/layer/parallel_1d/_utils.py'
2023-01-09T03:23:01,748   adding 'colossalai/nn/layer/parallel_1d/layers.py'
2023-01-09T03:23:01,752   adding 'colossalai/nn/layer/parallel_2d/__init__.py'
2023-01-09T03:23:01,759   adding 'colossalai/nn/layer/parallel_2d/_operation.py'
2023-01-09T03:23:01,762   adding 'colossalai/nn/layer/parallel_2d/_utils.py'
2023-01-09T03:23:01,770   adding 'colossalai/nn/layer/parallel_2d/layers.py'
2023-01-09T03:23:01,774   adding 'colossalai/nn/layer/parallel_2p5d/__init__.py'
2023-01-09T03:23:01,781   adding 'colossalai/nn/layer/parallel_2p5d/_operation.py'
2023-01-09T03:23:01,784   adding 'colossalai/nn/layer/parallel_2p5d/_utils.py'
2023-01-09T03:23:01,792   adding 'colossalai/nn/layer/parallel_2p5d/layers.py'
2023-01-09T03:23:01,796   adding 'colossalai/nn/layer/parallel_3d/__init__.py'
2023-01-09T03:23:01,801   adding 'colossalai/nn/layer/parallel_3d/_operation.py'
2023-01-09T03:23:01,804   adding 'colossalai/nn/layer/parallel_3d/_utils.py'
2023-01-09T03:23:01,812   adding 'colossalai/nn/layer/parallel_3d/layers.py'
2023-01-09T03:23:01,817   adding 'colossalai/nn/layer/parallel_sequence/__init__.py'
2023-01-09T03:23:01,819   adding 'colossalai/nn/layer/parallel_sequence/_operation.py'
2023-01-09T03:23:01,822   adding 'colossalai/nn/layer/parallel_sequence/_utils.py'
2023-01-09T03:23:01,825   adding 'colossalai/nn/layer/parallel_sequence/layers.py'
2023-01-09T03:23:01,829   adding 'colossalai/nn/layer/utils/__init__.py'
2023-01-09T03:23:01,831   adding 'colossalai/nn/layer/utils/common.py'
2023-01-09T03:23:01,834   adding 'colossalai/nn/layer/vanilla/__init__.py'
2023-01-09T03:23:01,839   adding 'colossalai/nn/layer/vanilla/layers.py'
2023-01-09T03:23:01,842   adding 'colossalai/nn/layer/wrapper/__init__.py'
2023-01-09T03:23:01,844   adding 'colossalai/nn/layer/wrapper/pipeline_wrapper.py'
2023-01-09T03:23:01,848   adding 'colossalai/nn/loss/__init__.py'
2023-01-09T03:23:01,851   adding 'colossalai/nn/loss/loss_1d.py'
2023-01-09T03:23:01,854   adding 'colossalai/nn/loss/loss_2d.py'
2023-01-09T03:23:01,857   adding 'colossalai/nn/loss/loss_2p5d.py'
2023-01-09T03:23:01,860   adding 'colossalai/nn/loss/loss_3d.py'
2023-01-09T03:23:01,862   adding 'colossalai/nn/loss/loss_moe.py'
2023-01-09T03:23:01,866   adding 'colossalai/nn/lr_scheduler/__init__.py'
2023-01-09T03:23:01,869   adding 'colossalai/nn/lr_scheduler/cosine.py'
2023-01-09T03:23:01,871   adding 'colossalai/nn/lr_scheduler/delayed.py'
2023-01-09T03:23:01,874   adding 'colossalai/nn/lr_scheduler/linear.py'
2023-01-09T03:23:01,876   adding 'colossalai/nn/lr_scheduler/multistep.py'
2023-01-09T03:23:01,879   adding 'colossalai/nn/lr_scheduler/onecycle.py'
2023-01-09T03:23:01,882   adding 'colossalai/nn/lr_scheduler/poly.py'
2023-01-09T03:23:01,884   adding 'colossalai/nn/lr_scheduler/torch.py'
2023-01-09T03:23:01,887   adding 'colossalai/nn/metric/__init__.py'
2023-01-09T03:23:01,889   adding 'colossalai/nn/metric/_utils.py'
2023-01-09T03:23:01,891   adding 'colossalai/nn/metric/accuracy_2d.py'
2023-01-09T03:23:01,894   adding 'colossalai/nn/metric/accuracy_2p5d.py'
2023-01-09T03:23:01,896   adding 'colossalai/nn/metric/accuracy_3d.py'
2023-01-09T03:23:01,899   adding 'colossalai/nn/optimizer/__init__.py'
2023-01-09T03:23:01,901   adding 'colossalai/nn/optimizer/colossalai_optimizer.py'
2023-01-09T03:23:01,904   adding 'colossalai/nn/optimizer/cpu_adam.py'
2023-01-09T03:23:01,908   adding 'colossalai/nn/optimizer/fused_adam.py'
2023-01-09T03:23:01,911   adding 'colossalai/nn/optimizer/fused_lamb.py'
2023-01-09T03:23:01,914   adding 'colossalai/nn/optimizer/fused_sgd.py'
2023-01-09T03:23:01,917   adding 'colossalai/nn/optimizer/gemini_optimizer.py'
2023-01-09T03:23:01,920   adding 'colossalai/nn/optimizer/hybrid_adam.py'
2023-01-09T03:23:01,923   adding 'colossalai/nn/optimizer/lamb.py'
2023-01-09T03:23:01,926   adding 'colossalai/nn/optimizer/lars.py'
2023-01-09T03:23:01,929   adding 'colossalai/nn/optimizer/nvme_optimizer.py'
2023-01-09T03:23:01,933   adding 'colossalai/nn/optimizer/zero_optimizer.py'
2023-01-09T03:23:01,936   adding 'colossalai/nn/parallel/__init__.py'
2023-01-09T03:23:01,943   adding 'colossalai/nn/parallel/data_parallel.py'
2023-01-09T03:23:01,947   adding 'colossalai/nn/parallel/gemini_parallel.py'
2023-01-09T03:23:01,949   adding 'colossalai/nn/parallel/reducer.py'
2023-01-09T03:23:01,952   adding 'colossalai/nn/parallel/utils.py'
2023-01-09T03:23:01,956   adding 'colossalai/nn/parallel/layers/__init__.py'
2023-01-09T03:23:01,959   adding 'colossalai/nn/parallel/layers/colo_module.py'
2023-01-09T03:23:01,961   adding 'colossalai/nn/parallel/layers/embedding.py'
2023-01-09T03:23:01,963   adding 'colossalai/nn/parallel/layers/linear.py'
2023-01-09T03:23:01,966   adding 'colossalai/nn/parallel/layers/module_utils.py'
2023-01-09T03:23:01,969   adding 'colossalai/nn/parallel/layers/cache_embedding/__init__.py'
2023-01-09T03:23:01,971   adding 'colossalai/nn/parallel/layers/cache_embedding/base_embedding.py'
2023-01-09T03:23:01,979   adding 'colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py'
2023-01-09T03:23:01,982   adding 'colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py'
2023-01-09T03:23:01,985   adding 'colossalai/nn/parallel/layers/cache_embedding/copyer.py'
2023-01-09T03:23:01,987   adding 'colossalai/nn/parallel/layers/cache_embedding/embedding_config.py'
2023-01-09T03:23:01,990   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py'
2023-01-09T03:23:01,994   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py'
2023-01-09T03:23:01,998   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py'
2023-01-09T03:23:02,001   adding 'colossalai/pipeline/__init__.py'
2023-01-09T03:23:02,003   adding 'colossalai/pipeline/layer_spec.py'
2023-01-09T03:23:02,007   adding 'colossalai/pipeline/pipelinable.py'
2023-01-09T03:23:02,010   adding 'colossalai/pipeline/pipeline_process_group.py'
2023-01-09T03:23:02,014   adding 'colossalai/pipeline/utils.py'
2023-01-09T03:23:02,017   adding 'colossalai/pipeline/middleware/__init__.py'
2023-01-09T03:23:02,020   adding 'colossalai/pipeline/middleware/topo.py'
2023-01-09T03:23:02,023   adding 'colossalai/pipeline/middleware/adaptor/__init__.py'
2023-01-09T03:23:02,026   adding 'colossalai/pipeline/middleware/adaptor/fx.py'
2023-01-09T03:23:02,030   adding 'colossalai/pipeline/rpc/__init__.py'
2023-01-09T03:23:02,044   adding 'colossalai/pipeline/rpc/_pipeline_base.py'
2023-01-09T03:23:02,049   adding 'colossalai/pipeline/rpc/_pipeline_schedule.py'
2023-01-09T03:23:02,052   adding 'colossalai/pipeline/rpc/utils.py'
2023-01-09T03:23:02,056   adding 'colossalai/registry/__init__.py'
2023-01-09T03:23:02,058   adding 'colossalai/registry/registry.py'
2023-01-09T03:23:02,062   adding 'colossalai/tensor/__init__.py'
2023-01-09T03:23:02,064   adding 'colossalai/tensor/colo_parameter.py'
2023-01-09T03:23:02,069   adding 'colossalai/tensor/colo_tensor.py'
2023-01-09T03:23:02,074   adding 'colossalai/tensor/comm_spec.py'
2023-01-09T03:23:02,077   adding 'colossalai/tensor/compute_spec.py'
2023-01-09T03:23:02,079   adding 'colossalai/tensor/const.py'
2023-01-09T03:23:02,082   adding 'colossalai/tensor/dist_spec_mgr.py'
2023-01-09T03:23:02,085   adding 'colossalai/tensor/distspec.py'
2023-01-09T03:23:02,087   adding 'colossalai/tensor/op_wrapper.py'
2023-01-09T03:23:02,090   adding 'colossalai/tensor/param_op_hook.py'
2023-01-09T03:23:02,094   adding 'colossalai/tensor/process_group.py'
2023-01-09T03:23:02,102   adding 'colossalai/tensor/shape_consistency.py'
2023-01-09T03:23:02,107   adding 'colossalai/tensor/sharding_spec.py'
2023-01-09T03:23:02,109   adding 'colossalai/tensor/tensor_spec.py'
2023-01-09T03:23:02,112   adding 'colossalai/tensor/utils.py'
2023-01-09T03:23:02,116   adding 'colossalai/testing/__init__.py'
2023-01-09T03:23:02,118   adding 'colossalai/testing/comparison.py'
2023-01-09T03:23:02,120   adding 'colossalai/testing/pytest_wrapper.py'
2023-01-09T03:23:02,122   adding 'colossalai/testing/random.py'
2023-01-09T03:23:02,126   adding 'colossalai/testing/utils.py'
2023-01-09T03:23:02,129   adding 'colossalai/trainer/__init__.py'
2023-01-09T03:23:02,133   adding 'colossalai/trainer/_trainer.py'
2023-01-09T03:23:02,137   adding 'colossalai/trainer/hooks/__init__.py'
2023-01-09T03:23:02,139   adding 'colossalai/trainer/hooks/_base_hook.py'
2023-01-09T03:23:02,142   adding 'colossalai/trainer/hooks/_checkpoint_hook.py'
2023-01-09T03:23:02,144   adding 'colossalai/trainer/hooks/_commons_.py'
2023-01-09T03:23:02,148   adding 'colossalai/trainer/hooks/_log_hook.py'
2023-01-09T03:23:02,150   adding 'colossalai/trainer/hooks/_lr_scheduler_hook.py'
2023-01-09T03:23:02,154   adding 'colossalai/trainer/hooks/_metric_hook.py'
2023-01-09T03:23:02,158   adding 'colossalai/utils/__init__.py'
2023-01-09T03:23:02,162   adding 'colossalai/utils/activation_checkpoint.py'
2023-01-09T03:23:02,166   adding 'colossalai/utils/checkpointing.py'
2023-01-09T03:23:02,171   adding 'colossalai/utils/common.py'
2023-01-09T03:23:02,174   adding 'colossalai/utils/cuda.py'
2023-01-09T03:23:02,177   adding 'colossalai/utils/memory.py'
2023-01-09T03:23:02,180   adding 'colossalai/utils/moe.py'
2023-01-09T03:23:02,182   adding 'colossalai/utils/timer.py'
2023-01-09T03:23:02,185   adding 'colossalai/utils/checkpoint/__init__.py'
2023-01-09T03:23:02,188   adding 'colossalai/utils/checkpoint/module_checkpoint.py'
2023-01-09T03:23:02,191   adding 'colossalai/utils/checkpoint/utils.py'
2023-01-09T03:23:02,194   adding 'colossalai/utils/checkpoint_io/__init__.py'
2023-01-09T03:23:02,196   adding 'colossalai/utils/checkpoint_io/backend.py'
2023-01-09T03:23:02,198   adding 'colossalai/utils/checkpoint_io/constant.py'
2023-01-09T03:23:02,202   adding 'colossalai/utils/checkpoint_io/convertor.py'
2023-01-09T03:23:02,205   adding 'colossalai/utils/checkpoint_io/distributed.py'
2023-01-09T03:23:02,208   adding 'colossalai/utils/checkpoint_io/io.py'
2023-01-09T03:23:02,210   adding 'colossalai/utils/checkpoint_io/meta.py'
2023-01-09T03:23:02,213   adding 'colossalai/utils/checkpoint_io/reader.py'
2023-01-09T03:23:02,217   adding 'colossalai/utils/checkpoint_io/utils.py'
2023-01-09T03:23:02,219   adding 'colossalai/utils/checkpoint_io/writer.py'
2023-01-09T03:23:02,223   adding 'colossalai/utils/data_sampler/__init__.py'
2023-01-09T03:23:02,225   adding 'colossalai/utils/data_sampler/base_sampler.py'
2023-01-09T03:23:02,228   adding 'colossalai/utils/data_sampler/data_parallel_sampler.py'
2023-01-09T03:23:02,231   adding 'colossalai/utils/model/__init__.py'
2023-01-09T03:23:02,234   adding 'colossalai/utils/model/colo_init_context.py'
2023-01-09T03:23:02,238   adding 'colossalai/utils/model/lazy_init_context.py'
2023-01-09T03:23:02,241   adding 'colossalai/utils/model/utils.py'
2023-01-09T03:23:02,244   adding 'colossalai/utils/multi_tensor_apply/__init__.py'
2023-01-09T03:23:02,246   adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py'
2023-01-09T03:23:02,250   adding 'colossalai/utils/profiler/__init__.py'
2023-01-09T03:23:02,252   adding 'colossalai/utils/profiler/extention.py'
2023-01-09T03:23:02,255   adding 'colossalai/utils/profiler/profiler.py'
2023-01-09T03:23:02,258   adding 'colossalai/utils/profiler/stateful_tensor_mem_extention.py'
2023-01-09T03:23:02,261   adding 'colossalai/utils/profiler/legacy/__init__.py'
2023-01-09T03:23:02,264   adding 'colossalai/utils/profiler/legacy/comm_profiler.py'
2023-01-09T03:23:02,268   adding 'colossalai/utils/profiler/legacy/pcie_profiler.py'
2023-01-09T03:23:02,270   adding 'colossalai/utils/profiler/legacy/prof_utils.py'
2023-01-09T03:23:02,273   adding 'colossalai/utils/rank_recorder/__init__.py'
2023-01-09T03:23:02,277   adding 'colossalai/utils/rank_recorder/rank_recorder.py'
2023-01-09T03:23:02,280   adding 'colossalai/utils/tensor_detector/__init__.py'
2023-01-09T03:23:02,283   adding 'colossalai/utils/tensor_detector/tensor_detector.py'
2023-01-09T03:23:02,287   adding 'colossalai/zero/__init__.py'
2023-01-09T03:23:02,290   adding 'colossalai/zero/init_ctx/__init__.py'
2023-01-09T03:23:02,294   adding 'colossalai/zero/init_ctx/init_context.py'
2023-01-09T03:23:02,298   adding 'colossalai/zero/shard_utils/__init__.py'
2023-01-09T03:23:02,300   adding 'colossalai/zero/shard_utils/base_shard_strategy.py'
2023-01-09T03:23:02,303   adding 'colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py'
2023-01-09T03:23:02,305   adding 'colossalai/zero/shard_utils/commons.py'
2023-01-09T03:23:02,307   adding 'colossalai/zero/shard_utils/tensor_shard_strategy.py'
2023-01-09T03:23:02,311   adding 'colossalai/zero/sharded_model/__init__.py'
2023-01-09T03:23:02,313   adding 'colossalai/zero/sharded_model/_utils.py'
2023-01-09T03:23:02,317   adding 'colossalai/zero/sharded_model/reduce_scatter.py'
2023-01-09T03:23:02,325   adding 'colossalai/zero/sharded_model/sharded_model_v2.py'
2023-01-09T03:23:02,327   adding 'colossalai/zero/sharded_model/utils.py'
2023-01-09T03:23:02,330   adding 'colossalai/zero/sharded_optim/__init__.py'
2023-01-09T03:23:02,334   adding 'colossalai/zero/sharded_optim/_utils.py'
2023-01-09T03:23:02,341   adding 'colossalai/zero/sharded_optim/low_level_optim.py'
2023-01-09T03:23:02,347   adding 'colossalai/zero/sharded_optim/sharded_optim_v2.py'
2023-01-09T03:23:02,351   adding 'colossalai/zero/sharded_optim/bookkeeping/__init__.py'
2023-01-09T03:23:02,353   adding 'colossalai/zero/sharded_optim/bookkeeping/base_store.py'
2023-01-09T03:23:02,355   adding 'colossalai/zero/sharded_optim/bookkeeping/bucket_store.py'
2023-01-09T03:23:02,357   adding 'colossalai/zero/sharded_optim/bookkeeping/gradient_store.py'
2023-01-09T03:23:02,360   adding 'colossalai/zero/sharded_optim/bookkeeping/parameter_store.py'
2023-01-09T03:23:02,362   adding 'colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py'
2023-01-09T03:23:02,365   adding 'colossalai/zero/sharded_param/__init__.py'
2023-01-09T03:23:02,368   adding 'colossalai/zero/sharded_param/sharded_param.py'
2023-01-09T03:23:02,371   adding 'colossalai/zero/sharded_param/sharded_tensor.py'
2023-01-09T03:23:02,374   adding 'colossalai/zero/utils/__init__.py'
2023-01-09T03:23:02,376   adding 'colossalai/zero/utils/gemini_hook.py'
2023-01-09T03:23:02,379   adding 'colossalai/zero/utils/zero_hook.py'
2023-01-09T03:23:02,385   adding 'op_builder/__init__.py'
2023-01-09T03:23:02,388   adding 'op_builder/builder.py'
2023-01-09T03:23:02,390   adding 'op_builder/cpu_adam.py'
2023-01-09T03:23:02,392   adding 'op_builder/fused_optim.py'
2023-01-09T03:23:02,394   adding 'op_builder/layernorm.py'
2023-01-09T03:23:02,397   adding 'op_builder/moe.py'
2023-01-09T03:23:02,399   adding 'op_builder/multi_head_attn.py'
2023-01-09T03:23:02,401   adding 'op_builder/scaled_masked_softmax.py'
2023-01-09T03:23:02,404   adding 'op_builder/scaled_upper_triangle_masked_softmax.py'
2023-01-09T03:23:02,406   adding 'op_builder/utils.py'
2023-01-09T03:23:02,410   adding 'colossalai-0.2.0.dist-info/LICENSE'
2023-01-09T03:23:02,414   adding 'colossalai-0.2.0.dist-info/METADATA'
2023-01-09T03:23:02,416   adding 'colossalai-0.2.0.dist-info/WHEEL'
2023-01-09T03:23:02,418   adding 'colossalai-0.2.0.dist-info/entry_points.txt'
2023-01-09T03:23:02,420   adding 'colossalai-0.2.0.dist-info/top_level.txt'
2023-01-09T03:23:02,446   adding 'colossalai-0.2.0.dist-info/RECORD'
2023-01-09T03:23:02,501   removing build/bdist.linux-armv7l/wheel
2023-01-09T03:23:03,087   Building wheel for colossalai (setup.py): finished with status 'done'
2023-01-09T03:23:03,121   Created wheel for colossalai: filename=colossalai-0.2.0-py3-none-any.whl size=915060 sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7
2023-01-09T03:23:03,123   Stored in directory: /tmp/pip-ephem-wheel-cache-8hp6p28g/wheels/74/dc/57/ad08747af2d5cb916672e8e20d3eb41e998cd1217a4dd885f4
2023-01-09T03:23:03,203 Successfully built colossalai
2023-01-09T03:23:03,282 Removed build tracker: '/tmp/pip-build-tracker-8426srfw'