2023-02-14T11:55:34,671 Created temporary directory: /tmp/pip-ephem-wheel-cache-_ild5i4p
2023-02-14T11:55:34,675 Created temporary directory: /tmp/pip-build-tracker-6b0zf939
2023-02-14T11:55:34,676 Initialized build tracking at /tmp/pip-build-tracker-6b0zf939
2023-02-14T11:55:34,676 Created build tracker: /tmp/pip-build-tracker-6b0zf939
2023-02-14T11:55:34,677 Entered build tracker: /tmp/pip-build-tracker-6b0zf939
2023-02-14T11:55:34,678 Created temporary directory: /tmp/pip-wheel-p9lyaq4d
2023-02-14T11:55:34,686 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453
2023-02-14T11:55:34,691 Created temporary directory: /tmp/pip-ephem-wheel-cache-rqv9ar_9
2023-02-14T11:55:34,742 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-02-14T11:55:34,749 2 location(s) to search for versions of colossalai:
2023-02-14T11:55:34,749 * https://pypi.org/simple/colossalai/
2023-02-14T11:55:34,749 * https://www.piwheels.org/simple/colossalai/
2023-02-14T11:55:34,750 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/
2023-02-14T11:55:34,751 Getting page https://pypi.org/simple/colossalai/
2023-02-14T11:55:34,754 Found index url https://pypi.org/simple
2023-02-14T11:55:34,985 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json
2023-02-14T11:55:34,990   Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0
2023-02-14T11:55:34,991   Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1
2023-02-14T11:55:34,993   Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2
2023-02-14T11:55:34,994   Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3
2023-02-14T11:55:34,995   Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4
2023-02-14T11:55:34,996 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/
2023-02-14T11:55:34,997 Getting page https://www.piwheels.org/simple/colossalai/
2023-02-14T11:55:34,999 Found index url https://www.piwheels.org/simple
2023-02-14T11:55:35,235 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html
2023-02-14T11:55:35,240   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-02-14T11:55:35,241   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-02-14T11:55:35,241   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-02-14T11:55:35,242   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-02-14T11:55:35,242 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/
2023-02-14T11:55:35,243 Skipping link: not a file: https://pypi.org/simple/colossalai/
2023-02-14T11:55:35,276 Given no hashes to check 1 links for project 'colossalai': discarding no candidates
2023-02-14T11:55:35,306 Collecting colossalai==0.2.4
2023-02-14T11:55:35,311   Created temporary directory: /tmp/pip-unpack-1ni6q4pd
2023-02-14T11:55:35,817   Downloading colossalai-0.2.4.tar.gz (705 kB)
2023-02-14T11:55:39,077   Added colossalai==0.2.4 from https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz to build tracker '/tmp/pip-build-tracker-6b0zf939'
2023-02-14T11:55:39,079   Running setup.py (path:/tmp/pip-wheel-p9lyaq4d/colossalai_44c1423284a84abab2fc02aadd7a52e3/setup.py) egg_info for package colossalai
2023-02-14T11:55:39,081   Created temporary directory: /tmp/pip-pip-egg-info-gxdo4wb_
2023-02-14T11:55:39,082   Preparing metadata (setup.py): started
2023-02-14T11:55:39,084   Running command python setup.py egg_info
2023-02-14T11:55:41,837   running egg_info
2023-02-14T11:55:41,842   creating /tmp/pip-pip-egg-info-gxdo4wb_/colossalai.egg-info
2023-02-14T11:55:41,905   writing /tmp/pip-pip-egg-info-gxdo4wb_/colossalai.egg-info/PKG-INFO
2023-02-14T11:55:41,911   writing dependency_links to /tmp/pip-pip-egg-info-gxdo4wb_/colossalai.egg-info/dependency_links.txt
2023-02-14T11:55:41,914   writing entry points to /tmp/pip-pip-egg-info-gxdo4wb_/colossalai.egg-info/entry_points.txt
2023-02-14T11:55:41,917   writing requirements to /tmp/pip-pip-egg-info-gxdo4wb_/colossalai.egg-info/requires.txt
2023-02-14T11:55:41,919   writing top-level names to /tmp/pip-pip-egg-info-gxdo4wb_/colossalai.egg-info/top_level.txt
2023-02-14T11:55:41,922   writing manifest file '/tmp/pip-pip-egg-info-gxdo4wb_/colossalai.egg-info/SOURCES.txt'
2023-02-14T11:55:42,331   reading manifest file '/tmp/pip-pip-egg-info-gxdo4wb_/colossalai.egg-info/SOURCES.txt'
2023-02-14T11:55:42,334   reading manifest template 'MANIFEST.in'
2023-02-14T11:55:44,352   warning: no files found matching '*.tr' under directory 'colossalai'
2023-02-14T11:55:45,396   warning: no files found matching '*.cc' under directory 'colossalai'
2023-02-14T11:55:45,905   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-02-14T11:55:45,923   adding license file 'LICENSE'
2023-02-14T11:55:45,993   writing manifest file '/tmp/pip-pip-egg-info-gxdo4wb_/colossalai.egg-info/SOURCES.txt'
2023-02-14T11:55:46,199   Preparing metadata (setup.py): finished with status 'done'
2023-02-14T11:55:46,214   Source in /tmp/pip-wheel-p9lyaq4d/colossalai_44c1423284a84abab2fc02aadd7a52e3 has version 0.2.4, which satisfies requirement colossalai==0.2.4 from https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz
2023-02-14T11:55:46,216   Removed colossalai==0.2.4 from https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz from build tracker '/tmp/pip-build-tracker-6b0zf939'
2023-02-14T11:55:46,234 Created temporary directory: /tmp/pip-unpack-sxt__fu_
2023-02-14T11:55:46,235 Building wheels for collected packages: colossalai
2023-02-14T11:55:46,244   Created temporary directory: /tmp/pip-wheel-elrzb79a
2023-02-14T11:55:46,245   Building wheel for colossalai (setup.py): started
2023-02-14T11:55:46,247   Destination directory: /tmp/pip-wheel-elrzb79a
2023-02-14T11:55:46,247   Running command python setup.py bdist_wheel
2023-02-14T11:55:48,949   running bdist_wheel
2023-02-14T11:55:49,694   running build
2023-02-14T11:55:49,694   running build_py
2023-02-14T11:55:49,766   creating build
2023-02-14T11:55:49,766   creating build/lib
2023-02-14T11:55:49,767   creating build/lib/op_builder
2023-02-14T11:55:49,770   copying op_builder/moe.py -> build/lib/op_builder
2023-02-14T11:55:49,773   copying op_builder/__init__.py -> build/lib/op_builder
2023-02-14T11:55:49,775   copying op_builder/builder.py -> build/lib/op_builder
2023-02-14T11:55:49,779   copying op_builder/utils.py -> build/lib/op_builder
2023-02-14T11:55:49,782   copying op_builder/scaled_masked_softmax.py -> build/lib/op_builder
2023-02-14T11:55:49,784   copying op_builder/multi_head_attn.py -> build/lib/op_builder
2023-02-14T11:55:49,787   copying op_builder/layernorm.py -> build/lib/op_builder
2023-02-14T11:55:49,790   copying op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/op_builder
2023-02-14T11:55:49,793   copying op_builder/fused_optim.py -> build/lib/op_builder
2023-02-14T11:55:49,796   copying op_builder/cpu_adam.py -> build/lib/op_builder
2023-02-14T11:55:49,800   creating build/lib/colossalai
2023-02-14T11:55:49,801   copying colossalai/version.py -> build/lib/colossalai
2023-02-14T11:55:49,804   copying colossalai/global_variables.py -> build/lib/colossalai
2023-02-14T11:55:49,807   copying colossalai/__init__.py -> build/lib/colossalai
2023-02-14T11:55:49,811   copying colossalai/core.py -> build/lib/colossalai
2023-02-14T11:55:49,814   copying colossalai/initialize.py -> build/lib/colossalai
2023-02-14T11:55:49,819   copying colossalai/constants.py -> build/lib/colossalai
2023-02-14T11:55:49,823   creating build/lib/colossalai/cli
2023-02-14T11:55:49,824   copying colossalai/cli/__init__.py -> build/lib/colossalai/cli
2023-02-14T11:55:49,827   copying colossalai/cli/cli.py -> build/lib/colossalai/cli
2023-02-14T11:55:49,832   creating build/lib/colossalai/builder
2023-02-14T11:55:49,833   copying colossalai/builder/__init__.py -> build/lib/colossalai/builder
2023-02-14T11:55:49,836   copying colossalai/builder/builder.py -> build/lib/colossalai/builder
2023-02-14T11:55:49,841   creating build/lib/colossalai/amp
2023-02-14T11:55:49,842   copying colossalai/amp/__init__.py -> build/lib/colossalai/amp
2023-02-14T11:55:49,846   copying colossalai/amp/amp_type.py -> build/lib/colossalai/amp
2023-02-14T11:55:49,851   creating build/lib/colossalai/fx
2023-02-14T11:55:49,852   copying colossalai/fx/proxy.py -> build/lib/colossalai/fx
2023-02-14T11:55:49,856   copying colossalai/fx/__init__.py -> build/lib/colossalai/fx
2023-02-14T11:55:49,859   copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx
2023-02-14T11:55:49,862   copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx
2023-02-14T11:55:49,866   copying colossalai/fx/_meta_registrations.py -> build/lib/colossalai/fx
2023-02-14T11:55:49,872   creating build/lib/colossalai/auto_parallel
2023-02-14T11:55:49,873   copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel
2023-02-14T11:55:49,877   creating build/lib/colossalai/_C
2023-02-14T11:55:49,878   copying colossalai/_C/__init__.py -> build/lib/colossalai/_C
2023-02-14T11:55:49,883   creating build/lib/colossalai/gemini
2023-02-14T11:55:49,884   copying colossalai/gemini/stateful_tensor.py -> build/lib/colossalai/gemini
2023-02-14T11:55:49,888   copying colossalai/gemini/tensor_utils.py -> build/lib/colossalai/gemini
2023-02-14T11:55:49,892   copying colossalai/gemini/__init__.py -> build/lib/colossalai/gemini
2023-02-14T11:55:49,895   copying colossalai/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/gemini
2023-02-14T11:55:49,899   copying colossalai/gemini/tensor_placement_policy.py -> build/lib/colossalai/gemini
2023-02-14T11:55:49,903   copying colossalai/gemini/placement_policy.py -> build/lib/colossalai/gemini
2023-02-14T11:55:49,907   copying colossalai/gemini/gemini_context.py -> build/lib/colossalai/gemini
2023-02-14T11:55:49,911   copying colossalai/gemini/gemini_mgr.py -> build/lib/colossalai/gemini
2023-02-14T11:55:49,916   creating build/lib/colossalai/engine
2023-02-14T11:55:49,917   copying colossalai/engine/__init__.py -> build/lib/colossalai/engine
2023-02-14T11:55:49,921   copying colossalai/engine/_base_engine.py -> build/lib/colossalai/engine
2023-02-14T11:55:49,926   creating build/lib/colossalai/pipeline
2023-02-14T11:55:49,928   copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline
2023-02-14T11:55:49,931   copying colossalai/pipeline/utils.py -> build/lib/colossalai/pipeline
2023-02-14T11:55:49,936   copying colossalai/pipeline/pipelinable.py -> build/lib/colossalai/pipeline
2023-02-14T11:55:49,940   copying colossalai/pipeline/layer_spec.py -> build/lib/colossalai/pipeline
2023-02-14T11:55:49,944   copying colossalai/pipeline/pipeline_process_group.py -> build/lib/colossalai/pipeline
2023-02-14T11:55:49,949   creating build/lib/colossalai/kernel
2023-02-14T11:55:49,950   copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel
2023-02-14T11:55:49,955   creating build/lib/colossalai/trainer
2023-02-14T11:55:49,956   copying colossalai/trainer/_trainer.py -> build/lib/colossalai/trainer
2023-02-14T11:55:49,961   copying colossalai/trainer/__init__.py -> build/lib/colossalai/trainer
2023-02-14T11:55:49,965   creating build/lib/colossalai/nn
2023-02-14T11:55:49,967   copying colossalai/nn/__init__.py -> build/lib/colossalai/nn
2023-02-14T11:55:49,970   copying colossalai/nn/init.py -> build/lib/colossalai/nn
2023-02-14T11:55:49,975   creating build/lib/colossalai/context
2023-02-14T11:55:49,977   copying colossalai/context/moe_context.py -> build/lib/colossalai/context
2023-02-14T11:55:49,981   copying colossalai/context/__init__.py -> build/lib/colossalai/context
2023-02-14T11:55:49,985   copying colossalai/context/parallel_mode.py -> build/lib/colossalai/context
2023-02-14T11:55:49,988   copying colossalai/context/config.py -> build/lib/colossalai/context
2023-02-14T11:55:49,991   copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context
2023-02-14T11:55:49,995   copying colossalai/context/parallel_context.py -> build/lib/colossalai/context
2023-02-14T11:55:50,001   creating build/lib/colossalai/device
2023-02-14T11:55:50,002   copying colossalai/device/__init__.py -> build/lib/colossalai/device
2023-02-14T11:55:50,005   copying colossalai/device/device_mesh.py -> build/lib/colossalai/device
2023-02-14T11:55:50,009   copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device
2023-02-14T11:55:50,014   copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device
2023-02-14T11:55:50,020   creating build/lib/colossalai/registry
2023-02-14T11:55:50,021   copying colossalai/registry/registry.py -> build/lib/colossalai/registry
2023-02-14T11:55:50,024   copying colossalai/registry/__init__.py -> build/lib/colossalai/registry
2023-02-14T11:55:50,029   creating build/lib/colossalai/communication
2023-02-14T11:55:50,030   copying colossalai/communication/ring.py -> build/lib/colossalai/communication
2023-02-14T11:55:50,034   copying colossalai/communication/p2p.py -> build/lib/colossalai/communication
2023-02-14T11:55:50,039   copying colossalai/communication/__init__.py -> build/lib/colossalai/communication
2023-02-14T11:55:50,042   copying colossalai/communication/utils.py -> build/lib/colossalai/communication
2023-02-14T11:55:50,046   copying colossalai/communication/p2p_v2.py -> build/lib/colossalai/communication
2023-02-14T11:55:50,050   copying colossalai/communication/collective.py -> build/lib/colossalai/communication
2023-02-14T11:55:50,056   creating build/lib/colossalai/utils
2023-02-14T11:55:50,058   copying colossalai/utils/moe.py -> build/lib/colossalai/utils
2023-02-14T11:55:50,061   copying colossalai/utils/checkpointing.py -> build/lib/colossalai/utils
2023-02-14T11:55:50,065   copying colossalai/utils/activation_checkpoint.py -> build/lib/colossalai/utils
2023-02-14T11:55:50,069   copying colossalai/utils/__init__.py -> build/lib/colossalai/utils
2023-02-14T11:55:50,073   copying colossalai/utils/cuda.py -> build/lib/colossalai/utils
2023-02-14T11:55:50,076   copying colossalai/utils/common.py -> build/lib/colossalai/utils
2023-02-14T11:55:50,081   copying colossalai/utils/memory.py -> build/lib/colossalai/utils
2023-02-14T11:55:50,085   copying colossalai/utils/timer.py -> build/lib/colossalai/utils
2023-02-14T11:55:50,091   creating build/lib/colossalai/tensor
2023-02-14T11:55:50,093   copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,097   copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,102   copying colossalai/tensor/tensor_spec.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,105   copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,110   copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,113   copying colossalai/tensor/op_wrapper.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,116   copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,120   copying colossalai/tensor/compute_spec.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,124   copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,128   copying colossalai/tensor/dist_spec_mgr.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,132   copying colossalai/tensor/const.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,135   copying colossalai/tensor/distspec.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,139   copying colossalai/tensor/process_group.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,143   copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,148   copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor
2023-02-14T11:55:50,156   creating build/lib/colossalai/logging
2023-02-14T11:55:50,157   copying colossalai/logging/__init__.py -> build/lib/colossalai/logging
2023-02-14T11:55:50,160   copying colossalai/logging/logger.py -> build/lib/colossalai/logging
2023-02-14T11:55:50,166   creating build/lib/colossalai/testing
2023-02-14T11:55:50,168   copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing
2023-02-14T11:55:50,171   copying colossalai/testing/__init__.py -> build/lib/colossalai/testing
2023-02-14T11:55:50,175   copying colossalai/testing/comparison.py -> build/lib/colossalai/testing
2023-02-14T11:55:50,178   copying colossalai/testing/utils.py -> build/lib/colossalai/testing
2023-02-14T11:55:50,183   copying colossalai/testing/random.py -> build/lib/colossalai/testing
2023-02-14T11:55:50,187   creating build/lib/colossalai/zero
2023-02-14T11:55:50,188   copying colossalai/zero/__init__.py -> build/lib/colossalai/zero
2023-02-14T11:55:50,193   creating build/lib/colossalai/cli/check
2023-02-14T11:55:50,195   copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check
2023-02-14T11:55:50,198   copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check
2023-02-14T11:55:50,204   creating build/lib/colossalai/cli/launcher
2023-02-14T11:55:50,205   copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher
2023-02-14T11:55:50,209   copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher
2023-02-14T11:55:50,212   copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher
2023-02-14T11:55:50,216   copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher
2023-02-14T11:55:50,221   creating build/lib/colossalai/cli/benchmark
2023-02-14T11:55:50,223   copying colossalai/cli/benchmark/__init__.py -> build/lib/colossalai/cli/benchmark
2023-02-14T11:55:50,226   copying colossalai/cli/benchmark/utils.py -> build/lib/colossalai/cli/benchmark
2023-02-14T11:55:50,230   copying colossalai/cli/benchmark/models.py -> build/lib/colossalai/cli/benchmark
2023-02-14T11:55:50,233   copying colossalai/cli/benchmark/benchmark.py -> build/lib/colossalai/cli/benchmark
2023-02-14T11:55:50,238   creating build/lib/colossalai/amp/torch_amp
2023-02-14T11:55:50,240   copying colossalai/amp/torch_amp/__init__.py -> build/lib/colossalai/amp/torch_amp
2023-02-14T11:55:50,243   copying colossalai/amp/torch_amp/torch_amp.py -> build/lib/colossalai/amp/torch_amp
2023-02-14T11:55:50,246   copying colossalai/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/amp/torch_amp
2023-02-14T11:55:50,253   creating build/lib/colossalai/amp/naive_amp
2023-02-14T11:55:50,254   copying colossalai/amp/naive_amp/naive_amp.py -> build/lib/colossalai/amp/naive_amp
2023-02-14T11:55:50,258   copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp
2023-02-14T11:55:50,261   copying colossalai/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/amp/naive_amp
2023-02-14T11:55:50,266   copying colossalai/amp/naive_amp/_utils.py -> build/lib/colossalai/amp/naive_amp
2023-02-14T11:55:50,270   creating build/lib/colossalai/amp/apex_amp
2023-02-14T11:55:50,271   copying colossalai/amp/apex_amp/__init__.py -> build/lib/colossalai/amp/apex_amp
2023-02-14T11:55:50,274   copying colossalai/amp/apex_amp/apex_amp.py -> build/lib/colossalai/amp/apex_amp
2023-02-14T11:55:50,279   creating build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-14T11:55:50,280   copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-14T11:55:50,284   copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-14T11:55:50,287   copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-14T11:55:50,290   copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-02-14T11:55:50,295   creating build/lib/colossalai/fx/tracer
2023-02-14T11:55:50,297   copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer
2023-02-14T11:55:50,300   copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer
2023-02-14T11:55:50,306   copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer
2023-02-14T11:55:50,309   copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer
2023-02-14T11:55:50,313   copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer
2023-02-14T11:55:50,318   copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer
2023-02-14T11:55:50,321   copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer
2023-02-14T11:55:50,325   creating build/lib/colossalai/fx/codegen
2023-02-14T11:55:50,327   copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen
2023-02-14T11:55:50,330   copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen
2023-02-14T11:55:50,338   creating build/lib/colossalai/fx/profiler
2023-02-14T11:55:50,339   copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler
2023-02-14T11:55:50,343   copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler
2023-02-14T11:55:50,348   copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler
2023-02-14T11:55:50,351   copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler
2023-02-14T11:55:50,354   copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler
2023-02-14T11:55:50,357   copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler
2023-02-14T11:55:50,361   copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler
2023-02-14T11:55:50,364   copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler
2023-02-14T11:55:50,370   creating build/lib/colossalai/fx/passes
2023-02-14T11:55:50,371   copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes
2023-02-14T11:55:50,376   copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes
2023-02-14T11:55:50,380   copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes
2023-02-14T11:55:50,384   copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes
2023-02-14T11:55:50,386   copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes
2023-02-14T11:55:50,390   copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes
2023-02-14T11:55:50,395   copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes
2023-02-14T11:55:50,398   copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes
2023-02-14T11:55:50,404   creating build/lib/colossalai/fx/tracer/bias_addition_patch
2023-02-14T11:55:50,405   copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch
2023-02-14T11:55:50,409   creating build/lib/colossalai/fx/tracer/meta_patch
2023-02-14T11:55:50,411   copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch
2023-02-14T11:55:50,415   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-14T11:55:50,417   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-14T11:55:50,420   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-14T11:55:50,423   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-14T11:55:50,426   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-14T11:55:50,432   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-14T11:55:50,434   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-14T11:55:50,437   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-14T11:55:50,441   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-14T11:55:50,444   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-14T11:55:50,447   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-14T11:55:50,452   creating build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:50,453   copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:50,456   copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:50,459   copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:50,463   copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:50,465   copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:50,469   copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:50,472   copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:50,476   copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:50,481   creating build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:50,482   copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:50,485   copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:50,489   copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:50,492   copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:50,495   copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:50,498   copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:50,502   copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:50,505   copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:50,510   creating build/lib/colossalai/fx/profiler/experimental
2023-02-14T11:55:50,511   copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-14T11:55:50,515   copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-14T11:55:50,518   copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-14T11:55:50,521   copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-14T11:55:50,525   copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental
2023-02-14T11:55:50,530   creating build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:50,531   copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:50,535   copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:50,538   copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:50,541   copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:50,544   copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:50,547   copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:50,551   copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:50,554   copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:50,558   copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:50,561   copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:50,564   copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:50,569   creating build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:50,571   copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:50,575   copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:50,578   copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:50,581   copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:50,584   copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:50,587   copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:50,590   copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:50,593   copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:50,596   copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:50,601   creating build/lib/colossalai/fx/passes/algorithms
2023-02-14T11:55:50,603   copying colossalai/fx/passes/algorithms/__init__.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-14T11:55:50,606   copying colossalai/fx/passes/algorithms/ckpt_solver_rotor.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-14T11:55:50,610   copying colossalai/fx/passes/algorithms/ckpt_solver_chen.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-14T11:55:50,613   copying colossalai/fx/passes/algorithms/ckpt_solver_pofo.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-14T11:55:50,618   copying colossalai/fx/passes/algorithms/build_c_ext.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-14T11:55:50,621   copying colossalai/fx/passes/algorithms/linearize.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-14T11:55:50,624   copying colossalai/fx/passes/algorithms/operation.py -> build/lib/colossalai/fx/passes/algorithms
2023-02-14T11:55:50,630   creating build/lib/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:50,631   copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:50,635   copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:50,638   copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:50,643   copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:50,646   copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:50,649   copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:50,654   creating build/lib/colossalai/auto_parallel/pipeline_shard
2023-02-14T11:55:50,655   copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard
2023-02-14T11:55:50,660   creating build/lib/colossalai/auto_parallel/tensor_shard
2023-02-14T11:55:50,661   copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-14T11:55:50,665   copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-14T11:55:50,668   copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-14T11:55:50,672   copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-02-14T11:55:50,677   creating build/lib/colossalai/auto_parallel/meta_profiler
2023-02-14T11:55:50,678   copying colossalai/auto_parallel/meta_profiler/metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-14T11:55:50,682   copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-14T11:55:50,685   copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-14T11:55:50,688   copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-02-14T11:55:50,692   creating build/lib/colossalai/auto_parallel/passes
2023-02-14T11:55:50,694   copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes
2023-02-14T11:55:50,698   copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes
2023-02-14T11:55:50,700   copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-02-14T11:55:50,704   copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes
2023-02-14T11:55:50,707   copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-02-14T11:55:50,712   copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-02-14T11:55:50,718   creating build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:50,719   copying colossalai/auto_parallel/tensor_shard/deprecated/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:50,723   copying colossalai/auto_parallel/tensor_shard/deprecated/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:50,727   copying colossalai/auto_parallel/tensor_shard/deprecated/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:50,730   copying colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:50,734   copying colossalai/auto_parallel/tensor_shard/deprecated/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:50,739   copying colossalai/auto_parallel/tensor_shard/deprecated/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:50,744   copying colossalai/auto_parallel/tensor_shard/deprecated/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:50,747   copying colossalai/auto_parallel/tensor_shard/deprecated/options.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:50,750   copying colossalai/auto_parallel/tensor_shard/deprecated/_utils.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:50,755   creating build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:50,757   copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:50,761   copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:50,764   copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:50,768   copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:50,773   copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:50,777   copying colossalai/auto_parallel/tensor_shard/solver/options.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:50,784   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,785   copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,789   copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,792   copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,796   copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,801   copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,804   copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,807   copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,810   copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,813   copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,816   copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,819   copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,822   copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,825   copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,828   copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,835   copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,838   copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,841   copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,844   copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,847   copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,851   copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,853   copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,856   copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,861   copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,864   copying colossalai/auto_parallel/tensor_shard/node_handler/option.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,867   copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,870   copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,873   copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,877   copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:50,881   creating build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:50,883   copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:50,886   copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:50,890   copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:50,894   copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:50,898   copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:50,901   copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:50,906   creating build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,908   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/dot_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,914   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/bcast_op_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,919   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,923   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,926   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,930   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,936   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,941   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,945   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,949   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,953   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,956   copying colossalai/auto_parallel/tensor_shard/deprecated/op_handler/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:50,962   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:50,964   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:50,967   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:50,971   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:50,975   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:50,978   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:50,981   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:50,987   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:50,990   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:50,994   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:50,998   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:51,001   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:51,005   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:51,009   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:51,012   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:51,015   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:51,018   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:51,023   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:51,027   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:51,030   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:51,037   creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:51,038   copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:51,042   copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:51,045   copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:51,049   copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:51,053   copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:51,056   copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:51,060   copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:51,066   creating build/lib/colossalai/gemini/memory_tracer
2023-02-14T11:55:51,068   copying colossalai/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-14T11:55:51,071   copying colossalai/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-14T11:55:51,074   copying colossalai/gemini/memory_tracer/__init__.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-14T11:55:51,077   copying colossalai/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-14T11:55:51,080   copying colossalai/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-14T11:55:51,084   copying colossalai/gemini/memory_tracer/utils.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-14T11:55:51,087   copying colossalai/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-14T11:55:51,090   copying colossalai/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-14T11:55:51,094   copying colossalai/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-02-14T11:55:51,098   creating build/lib/colossalai/gemini/paramhooks
2023-02-14T11:55:51,099   copying colossalai/gemini/paramhooks/__init__.py -> build/lib/colossalai/gemini/paramhooks
2023-02-14T11:55:51,103   copying colossalai/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/gemini/paramhooks
2023-02-14T11:55:51,107   creating build/lib/colossalai/gemini/ophooks
2023-02-14T11:55:51,109   copying colossalai/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/gemini/ophooks
2023-02-14T11:55:51,112   copying colossalai/gemini/ophooks/__init__.py -> build/lib/colossalai/gemini/ophooks
2023-02-14T11:55:51,115   copying colossalai/gemini/ophooks/utils.py -> build/lib/colossalai/gemini/ophooks
2023-02-14T11:55:51,120   copying colossalai/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/gemini/ophooks
2023-02-14T11:55:51,123   copying colossalai/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/gemini/ophooks
2023-02-14T11:55:51,128   creating build/lib/colossalai/gemini/chunk
2023-02-14T11:55:51,129   copying colossalai/gemini/chunk/manager.py -> build/lib/colossalai/gemini/chunk
2023-02-14T11:55:51,134   copying colossalai/gemini/chunk/__init__.py -> build/lib/colossalai/gemini/chunk
2023-02-14T11:55:51,137   copying colossalai/gemini/chunk/utils.py -> build/lib/colossalai/gemini/chunk
2023-02-14T11:55:51,140   copying colossalai/gemini/chunk/search_utils.py -> build/lib/colossalai/gemini/chunk
2023-02-14T11:55:51,144   copying colossalai/gemini/chunk/chunk.py -> build/lib/colossalai/gemini/chunk
2023-02-14T11:55:51,150   creating build/lib/colossalai/engine/gradient_accumulation
2023-02-14T11:55:51,151   copying colossalai/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/engine/gradient_accumulation
2023-02-14T11:55:51,154   copying colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/engine/gradient_accumulation
2023-02-14T11:55:51,160   creating build/lib/colossalai/engine/schedule
2023-02-14T11:55:51,161   copying colossalai/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/engine/schedule
2023-02-14T11:55:51,165   copying colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/engine/schedule
2023-02-14T11:55:51,169   copying colossalai/engine/schedule/__init__.py -> build/lib/colossalai/engine/schedule
2023-02-14T11:55:51,172   copying colossalai/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/engine/schedule
2023-02-14T11:55:51,178   copying colossalai/engine/schedule/_base_schedule.py -> build/lib/colossalai/engine/schedule
2023-02-14T11:55:51,184   creating build/lib/colossalai/engine/gradient_handler
2023-02-14T11:55:51,185   copying colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-14T11:55:51,189   copying colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-14T11:55:51,192   copying colossalai/engine/gradient_handler/__init__.py -> build/lib/colossalai/engine/gradient_handler
2023-02-14T11:55:51,195   copying colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-14T11:55:51,198   copying colossalai/engine/gradient_handler/utils.py -> build/lib/colossalai/engine/gradient_handler
2023-02-14T11:55:51,202   copying colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-14T11:55:51,205   copying colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-14T11:55:51,208   copying colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-02-14T11:55:51,213   creating build/lib/colossalai/pipeline/rpc
2023-02-14T11:55:51,214   copying colossalai/pipeline/rpc/__init__.py -> build/lib/colossalai/pipeline/rpc
2023-02-14T11:55:51,217   copying colossalai/pipeline/rpc/utils.py -> build/lib/colossalai/pipeline/rpc
2023-02-14T11:55:51,222   copying colossalai/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/pipeline/rpc
2023-02-14T11:55:51,229   copying colossalai/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/pipeline/rpc
2023-02-14T11:55:51,234   creating build/lib/colossalai/pipeline/middleware
2023-02-14T11:55:51,236   copying colossalai/pipeline/middleware/topo.py -> build/lib/colossalai/pipeline/middleware
2023-02-14T11:55:51,241   copying colossalai/pipeline/middleware/__init__.py -> build/lib/colossalai/pipeline/middleware
2023-02-14T11:55:51,245   creating build/lib/colossalai/pipeline/middleware/adaptor
2023-02-14T11:55:51,246   copying colossalai/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/pipeline/middleware/adaptor
2023-02-14T11:55:51,250   copying colossalai/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/pipeline/middleware/adaptor
2023-02-14T11:55:51,256   creating build/lib/colossalai/kernel/op_builder
2023-02-14T11:55:51,257   copying colossalai/kernel/op_builder/moe.py -> build/lib/colossalai/kernel/op_builder
2023-02-14T11:55:51,260   copying colossalai/kernel/op_builder/__init__.py -> build/lib/colossalai/kernel/op_builder
2023-02-14T11:55:51,263   copying colossalai/kernel/op_builder/builder.py -> build/lib/colossalai/kernel/op_builder
2023-02-14T11:55:51,267   copying colossalai/kernel/op_builder/utils.py -> build/lib/colossalai/kernel/op_builder
2023-02-14T11:55:51,270   copying colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-02-14T11:55:51,273   copying colossalai/kernel/op_builder/multi_head_attn.py -> build/lib/colossalai/kernel/op_builder
2023-02-14T11:55:51,276   copying colossalai/kernel/op_builder/layernorm.py -> build/lib/colossalai/kernel/op_builder
2023-02-14T11:55:51,280   copying colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-02-14T11:55:51,283   copying colossalai/kernel/op_builder/fused_optim.py -> build/lib/colossalai/kernel/op_builder
2023-02-14T11:55:51,286   copying colossalai/kernel/op_builder/cpu_adam.py -> build/lib/colossalai/kernel/op_builder
2023-02-14T11:55:51,291   creating build/lib/colossalai/kernel/cuda_native
2023-02-14T11:55:51,292   copying colossalai/kernel/cuda_native/__init__.py -> build/lib/colossalai/kernel/cuda_native
2023-02-14T11:55:51,295   copying colossalai/kernel/cuda_native/multihead_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-02-14T11:55:51,300   copying colossalai/kernel/cuda_native/flash_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-02-14T11:55:51,304   copying colossalai/kernel/cuda_native/layer_norm.py -> build/lib/colossalai/kernel/cuda_native
2023-02-14T11:55:51,307   copying colossalai/kernel/cuda_native/scaled_softmax.py -> build/lib/colossalai/kernel/cuda_native
2023-02-14T11:55:51,312   creating build/lib/colossalai/kernel/jit
2023-02-14T11:55:51,314   copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit
2023-02-14T11:55:51,317   copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit
2023-02-14T11:55:51,320   copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit
2023-02-14T11:55:51,323   copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit
2023-02-14T11:55:51,329   creating build/lib/colossalai/trainer/hooks
2023-02-14T11:55:51,330   copying colossalai/trainer/hooks/_base_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-14T11:55:51,334   copying colossalai/trainer/hooks/_log_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-14T11:55:51,338   copying colossalai/trainer/hooks/__init__.py -> build/lib/colossalai/trainer/hooks
2023-02-14T11:55:51,341   copying colossalai/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-14T11:55:51,345   copying colossalai/trainer/hooks/_metric_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-14T11:55:51,349   copying colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/trainer/hooks
2023-02-14T11:55:51,353   copying colossalai/trainer/hooks/_commons_.py -> build/lib/colossalai/trainer/hooks
2023-02-14T11:55:51,358   creating build/lib/colossalai/nn/parallel
2023-02-14T11:55:51,359   copying colossalai/nn/parallel/reducer.py -> build/lib/colossalai/nn/parallel
2023-02-14T11:55:51,363   copying colossalai/nn/parallel/__init__.py -> build/lib/colossalai/nn/parallel
2023-02-14T11:55:51,366   copying colossalai/nn/parallel/zero_wrapper.py -> build/lib/colossalai/nn/parallel
2023-02-14T11:55:51,370   copying colossalai/nn/parallel/utils.py -> build/lib/colossalai/nn/parallel
2023-02-14T11:55:51,374   copying colossalai/nn/parallel/data_parallel.py -> build/lib/colossalai/nn/parallel
2023-02-14T11:55:51,380   copying colossalai/nn/parallel/gemini_parallel.py -> build/lib/colossalai/nn/parallel
2023-02-14T11:55:51,385   creating build/lib/colossalai/nn/lr_scheduler
2023-02-14T11:55:51,386   copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-14T11:55:51,390   copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-14T11:55:51,394   copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-14T11:55:51,397   copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-14T11:55:51,401   copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-14T11:55:51,405   copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-14T11:55:51,408   copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-14T11:55:51,411   copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler
2023-02-14T11:55:51,416   creating build/lib/colossalai/nn/loss
2023-02-14T11:55:51,418   copying colossalai/nn/loss/loss_2d.py -> build/lib/colossalai/nn/loss
2023-02-14T11:55:51,422   copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss
2023-02-14T11:55:51,425   copying colossalai/nn/loss/loss_moe.py -> build/lib/colossalai/nn/loss
2023-02-14T11:55:51,428   copying colossalai/nn/loss/loss_2p5d.py -> build/lib/colossalai/nn/loss
2023-02-14T11:55:51,432   copying colossalai/nn/loss/loss_3d.py -> build/lib/colossalai/nn/loss
2023-02-14T11:55:51,436   copying colossalai/nn/loss/loss_1d.py -> build/lib/colossalai/nn/loss
2023-02-14T11:55:51,441   creating build/lib/colossalai/nn/layer
2023-02-14T11:55:51,442   copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer
2023-02-14T11:55:51,446   copying colossalai/nn/layer/base_layer.py -> build/lib/colossalai/nn/layer
2023-02-14T11:55:51,450   creating build/lib/colossalai/nn/metric
2023-02-14T11:55:51,452   copying colossalai/nn/metric/accuracy_3d.py -> build/lib/colossalai/nn/metric
2023-02-14T11:55:51,455   copying colossalai/nn/metric/__init__.py -> build/lib/colossalai/nn/metric
2023-02-14T11:55:51,458   copying colossalai/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/nn/metric
2023-02-14T11:55:51,462   copying colossalai/nn/metric/accuracy_2d.py -> build/lib/colossalai/nn/metric
2023-02-14T11:55:51,465   copying colossalai/nn/metric/_utils.py -> build/lib/colossalai/nn/metric
2023-02-14T11:55:51,470   creating build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,472   copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,476   copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,479   copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,483   copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,487   copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,491   copying colossalai/nn/optimizer/colossalai_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,494   copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,498   copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,501   copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,506   copying colossalai/nn/optimizer/gemini_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,509   copying colossalai/nn/optimizer/zero_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,513   copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer
2023-02-14T11:55:51,519   creating build/lib/colossalai/nn/_ops
2023-02-14T11:55:51,521   copying colossalai/nn/_ops/loss.py -> build/lib/colossalai/nn/_ops
2023-02-14T11:55:51,524   copying colossalai/nn/_ops/addmm.py -> build/lib/colossalai/nn/_ops
2023-02-14T11:55:51,528   copying colossalai/nn/_ops/element_wise.py -> build/lib/colossalai/nn/_ops
2023-02-14T11:55:51,532   copying colossalai/nn/_ops/__init__.py -> build/lib/colossalai/nn/_ops
2023-02-14T11:55:51,535   copying colossalai/nn/_ops/embedding.py -> build/lib/colossalai/nn/_ops
2023-02-14T11:55:51,539   copying colossalai/nn/_ops/view.py -> build/lib/colossalai/nn/_ops
2023-02-14T11:55:51,542   copying colossalai/nn/_ops/embedding_bag.py -> build/lib/colossalai/nn/_ops
2023-02-14T11:55:51,546   copying colossalai/nn/_ops/layernorm.py -> build/lib/colossalai/nn/_ops
2023-02-14T11:55:51,550   copying colossalai/nn/_ops/linear.py -> build/lib/colossalai/nn/_ops
2023-02-14T11:55:51,553   copying colossalai/nn/_ops/_utils.py -> build/lib/colossalai/nn/_ops
2023-02-14T11:55:51,557   copying colossalai/nn/_ops/batch_norm.py -> build/lib/colossalai/nn/_ops
2023-02-14T11:55:51,563   creating build/lib/colossalai/nn/parallel/layers
2023-02-14T11:55:51,565   copying colossalai/nn/parallel/layers/colo_module.py -> build/lib/colossalai/nn/parallel/layers
2023-02-14T11:55:51,568   copying colossalai/nn/parallel/layers/module_utils.py -> build/lib/colossalai/nn/parallel/layers
2023-02-14T11:55:51,572   copying colossalai/nn/parallel/layers/__init__.py -> build/lib/colossalai/nn/parallel/layers
2023-02-14T11:55:51,575   copying colossalai/nn/parallel/layers/embedding.py -> build/lib/colossalai/nn/parallel/layers
2023-02-14T11:55:51,579   copying colossalai/nn/parallel/layers/linear.py -> build/lib/colossalai/nn/parallel/layers
2023-02-14T11:55:51,584   creating build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:51,586   copying colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:51,591   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:51,595   copying colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:51,600   copying colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:51,603   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:51,607   copying colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:51,611   copying colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:51,614   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:51,619   copying colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:51,623   creating build/lib/colossalai/nn/layer/moe
2023-02-14T11:55:51,625   copying colossalai/nn/layer/moe/layers.py -> build/lib/colossalai/nn/layer/moe
2023-02-14T11:55:51,629   copying colossalai/nn/layer/moe/__init__.py -> build/lib/colossalai/nn/layer/moe
2023-02-14T11:55:51,632   copying colossalai/nn/layer/moe/utils.py -> build/lib/colossalai/nn/layer/moe
2023-02-14T11:55:51,635   copying colossalai/nn/layer/moe/_operation.py -> build/lib/colossalai/nn/layer/moe
2023-02-14T11:55:51,639   copying colossalai/nn/layer/moe/experts.py -> build/lib/colossalai/nn/layer/moe
2023-02-14T11:55:51,643   copying colossalai/nn/layer/moe/routers.py -> build/lib/colossalai/nn/layer/moe
2023-02-14T11:55:51,648   creating build/lib/colossalai/nn/layer/parallel_1d
2023-02-14T11:55:51,650   copying colossalai/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-14T11:55:51,656   copying colossalai/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-14T11:55:51,659   copying colossalai/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-14T11:55:51,662   copying colossalai/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-02-14T11:55:51,667   creating build/lib/colossalai/nn/layer/wrapper
2023-02-14T11:55:51,669   copying colossalai/nn/layer/wrapper/__init__.py -> build/lib/colossalai/nn/layer/wrapper
2023-02-14T11:55:51,672   copying colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/nn/layer/wrapper
2023-02-14T11:55:51,676   creating build/lib/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:51,678   copying colossalai/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:51,681   copying colossalai/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:51,685   copying colossalai/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:51,688   copying colossalai/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:51,691   copying colossalai/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:51,695   copying colossalai/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:51,699   creating build/lib/colossalai/nn/layer/vanilla
2023-02-14T11:55:51,700   copying colossalai/nn/layer/vanilla/layers.py -> build/lib/colossalai/nn/layer/vanilla
2023-02-14T11:55:51,704   copying colossalai/nn/layer/vanilla/__init__.py -> build/lib/colossalai/nn/layer/vanilla
2023-02-14T11:55:51,709   creating build/lib/colossalai/nn/layer/parallel_3d
2023-02-14T11:55:51,710   copying colossalai/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-14T11:55:51,716   copying colossalai/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-14T11:55:51,720   copying colossalai/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-14T11:55:51,724   copying colossalai/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-02-14T11:55:51,729   creating build/lib/colossalai/nn/layer/parallel_sequence
2023-02-14T11:55:51,730   copying colossalai/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-14T11:55:51,735   copying colossalai/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-14T11:55:51,738   copying colossalai/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-14T11:55:51,745   copying colossalai/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-02-14T11:55:51,750   creating build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-14T11:55:51,752   copying colossalai/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-14T11:55:51,759   copying colossalai/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-14T11:55:51,762   copying colossalai/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-14T11:55:51,767   copying colossalai/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-02-14T11:55:51,772   creating build/lib/colossalai/nn/layer/utils
2023-02-14T11:55:51,773   copying colossalai/nn/layer/utils/__init__.py -> build/lib/colossalai/nn/layer/utils
2023-02-14T11:55:51,776   copying colossalai/nn/layer/utils/common.py -> build/lib/colossalai/nn/layer/utils
2023-02-14T11:55:51,781   creating build/lib/colossalai/nn/layer/parallel_2d
2023-02-14T11:55:51,783   copying colossalai/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-14T11:55:51,789   copying colossalai/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-14T11:55:51,792   copying colossalai/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-14T11:55:51,797   copying colossalai/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-02-14T11:55:51,803   creating build/lib/colossalai/context/process_group_initializer
2023-02-14T11:55:51,804   copying colossalai/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-14T11:55:51,809   copying colossalai/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/context/process_group_initializer
2023-02-14T11:55:51,812   copying colossalai/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-14T11:55:51,816   copying colossalai/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/context/process_group_initializer
2023-02-14T11:55:51,819   copying colossalai/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-14T11:55:51,823   copying colossalai/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/context/process_group_initializer
2023-02-14T11:55:51,827   copying colossalai/context/process_group_initializer/__init__.py -> build/lib/colossalai/context/process_group_initializer
2023-02-14T11:55:51,830   copying colossalai/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/context/process_group_initializer
2023-02-14T11:55:51,833   copying colossalai/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/context/process_group_initializer
2023-02-14T11:55:51,836   copying colossalai/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/context/process_group_initializer
2023-02-14T11:55:51,840   copying colossalai/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/context/process_group_initializer
2023-02-14T11:55:51,845   creating build/lib/colossalai/context/random
2023-02-14T11:55:51,846   copying colossalai/context/random/_helper.py -> build/lib/colossalai/context/random
2023-02-14T11:55:51,850   copying colossalai/context/random/__init__.py -> build/lib/colossalai/context/random
2023-02-14T11:55:51,853   copying colossalai/context/random/seed_manager.py -> build/lib/colossalai/context/random
2023-02-14T11:55:51,858   creating build/lib/colossalai/utils/model
2023-02-14T11:55:51,862   copying colossalai/utils/model/experimental.py -> build/lib/colossalai/utils/model
2023-02-14T11:55:51,867   copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model
2023-02-14T11:55:51,870   copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model
2023-02-14T11:55:51,874   copying colossalai/utils/model/lazy_init_context.py -> build/lib/colossalai/utils/model
2023-02-14T11:55:51,879   copying colossalai/utils/model/colo_init_context.py -> build/lib/colossalai/utils/model
2023-02-14T11:55:51,885   creating build/lib/colossalai/utils/checkpoint
2023-02-14T11:55:51,887   copying colossalai/utils/checkpoint/__init__.py -> build/lib/colossalai/utils/checkpoint
2023-02-14T11:55:51,891   copying colossalai/utils/checkpoint/utils.py -> build/lib/colossalai/utils/checkpoint
2023-02-14T11:55:51,895   copying colossalai/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/utils/checkpoint
2023-02-14T11:55:51,901   creating build/lib/colossalai/utils/tensor_detector
2023-02-14T11:55:51,903   copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector
2023-02-14T11:55:51,907   copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector
2023-02-14T11:55:51,913   creating build/lib/colossalai/utils/rank_recorder
2023-02-14T11:55:51,915   copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder
2023-02-14T11:55:51,919   copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder
2023-02-14T11:55:51,925   creating build/lib/colossalai/utils/profiler
2023-02-14T11:55:51,928   copying colossalai/utils/profiler/profiler.py -> build/lib/colossalai/utils/profiler
2023-02-14T11:55:51,933   copying colossalai/utils/profiler/__init__.py -> build/lib/colossalai/utils/profiler
2023-02-14T11:55:51,936   copying colossalai/utils/profiler/extention.py -> build/lib/colossalai/utils/profiler
2023-02-14T11:55:51,939   copying colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/utils/profiler
2023-02-14T11:55:51,944   creating build/lib/colossalai/utils/checkpoint_io
2023-02-14T11:55:51,946   copying colossalai/utils/checkpoint_io/writer.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-14T11:55:51,950   copying colossalai/utils/checkpoint_io/reader.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-14T11:55:51,954   copying colossalai/utils/checkpoint_io/io.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-14T11:55:51,957   copying colossalai/utils/checkpoint_io/distributed.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-14T11:55:51,961   copying colossalai/utils/checkpoint_io/__init__.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-14T11:55:51,964   copying colossalai/utils/checkpoint_io/utils.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-14T11:55:51,969   copying colossalai/utils/checkpoint_io/meta.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-14T11:55:51,972   copying colossalai/utils/checkpoint_io/backend.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-14T11:55:51,975   copying colossalai/utils/checkpoint_io/convertor.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-14T11:55:51,980   copying colossalai/utils/checkpoint_io/constant.py -> build/lib/colossalai/utils/checkpoint_io
2023-02-14T11:55:51,984   creating build/lib/colossalai/utils/multi_tensor_apply
2023-02-14T11:55:51,985   copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-02-14T11:55:51,989   copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-02-14T11:55:51,993   creating build/lib/colossalai/utils/data_sampler
2023-02-14T11:55:51,995   copying colossalai/utils/data_sampler/base_sampler.py -> build/lib/colossalai/utils/data_sampler
2023-02-14T11:55:51,998   copying colossalai/utils/data_sampler/__init__.py -> build/lib/colossalai/utils/data_sampler
2023-02-14T11:55:52,002   copying colossalai/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/utils/data_sampler
2023-02-14T11:55:52,007   creating build/lib/colossalai/utils/profiler/legacy
2023-02-14T11:55:52,008   copying colossalai/utils/profiler/legacy/__init__.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-14T11:55:52,012   copying colossalai/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-14T11:55:52,016   copying colossalai/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-14T11:55:52,020   copying colossalai/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/utils/profiler/legacy
2023-02-14T11:55:52,025   creating build/lib/colossalai/zero/sharded_model
2023-02-14T11:55:52,026   copying colossalai/zero/sharded_model/__init__.py -> build/lib/colossalai/zero/sharded_model
2023-02-14T11:55:52,030   copying colossalai/zero/sharded_model/utils.py -> build/lib/colossalai/zero/sharded_model
2023-02-14T11:55:52,033   copying colossalai/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/zero/sharded_model
2023-02-14T11:55:52,037   copying colossalai/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/zero/sharded_model
2023-02-14T11:55:52,043   copying colossalai/zero/sharded_model/_utils.py -> build/lib/colossalai/zero/sharded_model
2023-02-14T11:55:52,048   creating build/lib/colossalai/zero/shard_utils
2023-02-14T11:55:52,051   copying colossalai/zero/shard_utils/__init__.py -> build/lib/colossalai/zero/shard_utils
2023-02-14T11:55:52,055   copying colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-02-14T11:55:52,059   copying colossalai/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-02-14T11:55:52,063   copying colossalai/zero/shard_utils/commons.py -> build/lib/colossalai/zero/shard_utils
2023-02-14T11:55:52,071   copying colossalai/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-02-14T11:55:52,076   creating build/lib/colossalai/zero/init_ctx
2023-02-14T11:55:52,078   copying colossalai/zero/init_ctx/__init__.py -> build/lib/colossalai/zero/init_ctx
2023-02-14T11:55:52,082   copying colossalai/zero/init_ctx/init_context.py -> build/lib/colossalai/zero/init_ctx
2023-02-14T11:55:52,087   creating build/lib/colossalai/zero/sharded_optim
2023-02-14T11:55:52,089   copying colossalai/zero/sharded_optim/low_level_optim.py -> build/lib/colossalai/zero/sharded_optim
2023-02-14T11:55:52,094   copying colossalai/zero/sharded_optim/__init__.py -> build/lib/colossalai/zero/sharded_optim
2023-02-14T11:55:52,098   copying colossalai/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/zero/sharded_optim
2023-02-14T11:55:52,102   copying colossalai/zero/sharded_optim/_utils.py -> build/lib/colossalai/zero/sharded_optim
2023-02-14T11:55:52,107   creating build/lib/colossalai/zero/utils
2023-02-14T11:55:52,109   copying colossalai/zero/utils/gemini_hook.py -> build/lib/colossalai/zero/utils
2023-02-14T11:55:52,113   copying colossalai/zero/utils/zero_hook.py -> build/lib/colossalai/zero/utils
2023-02-14T11:55:52,116   copying colossalai/zero/utils/__init__.py -> build/lib/colossalai/zero/utils
2023-02-14T11:55:52,121   creating build/lib/colossalai/zero/sharded_param
2023-02-14T11:55:52,122   copying colossalai/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/zero/sharded_param
2023-02-14T11:55:52,126   copying colossalai/zero/sharded_param/sharded_param.py -> build/lib/colossalai/zero/sharded_param
2023-02-14T11:55:52,129   copying colossalai/zero/sharded_param/__init__.py -> build/lib/colossalai/zero/sharded_param
2023-02-14T11:55:52,134   creating build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:52,136   copying colossalai/zero/sharded_optim/bookkeeping/base_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:52,139   copying colossalai/zero/sharded_optim/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:52,142   copying colossalai/zero/sharded_optim/bookkeeping/__init__.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:52,145   copying colossalai/zero/sharded_optim/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:52,149   copying colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:52,152   copying colossalai/zero/sharded_optim/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:52,189   creating build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,191   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,195   copying colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,201   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,205   copying colossalai/kernel/cuda_native/csrc/compat.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,210   copying colossalai/kernel/cuda_native/csrc/type_shim.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,215   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,220   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,224   copying colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,228   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,233   copying colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,237   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,241   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,247   copying colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,253   copying colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,257   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,262   copying colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,267   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,271   copying colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,275   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,281   copying colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,285   copying colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,289   copying colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,293   copying colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:52,298   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels
2023-02-14T11:55:52,298   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,300   copying colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,304   copying colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,309   copying colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,313   copying colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,317   copying colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,321   copying colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,325   copying colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,329   copying colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,333   copying colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,337   copying colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,343   copying colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,349   copying colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:52,592   /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
2023-02-14T11:55:52,593     setuptools.SetuptoolsDeprecationWarning,
2023-02-14T11:55:52,659   installing to build/bdist.linux-armv7l/wheel
2023-02-14T11:55:52,659   running install
2023-02-14T11:55:52,720   running install_lib
2023-02-14T11:55:52,793   creating build/bdist.linux-armv7l
2023-02-14T11:55:52,794   creating build/bdist.linux-armv7l/wheel
2023-02-14T11:55:52,801   creating build/bdist.linux-armv7l/wheel/op_builder
2023-02-14T11:55:52,803   copying build/lib/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-14T11:55:52,808   copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-14T11:55:52,811   copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-14T11:55:52,815   copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-14T11:55:52,819   copying build/lib/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-14T11:55:52,822   copying build/lib/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-14T11:55:52,825   copying build/lib/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-14T11:55:52,829   copying build/lib/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-14T11:55:52,832   copying build/lib/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-14T11:55:52,835   copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder
2023-02-14T11:55:52,842   creating build/bdist.linux-armv7l/wheel/colossalai
2023-02-14T11:55:52,844   copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-14T11:55:52,848   creating build/bdist.linux-armv7l/wheel/colossalai/cli
2023-02-14T11:55:52,851   creating build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-02-14T11:55:52,853   copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-02-14T11:55:52,856   copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-02-14T11:55:52,861   copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-02-14T11:55:52,865   creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-14T11:55:52,866   copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-14T11:55:52,870   copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-14T11:55:52,875   copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-14T11:55:52,879   copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-02-14T11:55:52,883   copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-02-14T11:55:52,887   creating build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-14T11:55:52,888   copying build/lib/colossalai/cli/benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-14T11:55:52,893   copying build/lib/colossalai/cli/benchmark/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-14T11:55:52,896   copying build/lib/colossalai/cli/benchmark/models.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-14T11:55:52,900   copying build/lib/colossalai/cli/benchmark/benchmark.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-02-14T11:55:52,905   creating build/bdist.linux-armv7l/wheel/colossalai/builder
2023-02-14T11:55:52,907   copying build/lib/colossalai/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/builder
2023-02-14T11:55:52,910   copying build/lib/colossalai/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/builder
2023-02-14T11:55:52,914   creating build/bdist.linux-armv7l/wheel/colossalai/amp
2023-02-14T11:55:52,917   creating build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-14T11:55:52,918   copying build/lib/colossalai/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-14T11:55:52,922   copying build/lib/colossalai/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-14T11:55:52,925   copying build/lib/colossalai/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-02-14T11:55:52,933   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-14T11:55:52,934   copying build/lib/colossalai/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-14T11:55:52,938   copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-14T11:55:52,941   copying build/lib/colossalai/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-14T11:55:52,947   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-14T11:55:52,948   copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-14T11:55:52,952   copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-14T11:55:52,955   copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-14T11:55:52,958   copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-02-14T11:55:52,962   copying build/lib/colossalai/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-02-14T11:55:52,967   copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-02-14T11:55:52,976   creating build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-02-14T11:55:52,979   copying build/lib/colossalai/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-02-14T11:55:52,988   copying build/lib/colossalai/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-02-14T11:55:52,997   copying build/lib/colossalai/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-02-14T11:55:53,017   creating build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-14T11:55:53,024   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-14T11:55:53,033   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-02-14T11:55:53,041   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-14T11:55:53,043   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-14T11:55:53,051   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-14T11:55:53,062   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-14T11:55:53,075   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-02-14T11:55:53,093   copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-02-14T11:55:53,102   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-14T11:55:53,104   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-14T11:55:53,109   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-14T11:55:53,113   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-14T11:55:53,117   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-14T11:55:53,121   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-02-14T11:55:53,125   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-02-14T11:55:53,129   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:53,131   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:53,136   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:53,140   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:53,144   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:53,148   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:53,153   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:53,157   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:53,161   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-02-14T11:55:53,165   copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-02-14T11:55:53,171   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:53,173   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:53,177   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:53,181   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:53,185   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:53,189   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:53,193   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:53,198   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:53,203   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-02-14T11:55:53,207   copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-14T11:55:53,211   copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-14T11:55:53,216   copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-14T11:55:53,220   copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-14T11:55:53,224   copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-14T11:55:53,229   copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-14T11:55:53,234   copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-02-14T11:55:53,239   creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-02-14T11:55:53,241   copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-02-14T11:55:53,245   copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-02-14T11:55:53,251   copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-14T11:55:53,255   copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-14T11:55:53,259   copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-14T11:55:53,265   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-14T11:55:53,267   copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-14T11:55:53,271   copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-14T11:55:53,276   copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-14T11:55:53,280   copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-14T11:55:53,284   copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-14T11:55:53,288   copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-14T11:55:53,293   copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-14T11:55:53,298   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-14T11:55:53,300   copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-14T11:55:53,305   copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-14T11:55:53,309   copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-14T11:55:53,314   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:53,316   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:53,321   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:53,324   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:53,328   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:53,332   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:53,336   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:53,340   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:53,344   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:53,349   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:53,353   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:53,357   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-02-14T11:55:53,361   copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-14T11:55:53,366   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:53,369   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:53,373   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:53,377   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:53,381   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:53,385   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:53,389   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:53,393   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:53,397   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:53,401   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-02-14T11:55:53,405   copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-02-14T11:55:53,409   copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-02-14T11:55:53,414   copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-14T11:55:53,419   copying build/lib/colossalai/fx/_meta_registrations.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-02-14T11:55:53,425   creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-14T11:55:53,427   copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-14T11:55:53,432   copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-14T11:55:53,437   copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-14T11:55:53,442   copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-14T11:55:53,446   copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-14T11:55:53,450   copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-14T11:55:53,455   copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-14T11:55:53,461   creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-14T11:55:53,463   copying build/lib/colossalai/fx/passes/algorithms/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-14T11:55:53,467   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-14T11:55:53,472   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-14T11:55:53,476   copying build/lib/colossalai/fx/passes/algorithms/ckpt_solver_pofo.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-14T11:55:53,482   copying build/lib/colossalai/fx/passes/algorithms/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-14T11:55:53,486   copying build/lib/colossalai/fx/passes/algorithms/linearize.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-14T11:55:53,490   copying build/lib/colossalai/fx/passes/algorithms/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes/algorithms
2023-02-14T11:55:53,494   copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-02-14T11:55:53,499   copying build/lib/colossalai/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-14T11:55:53,504   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-02-14T11:55:53,506   copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-02-14T11:55:53,511   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:53,513   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:53,518   copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:53,521   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:53,527   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:53,531   copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:53,535   copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-02-14T11:55:53,541   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-02-14T11:55:53,543   copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-02-14T11:55:53,548   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-14T11:55:53,551   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:53,553   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:53,557   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:53,561   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:53,564   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:53,568   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:53,573   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:53,580   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,581   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/dot_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,587   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/bcast_op_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,594   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,599   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,602   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,606   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,612   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,617   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,622   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,627   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,631   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,636   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/op_handler/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated/op_handler
2023-02-14T11:55:53,641   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:53,645   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:53,648   copying build/lib/colossalai/auto_parallel/tensor_shard/deprecated/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/deprecated
2023-02-14T11:55:53,652   copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-14T11:55:53,656   copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-14T11:55:53,660   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:53,661   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:53,666   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:53,669   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:53,673   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:53,678   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:53,682   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-02-14T11:55:53,687   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,691   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,693   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,697   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,702   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,707   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,711   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,715   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,722   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,726   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,731   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,736   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,740   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,745   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,750   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,754   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,758   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,762   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,767   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,772   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,777   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-02-14T11:55:53,782   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,786   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,791   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,796   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,801   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,805   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,808   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,812   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,816   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,820   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,824   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,827   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,832   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,836   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,840   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,844   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,848   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,852   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,856   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,860   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,864   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,869   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,873   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,877   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/option.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,881   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,885   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,889   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,894   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-02-14T11:55:53,898   copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-14T11:55:53,903   copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-02-14T11:55:53,907   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:53,909   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:53,912   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:53,916   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:53,920   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:53,923   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:53,926   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-02-14T11:55:53,931   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-14T11:55:53,933   copying build/lib/colossalai/auto_parallel/meta_profiler/metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-14T11:55:53,936   copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-14T11:55:53,939   copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-14T11:55:53,942   copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-02-14T11:55:53,947   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:53,948   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:53,952   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:53,956   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:53,960   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:53,963   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:53,967   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:53,972   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-02-14T11:55:53,977   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-14T11:55:53,978   copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-14T11:55:53,982   copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-14T11:55:53,985   copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-14T11:55:53,989   copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-14T11:55:53,992   copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-14T11:55:53,997   copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-02-14T11:55:54,000   copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-14T11:55:54,004   creating build/bdist.linux-armv7l/wheel/colossalai/_C
2023-02-14T11:55:54,006   copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C
2023-02-14T11:55:54,010   creating build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-14T11:55:54,012   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-14T11:55:54,014   copying build/lib/colossalai/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-14T11:55:54,017   copying build/lib/colossalai/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-14T11:55:54,021   copying build/lib/colossalai/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-14T11:55:54,024   copying build/lib/colossalai/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-14T11:55:54,027   copying build/lib/colossalai/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-14T11:55:54,031   copying build/lib/colossalai/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-14T11:55:54,034   copying build/lib/colossalai/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-14T11:55:54,037   copying build/lib/colossalai/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-14T11:55:54,041   copying build/lib/colossalai/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-02-14T11:55:54,044   copying build/lib/colossalai/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-14T11:55:54,049   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-02-14T11:55:54,051   copying build/lib/colossalai/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-02-14T11:55:54,054   copying build/lib/colossalai/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-02-14T11:55:54,058   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-14T11:55:54,060   copying build/lib/colossalai/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-14T11:55:54,063   copying build/lib/colossalai/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-14T11:55:54,066   copying build/lib/colossalai/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-14T11:55:54,070   copying build/lib/colossalai/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-14T11:55:54,074   copying build/lib/colossalai/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-02-14T11:55:54,077   copying build/lib/colossalai/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-14T11:55:54,080   copying build/lib/colossalai/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-14T11:55:54,083   copying build/lib/colossalai/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-14T11:55:54,088   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-14T11:55:54,089   copying build/lib/colossalai/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-14T11:55:54,094   copying build/lib/colossalai/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-14T11:55:54,097   copying build/lib/colossalai/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-14T11:55:54,100   copying build/lib/colossalai/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-14T11:55:54,104   copying build/lib/colossalai/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-02-14T11:55:54,109   copying build/lib/colossalai/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-14T11:55:54,113   copying build/lib/colossalai/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-14T11:55:54,117   copying build/lib/colossalai/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-14T11:55:54,120   copying build/lib/colossalai/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-02-14T11:55:54,125   creating build/bdist.linux-armv7l/wheel/colossalai/engine
2023-02-14T11:55:54,127   creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-02-14T11:55:54,129   copying build/lib/colossalai/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-02-14T11:55:54,133   copying build/lib/colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-02-14T11:55:54,138   creating build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-14T11:55:54,140   copying build/lib/colossalai/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-14T11:55:54,144   copying build/lib/colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-14T11:55:54,148   copying build/lib/colossalai/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-14T11:55:54,151   copying build/lib/colossalai/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-14T11:55:54,157   copying build/lib/colossalai/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-02-14T11:55:54,161   copying build/lib/colossalai/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine
2023-02-14T11:55:54,165   creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-14T11:55:54,167   copying build/lib/colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-14T11:55:54,170   copying build/lib/colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-14T11:55:54,173   copying build/lib/colossalai/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-14T11:55:54,177   copying build/lib/colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-14T11:55:54,180   copying build/lib/colossalai/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-14T11:55:54,183   copying build/lib/colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-14T11:55:54,187   copying build/lib/colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-14T11:55:54,190   copying build/lib/colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-02-14T11:55:54,193   copying build/lib/colossalai/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/engine
2023-02-14T11:55:54,198   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-14T11:55:54,201   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-14T11:55:54,202   copying build/lib/colossalai/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-14T11:55:54,206   copying build/lib/colossalai/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-14T11:55:54,210   copying build/lib/colossalai/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-14T11:55:54,217   copying build/lib/colossalai/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-02-14T11:55:54,222   copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-14T11:55:54,226   copying build/lib/colossalai/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-14T11:55:54,231   copying build/lib/colossalai/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-14T11:55:54,236   copying build/lib/colossalai/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-14T11:55:54,241   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-02-14T11:55:54,243   copying build/lib/colossalai/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-02-14T11:55:54,248   copying build/lib/colossalai/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-02-14T11:55:54,253   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-02-14T11:55:54,254   copying build/lib/colossalai/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-02-14T11:55:54,257   copying build/lib/colossalai/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-02-14T11:55:54,261   copying build/lib/colossalai/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-02-14T11:55:54,266   creating build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-02-14T11:55:54,269   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-14T11:55:54,270   copying build/lib/colossalai/kernel/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-14T11:55:54,274   copying build/lib/colossalai/kernel/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-14T11:55:54,277   copying build/lib/colossalai/kernel/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-14T11:55:54,281   copying build/lib/colossalai/kernel/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-14T11:55:54,284   copying build/lib/colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-14T11:55:54,287   copying build/lib/colossalai/kernel/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-14T11:55:54,290   copying build/lib/colossalai/kernel/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-14T11:55:54,293   copying build/lib/colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-14T11:55:54,296   copying build/lib/colossalai/kernel/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-14T11:55:54,300   copying build/lib/colossalai/kernel/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-02-14T11:55:54,303   copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-02-14T11:55:54,307   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-14T11:55:54,308   copying build/lib/colossalai/kernel/cuda_native/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-14T11:55:54,312   copying build/lib/colossalai/kernel/cuda_native/multihead_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-14T11:55:54,316   copying build/lib/colossalai/kernel/cuda_native/flash_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-14T11:55:54,321   copying build/lib/colossalai/kernel/cuda_native/layer_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-14T11:55:54,324   copying build/lib/colossalai/kernel/cuda_native/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-02-14T11:55:54,329   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,331   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,334   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,339   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,342   copying build/lib/colossalai/kernel/cuda_native/csrc/compat.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,345   copying build/lib/colossalai/kernel/cuda_native/csrc/type_shim.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,350   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,355   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,358   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,362   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,365   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,370   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,373   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,377   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,382   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,386   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,391   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,395   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,398   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,402   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,407   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,411   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,416   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels
2023-02-14T11:55:54,419   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,421   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,424   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,427   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,430   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,433   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,436   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,440   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,443   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,447   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,450   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,454   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,457   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-02-14T11:55:54,460   copying build/lib/colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,463   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-02-14T11:55:54,468   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-14T11:55:54,470   copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-14T11:55:54,473   copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-14T11:55:54,476   copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-14T11:55:54,479   copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-02-14T11:55:54,482   copying build/lib/colossalai/core.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-14T11:55:54,486   creating build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-02-14T11:55:54,487   copying build/lib/colossalai/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-02-14T11:55:54,492   copying build/lib/colossalai/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-02-14T11:55:54,496   creating build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-14T11:55:54,498   copying build/lib/colossalai/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-14T11:55:54,501   copying build/lib/colossalai/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-14T11:55:54,505   copying build/lib/colossalai/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-14T11:55:54,508   copying build/lib/colossalai/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-14T11:55:54,511   copying build/lib/colossalai/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-14T11:55:54,515   copying build/lib/colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-14T11:55:54,519   copying build/lib/colossalai/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-02-14T11:55:54,523   creating build/bdist.linux-armv7l/wheel/colossalai/nn
2023-02-14T11:55:54,525   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-14T11:55:54,527   copying build/lib/colossalai/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-14T11:55:54,531   copying build/lib/colossalai/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-14T11:55:54,535   copying build/lib/colossalai/nn/parallel/zero_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-14T11:55:54,540   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-14T11:55:54,542   copying build/lib/colossalai/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-14T11:55:54,546   copying build/lib/colossalai/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-14T11:55:54,550   copying build/lib/colossalai/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-14T11:55:54,554   copying build/lib/colossalai/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-14T11:55:54,559   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:54,561   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:54,565   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:54,570   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:54,576   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:54,579   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:54,583   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:54,586   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:54,589   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:54,593   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-02-14T11:55:54,596   copying build/lib/colossalai/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-02-14T11:55:54,599   copying build/lib/colossalai/nn/parallel/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-14T11:55:54,603   copying build/lib/colossalai/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-14T11:55:54,608   copying build/lib/colossalai/nn/parallel/gemini_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-02-14T11:55:54,611   copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-02-14T11:55:54,614   copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-02-14T11:55:54,619   creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-14T11:55:54,620   copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-14T11:55:54,624   copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-14T11:55:54,627   copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-14T11:55:54,630   copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-14T11:55:54,633   copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-14T11:55:54,637   copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-14T11:55:54,640   copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-14T11:55:54,643   copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-02-14T11:55:54,648   creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-14T11:55:54,650   copying build/lib/colossalai/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-14T11:55:54,653   copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-14T11:55:54,656   copying build/lib/colossalai/nn/loss/loss_moe.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-14T11:55:54,660   copying build/lib/colossalai/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-14T11:55:54,664   copying build/lib/colossalai/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-14T11:55:54,667   copying build/lib/colossalai/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-02-14T11:55:54,672   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-02-14T11:55:54,675   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-14T11:55:54,676   copying build/lib/colossalai/nn/layer/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-14T11:55:54,680   copying build/lib/colossalai/nn/layer/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-14T11:55:54,684   copying build/lib/colossalai/nn/layer/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-14T11:55:54,687   copying build/lib/colossalai/nn/layer/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-14T11:55:54,690   copying build/lib/colossalai/nn/layer/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-14T11:55:54,694   copying build/lib/colossalai/nn/layer/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-02-14T11:55:54,699   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-14T11:55:54,700   copying build/lib/colossalai/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-14T11:55:54,707   copying build/lib/colossalai/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-14T11:55:54,710   copying build/lib/colossalai/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-14T11:55:54,713   copying build/lib/colossalai/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-02-14T11:55:54,718   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-02-14T11:55:54,720   copying build/lib/colossalai/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-02-14T11:55:54,724   copying build/lib/colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-02-14T11:55:54,727   copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-02-14T11:55:54,731   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:54,732   copying build/lib/colossalai/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:54,735   copying build/lib/colossalai/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:54,739   copying build/lib/colossalai/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:54,743   copying build/lib/colossalai/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:54,747   copying build/lib/colossalai/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:54,751   copying build/lib/colossalai/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-02-14T11:55:54,756   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-02-14T11:55:54,758   copying build/lib/colossalai/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-02-14T11:55:54,763   copying build/lib/colossalai/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-02-14T11:55:54,769   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-14T11:55:54,771   copying build/lib/colossalai/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-14T11:55:54,777   copying build/lib/colossalai/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-14T11:55:54,781   copying build/lib/colossalai/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-14T11:55:54,787   copying build/lib/colossalai/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-02-14T11:55:54,792   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-14T11:55:54,795   copying build/lib/colossalai/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-14T11:55:54,800   copying build/lib/colossalai/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-14T11:55:54,804   copying build/lib/colossalai/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-14T11:55:54,808   copying build/lib/colossalai/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-02-14T11:55:54,813   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-14T11:55:54,815   copying build/lib/colossalai/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-14T11:55:54,823   copying build/lib/colossalai/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-14T11:55:54,826   copying build/lib/colossalai/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-14T11:55:54,834   copying build/lib/colossalai/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-02-14T11:55:54,839   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-02-14T11:55:54,841   copying build/lib/colossalai/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-02-14T11:55:54,845   copying build/lib/colossalai/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-02-14T11:55:54,850   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-14T11:55:54,851   copying build/lib/colossalai/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-14T11:55:54,859   copying build/lib/colossalai/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-14T11:55:54,862   copying build/lib/colossalai/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-14T11:55:54,868   copying build/lib/colossalai/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-02-14T11:55:54,872   copying build/lib/colossalai/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-02-14T11:55:54,877   creating build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-14T11:55:54,878   copying build/lib/colossalai/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-14T11:55:54,881   copying build/lib/colossalai/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-14T11:55:54,884   copying build/lib/colossalai/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-14T11:55:54,888   copying build/lib/colossalai/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-14T11:55:54,891   copying build/lib/colossalai/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-02-14T11:55:54,895   creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,897   copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,901   copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,904   copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,908   copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,911   copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,915   copying build/lib/colossalai/nn/optimizer/colossalai_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,918   copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,922   copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,926   copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,930   copying build/lib/colossalai/nn/optimizer/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,933   copying build/lib/colossalai/nn/optimizer/zero_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,937   copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-02-14T11:55:54,943   creating build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-14T11:55:54,945   copying build/lib/colossalai/nn/_ops/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-14T11:55:54,949   copying build/lib/colossalai/nn/_ops/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-14T11:55:54,953   copying build/lib/colossalai/nn/_ops/element_wise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-14T11:55:54,957   copying build/lib/colossalai/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-14T11:55:54,961   copying build/lib/colossalai/nn/_ops/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-14T11:55:54,966   copying build/lib/colossalai/nn/_ops/view.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-14T11:55:54,970   copying build/lib/colossalai/nn/_ops/embedding_bag.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-14T11:55:54,974   copying build/lib/colossalai/nn/_ops/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-14T11:55:54,978   copying build/lib/colossalai/nn/_ops/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-14T11:55:54,982   copying build/lib/colossalai/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-14T11:55:54,986   copying build/lib/colossalai/nn/_ops/batch_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-02-14T11:55:54,991   creating build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-14T11:55:54,992   copying build/lib/colossalai/context/moe_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-14T11:55:54,997   creating build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-14T11:55:54,999   copying build/lib/colossalai/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-14T11:55:55,003   copying build/lib/colossalai/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-14T11:55:55,006   copying build/lib/colossalai/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-14T11:55:55,010   copying build/lib/colossalai/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-14T11:55:55,013   copying build/lib/colossalai/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-14T11:55:55,018   copying build/lib/colossalai/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-14T11:55:55,021   copying build/lib/colossalai/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-14T11:55:55,024   copying build/lib/colossalai/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-14T11:55:55,027   copying build/lib/colossalai/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-14T11:55:55,031   copying build/lib/colossalai/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-14T11:55:55,034   copying build/lib/colossalai/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-02-14T11:55:55,037   copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-14T11:55:55,040   copying build/lib/colossalai/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-14T11:55:55,043   copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-14T11:55:55,047   creating build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-14T11:55:55,049   copying build/lib/colossalai/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-14T11:55:55,053   copying build/lib/colossalai/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-14T11:55:55,056   copying build/lib/colossalai/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-02-14T11:55:55,059   copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-14T11:55:55,062   copying build/lib/colossalai/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-02-14T11:55:55,066   copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-14T11:55:55,072   creating build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-14T11:55:55,074   copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-14T11:55:55,077   copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-14T11:55:55,081   copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-14T11:55:55,085   copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-02-14T11:55:55,090   creating build/bdist.linux-armv7l/wheel/colossalai/registry
2023-02-14T11:55:55,091   copying build/lib/colossalai/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/registry
2023-02-14T11:55:55,095   copying build/lib/colossalai/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/registry
2023-02-14T11:55:55,099   creating build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-14T11:55:55,100   copying build/lib/colossalai/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-14T11:55:55,104   copying build/lib/colossalai/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-14T11:55:55,108   copying build/lib/colossalai/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-14T11:55:55,111   copying build/lib/colossalai/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-14T11:55:55,115   copying build/lib/colossalai/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-14T11:55:55,119   copying build/lib/colossalai/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-02-14T11:55:55,123   copying build/lib/colossalai/constants.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-02-14T11:55:55,127   creating build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-14T11:55:55,130   creating build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-14T11:55:55,131   copying build/lib/colossalai/utils/model/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-14T11:55:55,136   copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-14T11:55:55,138   copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-14T11:55:55,141   copying build/lib/colossalai/utils/model/lazy_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-14T11:55:55,145   copying build/lib/colossalai/utils/model/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-02-14T11:55:55,149   copying build/lib/colossalai/utils/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-14T11:55:55,152   copying build/lib/colossalai/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-14T11:55:55,156   copying build/lib/colossalai/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-14T11:55:55,160   copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-14T11:55:55,164   creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-14T11:55:55,166   copying build/lib/colossalai/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-14T11:55:55,169   copying build/lib/colossalai/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-14T11:55:55,172   copying build/lib/colossalai/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-02-14T11:55:55,176   creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-02-14T11:55:55,178   copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-02-14T11:55:55,181   copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-02-14T11:55:55,186   creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-02-14T11:55:55,187   copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-02-14T11:55:55,191   copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-02-14T11:55:55,194   copying build/lib/colossalai/utils/cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-14T11:55:55,199   creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-14T11:55:55,200   copying build/lib/colossalai/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-14T11:55:55,204   copying build/lib/colossalai/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-14T11:55:55,207   copying build/lib/colossalai/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-14T11:55:55,210   copying build/lib/colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-02-14T11:55:55,214   creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-14T11:55:55,216   copying build/lib/colossalai/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-14T11:55:55,219   copying build/lib/colossalai/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-14T11:55:55,223   copying build/lib/colossalai/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-14T11:55:55,227   copying build/lib/colossalai/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-02-14T11:55:55,231   creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-14T11:55:55,233   copying build/lib/colossalai/utils/checkpoint_io/writer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-14T11:55:55,236   copying build/lib/colossalai/utils/checkpoint_io/reader.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-14T11:55:55,240   copying build/lib/colossalai/utils/checkpoint_io/io.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-14T11:55:55,244   copying build/lib/colossalai/utils/checkpoint_io/distributed.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-14T11:55:55,247   copying build/lib/colossalai/utils/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-14T11:55:55,251   copying build/lib/colossalai/utils/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-14T11:55:55,254   copying build/lib/colossalai/utils/checkpoint_io/meta.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-14T11:55:55,257   copying build/lib/colossalai/utils/checkpoint_io/backend.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-14T11:55:55,261   copying build/lib/colossalai/utils/checkpoint_io/convertor.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-14T11:55:55,265   copying build/lib/colossalai/utils/checkpoint_io/constant.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-02-14T11:55:55,269   creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-02-14T11:55:55,271   copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-02-14T11:55:55,274   copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-02-14T11:55:55,277   copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-14T11:55:55,282   copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-14T11:55:55,287   creating build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-14T11:55:55,289   copying build/lib/colossalai/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-14T11:55:55,292   copying build/lib/colossalai/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-14T11:55:55,295   copying build/lib/colossalai/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-02-14T11:55:55,299   copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-02-14T11:55:55,304   creating build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,305   copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,309   copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,313   copying build/lib/colossalai/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,316   copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,321   copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,325   copying build/lib/colossalai/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,328   copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,332   copying build/lib/colossalai/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,335   copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,339   copying build/lib/colossalai/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,343   copying build/lib/colossalai/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,346   copying build/lib/colossalai/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,349   copying build/lib/colossalai/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,353   copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,357   copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-02-14T11:55:55,364   creating build/bdist.linux-armv7l/wheel/colossalai/logging
2023-02-14T11:55:55,366   copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-02-14T11:55:55,369   copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-02-14T11:55:55,374   creating build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-14T11:55:55,375   copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-14T11:55:55,379   copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-14T11:55:55,382   copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-14T11:55:55,385   copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-14T11:55:55,389   copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-02-14T11:55:55,393   creating build/bdist.linux-armv7l/wheel/colossalai/zero
2023-02-14T11:55:55,395   copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero
2023-02-14T11:55:55,399   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-14T11:55:55,401   copying build/lib/colossalai/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-14T11:55:55,404   copying build/lib/colossalai/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-14T11:55:55,407   copying build/lib/colossalai/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-14T11:55:55,411   copying build/lib/colossalai/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-14T11:55:55,417   copying build/lib/colossalai/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-02-14T11:55:55,421   creating build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-14T11:55:55,423   copying build/lib/colossalai/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-14T11:55:55,426   copying build/lib/colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-14T11:55:55,430   copying build/lib/colossalai/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-14T11:55:55,433   copying build/lib/colossalai/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-14T11:55:55,436   copying build/lib/colossalai/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-02-14T11:55:55,440   creating build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-02-14T11:55:55,441   copying build/lib/colossalai/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-02-14T11:55:55,445   copying build/lib/colossalai/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-02-14T11:55:55,450   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-14T11:55:55,451   copying build/lib/colossalai/zero/sharded_optim/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-14T11:55:55,456   copying build/lib/colossalai/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-14T11:55:55,461   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:55,462   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:55,466   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:55,469   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:55,472   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:55,475   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:55,479   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-02-14T11:55:55,482   copying build/lib/colossalai/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-14T11:55:55,486   copying build/lib/colossalai/zero/sharded_optim/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-02-14T11:55:55,491   creating build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-14T11:55:55,493   copying build/lib/colossalai/zero/utils/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-14T11:55:55,496   copying build/lib/colossalai/zero/utils/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-14T11:55:55,500   copying build/lib/colossalai/zero/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-02-14T11:55:55,504   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-14T11:55:55,505   copying build/lib/colossalai/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-14T11:55:55,509   copying build/lib/colossalai/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-14T11:55:55,512   copying build/lib/colossalai/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-02-14T11:55:55,515   running install_egg_info
2023-02-14T11:55:55,720   running egg_info
2023-02-14T11:55:55,782   writing colossalai.egg-info/PKG-INFO
2023-02-14T11:55:55,787   writing dependency_links to colossalai.egg-info/dependency_links.txt
2023-02-14T11:55:55,791   writing entry points to colossalai.egg-info/entry_points.txt
2023-02-14T11:55:55,793   writing requirements to colossalai.egg-info/requires.txt
2023-02-14T11:55:55,796   writing top-level names to colossalai.egg-info/top_level.txt
2023-02-14T11:55:56,064   reading manifest file 'colossalai.egg-info/SOURCES.txt'
2023-02-14T11:55:56,136   reading manifest template 'MANIFEST.in'
2023-02-14T11:55:58,181   warning: no files found matching '*.tr' under directory 'colossalai'
2023-02-14T11:55:59,182   warning: no files found matching '*.cc' under directory 'colossalai'
2023-02-14T11:55:59,683   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-02-14T11:55:59,700   adding license file 'LICENSE'
2023-02-14T11:55:59,797   writing manifest file 'colossalai.egg-info/SOURCES.txt'
2023-02-14T11:55:59,803   Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.2.4-py3.7.egg-info
2023-02-14T11:55:59,830   running install_scripts
2023-02-14T11:56:00,009   adding license file "LICENSE" (matched pattern "LICEN[CS]E*")
2023-02-14T11:56:00,019   creating build/bdist.linux-armv7l/wheel/colossalai-0.2.4.dist-info/WHEEL
2023-02-14T11:56:00,024   creating '/tmp/pip-wheel-elrzb79a/colossalai-0.2.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2023-02-14T11:56:00,030   adding 'colossalai/__init__.py'
2023-02-14T11:56:00,033   adding 'colossalai/constants.py'
2023-02-14T11:56:00,036   adding 'colossalai/core.py'
2023-02-14T11:56:00,039   adding 'colossalai/global_variables.py'
2023-02-14T11:56:00,046   adding 'colossalai/initialize.py'
2023-02-14T11:56:00,049   adding 'colossalai/version.py'
2023-02-14T11:56:00,053   adding 'colossalai/_C/__init__.py'
2023-02-14T11:56:00,057   adding 'colossalai/amp/__init__.py'
2023-02-14T11:56:00,059   adding 'colossalai/amp/amp_type.py'
2023-02-14T11:56:00,063   adding 'colossalai/amp/apex_amp/__init__.py'
2023-02-14T11:56:00,066   adding 'colossalai/amp/apex_amp/apex_amp.py'
2023-02-14T11:56:00,071   adding 'colossalai/amp/naive_amp/__init__.py'
2023-02-14T11:56:00,076   adding 'colossalai/amp/naive_amp/_fp16_optimizer.py'
2023-02-14T11:56:00,079   adding 'colossalai/amp/naive_amp/_utils.py'
2023-02-14T11:56:00,083   adding 'colossalai/amp/naive_amp/naive_amp.py'
2023-02-14T11:56:00,087   adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py'
2023-02-14T11:56:00,090   adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py'
2023-02-14T11:56:00,093   adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py'
2023-02-14T11:56:00,096   adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py'
2023-02-14T11:56:00,100   adding 'colossalai/amp/torch_amp/__init__.py'
2023-02-14T11:56:00,109   adding 'colossalai/amp/torch_amp/_grad_scaler.py'
2023-02-14T11:56:00,113   adding 'colossalai/amp/torch_amp/torch_amp.py'
2023-02-14T11:56:00,117   adding 'colossalai/auto_parallel/__init__.py'
2023-02-14T11:56:00,121   adding 'colossalai/auto_parallel/checkpoint/__init__.py'
2023-02-14T11:56:00,124   adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py'
2023-02-14T11:56:00,128   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py'
2023-02-14T11:56:00,131   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py'
2023-02-14T11:56:00,136   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py'
2023-02-14T11:56:00,140   adding 'colossalai/auto_parallel/checkpoint/operation.py'
2023-02-14T11:56:00,143   adding 'colossalai/auto_parallel/meta_profiler/__init__.py'
2023-02-14T11:56:00,145   adding 'colossalai/auto_parallel/meta_profiler/constants.py'
2023-02-14T11:56:00,148   adding 'colossalai/auto_parallel/meta_profiler/metainfo.py'
2023-02-14T11:56:00,150   adding 'colossalai/auto_parallel/meta_profiler/registry.py'
2023-02-14T11:56:00,153   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py'
2023-02-14T11:56:00,156   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py'
2023-02-14T11:56:00,159   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py'
2023-02-14T11:56:00,162   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py'
2023-02-14T11:56:00,167   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py'
2023-02-14T11:56:00,171   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py'
2023-02-14T11:56:00,174   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py'
2023-02-14T11:56:00,177   adding 'colossalai/auto_parallel/passes/__init__.py'
2023-02-14T11:56:00,180   adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py'
2023-02-14T11:56:00,182   adding 'colossalai/auto_parallel/passes/constants.py'
2023-02-14T11:56:00,185   adding 'colossalai/auto_parallel/passes/meta_info_prop.py'
2023-02-14T11:56:00,189   adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py'
2023-02-14T11:56:00,195   adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py'
2023-02-14T11:56:00,199   adding 'colossalai/auto_parallel/pipeline_shard/__init__.py'
2023-02-14T11:56:00,202   adding 'colossalai/auto_parallel/tensor_shard/__init__.py'
2023-02-14T11:56:00,204   adding 'colossalai/auto_parallel/tensor_shard/constants.py'
2023-02-14T11:56:00,209   adding 'colossalai/auto_parallel/tensor_shard/initialize.py'
2023-02-14T11:56:00,213   adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py'
2023-02-14T11:56:00,216   adding 'colossalai/auto_parallel/tensor_shard/deprecated/__init__.py'
2023-02-14T11:56:00,220   adding 'colossalai/auto_parallel/tensor_shard/deprecated/_utils.py'
2023-02-14T11:56:00,222   adding 'colossalai/auto_parallel/tensor_shard/deprecated/constants.py'
2023-02-14T11:56:00,226   adding 'colossalai/auto_parallel/tensor_shard/deprecated/cost_graph.py'
2023-02-14T11:56:00,229   adding 'colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py'
2023-02-14T11:56:00,231   adding 'colossalai/auto_parallel/tensor_shard/deprecated/options.py'
2023-02-14T11:56:00,234   adding 'colossalai/auto_parallel/tensor_shard/deprecated/sharding_strategy.py'
2023-02-14T11:56:00,239   adding 'colossalai/auto_parallel/tensor_shard/deprecated/solver.py'
2023-02-14T11:56:00,245   adding 'colossalai/auto_parallel/tensor_shard/deprecated/strategies_constructor.py'
2023-02-14T11:56:00,249   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/__init__.py'
2023-02-14T11:56:00,254   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/batch_norm_handler.py'
2023-02-14T11:56:00,260   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/bcast_op_handler.py'
2023-02-14T11:56:00,267   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/conv_handler.py'
2023-02-14T11:56:00,273   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/dot_handler.py'
2023-02-14T11:56:00,277   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py'
2023-02-14T11:56:00,281   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py'
2023-02-14T11:56:00,284   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py'
2023-02-14T11:56:00,287   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py'
2023-02-14T11:56:00,289   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/strategy_generator.py'
2023-02-14T11:56:00,292   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py'
2023-02-14T11:56:00,296   adding 'colossalai/auto_parallel/tensor_shard/deprecated/op_handler/where_handler.py'
2023-02-14T11:56:00,301   adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py'
2023-02-14T11:56:00,303   adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py'
2023-02-14T11:56:00,306   adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py'
2023-02-14T11:56:00,309   adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py'
2023-02-14T11:56:00,312   adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py'
2023-02-14T11:56:00,315   adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py'
2023-02-14T11:56:00,317   adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py'
2023-02-14T11:56:00,321   adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py'
2023-02-14T11:56:00,323   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py'
2023-02-14T11:56:00,326   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py'
2023-02-14T11:56:00,328   adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py'
2023-02-14T11:56:00,332   adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py'
2023-02-14T11:56:00,338   adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py'
2023-02-14T11:56:00,343   adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py'
2023-02-14T11:56:00,346   adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py'
2023-02-14T11:56:00,348   adding 'colossalai/auto_parallel/tensor_shard/node_handler/option.py'
2023-02-14T11:56:00,350   adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py'
2023-02-14T11:56:00,353   adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py'
2023-02-14T11:56:00,355   adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py'
2023-02-14T11:56:00,357   adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py'
2023-02-14T11:56:00,360   adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py'
2023-02-14T11:56:00,362   adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py'
2023-02-14T11:56:00,365   adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py'
2023-02-14T11:56:00,367   adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py'
2023-02-14T11:56:00,369   adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py'
2023-02-14T11:56:00,372   adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py'
2023-02-14T11:56:00,374   adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py'
2023-02-14T11:56:00,377   adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py'
2023-02-14T11:56:00,381   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py'
2023-02-14T11:56:00,384   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py'
2023-02-14T11:56:00,387   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py'
2023-02-14T11:56:00,392   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py'
2023-02-14T11:56:00,396   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py'
2023-02-14T11:56:00,399   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py'
2023-02-14T11:56:00,402   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py'
2023-02-14T11:56:00,405   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py'
2023-02-14T11:56:00,412   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py'
2023-02-14T11:56:00,416   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py'
2023-02-14T11:56:00,419   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py'
2023-02-14T11:56:00,421   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py'
2023-02-14T11:56:00,426   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py'
2023-02-14T11:56:00,430   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py'
2023-02-14T11:56:00,434   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py'
2023-02-14T11:56:00,437   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py'
2023-02-14T11:56:00,440   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py'
2023-02-14T11:56:00,442   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py'
2023-02-14T11:56:00,445   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py'
2023-02-14T11:56:00,448   adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py'
2023-02-14T11:56:00,452   adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py'
2023-02-14T11:56:00,455   adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py'
2023-02-14T11:56:00,457   adding 'colossalai/auto_parallel/tensor_shard/solver/options.py'
2023-02-14T11:56:00,463   adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py'
2023-02-14T11:56:00,466   adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py'
2023-02-14T11:56:00,470   adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py'
2023-02-14T11:56:00,473   adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py'
2023-02-14T11:56:00,475   adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py'
2023-02-14T11:56:00,478   adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py'
2023-02-14T11:56:00,482   adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py'
2023-02-14T11:56:00,485   adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py'
2023-02-14T11:56:00,488   adding 'colossalai/builder/__init__.py'
2023-02-14T11:56:00,490   adding 'colossalai/builder/builder.py'
2023-02-14T11:56:00,493   adding 'colossalai/cli/__init__.py'
2023-02-14T11:56:00,495   adding 'colossalai/cli/cli.py'
2023-02-14T11:56:00,499   adding 'colossalai/cli/benchmark/__init__.py'
2023-02-14T11:56:00,502   adding 'colossalai/cli/benchmark/benchmark.py'
2023-02-14T11:56:00,504   adding 'colossalai/cli/benchmark/models.py'
2023-02-14T11:56:00,507   adding 'colossalai/cli/benchmark/utils.py'
2023-02-14T11:56:00,510   adding 'colossalai/cli/check/__init__.py'
2023-02-14T11:56:00,513   adding 'colossalai/cli/check/check_installation.py'
2023-02-14T11:56:00,517   adding 'colossalai/cli/launcher/__init__.py'
2023-02-14T11:56:00,520   adding 'colossalai/cli/launcher/hostinfo.py'
2023-02-14T11:56:00,523   adding 'colossalai/cli/launcher/multinode_runner.py'
2023-02-14T11:56:00,526   adding 'colossalai/cli/launcher/run.py'
2023-02-14T11:56:00,530   adding 'colossalai/communication/__init__.py'
2023-02-14T11:56:00,534   adding 'colossalai/communication/collective.py'
2023-02-14T11:56:00,538   adding 'colossalai/communication/p2p.py'
2023-02-14T11:56:00,542   adding 'colossalai/communication/p2p_v2.py'
2023-02-14T11:56:00,544   adding 'colossalai/communication/ring.py'
2023-02-14T11:56:00,547   adding 'colossalai/communication/utils.py'
2023-02-14T11:56:00,551   adding 'colossalai/context/__init__.py'
2023-02-14T11:56:00,553   adding 'colossalai/context/config.py'
2023-02-14T11:56:00,556   adding 'colossalai/context/moe_context.py'
2023-02-14T11:56:00,562   adding 'colossalai/context/parallel_context.py'
2023-02-14T11:56:00,565   adding 'colossalai/context/parallel_mode.py'
2023-02-14T11:56:00,567   adding 'colossalai/context/singleton_meta.py'
2023-02-14T11:56:00,571   adding 'colossalai/context/process_group_initializer/__init__.py'
2023-02-14T11:56:00,573   adding 'colossalai/context/process_group_initializer/initializer_1d.py'
2023-02-14T11:56:00,576   adding 'colossalai/context/process_group_initializer/initializer_2d.py'
2023-02-14T11:56:00,579   adding 'colossalai/context/process_group_initializer/initializer_2p5d.py'
2023-02-14T11:56:00,583   adding 'colossalai/context/process_group_initializer/initializer_3d.py'
2023-02-14T11:56:00,585   adding 'colossalai/context/process_group_initializer/initializer_data.py'
2023-02-14T11:56:00,588   adding 'colossalai/context/process_group_initializer/initializer_model.py'
2023-02-14T11:56:00,590   adding 'colossalai/context/process_group_initializer/initializer_pipeline.py'
2023-02-14T11:56:00,593   adding 'colossalai/context/process_group_initializer/initializer_sequence.py'
2023-02-14T11:56:00,595   adding 'colossalai/context/process_group_initializer/initializer_tensor.py'
2023-02-14T11:56:00,597   adding 'colossalai/context/process_group_initializer/process_group_initializer.py'
2023-02-14T11:56:00,600   adding 'colossalai/context/random/__init__.py'
2023-02-14T11:56:00,603   adding 'colossalai/context/random/_helper.py'
2023-02-14T11:56:00,606   adding 'colossalai/context/random/seed_manager.py'
2023-02-14T11:56:00,609   adding 'colossalai/device/__init__.py'
2023-02-14T11:56:00,614   adding 'colossalai/device/alpha_beta_profiler.py'
2023-02-14T11:56:00,617   adding 'colossalai/device/calc_pipeline_strategy.py'
2023-02-14T11:56:00,621   adding 'colossalai/device/device_mesh.py'
2023-02-14T11:56:00,624   adding 'colossalai/engine/__init__.py'
2023-02-14T11:56:00,628   adding 'colossalai/engine/_base_engine.py'
2023-02-14T11:56:00,632   adding 'colossalai/engine/gradient_accumulation/__init__.py'
2023-02-14T11:56:00,635   adding 'colossalai/engine/gradient_accumulation/_gradient_accumulation.py'
2023-02-14T11:56:00,639   adding 'colossalai/engine/gradient_handler/__init__.py'
2023-02-14T11:56:00,641   adding 'colossalai/engine/gradient_handler/_base_gradient_handler.py'
2023-02-14T11:56:00,643   adding 'colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py'
2023-02-14T11:56:00,646   adding 'colossalai/engine/gradient_handler/_moe_gradient_handler.py'
2023-02-14T11:56:00,649   adding 'colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py'
2023-02-14T11:56:00,651   adding 'colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py'
2023-02-14T11:56:00,653   adding 'colossalai/engine/gradient_handler/_zero_gradient_handler.py'
2023-02-14T11:56:00,655   adding 'colossalai/engine/gradient_handler/utils.py'
2023-02-14T11:56:00,659   adding 'colossalai/engine/schedule/__init__.py'
2023-02-14T11:56:00,662   adding 'colossalai/engine/schedule/_base_schedule.py'
2023-02-14T11:56:00,664   adding 'colossalai/engine/schedule/_non_pipeline_schedule.py'
2023-02-14T11:56:00,673   adding 'colossalai/engine/schedule/_pipeline_schedule.py'
2023-02-14T11:56:00,677   adding 'colossalai/engine/schedule/_pipeline_schedule_v2.py'
2023-02-14T11:56:00,681   adding 'colossalai/fx/__init__.py'
2023-02-14T11:56:00,683   adding 'colossalai/fx/_compatibility.py'
2023-02-14T11:56:00,688   adding 'colossalai/fx/_meta_registrations.py'
2023-02-14T11:56:00,692   adding 'colossalai/fx/graph_module.py'
2023-02-14T11:56:00,695   adding 'colossalai/fx/proxy.py'
2023-02-14T11:56:00,698   adding 'colossalai/fx/codegen/__init__.py'
2023-02-14T11:56:00,708   adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py'
2023-02-14T11:56:00,712   adding 'colossalai/fx/passes/__init__.py'
2023-02-14T11:56:00,716   adding 'colossalai/fx/passes/adding_split_node_pass.py'
2023-02-14T11:56:00,720   adding 'colossalai/fx/passes/concrete_info_prop.py'
2023-02-14T11:56:00,724   adding 'colossalai/fx/passes/meta_info_prop.py'
2023-02-14T11:56:00,730   adding 'colossalai/fx/passes/passes_for_gpt2_test.py'
2023-02-14T11:56:00,733   adding 'colossalai/fx/passes/shard_1d_pass.py'
2023-02-14T11:56:00,737   adding 'colossalai/fx/passes/split_module.py'
2023-02-14T11:56:00,741   adding 'colossalai/fx/passes/utils.py'
2023-02-14T11:56:00,744   adding 'colossalai/fx/passes/algorithms/__init__.py'
2023-02-14T11:56:00,747   adding 'colossalai/fx/passes/algorithms/build_c_ext.py'
2023-02-14T11:56:00,750   adding 'colossalai/fx/passes/algorithms/ckpt_solver_chen.py'
2023-02-14T11:56:00,756   adding 'colossalai/fx/passes/algorithms/ckpt_solver_pofo.py'
2023-02-14T11:56:00,761   adding 'colossalai/fx/passes/algorithms/ckpt_solver_rotor.py'
2023-02-14T11:56:00,764   adding 'colossalai/fx/passes/algorithms/linearize.py'
2023-02-14T11:56:00,767   adding 'colossalai/fx/passes/algorithms/operation.py'
2023-02-14T11:56:00,771   adding 'colossalai/fx/profiler/__init__.py'
2023-02-14T11:56:00,773   adding 'colossalai/fx/profiler/constants.py'
2023-02-14T11:56:00,776   adding 'colossalai/fx/profiler/dataflow.py'
2023-02-14T11:56:00,779   adding 'colossalai/fx/profiler/memory_utils.py'
2023-02-14T11:56:00,783   adding 'colossalai/fx/profiler/opcount.py'
2023-02-14T11:56:00,788   adding 'colossalai/fx/profiler/profiler.py'
2023-02-14T11:56:00,791   adding 'colossalai/fx/profiler/shard_utils.py'
2023-02-14T11:56:00,794   adding 'colossalai/fx/profiler/tensor.py'
2023-02-14T11:56:00,798   adding 'colossalai/fx/profiler/experimental/__init__.py'
2023-02-14T11:56:00,800   adding 'colossalai/fx/profiler/experimental/constants.py'
2023-02-14T11:56:00,803   adding 'colossalai/fx/profiler/experimental/profiler.py'
2023-02-14T11:56:00,805   adding 'colossalai/fx/profiler/experimental/registry.py'
2023-02-14T11:56:00,807   adding 'colossalai/fx/profiler/experimental/shard_utils.py'
2023-02-14T11:56:00,811   adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py'
2023-02-14T11:56:00,813   adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py'
2023-02-14T11:56:00,816   adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py'
2023-02-14T11:56:00,818   adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py'
2023-02-14T11:56:00,820   adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py'
2023-02-14T11:56:00,823   adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py'
2023-02-14T11:56:00,825   adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py'
2023-02-14T11:56:00,827   adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py'
2023-02-14T11:56:00,830   adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py'
2023-02-14T11:56:00,834   adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py'
2023-02-14T11:56:00,836   adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py'
2023-02-14T11:56:00,839   adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py'
2023-02-14T11:56:00,842   adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py'
2023-02-14T11:56:00,845   adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py'
2023-02-14T11:56:00,848   adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py'
2023-02-14T11:56:00,851   adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py'
2023-02-14T11:56:00,854   adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py'
2023-02-14T11:56:00,856   adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py'
2023-02-14T11:56:00,858   adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py'
2023-02-14T11:56:00,861   adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py'
2023-02-14T11:56:00,864   adding 'colossalai/fx/tracer/__init__.py'
2023-02-14T11:56:00,867   adding 'colossalai/fx/tracer/_meta_trace.py'
2023-02-14T11:56:00,869   adding 'colossalai/fx/tracer/_symbolic_trace.py'
2023-02-14T11:56:00,872   adding 'colossalai/fx/tracer/_tracer_utils.py'
2023-02-14T11:56:00,879   adding 'colossalai/fx/tracer/experimental.py'
2023-02-14T11:56:00,882   adding 'colossalai/fx/tracer/registry.py'
2023-02-14T11:56:00,889   adding 'colossalai/fx/tracer/tracer.py'
2023-02-14T11:56:00,892   adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py'
2023-02-14T11:56:00,896   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py'
2023-02-14T11:56:00,899   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py'
2023-02-14T11:56:00,902   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py'
2023-02-14T11:56:00,904   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py'
2023-02-14T11:56:00,907   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py'
2023-02-14T11:56:00,910   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py'
2023-02-14T11:56:00,913   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py'
2023-02-14T11:56:00,915   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py'
2023-02-14T11:56:00,918   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py'
2023-02-14T11:56:00,921   adding 'colossalai/fx/tracer/meta_patch/__init__.py'
2023-02-14T11:56:00,924   adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py'
2023-02-14T11:56:00,926   adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py'
2023-02-14T11:56:00,929   adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py'
2023-02-14T11:56:00,932   adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py'
2023-02-14T11:56:00,934   adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py'
2023-02-14T11:56:00,936   adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py'
2023-02-14T11:56:00,938   adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py'
2023-02-14T11:56:00,941   adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py'
2023-02-14T11:56:00,945   adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py'
2023-02-14T11:56:00,947   adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py'
2023-02-14T11:56:00,950   adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py'
2023-02-14T11:56:00,952   adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py'
2023-02-14T11:56:00,954   adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py'
2023-02-14T11:56:00,956   adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py'
2023-02-14T11:56:00,959   adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py'
2023-02-14T11:56:00,961   adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py'
2023-02-14T11:56:00,965   adding 'colossalai/gemini/__init__.py'
2023-02-14T11:56:00,967   adding 'colossalai/gemini/gemini_context.py'
2023-02-14T11:56:00,970   adding 'colossalai/gemini/gemini_mgr.py'
2023-02-14T11:56:00,974   adding 'colossalai/gemini/placement_policy.py'
2023-02-14T11:56:00,977   adding 'colossalai/gemini/stateful_tensor.py'
2023-02-14T11:56:00,980   adding 'colossalai/gemini/stateful_tensor_mgr.py'
2023-02-14T11:56:00,983   adding 'colossalai/gemini/tensor_placement_policy.py'
2023-02-14T11:56:00,986   adding 'colossalai/gemini/tensor_utils.py'
2023-02-14T11:56:00,989   adding 'colossalai/gemini/chunk/__init__.py'
2023-02-14T11:56:00,996   adding 'colossalai/gemini/chunk/chunk.py'
2023-02-14T11:56:01,000   adding 'colossalai/gemini/chunk/manager.py'
2023-02-14T11:56:01,003   adding 'colossalai/gemini/chunk/search_utils.py'
2023-02-14T11:56:01,005   adding 'colossalai/gemini/chunk/utils.py'
2023-02-14T11:56:01,009   adding 'colossalai/gemini/memory_tracer/__init__.py'
2023-02-14T11:56:01,011   adding 'colossalai/gemini/memory_tracer/chunk_memstats_collector.py'
2023-02-14T11:56:01,014   adding 'colossalai/gemini/memory_tracer/memory_monitor.py'
2023-02-14T11:56:01,017   adding 'colossalai/gemini/memory_tracer/memory_stats.py'
2023-02-14T11:56:01,020   adding 'colossalai/gemini/memory_tracer/memstats_collector.py'
2023-02-14T11:56:01,022   adding 'colossalai/gemini/memory_tracer/param_runtime_order.py'
2023-02-14T11:56:01,025   adding 'colossalai/gemini/memory_tracer/runtime_mem_tracer.py'
2023-02-14T11:56:01,028   adding 'colossalai/gemini/memory_tracer/static_memstats_collector.py'
2023-02-14T11:56:01,030   adding 'colossalai/gemini/memory_tracer/utils.py'
2023-02-14T11:56:01,034   adding 'colossalai/gemini/ophooks/__init__.py'
2023-02-14T11:56:01,036   adding 'colossalai/gemini/ophooks/_shard_grad_ophook.py'
2023-02-14T11:56:01,038   adding 'colossalai/gemini/ophooks/_shard_param_ophook.py'
2023-02-14T11:56:01,041   adding 'colossalai/gemini/ophooks/runtime_mem_tracer_hook.py'
2023-02-14T11:56:01,044   adding 'colossalai/gemini/ophooks/utils.py'
2023-02-14T11:56:01,047   adding 'colossalai/gemini/paramhooks/__init__.py'
2023-02-14T11:56:01,049   adding 'colossalai/gemini/paramhooks/_param_hookmgr.py'
2023-02-14T11:56:01,052   adding 'colossalai/kernel/__init__.py'
2023-02-14T11:56:01,056   adding 'colossalai/kernel/cuda_native/__init__.py'
2023-02-14T11:56:01,061   adding 'colossalai/kernel/cuda_native/flash_attention.py'
2023-02-14T11:56:01,064   adding 'colossalai/kernel/cuda_native/layer_norm.py'
2023-02-14T11:56:01,067   adding 'colossalai/kernel/cuda_native/multihead_attention.py'
2023-02-14T11:56:01,071   adding 'colossalai/kernel/cuda_native/scaled_softmax.py'
2023-02-14T11:56:01,075   adding 'colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp'
2023-02-14T11:56:01,077   adding 'colossalai/kernel/cuda_native/csrc/compat.h'
2023-02-14T11:56:01,081   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.cpp'
2023-02-14T11:56:01,085   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.h'
2023-02-14T11:56:01,087   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp'
2023-02-14T11:56:01,094   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu'
2023-02-14T11:56:01,098   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda.cpp'
2023-02-14T11:56:01,103   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu'
2023-02-14T11:56:01,106   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu'
2023-02-14T11:56:01,110   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh'
2023-02-14T11:56:01,113   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu'
2023-02-14T11:56:01,118   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu'
2023-02-14T11:56:01,121   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu'
2023-02-14T11:56:01,124   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu'
2023-02-14T11:56:01,128   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp'
2023-02-14T11:56:01,132   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h'
2023-02-14T11:56:01,134   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp'
2023-02-14T11:56:01,139   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h'
2023-02-14T11:56:01,142   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu'
2023-02-14T11:56:01,144   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp'
2023-02-14T11:56:01,149   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h'
2023-02-14T11:56:01,152   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu'
2023-02-14T11:56:01,155   adding 'colossalai/kernel/cuda_native/csrc/type_shim.h'
2023-02-14T11:56:01,160   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h'
2023-02-14T11:56:01,163   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/context.h'
2023-02-14T11:56:01,165   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h'
2023-02-14T11:56:01,167   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h'
2023-02-14T11:56:01,170   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h'
2023-02-14T11:56:01,172   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h'
2023-02-14T11:56:01,175   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h'
2023-02-14T11:56:01,178   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h'
2023-02-14T11:56:01,181   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh'
2023-02-14T11:56:01,183   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h'
2023-02-14T11:56:01,186   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h'
2023-02-14T11:56:01,189   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h'
2023-02-14T11:56:01,192   adding 'colossalai/kernel/jit/__init__.py'
2023-02-14T11:56:01,194   adding 'colossalai/kernel/jit/bias_dropout_add.py'
2023-02-14T11:56:01,196   adding 'colossalai/kernel/jit/bias_gelu.py'
2023-02-14T11:56:01,199   adding 'colossalai/kernel/jit/option.py'
2023-02-14T11:56:01,203   adding 'colossalai/kernel/op_builder/__init__.py'
2023-02-14T11:56:01,206   adding 'colossalai/kernel/op_builder/builder.py'
2023-02-14T11:56:01,208   adding 'colossalai/kernel/op_builder/cpu_adam.py'
2023-02-14T11:56:01,211   adding 'colossalai/kernel/op_builder/fused_optim.py'
2023-02-14T11:56:01,213   adding 'colossalai/kernel/op_builder/layernorm.py'
2023-02-14T11:56:01,215   adding 'colossalai/kernel/op_builder/moe.py'
2023-02-14T11:56:01,217   adding 'colossalai/kernel/op_builder/multi_head_attn.py'
2023-02-14T11:56:01,220   adding 'colossalai/kernel/op_builder/scaled_masked_softmax.py'
2023-02-14T11:56:01,222   adding 'colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py'
2023-02-14T11:56:01,224   adding 'colossalai/kernel/op_builder/utils.py'
2023-02-14T11:56:01,228   adding 'colossalai/logging/__init__.py'
2023-02-14T11:56:01,231   adding 'colossalai/logging/logger.py'
2023-02-14T11:56:01,234   adding 'colossalai/nn/__init__.py'
2023-02-14T11:56:01,237   adding 'colossalai/nn/init.py'
2023-02-14T11:56:01,241   adding 'colossalai/nn/_ops/__init__.py'
2023-02-14T11:56:01,244   adding 'colossalai/nn/_ops/_utils.py'
2023-02-14T11:56:01,247   adding 'colossalai/nn/_ops/addmm.py'
2023-02-14T11:56:01,249   adding 'colossalai/nn/_ops/batch_norm.py'
2023-02-14T11:56:01,252   adding 'colossalai/nn/_ops/element_wise.py'
2023-02-14T11:56:01,255   adding 'colossalai/nn/_ops/embedding.py'
2023-02-14T11:56:01,258   adding 'colossalai/nn/_ops/embedding_bag.py'
2023-02-14T11:56:01,260   adding 'colossalai/nn/_ops/layernorm.py'
2023-02-14T11:56:01,263   adding 'colossalai/nn/_ops/linear.py'
2023-02-14T11:56:01,266   adding 'colossalai/nn/_ops/loss.py'
2023-02-14T11:56:01,269   adding 'colossalai/nn/_ops/view.py'
2023-02-14T11:56:01,272   adding 'colossalai/nn/layer/__init__.py'
2023-02-14T11:56:01,274   adding 'colossalai/nn/layer/base_layer.py'
2023-02-14T11:56:01,278   adding 'colossalai/nn/layer/colossalai_layer/__init__.py'
2023-02-14T11:56:01,280   adding 'colossalai/nn/layer/colossalai_layer/_utils.py'
2023-02-14T11:56:01,282   adding 'colossalai/nn/layer/colossalai_layer/dropout.py'
2023-02-14T11:56:01,285   adding 'colossalai/nn/layer/colossalai_layer/embedding.py'
2023-02-14T11:56:01,288   adding 'colossalai/nn/layer/colossalai_layer/linear.py'
2023-02-14T11:56:01,290   adding 'colossalai/nn/layer/colossalai_layer/normalization.py'
2023-02-14T11:56:01,294   adding 'colossalai/nn/layer/moe/__init__.py'
2023-02-14T11:56:01,296   adding 'colossalai/nn/layer/moe/_operation.py'
2023-02-14T11:56:01,300   adding 'colossalai/nn/layer/moe/experts.py'
2023-02-14T11:56:01,303   adding 'colossalai/nn/layer/moe/layers.py'
2023-02-14T11:56:01,307   adding 'colossalai/nn/layer/moe/routers.py'
2023-02-14T11:56:01,310   adding 'colossalai/nn/layer/moe/utils.py'
2023-02-14T11:56:01,313   adding 'colossalai/nn/layer/parallel_1d/__init__.py'
2023-02-14T11:56:01,315   adding 'colossalai/nn/layer/parallel_1d/_operation.py'
2023-02-14T11:56:01,318   adding 'colossalai/nn/layer/parallel_1d/_utils.py'
2023-02-14T11:56:01,327   adding 'colossalai/nn/layer/parallel_1d/layers.py'
2023-02-14T11:56:01,331   adding 'colossalai/nn/layer/parallel_2d/__init__.py'
2023-02-14T11:56:01,337   adding 'colossalai/nn/layer/parallel_2d/_operation.py'
2023-02-14T11:56:01,340   adding 'colossalai/nn/layer/parallel_2d/_utils.py'
2023-02-14T11:56:01,348   adding 'colossalai/nn/layer/parallel_2d/layers.py'
2023-02-14T11:56:01,353   adding 'colossalai/nn/layer/parallel_2p5d/__init__.py'
2023-02-14T11:56:01,359   adding 'colossalai/nn/layer/parallel_2p5d/_operation.py'
2023-02-14T11:56:01,362   adding 'colossalai/nn/layer/parallel_2p5d/_utils.py'
2023-02-14T11:56:01,371   adding 'colossalai/nn/layer/parallel_2p5d/layers.py'
2023-02-14T11:56:01,375   adding 'colossalai/nn/layer/parallel_3d/__init__.py'
2023-02-14T11:56:01,380   adding 'colossalai/nn/layer/parallel_3d/_operation.py'
2023-02-14T11:56:01,383   adding 'colossalai/nn/layer/parallel_3d/_utils.py'
2023-02-14T11:56:01,391   adding 'colossalai/nn/layer/parallel_3d/layers.py'
2023-02-14T11:56:01,395   adding 'colossalai/nn/layer/parallel_sequence/__init__.py'
2023-02-14T11:56:01,398   adding 'colossalai/nn/layer/parallel_sequence/_operation.py'
2023-02-14T11:56:01,400   adding 'colossalai/nn/layer/parallel_sequence/_utils.py'
2023-02-14T11:56:01,404   adding 'colossalai/nn/layer/parallel_sequence/layers.py'
2023-02-14T11:56:01,407   adding 'colossalai/nn/layer/utils/__init__.py'
2023-02-14T11:56:01,409   adding 'colossalai/nn/layer/utils/common.py'
2023-02-14T11:56:01,413   adding 'colossalai/nn/layer/vanilla/__init__.py'
2023-02-14T11:56:01,417   adding 'colossalai/nn/layer/vanilla/layers.py'
2023-02-14T11:56:01,420   adding 'colossalai/nn/layer/wrapper/__init__.py'
2023-02-14T11:56:01,422   adding 'colossalai/nn/layer/wrapper/pipeline_wrapper.py'
2023-02-14T11:56:01,426   adding 'colossalai/nn/loss/__init__.py'
2023-02-14T11:56:01,439   adding 'colossalai/nn/loss/loss_1d.py'
2023-02-14T11:56:01,442   adding 'colossalai/nn/loss/loss_2d.py'
2023-02-14T11:56:01,445   adding 'colossalai/nn/loss/loss_2p5d.py'
2023-02-14T11:56:01,449   adding 'colossalai/nn/loss/loss_3d.py'
2023-02-14T11:56:01,451   adding 'colossalai/nn/loss/loss_moe.py'
2023-02-14T11:56:01,455   adding 'colossalai/nn/lr_scheduler/__init__.py'
2023-02-14T11:56:01,458   adding 'colossalai/nn/lr_scheduler/cosine.py'
2023-02-14T11:56:01,461   adding 'colossalai/nn/lr_scheduler/delayed.py'
2023-02-14T11:56:01,463   adding 'colossalai/nn/lr_scheduler/linear.py'
2023-02-14T11:56:01,466   adding 'colossalai/nn/lr_scheduler/multistep.py'
2023-02-14T11:56:01,469   adding 'colossalai/nn/lr_scheduler/onecycle.py'
2023-02-14T11:56:01,472   adding 'colossalai/nn/lr_scheduler/poly.py'
2023-02-14T11:56:01,474   adding 'colossalai/nn/lr_scheduler/torch.py'
2023-02-14T11:56:01,477   adding 'colossalai/nn/metric/__init__.py'
2023-02-14T11:56:01,480   adding 'colossalai/nn/metric/_utils.py'
2023-02-14T11:56:01,482   adding 'colossalai/nn/metric/accuracy_2d.py'
2023-02-14T11:56:01,484   adding 'colossalai/nn/metric/accuracy_2p5d.py'
2023-02-14T11:56:01,487   adding 'colossalai/nn/metric/accuracy_3d.py'
2023-02-14T11:56:01,490   adding 'colossalai/nn/optimizer/__init__.py'
2023-02-14T11:56:01,493   adding 'colossalai/nn/optimizer/colossalai_optimizer.py'
2023-02-14T11:56:01,496   adding 'colossalai/nn/optimizer/cpu_adam.py'
2023-02-14T11:56:01,499   adding 'colossalai/nn/optimizer/fused_adam.py'
2023-02-14T11:56:01,503   adding 'colossalai/nn/optimizer/fused_lamb.py'
2023-02-14T11:56:01,506   adding 'colossalai/nn/optimizer/fused_sgd.py'
2023-02-14T11:56:01,509   adding 'colossalai/nn/optimizer/gemini_optimizer.py'
2023-02-14T11:56:01,512   adding 'colossalai/nn/optimizer/hybrid_adam.py'
2023-02-14T11:56:01,514   adding 'colossalai/nn/optimizer/lamb.py'
2023-02-14T11:56:01,517   adding 'colossalai/nn/optimizer/lars.py'
2023-02-14T11:56:01,520   adding 'colossalai/nn/optimizer/nvme_optimizer.py'
2023-02-14T11:56:01,525   adding 'colossalai/nn/optimizer/zero_optimizer.py'
2023-02-14T11:56:01,528   adding 'colossalai/nn/parallel/__init__.py'
2023-02-14T11:56:01,537   adding 'colossalai/nn/parallel/data_parallel.py'
2023-02-14T11:56:01,540   adding 'colossalai/nn/parallel/gemini_parallel.py'
2023-02-14T11:56:01,543   adding 'colossalai/nn/parallel/reducer.py'
2023-02-14T11:56:01,545   adding 'colossalai/nn/parallel/utils.py'
2023-02-14T11:56:01,549   adding 'colossalai/nn/parallel/zero_wrapper.py'
2023-02-14T11:56:01,552   adding 'colossalai/nn/parallel/layers/__init__.py'
2023-02-14T11:56:01,554   adding 'colossalai/nn/parallel/layers/colo_module.py'
2023-02-14T11:56:01,556   adding 'colossalai/nn/parallel/layers/embedding.py'
2023-02-14T11:56:01,559   adding 'colossalai/nn/parallel/layers/linear.py'
2023-02-14T11:56:01,561   adding 'colossalai/nn/parallel/layers/module_utils.py'
2023-02-14T11:56:01,565   adding 'colossalai/nn/parallel/layers/cache_embedding/__init__.py'
2023-02-14T11:56:01,567   adding 'colossalai/nn/parallel/layers/cache_embedding/base_embedding.py'
2023-02-14T11:56:01,574   adding 'colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py'
2023-02-14T11:56:01,578   adding 'colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py'
2023-02-14T11:56:01,581   adding 'colossalai/nn/parallel/layers/cache_embedding/copyer.py'
2023-02-14T11:56:01,583   adding 'colossalai/nn/parallel/layers/cache_embedding/embedding_config.py'
2023-02-14T11:56:01,586   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py'
2023-02-14T11:56:01,590   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py'
2023-02-14T11:56:01,593   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py'
2023-02-14T11:56:01,596   adding 'colossalai/pipeline/__init__.py'
2023-02-14T11:56:01,599   adding 'colossalai/pipeline/layer_spec.py'
2023-02-14T11:56:01,603   adding 'colossalai/pipeline/pipelinable.py'
2023-02-14T11:56:01,606   adding 'colossalai/pipeline/pipeline_process_group.py'
2023-02-14T11:56:01,610   adding 'colossalai/pipeline/utils.py'
2023-02-14T11:56:01,613   adding 'colossalai/pipeline/middleware/__init__.py'
2023-02-14T11:56:01,616   adding 'colossalai/pipeline/middleware/topo.py'
2023-02-14T11:56:01,619   adding 'colossalai/pipeline/middleware/adaptor/__init__.py'
2023-02-14T11:56:01,622   adding 'colossalai/pipeline/middleware/adaptor/fx.py'
2023-02-14T11:56:01,625   adding 'colossalai/pipeline/rpc/__init__.py'
2023-02-14T11:56:01,639   adding 'colossalai/pipeline/rpc/_pipeline_base.py'
2023-02-14T11:56:01,645   adding 'colossalai/pipeline/rpc/_pipeline_schedule.py'
2023-02-14T11:56:01,648   adding 'colossalai/pipeline/rpc/utils.py'
2023-02-14T11:56:01,651   adding 'colossalai/registry/__init__.py'
2023-02-14T11:56:01,654   adding 'colossalai/registry/registry.py'
2023-02-14T11:56:01,657   adding 'colossalai/tensor/__init__.py'
2023-02-14T11:56:01,661   adding 'colossalai/tensor/colo_parameter.py'
2023-02-14T11:56:01,665   adding 'colossalai/tensor/colo_tensor.py'
2023-02-14T11:56:01,671   adding 'colossalai/tensor/comm_spec.py'
2023-02-14T11:56:01,673   adding 'colossalai/tensor/compute_spec.py'
2023-02-14T11:56:01,675   adding 'colossalai/tensor/const.py'
2023-02-14T11:56:01,678   adding 'colossalai/tensor/dist_spec_mgr.py'
2023-02-14T11:56:01,681   adding 'colossalai/tensor/distspec.py'
2023-02-14T11:56:01,683   adding 'colossalai/tensor/op_wrapper.py'
2023-02-14T11:56:01,686   adding 'colossalai/tensor/param_op_hook.py'
2023-02-14T11:56:01,690   adding 'colossalai/tensor/process_group.py'
2023-02-14T11:56:01,698   adding 'colossalai/tensor/shape_consistency.py'
2023-02-14T11:56:01,703   adding 'colossalai/tensor/sharding_spec.py'
2023-02-14T11:56:01,705   adding 'colossalai/tensor/tensor_spec.py'
2023-02-14T11:56:01,709   adding 'colossalai/tensor/utils.py'
2023-02-14T11:56:01,712   adding 'colossalai/testing/__init__.py'
2023-02-14T11:56:01,714   adding 'colossalai/testing/comparison.py'
2023-02-14T11:56:01,717   adding 'colossalai/testing/pytest_wrapper.py'
2023-02-14T11:56:01,719   adding 'colossalai/testing/random.py'
2023-02-14T11:56:01,722   adding 'colossalai/testing/utils.py'
2023-02-14T11:56:01,725   adding 'colossalai/trainer/__init__.py'
2023-02-14T11:56:01,730   adding 'colossalai/trainer/_trainer.py'
2023-02-14T11:56:01,733   adding 'colossalai/trainer/hooks/__init__.py'
2023-02-14T11:56:01,736   adding 'colossalai/trainer/hooks/_base_hook.py'
2023-02-14T11:56:01,738   adding 'colossalai/trainer/hooks/_checkpoint_hook.py'
2023-02-14T11:56:01,740   adding 'colossalai/trainer/hooks/_commons_.py'
2023-02-14T11:56:01,744   adding 'colossalai/trainer/hooks/_log_hook.py'
2023-02-14T11:56:01,747   adding 'colossalai/trainer/hooks/_lr_scheduler_hook.py'
2023-02-14T11:56:01,751   adding 'colossalai/trainer/hooks/_metric_hook.py'
2023-02-14T11:56:01,755   adding 'colossalai/utils/__init__.py'
2023-02-14T11:56:01,759   adding 'colossalai/utils/activation_checkpoint.py'
2023-02-14T11:56:01,763   adding 'colossalai/utils/checkpointing.py'
2023-02-14T11:56:01,769   adding 'colossalai/utils/common.py'
2023-02-14T11:56:01,771   adding 'colossalai/utils/cuda.py'
2023-02-14T11:56:01,774   adding 'colossalai/utils/memory.py'
2023-02-14T11:56:01,777   adding 'colossalai/utils/moe.py'
2023-02-14T11:56:01,779   adding 'colossalai/utils/timer.py'
2023-02-14T11:56:01,783   adding 'colossalai/utils/checkpoint/__init__.py'
2023-02-14T11:56:01,785   adding 'colossalai/utils/checkpoint/module_checkpoint.py'
2023-02-14T11:56:01,788   adding 'colossalai/utils/checkpoint/utils.py'
2023-02-14T11:56:01,791   adding 'colossalai/utils/checkpoint_io/__init__.py'
2023-02-14T11:56:01,793   adding 'colossalai/utils/checkpoint_io/backend.py'
2023-02-14T11:56:01,796   adding 'colossalai/utils/checkpoint_io/constant.py'
2023-02-14T11:56:01,799   adding 'colossalai/utils/checkpoint_io/convertor.py'
2023-02-14T11:56:01,802   adding 'colossalai/utils/checkpoint_io/distributed.py'
2023-02-14T11:56:01,805   adding 'colossalai/utils/checkpoint_io/io.py'
2023-02-14T11:56:01,807   adding 'colossalai/utils/checkpoint_io/meta.py'
2023-02-14T11:56:01,810   adding 'colossalai/utils/checkpoint_io/reader.py'
2023-02-14T11:56:01,814   adding 'colossalai/utils/checkpoint_io/utils.py'
2023-02-14T11:56:01,816   adding 'colossalai/utils/checkpoint_io/writer.py'
2023-02-14T11:56:01,819   adding 'colossalai/utils/data_sampler/__init__.py'
2023-02-14T11:56:01,822   adding 'colossalai/utils/data_sampler/base_sampler.py'
2023-02-14T11:56:01,825   adding 'colossalai/utils/data_sampler/data_parallel_sampler.py'
2023-02-14T11:56:01,829   adding 'colossalai/utils/model/__init__.py'
2023-02-14T11:56:01,832   adding 'colossalai/utils/model/colo_init_context.py'
2023-02-14T11:56:01,837   adding 'colossalai/utils/model/experimental.py'
2023-02-14T11:56:01,841   adding 'colossalai/utils/model/lazy_init_context.py'
2023-02-14T11:56:01,843   adding 'colossalai/utils/model/utils.py'
2023-02-14T11:56:01,847   adding 'colossalai/utils/multi_tensor_apply/__init__.py'
2023-02-14T11:56:01,849   adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py'
2023-02-14T11:56:01,852   adding 'colossalai/utils/profiler/__init__.py'
2023-02-14T11:56:01,854   adding 'colossalai/utils/profiler/extention.py'
2023-02-14T11:56:01,857   adding 'colossalai/utils/profiler/profiler.py'
2023-02-14T11:56:01,860   adding 'colossalai/utils/profiler/stateful_tensor_mem_extention.py'
2023-02-14T11:56:01,863   adding 'colossalai/utils/profiler/legacy/__init__.py'
2023-02-14T11:56:01,867   adding 'colossalai/utils/profiler/legacy/comm_profiler.py'
2023-02-14T11:56:01,870   adding 'colossalai/utils/profiler/legacy/pcie_profiler.py'
2023-02-14T11:56:01,873   adding 'colossalai/utils/profiler/legacy/prof_utils.py'
2023-02-14T11:56:01,876   adding 'colossalai/utils/rank_recorder/__init__.py'
2023-02-14T11:56:01,879   adding 'colossalai/utils/rank_recorder/rank_recorder.py'
2023-02-14T11:56:01,882   adding 'colossalai/utils/tensor_detector/__init__.py'
2023-02-14T11:56:01,885   adding 'colossalai/utils/tensor_detector/tensor_detector.py'
2023-02-14T11:56:01,889   adding 'colossalai/zero/__init__.py'
2023-02-14T11:56:01,893   adding 'colossalai/zero/init_ctx/__init__.py'
2023-02-14T11:56:01,897   adding 'colossalai/zero/init_ctx/init_context.py'
2023-02-14T11:56:01,901   adding 'colossalai/zero/shard_utils/__init__.py'
2023-02-14T11:56:01,903   adding 'colossalai/zero/shard_utils/base_shard_strategy.py'
2023-02-14T11:56:01,905   adding 'colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py'
2023-02-14T11:56:01,908   adding 'colossalai/zero/shard_utils/commons.py'
2023-02-14T11:56:01,911   adding 'colossalai/zero/shard_utils/tensor_shard_strategy.py'
2023-02-14T11:56:01,914   adding 'colossalai/zero/sharded_model/__init__.py'
2023-02-14T11:56:01,917   adding 'colossalai/zero/sharded_model/_utils.py'
2023-02-14T11:56:01,920   adding 'colossalai/zero/sharded_model/reduce_scatter.py'
2023-02-14T11:56:01,928   adding 'colossalai/zero/sharded_model/sharded_model_v2.py'
2023-02-14T11:56:01,931   adding 'colossalai/zero/sharded_model/utils.py'
2023-02-14T11:56:01,934   adding 'colossalai/zero/sharded_optim/__init__.py'
2023-02-14T11:56:01,938   adding 'colossalai/zero/sharded_optim/_utils.py'
2023-02-14T11:56:01,946   adding 'colossalai/zero/sharded_optim/low_level_optim.py'
2023-02-14T11:56:01,951   adding 'colossalai/zero/sharded_optim/sharded_optim_v2.py'
2023-02-14T11:56:01,955   adding 'colossalai/zero/sharded_optim/bookkeeping/__init__.py'
2023-02-14T11:56:01,957   adding 'colossalai/zero/sharded_optim/bookkeeping/base_store.py'
2023-02-14T11:56:01,960   adding 'colossalai/zero/sharded_optim/bookkeeping/bucket_store.py'
2023-02-14T11:56:01,962   adding 'colossalai/zero/sharded_optim/bookkeeping/gradient_store.py'
2023-02-14T11:56:01,965   adding 'colossalai/zero/sharded_optim/bookkeeping/parameter_store.py'
2023-02-14T11:56:01,967   adding 'colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py'
2023-02-14T11:56:01,970   adding 'colossalai/zero/sharded_param/__init__.py'
2023-02-14T11:56:01,973   adding 'colossalai/zero/sharded_param/sharded_param.py'
2023-02-14T11:56:01,975   adding 'colossalai/zero/sharded_param/sharded_tensor.py'
2023-02-14T11:56:01,978   adding 'colossalai/zero/utils/__init__.py'
2023-02-14T11:56:01,980   adding 'colossalai/zero/utils/gemini_hook.py'
2023-02-14T11:56:01,983   adding 'colossalai/zero/utils/zero_hook.py'
2023-02-14T11:56:01,989   adding 'op_builder/__init__.py'
2023-02-14T11:56:01,993   adding 'op_builder/builder.py'
2023-02-14T11:56:01,995   adding 'op_builder/cpu_adam.py'
2023-02-14T11:56:01,997   adding 'op_builder/fused_optim.py'
2023-02-14T11:56:02,000   adding 'op_builder/layernorm.py'
2023-02-14T11:56:02,002   adding 'op_builder/moe.py'
2023-02-14T11:56:02,004   adding 'op_builder/multi_head_attn.py'
2023-02-14T11:56:02,006   adding 'op_builder/scaled_masked_softmax.py'
2023-02-14T11:56:02,008   adding 'op_builder/scaled_upper_triangle_masked_softmax.py'
2023-02-14T11:56:02,011   adding 'op_builder/utils.py'
2023-02-14T11:56:02,015   adding 'colossalai-0.2.4.dist-info/LICENSE'
2023-02-14T11:56:02,020   adding 'colossalai-0.2.4.dist-info/METADATA'
2023-02-14T11:56:02,022   adding 'colossalai-0.2.4.dist-info/WHEEL'
2023-02-14T11:56:02,023   adding 'colossalai-0.2.4.dist-info/entry_points.txt'
2023-02-14T11:56:02,025   adding 'colossalai-0.2.4.dist-info/top_level.txt'
2023-02-14T11:56:02,051   adding 'colossalai-0.2.4.dist-info/RECORD'
2023-02-14T11:56:02,109   removing build/bdist.linux-armv7l/wheel
2023-02-14T11:56:02,680   Building wheel for colossalai (setup.py): finished with status 'done'
2023-02-14T11:56:02,714   Created wheel for colossalai: filename=colossalai-0.2.4-py3-none-any.whl size=926472 sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f
2023-02-14T11:56:02,716   Stored in directory: /tmp/pip-ephem-wheel-cache-rqv9ar_9/wheels/6b/79/d4/e847a04473be1d2396f62e0321b298584a9ca3dc8419b5802f
2023-02-14T11:56:02,794 Successfully built colossalai
2023-02-14T11:56:02,871 Removed build tracker: '/tmp/pip-build-tracker-6b0zf939'