2023-03-29T02:33:03,573 Created temporary directory: /tmp/pip-ephem-wheel-cache-b4gu5_ei
2023-03-29T02:33:03,579 Created temporary directory: /tmp/pip-build-tracker-o9f0m8t6
2023-03-29T02:33:03,580 Initialized build tracking at /tmp/pip-build-tracker-o9f0m8t6
2023-03-29T02:33:03,581 Created build tracker: /tmp/pip-build-tracker-o9f0m8t6
2023-03-29T02:33:03,581 Entered build tracker: /tmp/pip-build-tracker-o9f0m8t6
2023-03-29T02:33:03,582 Created temporary directory: /tmp/pip-wheel-_2nlksoz
2023-03-29T02:33:03,597 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453
2023-03-29T02:33:03,603 Created temporary directory: /tmp/pip-ephem-wheel-cache-9x8numt2
2023-03-29T02:33:03,662 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-03-29T02:33:03,669 2 location(s) to search for versions of colossalai:
2023-03-29T02:33:03,669 * https://pypi.org/simple/colossalai/
2023-03-29T02:33:03,669 * https://www.piwheels.org/simple/colossalai/
2023-03-29T02:33:03,670 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/
2023-03-29T02:33:03,672 Getting page https://pypi.org/simple/colossalai/
2023-03-29T02:33:03,675 Found index url https://pypi.org/simple
2023-03-29T02:33:03,905 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json
2023-03-29T02:33:03,912   Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0
2023-03-29T02:33:03,914   Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1
2023-03-29T02:33:03,915   Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2
2023-03-29T02:33:03,917   Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3
2023-03-29T02:33:03,918   Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4
2023-03-29T02:33:03,919   Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5
2023-03-29T02:33:03,921   Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6
2023-03-29T02:33:03,923   Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7
2023-03-29T02:33:03,924   Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8
2023-03-29T02:33:03,925 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/
2023-03-29T02:33:03,926 Getting page https://www.piwheels.org/simple/colossalai/
2023-03-29T02:33:03,928 Found index url https://www.piwheels.org/simple
2023-03-29T02:33:04,161 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html
2023-03-29T02:33:04,169   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-03-29T02:33:04,170   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-03-29T02:33:04,170   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-03-29T02:33:04,171   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-03-29T02:33:04,171   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-03-29T02:33:04,172   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-03-29T02:33:04,172   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-03-29T02:33:04,172   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-03-29T02:33:04,173 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/
2023-03-29T02:33:04,174 Skipping link: not a file: https://pypi.org/simple/colossalai/
2023-03-29T02:33:04,209 Given no hashes to check 1 links for project 'colossalai': discarding no candidates
2023-03-29T02:33:04,239 Collecting colossalai==0.2.8
2023-03-29T02:33:04,244   Created temporary directory: /tmp/pip-unpack-_3mkb7b5
2023-03-29T02:33:04,626   Downloading colossalai-0.2.8.tar.gz (728 kB)
2023-03-29T02:33:08,076   Added colossalai==0.2.8 from https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz to build tracker '/tmp/pip-build-tracker-o9f0m8t6'
2023-03-29T02:33:08,080   Running setup.py (path:/tmp/pip-wheel-_2nlksoz/colossalai_a5967d547cd74f8fb4c78da0bc929369/setup.py) egg_info for package colossalai
2023-03-29T02:33:08,081   Created temporary directory: /tmp/pip-pip-egg-info-xewmfrba
2023-03-29T02:33:08,082   Preparing metadata (setup.py): started
2023-03-29T02:33:08,084   Running command python setup.py egg_info
2023-03-29T02:33:09,882   running egg_info
2023-03-29T02:33:09,884   creating /tmp/pip-pip-egg-info-xewmfrba/colossalai.egg-info
2023-03-29T02:33:09,949   writing /tmp/pip-pip-egg-info-xewmfrba/colossalai.egg-info/PKG-INFO
2023-03-29T02:33:09,955   writing dependency_links to /tmp/pip-pip-egg-info-xewmfrba/colossalai.egg-info/dependency_links.txt
2023-03-29T02:33:09,959   writing entry points to /tmp/pip-pip-egg-info-xewmfrba/colossalai.egg-info/entry_points.txt
2023-03-29T02:33:09,962   writing requirements to /tmp/pip-pip-egg-info-xewmfrba/colossalai.egg-info/requires.txt
2023-03-29T02:33:09,964   writing top-level names to /tmp/pip-pip-egg-info-xewmfrba/colossalai.egg-info/top_level.txt
2023-03-29T02:33:09,966   writing manifest file '/tmp/pip-pip-egg-info-xewmfrba/colossalai.egg-info/SOURCES.txt'
2023-03-29T02:33:10,364   reading manifest file '/tmp/pip-pip-egg-info-xewmfrba/colossalai.egg-info/SOURCES.txt'
2023-03-29T02:33:10,367   reading manifest template 'MANIFEST.in'
2023-03-29T02:33:12,548   warning: no files found matching '*.tr' under directory 'colossalai'
2023-03-29T02:33:13,573   warning: no files found matching '*.cc' under directory 'colossalai'
2023-03-29T02:33:14,086   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-03-29T02:33:14,104   adding license file 'LICENSE'
2023-03-29T02:33:14,173   writing manifest file '/tmp/pip-pip-egg-info-xewmfrba/colossalai.egg-info/SOURCES.txt'
2023-03-29T02:33:14,294   Preparing metadata (setup.py): finished with status 'done'
2023-03-29T02:33:14,311   Source in /tmp/pip-wheel-_2nlksoz/colossalai_a5967d547cd74f8fb4c78da0bc929369 has version 0.2.8, which satisfies requirement colossalai==0.2.8 from https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz
2023-03-29T02:33:14,313   Removed colossalai==0.2.8 from https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz from build tracker '/tmp/pip-build-tracker-o9f0m8t6'
2023-03-29T02:33:14,332 Created temporary directory: /tmp/pip-unpack-dao_watg
2023-03-29T02:33:14,333 Building wheels for collected packages: colossalai
2023-03-29T02:33:14,342   Created temporary directory: /tmp/pip-wheel-8qe16anb
2023-03-29T02:33:14,343   Building wheel for colossalai (setup.py): started
2023-03-29T02:33:14,345   Destination directory: /tmp/pip-wheel-8qe16anb
2023-03-29T02:33:14,345   Running command python setup.py bdist_wheel
2023-03-29T02:33:16,434   running bdist_wheel
2023-03-29T02:33:17,467   running build
2023-03-29T02:33:17,468   running build_py
2023-03-29T02:33:17,532   creating build
2023-03-29T02:33:17,533   creating build/lib
2023-03-29T02:33:17,534   creating build/lib/colossalai
2023-03-29T02:33:17,536   copying colossalai/version.py -> build/lib/colossalai
2023-03-29T02:33:17,540   copying colossalai/constants.py -> build/lib/colossalai
2023-03-29T02:33:17,543   copying colossalai/global_variables.py -> build/lib/colossalai
2023-03-29T02:33:17,546   copying colossalai/core.py -> build/lib/colossalai
2023-03-29T02:33:17,550   copying colossalai/__init__.py -> build/lib/colossalai
2023-03-29T02:33:17,553   copying colossalai/initialize.py -> build/lib/colossalai
2023-03-29T02:33:17,560   creating build/lib/colossalai/_C
2023-03-29T02:33:17,561   copying colossalai/_C/__init__.py -> build/lib/colossalai/_C
2023-03-29T02:33:17,565   creating build/lib/colossalai/engine
2023-03-29T02:33:17,567   copying colossalai/engine/_base_engine.py -> build/lib/colossalai/engine
2023-03-29T02:33:17,571   copying colossalai/engine/__init__.py -> build/lib/colossalai/engine
2023-03-29T02:33:17,576   creating build/lib/colossalai/trainer
2023-03-29T02:33:17,578   copying colossalai/trainer/_trainer.py -> build/lib/colossalai/trainer
2023-03-29T02:33:17,582   copying colossalai/trainer/__init__.py -> build/lib/colossalai/trainer
2023-03-29T02:33:17,587   creating build/lib/colossalai/fx
2023-03-29T02:33:17,589   copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx
2023-03-29T02:33:17,593   copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx
2023-03-29T02:33:17,597   copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx
2023-03-29T02:33:17,601   copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx
2023-03-29T02:33:17,605   copying colossalai/fx/proxy.py -> build/lib/colossalai/fx
2023-03-29T02:33:17,609   copying colossalai/fx/__init__.py -> build/lib/colossalai/fx
2023-03-29T02:33:17,613   creating build/lib/colossalai/builder
2023-03-29T02:33:17,615   copying colossalai/builder/__init__.py -> build/lib/colossalai/builder
2023-03-29T02:33:17,618   copying colossalai/builder/builder.py -> build/lib/colossalai/builder
2023-03-29T02:33:17,624   creating build/lib/colossalai/testing
2023-03-29T02:33:17,625   copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing
2023-03-29T02:33:17,629   copying colossalai/testing/utils.py -> build/lib/colossalai/testing
2023-03-29T02:33:17,634   copying colossalai/testing/comparison.py -> build/lib/colossalai/testing
2023-03-29T02:33:17,637   copying colossalai/testing/random.py -> build/lib/colossalai/testing
2023-03-29T02:33:17,641   copying colossalai/testing/__init__.py -> build/lib/colossalai/testing
2023-03-29T02:33:17,645   creating build/lib/colossalai/checkpoint_io
2023-03-29T02:33:17,647   copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io
2023-03-29T02:33:17,652   copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io
2023-03-29T02:33:17,656   copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io
2023-03-29T02:33:17,661   creating build/lib/colossalai/kernel
2023-03-29T02:33:17,662   copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel
2023-03-29T02:33:17,667   creating build/lib/colossalai/auto_parallel
2023-03-29T02:33:17,669   copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel
2023-03-29T02:33:17,673   creating build/lib/colossalai/registry
2023-03-29T02:33:17,675   copying colossalai/registry/registry.py -> build/lib/colossalai/registry
2023-03-29T02:33:17,679   copying colossalai/registry/__init__.py -> build/lib/colossalai/registry
2023-03-29T02:33:17,684   creating build/lib/colossalai/amp
2023-03-29T02:33:17,685   copying colossalai/amp/amp_type.py -> build/lib/colossalai/amp
2023-03-29T02:33:17,689   copying colossalai/amp/__init__.py -> build/lib/colossalai/amp
2023-03-29T02:33:17,696   creating build/lib/colossalai/zero
2023-03-29T02:33:17,697   copying colossalai/zero/__init__.py -> build/lib/colossalai/zero
2023-03-29T02:33:17,703   creating build/lib/colossalai/cluster
2023-03-29T02:33:17,704   copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster
2023-03-29T02:33:17,708   copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster
2023-03-29T02:33:17,713   copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster
2023-03-29T02:33:17,717   copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster
2023-03-29T02:33:17,722   creating build/lib/colossalai/nn
2023-03-29T02:33:17,724   copying colossalai/nn/init.py -> build/lib/colossalai/nn
2023-03-29T02:33:17,728   copying colossalai/nn/__init__.py -> build/lib/colossalai/nn
2023-03-29T02:33:17,735   creating build/lib/colossalai/tensor
2023-03-29T02:33:17,737   copying colossalai/tensor/process_group.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,742   copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,747   copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,751   copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,755   copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,760   copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,764   copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,771   copying colossalai/tensor/tensor_spec.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,774   copying colossalai/tensor/const.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,777   copying colossalai/tensor/op_wrapper.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,781   copying colossalai/tensor/compute_spec.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,784   copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,789   copying colossalai/tensor/dist_spec_mgr.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,832   copying colossalai/tensor/distspec.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,836   copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor
2023-03-29T02:33:17,840   creating build/lib/colossalai/cli
2023-03-29T02:33:17,842   copying colossalai/cli/cli.py -> build/lib/colossalai/cli
2023-03-29T02:33:17,845   copying colossalai/cli/__init__.py -> build/lib/colossalai/cli
2023-03-29T02:33:17,850   creating build/lib/colossalai/communication
2023-03-29T02:33:17,852   copying colossalai/communication/utils.py -> build/lib/colossalai/communication
2023-03-29T02:33:17,856   copying colossalai/communication/p2p_v2.py -> build/lib/colossalai/communication
2023-03-29T02:33:17,860   copying colossalai/communication/collective.py -> build/lib/colossalai/communication
2023-03-29T02:33:17,864   copying colossalai/communication/ring.py -> build/lib/colossalai/communication
2023-03-29T02:33:17,867   copying colossalai/communication/p2p.py -> build/lib/colossalai/communication
2023-03-29T02:33:17,872   copying colossalai/communication/__init__.py -> build/lib/colossalai/communication
2023-03-29T02:33:17,877   creating build/lib/colossalai/device
2023-03-29T02:33:17,878   copying colossalai/device/device_mesh.py -> build/lib/colossalai/device
2023-03-29T02:33:17,883   copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device
2023-03-29T02:33:17,887   copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device
2023-03-29T02:33:17,891   copying colossalai/device/__init__.py -> build/lib/colossalai/device
2023-03-29T02:33:17,896   creating build/lib/colossalai/pipeline
2023-03-29T02:33:17,898   copying colossalai/pipeline/pipelinable.py -> build/lib/colossalai/pipeline
2023-03-29T02:33:17,903   copying colossalai/pipeline/pipeline_process_group.py -> build/lib/colossalai/pipeline
2023-03-29T02:33:17,907   copying colossalai/pipeline/utils.py -> build/lib/colossalai/pipeline
2023-03-29T02:33:17,911   copying colossalai/pipeline/layer_spec.py -> build/lib/colossalai/pipeline
2023-03-29T02:33:17,914   copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline
2023-03-29T02:33:17,919   creating build/lib/colossalai/context
2023-03-29T02:33:17,921   copying colossalai/context/config.py -> build/lib/colossalai/context
2023-03-29T02:33:17,925   copying colossalai/context/parallel_context.py -> build/lib/colossalai/context
2023-03-29T02:33:17,930   copying colossalai/context/parallel_mode.py -> build/lib/colossalai/context
2023-03-29T02:33:17,933   copying colossalai/context/moe_context.py -> build/lib/colossalai/context
2023-03-29T02:33:17,937   copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context
2023-03-29T02:33:17,940   copying colossalai/context/__init__.py -> build/lib/colossalai/context
2023-03-29T02:33:17,946   creating build/lib/colossalai/utils
2023-03-29T02:33:17,948   copying colossalai/utils/cuda.py -> build/lib/colossalai/utils
2023-03-29T02:33:17,952   copying colossalai/utils/memory.py -> build/lib/colossalai/utils
2023-03-29T02:33:17,955   copying colossalai/utils/common.py -> build/lib/colossalai/utils
2023-03-29T02:33:17,960   copying colossalai/utils/checkpointing.py -> build/lib/colossalai/utils
2023-03-29T02:33:17,965   copying colossalai/utils/timer.py -> build/lib/colossalai/utils
2023-03-29T02:33:17,969   copying colossalai/utils/moe.py -> build/lib/colossalai/utils
2023-03-29T02:33:17,973   copying colossalai/utils/activation_checkpoint.py -> build/lib/colossalai/utils
2023-03-29T02:33:17,977   copying colossalai/utils/__init__.py -> build/lib/colossalai/utils
2023-03-29T02:33:17,982   creating build/lib/colossalai/logging
2023-03-29T02:33:17,984   copying colossalai/logging/logger.py -> build/lib/colossalai/logging
2023-03-29T02:33:17,988   copying colossalai/logging/__init__.py -> build/lib/colossalai/logging
2023-03-29T02:33:17,992   creating build/lib/colossalai/booster
2023-03-29T02:33:17,994   copying colossalai/booster/booster.py -> build/lib/colossalai/booster
2023-03-29T02:33:18,018   copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster
2023-03-29T02:33:18,021   copying colossalai/booster/__init__.py -> build/lib/colossalai/booster
2023-03-29T02:33:18,026   creating build/lib/colossalai/gemini
2023-03-29T02:33:18,028   copying colossalai/gemini/placement_policy.py -> build/lib/colossalai/gemini
2023-03-29T02:33:18,033   copying colossalai/gemini/tensor_placement_policy.py -> build/lib/colossalai/gemini
2023-03-29T02:33:18,037   copying colossalai/gemini/gemini_mgr.py -> build/lib/colossalai/gemini
2023-03-29T02:33:18,041   copying colossalai/gemini/gemini_context.py -> build/lib/colossalai/gemini
2023-03-29T02:33:18,106   copying colossalai/gemini/tensor_utils.py -> build/lib/colossalai/gemini
2023-03-29T02:33:18,110   copying colossalai/gemini/stateful_tensor.py -> build/lib/colossalai/gemini
2023-03-29T02:33:18,114   copying colossalai/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/gemini
2023-03-29T02:33:18,118   copying colossalai/gemini/__init__.py -> build/lib/colossalai/gemini
2023-03-29T02:33:18,123   creating build/lib/colossalai/interface
2023-03-29T02:33:18,125   copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface
2023-03-29T02:33:18,129   copying colossalai/interface/model.py -> build/lib/colossalai/interface
2023-03-29T02:33:18,132   copying colossalai/interface/__init__.py -> build/lib/colossalai/interface
2023-03-29T02:33:18,137   creating build/lib/colossalai/engine/schedule
2023-03-29T02:33:18,139   copying colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/engine/schedule
2023-03-29T02:33:18,143   copying colossalai/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/engine/schedule
2023-03-29T02:33:18,149   copying colossalai/engine/schedule/_base_schedule.py -> build/lib/colossalai/engine/schedule
2023-03-29T02:33:18,154   copying colossalai/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/engine/schedule
2023-03-29T02:33:18,157   copying colossalai/engine/schedule/__init__.py -> build/lib/colossalai/engine/schedule
2023-03-29T02:33:18,161   creating build/lib/colossalai/engine/gradient_accumulation
2023-03-29T02:33:18,163   copying colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/engine/gradient_accumulation
2023-03-29T02:33:18,168   copying colossalai/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/engine/gradient_accumulation
2023-03-29T02:33:18,173   creating build/lib/colossalai/engine/gradient_handler
2023-03-29T02:33:18,175   copying colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-03-29T02:33:18,178   copying colossalai/engine/gradient_handler/utils.py -> build/lib/colossalai/engine/gradient_handler
2023-03-29T02:33:18,182   copying colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-03-29T02:33:18,185   copying colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-03-29T02:33:18,188   copying colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-03-29T02:33:18,191   copying colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-03-29T02:33:18,195   copying colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/engine/gradient_handler
2023-03-29T02:33:18,198   copying colossalai/engine/gradient_handler/__init__.py -> build/lib/colossalai/engine/gradient_handler
2023-03-29T02:33:18,204   creating build/lib/colossalai/trainer/hooks
2023-03-29T02:33:18,206   copying colossalai/trainer/hooks/_base_hook.py -> build/lib/colossalai/trainer/hooks
2023-03-29T02:33:18,210   copying colossalai/trainer/hooks/_commons_.py -> build/lib/colossalai/trainer/hooks
2023-03-29T02:33:18,213   copying colossalai/trainer/hooks/_log_hook.py -> build/lib/colossalai/trainer/hooks
2023-03-29T02:33:18,218   copying colossalai/trainer/hooks/_metric_hook.py -> build/lib/colossalai/trainer/hooks
2023-03-29T02:33:18,223   copying colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/trainer/hooks
2023-03-29T02:33:18,227   copying colossalai/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/trainer/hooks
2023-03-29T02:33:18,230   copying colossalai/trainer/hooks/__init__.py -> build/lib/colossalai/trainer/hooks
2023-03-29T02:33:18,236   creating build/lib/colossalai/fx/profiler
2023-03-29T02:33:18,238   copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler
2023-03-29T02:33:18,243   copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler
2023-03-29T02:33:18,246   copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler
2023-03-29T02:33:18,252   copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler
2023-03-29T02:33:18,257   copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler
2023-03-29T02:33:18,262   copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler
2023-03-29T02:33:18,266   copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler
2023-03-29T02:33:18,270   copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler
2023-03-29T02:33:18,275   creating build/lib/colossalai/fx/passes
2023-03-29T02:33:18,277   copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes
2023-03-29T02:33:18,282   copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes
2023-03-29T02:33:18,287   copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes
2023-03-29T02:33:18,291   copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes
2023-03-29T02:33:18,296   copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes
2023-03-29T02:33:18,301   copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes
2023-03-29T02:33:18,306   copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes
2023-03-29T02:33:18,310   copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes
2023-03-29T02:33:18,315   creating build/lib/colossalai/fx/tracer
2023-03-29T02:33:18,317   copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer
2023-03-29T02:33:18,321   copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer
2023-03-29T02:33:18,327   copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer
2023-03-29T02:33:18,330   copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer
2023-03-29T02:33:18,336   copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer
2023-03-29T02:33:18,339   copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer
2023-03-29T02:33:18,342   copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer
2023-03-29T02:33:18,347   creating build/lib/colossalai/fx/codegen
2023-03-29T02:33:18,349   copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen
2023-03-29T02:33:18,355   copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen
2023-03-29T02:33:18,360   creating build/lib/colossalai/fx/profiler/experimental
2023-03-29T02:33:18,362   copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental
2023-03-29T02:33:18,366   copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental
2023-03-29T02:33:18,370   copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental
2023-03-29T02:33:18,373   copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental
2023-03-29T02:33:18,377   copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental
2023-03-29T02:33:18,382   creating build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:18,384   copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:18,388   copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:18,392   copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:18,395   copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:18,399   copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:18,402   copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:18,406   copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:18,410   copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:18,413   copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:18,417   copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:18,420   copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:18,426   creating build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:18,428   copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:18,431   copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:18,435   copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:18,438   copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:18,442   copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:18,446   copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:18,449   copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:18,453   copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:18,456   copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:18,461   creating build/lib/colossalai/fx/tracer/bias_addition_patch
2023-03-29T02:33:18,462   copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch
2023-03-29T02:33:18,467   creating build/lib/colossalai/fx/tracer/meta_patch
2023-03-29T02:33:18,469   copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch
2023-03-29T02:33:18,474   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-03-29T02:33:18,476   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-03-29T02:33:18,480   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-03-29T02:33:18,484   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-03-29T02:33:18,487   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-03-29T02:33:18,492   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-03-29T02:33:18,494   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-03-29T02:33:18,498   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-03-29T02:33:18,502   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-03-29T02:33:18,506   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-03-29T02:33:18,509   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-03-29T02:33:18,515   creating build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:18,517   copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:18,521   copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:18,524   copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:18,528   copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:18,531   copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:18,535   copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:18,539   copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:18,543   copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:18,548   creating build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:18,550   copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:18,554   copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:18,557   copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:18,561   copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:18,565   copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:18,569   copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:18,573   copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:18,577   copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:18,582   creating build/lib/colossalai/kernel/op_builder
2023-03-29T02:33:18,584   copying colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-03-29T02:33:18,588   copying colossalai/kernel/op_builder/fused_optim.py -> build/lib/colossalai/kernel/op_builder
2023-03-29T02:33:18,592   copying colossalai/kernel/op_builder/cpu_adam.py -> build/lib/colossalai/kernel/op_builder
2023-03-29T02:33:18,595   copying colossalai/kernel/op_builder/utils.py -> build/lib/colossalai/kernel/op_builder
2023-03-29T02:33:18,599   copying colossalai/kernel/op_builder/multi_head_attn.py -> build/lib/colossalai/kernel/op_builder
2023-03-29T02:33:18,603   copying colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-03-29T02:33:18,607   copying colossalai/kernel/op_builder/layernorm.py -> build/lib/colossalai/kernel/op_builder
2023-03-29T02:33:18,610   copying colossalai/kernel/op_builder/moe.py -> build/lib/colossalai/kernel/op_builder
2023-03-29T02:33:18,614   copying colossalai/kernel/op_builder/__init__.py -> build/lib/colossalai/kernel/op_builder
2023-03-29T02:33:18,617   copying colossalai/kernel/op_builder/builder.py -> build/lib/colossalai/kernel/op_builder
2023-03-29T02:33:18,623   creating build/lib/colossalai/kernel/jit
2023-03-29T02:33:18,625   copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit
2023-03-29T02:33:18,629   copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit
2023-03-29T02:33:18,632   copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit
2023-03-29T02:33:18,636   copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit
2023-03-29T02:33:18,641   creating build/lib/colossalai/kernel/cuda_native
2023-03-29T02:33:18,643   copying colossalai/kernel/cuda_native/flash_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-03-29T02:33:18,648   copying colossalai/kernel/cuda_native/layer_norm.py -> build/lib/colossalai/kernel/cuda_native
2023-03-29T02:33:18,652   copying colossalai/kernel/cuda_native/multihead_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-03-29T02:33:18,656   copying colossalai/kernel/cuda_native/scaled_softmax.py -> build/lib/colossalai/kernel/cuda_native
2023-03-29T02:33:18,661   copying colossalai/kernel/cuda_native/__init__.py -> build/lib/colossalai/kernel/cuda_native
2023-03-29T02:33:18,666   creating build/lib/colossalai/auto_parallel/passes
2023-03-29T02:33:18,667   copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes
2023-03-29T02:33:18,671   copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes
2023-03-29T02:33:18,675   copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-03-29T02:33:18,679   copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-03-29T02:33:18,683   copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-03-29T02:33:18,688   copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes
2023-03-29T02:33:18,692   creating build/lib/colossalai/auto_parallel/pipeline_shard
2023-03-29T02:33:18,694   copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard
2023-03-29T02:33:18,698   creating build/lib/colossalai/auto_parallel/tensor_shard
2023-03-29T02:33:18,701   copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-03-29T02:33:18,704   copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-03-29T02:33:18,708   copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-03-29T02:33:18,712   copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-03-29T02:33:18,714   copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-03-29T02:33:18,721   creating build/lib/colossalai/auto_parallel/offload
2023-03-29T02:33:18,723   copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload
2023-03-29T02:33:18,727   copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload
2023-03-29T02:33:18,732   copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload
2023-03-29T02:33:18,735   copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload
2023-03-29T02:33:18,740   copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload
2023-03-29T02:33:18,744   copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload
2023-03-29T02:33:18,747   copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload
2023-03-29T02:33:18,752   copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload
2023-03-29T02:33:18,755   copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload
2023-03-29T02:33:18,760   copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload
2023-03-29T02:33:18,764   creating build/lib/colossalai/auto_parallel/meta_profiler
2023-03-29T02:33:18,766   copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-03-29T02:33:18,770   copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-03-29T02:33:18,773   copying colossalai/auto_parallel/meta_profiler/metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-03-29T02:33:18,776   copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-03-29T02:33:18,781   creating build/lib/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:18,783   copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:18,786   copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:18,791   copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:18,795   copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:18,799   copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:18,803   copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:18,807   creating build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-03-29T02:33:18,809   copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-03-29T02:33:18,813   copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-03-29T02:33:18,818   copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-03-29T02:33:18,823   copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-03-29T02:33:18,827   copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-03-29T02:33:18,831   creating build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:18,833   copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:18,837   copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:18,841   copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:18,845   copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:18,849   copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:18,853   copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:18,860   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,862   copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,866   copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,870   copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,874   copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,877   copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,881   copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,884   copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,888   copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,891   copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,896   copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,899   copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,904   copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,907   copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,910   copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,914   copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,917   copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,921   copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,924   copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,927   copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,931   copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,934   copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,938   copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,943   copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,946   copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,950   copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,954   copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,957   copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:18,964   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:18,966   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:18,972   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:18,977   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:18,981   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:18,985   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:18,989   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:18,993   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:18,996   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:18,999   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:19,004   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:19,007   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:19,011   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:19,016   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:19,020   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:19,024   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:19,027   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:19,032   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:19,035   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:19,040   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:19,046   creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:19,047   copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:19,051   copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:19,055   copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:19,060   copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:19,065   copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:19,068   copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:19,072   copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:19,075   copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:19,080   copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:19,083   copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:19,086   copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:19,092   creating build/lib/colossalai/amp/torch_amp
2023-03-29T02:33:19,093   copying colossalai/amp/torch_amp/torch_amp.py -> build/lib/colossalai/amp/torch_amp
2023-03-29T02:33:19,097   copying colossalai/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/amp/torch_amp
2023-03-29T02:33:19,102   copying colossalai/amp/torch_amp/__init__.py -> build/lib/colossalai/amp/torch_amp
2023-03-29T02:33:19,107   creating build/lib/colossalai/amp/apex_amp
2023-03-29T02:33:19,108   copying colossalai/amp/apex_amp/__init__.py -> build/lib/colossalai/amp/apex_amp
2023-03-29T02:33:19,112   copying colossalai/amp/apex_amp/apex_amp.py -> build/lib/colossalai/amp/apex_amp
2023-03-29T02:33:19,117   creating build/lib/colossalai/amp/naive_amp
2023-03-29T02:33:19,118   copying colossalai/amp/naive_amp/_utils.py -> build/lib/colossalai/amp/naive_amp
2023-03-29T02:33:19,122   copying colossalai/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/amp/naive_amp
2023-03-29T02:33:19,127   copying colossalai/amp/naive_amp/naive_amp.py -> build/lib/colossalai/amp/naive_amp
2023-03-29T02:33:19,131   copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp
2023-03-29T02:33:19,136   creating build/lib/colossalai/amp/naive_amp/grad_scaler
2023-03-29T02:33:19,137   copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-03-29T02:33:19,141   copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-03-29T02:33:19,145   copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-03-29T02:33:19,149   copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-03-29T02:33:19,154   creating build/lib/colossalai/zero/sharded_model
2023-03-29T02:33:19,155   copying colossalai/zero/sharded_model/_utils.py -> build/lib/colossalai/zero/sharded_model
2023-03-29T02:33:19,159   copying colossalai/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/zero/sharded_model
2023-03-29T02:33:19,164   copying colossalai/zero/sharded_model/utils.py -> build/lib/colossalai/zero/sharded_model
2023-03-29T02:33:19,168   copying colossalai/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/zero/sharded_model
2023-03-29T02:33:19,174   copying colossalai/zero/sharded_model/__init__.py -> build/lib/colossalai/zero/sharded_model
2023-03-29T02:33:19,179   creating build/lib/colossalai/zero/shard_utils
2023-03-29T02:33:19,181   copying colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-03-29T02:33:19,185   copying colossalai/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-03-29T02:33:19,188   copying colossalai/zero/shard_utils/commons.py -> build/lib/colossalai/zero/shard_utils
2023-03-29T02:33:19,192   copying colossalai/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/zero/shard_utils
2023-03-29T02:33:19,195   copying colossalai/zero/shard_utils/__init__.py -> build/lib/colossalai/zero/shard_utils
2023-03-29T02:33:19,200   creating build/lib/colossalai/zero/sharded_param
2023-03-29T02:33:19,202   copying colossalai/zero/sharded_param/sharded_param.py -> build/lib/colossalai/zero/sharded_param
2023-03-29T02:33:19,206   copying colossalai/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/zero/sharded_param
2023-03-29T02:33:19,209   copying colossalai/zero/sharded_param/__init__.py -> build/lib/colossalai/zero/sharded_param
2023-03-29T02:33:19,214   creating build/lib/colossalai/zero/sharded_optim
2023-03-29T02:33:19,216   copying colossalai/zero/sharded_optim/_utils.py -> build/lib/colossalai/zero/sharded_optim
2023-03-29T02:33:19,221   copying colossalai/zero/sharded_optim/low_level_optim.py -> build/lib/colossalai/zero/sharded_optim
2023-03-29T02:33:19,227   copying colossalai/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/zero/sharded_optim
2023-03-29T02:33:19,232   copying colossalai/zero/sharded_optim/__init__.py -> build/lib/colossalai/zero/sharded_optim
2023-03-29T02:33:19,237   creating build/lib/colossalai/zero/init_ctx
2023-03-29T02:33:19,239   copying colossalai/zero/init_ctx/init_context.py -> build/lib/colossalai/zero/init_ctx
2023-03-29T02:33:19,243   copying colossalai/zero/init_ctx/__init__.py -> build/lib/colossalai/zero/init_ctx
2023-03-29T02:33:19,248   creating build/lib/colossalai/zero/utils
2023-03-29T02:33:19,250   copying colossalai/zero/utils/zero_hook.py -> build/lib/colossalai/zero/utils
2023-03-29T02:33:19,254   copying colossalai/zero/utils/gemini_hook.py -> build/lib/colossalai/zero/utils
2023-03-29T02:33:19,257   copying colossalai/zero/utils/__init__.py -> build/lib/colossalai/zero/utils
2023-03-29T02:33:19,262   creating build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:19,264   copying colossalai/zero/sharded_optim/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:19,268   copying colossalai/zero/sharded_optim/bookkeeping/base_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:19,272   copying colossalai/zero/sharded_optim/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:19,275   copying colossalai/zero/sharded_optim/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:19,279   copying colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:19,282   copying colossalai/zero/sharded_optim/bookkeeping/__init__.py -> build/lib/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:19,288   creating build/lib/colossalai/nn/_ops
2023-03-29T02:33:19,290   copying colossalai/nn/_ops/embedding.py -> build/lib/colossalai/nn/_ops
2023-03-29T02:33:19,295   copying colossalai/nn/_ops/_utils.py -> build/lib/colossalai/nn/_ops
2023-03-29T02:33:19,300   copying colossalai/nn/_ops/linear.py -> build/lib/colossalai/nn/_ops
2023-03-29T02:33:19,304   copying colossalai/nn/_ops/batch_norm.py -> build/lib/colossalai/nn/_ops
2023-03-29T02:33:19,307   copying colossalai/nn/_ops/addmm.py -> build/lib/colossalai/nn/_ops
2023-03-29T02:33:19,311   copying colossalai/nn/_ops/embedding_bag.py -> build/lib/colossalai/nn/_ops
2023-03-29T02:33:19,315   copying colossalai/nn/_ops/layernorm.py -> build/lib/colossalai/nn/_ops
2023-03-29T02:33:19,318   copying colossalai/nn/_ops/loss.py -> build/lib/colossalai/nn/_ops
2023-03-29T02:33:19,322   copying colossalai/nn/_ops/element_wise.py -> build/lib/colossalai/nn/_ops
2023-03-29T02:33:19,326   copying colossalai/nn/_ops/view.py -> build/lib/colossalai/nn/_ops
2023-03-29T02:33:19,330   copying colossalai/nn/_ops/__init__.py -> build/lib/colossalai/nn/_ops
2023-03-29T02:33:19,335   creating build/lib/colossalai/nn/parallel
2023-03-29T02:33:19,336   copying colossalai/nn/parallel/gemini_parallel.py -> build/lib/colossalai/nn/parallel
2023-03-29T02:33:19,340   copying colossalai/nn/parallel/data_parallel.py -> build/lib/colossalai/nn/parallel
2023-03-29T02:33:19,346   copying colossalai/nn/parallel/utils.py -> build/lib/colossalai/nn/parallel
2023-03-29T02:33:19,350   copying colossalai/nn/parallel/reducer.py -> build/lib/colossalai/nn/parallel
2023-03-29T02:33:19,355   copying colossalai/nn/parallel/zero_wrapper.py -> build/lib/colossalai/nn/parallel
2023-03-29T02:33:19,359   copying colossalai/nn/parallel/__init__.py -> build/lib/colossalai/nn/parallel
2023-03-29T02:33:19,365   creating build/lib/colossalai/nn/layer
2023-03-29T02:33:19,367   copying colossalai/nn/layer/base_layer.py -> build/lib/colossalai/nn/layer
2023-03-29T02:33:19,372   copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer
2023-03-29T02:33:19,379   creating build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,381   copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,386   copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,391   copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,396   copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,401   copying colossalai/nn/optimizer/zero_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,407   copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,413   copying colossalai/nn/optimizer/gemini_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,417   copying colossalai/nn/optimizer/colossalai_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,421   copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,426   copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,431   copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,435   copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer
2023-03-29T02:33:19,442   creating build/lib/colossalai/nn/lr_scheduler
2023-03-29T02:33:19,445   copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler
2023-03-29T02:33:19,451   copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler
2023-03-29T02:33:19,456   copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler
2023-03-29T02:33:19,461   copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler
2023-03-29T02:33:19,465   copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler
2023-03-29T02:33:19,470   copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler
2023-03-29T02:33:19,473   copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler
2023-03-29T02:33:19,477   copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler
2023-03-29T02:33:19,482   creating build/lib/colossalai/nn/metric
2023-03-29T02:33:19,484   copying colossalai/nn/metric/_utils.py -> build/lib/colossalai/nn/metric
2023-03-29T02:33:19,488   copying colossalai/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/nn/metric
2023-03-29T02:33:19,492   copying colossalai/nn/metric/accuracy_2d.py -> build/lib/colossalai/nn/metric
2023-03-29T02:33:19,496   copying colossalai/nn/metric/accuracy_3d.py -> build/lib/colossalai/nn/metric
2023-03-29T02:33:19,499   copying colossalai/nn/metric/__init__.py -> build/lib/colossalai/nn/metric
2023-03-29T02:33:19,504   creating build/lib/colossalai/nn/loss
2023-03-29T02:33:19,506   copying colossalai/nn/loss/loss_moe.py -> build/lib/colossalai/nn/loss
2023-03-29T02:33:19,510   copying colossalai/nn/loss/loss_2d.py -> build/lib/colossalai/nn/loss
2023-03-29T02:33:19,514   copying colossalai/nn/loss/loss_2p5d.py -> build/lib/colossalai/nn/loss
2023-03-29T02:33:19,519   copying colossalai/nn/loss/loss_1d.py -> build/lib/colossalai/nn/loss
2023-03-29T02:33:19,523   copying colossalai/nn/loss/loss_3d.py -> build/lib/colossalai/nn/loss
2023-03-29T02:33:19,527   copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss
2023-03-29T02:33:19,533   creating build/lib/colossalai/nn/parallel/layers
2023-03-29T02:33:19,535   copying colossalai/nn/parallel/layers/colo_module.py -> build/lib/colossalai/nn/parallel/layers
2023-03-29T02:33:19,539   copying colossalai/nn/parallel/layers/embedding.py -> build/lib/colossalai/nn/parallel/layers
2023-03-29T02:33:19,543   copying colossalai/nn/parallel/layers/module_utils.py -> build/lib/colossalai/nn/parallel/layers
2023-03-29T02:33:19,547   copying colossalai/nn/parallel/layers/linear.py -> build/lib/colossalai/nn/parallel/layers
2023-03-29T02:33:19,551   copying colossalai/nn/parallel/layers/__init__.py -> build/lib/colossalai/nn/parallel/layers
2023-03-29T02:33:19,556   creating build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:19,558   copying colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:19,562   copying colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:19,567   copying colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:19,571   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:19,575   copying colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:19,580   copying colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:19,583   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:19,588   copying colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:19,592   copying colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:19,597   creating build/lib/colossalai/nn/layer/parallel_1d
2023-03-29T02:33:19,599   copying colossalai/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-03-29T02:33:19,603   copying colossalai/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-03-29T02:33:19,611   copying colossalai/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-03-29T02:33:19,615   copying colossalai/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/nn/layer/parallel_1d
2023-03-29T02:33:19,621   creating build/lib/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:19,623   copying colossalai/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:19,628   copying colossalai/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:19,633   copying colossalai/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:19,638   copying colossalai/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:19,642   copying colossalai/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:19,645   copying colossalai/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:19,650   creating build/lib/colossalai/nn/layer/parallel_2p5d
2023-03-29T02:33:19,652   copying colossalai/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-03-29T02:33:19,656   copying colossalai/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-03-29T02:33:19,662   copying colossalai/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-03-29T02:33:19,670   copying colossalai/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2p5d
2023-03-29T02:33:19,676   creating build/lib/colossalai/nn/layer/moe
2023-03-29T02:33:19,678   copying colossalai/nn/layer/moe/experts.py -> build/lib/colossalai/nn/layer/moe
2023-03-29T02:33:19,684   copying colossalai/nn/layer/moe/utils.py -> build/lib/colossalai/nn/layer/moe
2023-03-29T02:33:19,688   copying colossalai/nn/layer/moe/layers.py -> build/lib/colossalai/nn/layer/moe
2023-03-29T02:33:19,693   copying colossalai/nn/layer/moe/_operation.py -> build/lib/colossalai/nn/layer/moe
2023-03-29T02:33:19,698   copying colossalai/nn/layer/moe/routers.py -> build/lib/colossalai/nn/layer/moe
2023-03-29T02:33:19,703   copying colossalai/nn/layer/moe/__init__.py -> build/lib/colossalai/nn/layer/moe
2023-03-29T02:33:19,709   creating build/lib/colossalai/nn/layer/utils
2023-03-29T02:33:19,712   copying colossalai/nn/layer/utils/common.py -> build/lib/colossalai/nn/layer/utils
2023-03-29T02:33:19,715   copying colossalai/nn/layer/utils/__init__.py -> build/lib/colossalai/nn/layer/utils
2023-03-29T02:33:19,720   creating build/lib/colossalai/nn/layer/vanilla
2023-03-29T02:33:19,722   copying colossalai/nn/layer/vanilla/layers.py -> build/lib/colossalai/nn/layer/vanilla
2023-03-29T02:33:19,727   copying colossalai/nn/layer/vanilla/__init__.py -> build/lib/colossalai/nn/layer/vanilla
2023-03-29T02:33:19,733   creating build/lib/colossalai/nn/layer/parallel_sequence
2023-03-29T02:33:19,735   copying colossalai/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-03-29T02:33:19,739   copying colossalai/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-03-29T02:33:19,743   copying colossalai/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-03-29T02:33:19,747   copying colossalai/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/nn/layer/parallel_sequence
2023-03-29T02:33:19,752   creating build/lib/colossalai/nn/layer/wrapper
2023-03-29T02:33:19,754   copying colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/nn/layer/wrapper
2023-03-29T02:33:19,758   copying colossalai/nn/layer/wrapper/__init__.py -> build/lib/colossalai/nn/layer/wrapper
2023-03-29T02:33:19,763   creating build/lib/colossalai/nn/layer/parallel_3d
2023-03-29T02:33:19,765   copying colossalai/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-03-29T02:33:19,769   copying colossalai/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-03-29T02:33:19,776   copying colossalai/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-03-29T02:33:19,783   copying colossalai/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/nn/layer/parallel_3d
2023-03-29T02:33:19,788   creating build/lib/colossalai/nn/layer/parallel_2d
2023-03-29T02:33:19,791   copying colossalai/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-03-29T02:33:19,796   copying colossalai/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-03-29T02:33:19,804   copying colossalai/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-03-29T02:33:19,810   copying colossalai/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/nn/layer/parallel_2d
2023-03-29T02:33:19,816   creating build/lib/colossalai/tensor/d_tensor
2023-03-29T02:33:19,818   copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor
2023-03-29T02:33:19,823   copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor
2023-03-29T02:33:19,828   copying colossalai/tensor/d_tensor/d_tensor.py -> build/lib/colossalai/tensor/d_tensor
2023-03-29T02:33:19,833   copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor
2023-03-29T02:33:19,837   copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor
2023-03-29T02:33:19,844   copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor
2023-03-29T02:33:19,848   copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor
2023-03-29T02:33:19,853   copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor
2023-03-29T02:33:19,857   creating build/lib/colossalai/cli/check
2023-03-29T02:33:19,860   copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check
2023-03-29T02:33:19,865   copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check
2023-03-29T02:33:19,871   creating build/lib/colossalai/cli/benchmark
2023-03-29T02:33:19,873   copying colossalai/cli/benchmark/benchmark.py -> build/lib/colossalai/cli/benchmark
2023-03-29T02:33:19,878   copying colossalai/cli/benchmark/utils.py -> build/lib/colossalai/cli/benchmark
2023-03-29T02:33:19,883   copying colossalai/cli/benchmark/models.py -> build/lib/colossalai/cli/benchmark
2023-03-29T02:33:19,887   copying colossalai/cli/benchmark/__init__.py -> build/lib/colossalai/cli/benchmark
2023-03-29T02:33:19,893   creating build/lib/colossalai/cli/launcher
2023-03-29T02:33:19,895   copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher
2023-03-29T02:33:19,900   copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher
2023-03-29T02:33:19,905   copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher
2023-03-29T02:33:19,909   copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher
2023-03-29T02:33:19,914   creating build/lib/colossalai/pipeline/middleware
2023-03-29T02:33:19,917   copying colossalai/pipeline/middleware/topo.py -> build/lib/colossalai/pipeline/middleware
2023-03-29T02:33:19,922   copying colossalai/pipeline/middleware/__init__.py -> build/lib/colossalai/pipeline/middleware
2023-03-29T02:33:19,928   creating build/lib/colossalai/pipeline/rpc
2023-03-29T02:33:19,930   copying colossalai/pipeline/rpc/utils.py -> build/lib/colossalai/pipeline/rpc
2023-03-29T02:33:19,935   copying colossalai/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/pipeline/rpc
2023-03-29T02:33:19,941   copying colossalai/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/pipeline/rpc
2023-03-29T02:33:19,948   copying colossalai/pipeline/rpc/__init__.py -> build/lib/colossalai/pipeline/rpc
2023-03-29T02:33:19,953   creating build/lib/colossalai/pipeline/middleware/adaptor
2023-03-29T02:33:19,955   copying colossalai/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/pipeline/middleware/adaptor
2023-03-29T02:33:19,959   copying colossalai/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/pipeline/middleware/adaptor
2023-03-29T02:33:19,965   creating build/lib/colossalai/context/process_group_initializer
2023-03-29T02:33:19,966   copying colossalai/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/context/process_group_initializer
2023-03-29T02:33:19,971   copying colossalai/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/context/process_group_initializer
2023-03-29T02:33:19,975   copying colossalai/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/context/process_group_initializer
2023-03-29T02:33:19,980   copying colossalai/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/context/process_group_initializer
2023-03-29T02:33:19,984   copying colossalai/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/context/process_group_initializer
2023-03-29T02:33:19,988   copying colossalai/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/context/process_group_initializer
2023-03-29T02:33:19,993   copying colossalai/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/context/process_group_initializer
2023-03-29T02:33:19,998   copying colossalai/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/context/process_group_initializer
2023-03-29T02:33:20,002   copying colossalai/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/context/process_group_initializer
2023-03-29T02:33:20,006   copying colossalai/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/context/process_group_initializer
2023-03-29T02:33:20,011   copying colossalai/context/process_group_initializer/__init__.py -> build/lib/colossalai/context/process_group_initializer
2023-03-29T02:33:20,016   creating build/lib/colossalai/context/random
2023-03-29T02:33:20,019   copying colossalai/context/random/seed_manager.py -> build/lib/colossalai/context/random
2023-03-29T02:33:20,024   copying colossalai/context/random/_helper.py -> build/lib/colossalai/context/random
2023-03-29T02:33:20,028   copying colossalai/context/random/__init__.py -> build/lib/colossalai/context/random
2023-03-29T02:33:20,034   creating build/lib/colossalai/utils/tensor_detector
2023-03-29T02:33:20,036   copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector
2023-03-29T02:33:20,041   copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector
2023-03-29T02:33:20,047   creating build/lib/colossalai/utils/profiler
2023-03-29T02:33:20,050   copying colossalai/utils/profiler/extention.py -> build/lib/colossalai/utils/profiler
2023-03-29T02:33:20,054   copying colossalai/utils/profiler/profiler.py -> build/lib/colossalai/utils/profiler
2023-03-29T02:33:20,059   copying colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/utils/profiler
2023-03-29T02:33:20,063   copying colossalai/utils/profiler/__init__.py -> build/lib/colossalai/utils/profiler
2023-03-29T02:33:20,070   creating build/lib/colossalai/utils/checkpoint_io
2023-03-29T02:33:20,072   copying colossalai/utils/checkpoint_io/utils.py -> build/lib/colossalai/utils/checkpoint_io
2023-03-29T02:33:20,077   copying colossalai/utils/checkpoint_io/distributed.py -> build/lib/colossalai/utils/checkpoint_io
2023-03-29T02:33:20,082   copying colossalai/utils/checkpoint_io/io.py -> build/lib/colossalai/utils/checkpoint_io
2023-03-29T02:33:20,087   copying colossalai/utils/checkpoint_io/backend.py -> build/lib/colossalai/utils/checkpoint_io
2023-03-29T02:33:20,091   copying colossalai/utils/checkpoint_io/writer.py -> build/lib/colossalai/utils/checkpoint_io
2023-03-29T02:33:20,095   copying colossalai/utils/checkpoint_io/convertor.py -> build/lib/colossalai/utils/checkpoint_io
2023-03-29T02:33:20,099   copying colossalai/utils/checkpoint_io/constant.py -> build/lib/colossalai/utils/checkpoint_io
2023-03-29T02:33:20,102   copying colossalai/utils/checkpoint_io/reader.py -> build/lib/colossalai/utils/checkpoint_io
2023-03-29T02:33:20,106   copying colossalai/utils/checkpoint_io/__init__.py -> build/lib/colossalai/utils/checkpoint_io
2023-03-29T02:33:20,110   copying colossalai/utils/checkpoint_io/meta.py -> build/lib/colossalai/utils/checkpoint_io
2023-03-29T02:33:20,114   creating build/lib/colossalai/utils/rank_recorder
2023-03-29T02:33:20,116   copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder
2023-03-29T02:33:20,121   copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder
2023-03-29T02:33:20,125   creating build/lib/colossalai/utils/multi_tensor_apply
2023-03-29T02:33:20,127   copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-03-29T02:33:20,131   copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-03-29T02:33:20,135   creating build/lib/colossalai/utils/data_sampler
2023-03-29T02:33:20,137   copying colossalai/utils/data_sampler/base_sampler.py -> build/lib/colossalai/utils/data_sampler
2023-03-29T02:33:20,141   copying colossalai/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/utils/data_sampler
2023-03-29T02:33:20,145   copying colossalai/utils/data_sampler/__init__.py -> build/lib/colossalai/utils/data_sampler
2023-03-29T02:33:20,150   creating build/lib/colossalai/utils/checkpoint
2023-03-29T02:33:20,152   copying colossalai/utils/checkpoint/utils.py -> build/lib/colossalai/utils/checkpoint
2023-03-29T02:33:20,155   copying colossalai/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/utils/checkpoint
2023-03-29T02:33:20,159   copying colossalai/utils/checkpoint/__init__.py -> build/lib/colossalai/utils/checkpoint
2023-03-29T02:33:20,164   creating build/lib/colossalai/utils/model
2023-03-29T02:33:20,166   copying colossalai/utils/model/lazy_init_context.py -> build/lib/colossalai/utils/model
2023-03-29T02:33:20,171   copying colossalai/utils/model/experimental.py -> build/lib/colossalai/utils/model
2023-03-29T02:33:20,176   copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model
2023-03-29T02:33:20,180   copying colossalai/utils/model/colo_init_context.py -> build/lib/colossalai/utils/model
2023-03-29T02:33:20,185   copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model
2023-03-29T02:33:20,190   creating build/lib/colossalai/utils/profiler/legacy
2023-03-29T02:33:20,193   copying colossalai/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/utils/profiler/legacy
2023-03-29T02:33:20,197   copying colossalai/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/utils/profiler/legacy
2023-03-29T02:33:20,202   copying colossalai/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/utils/profiler/legacy
2023-03-29T02:33:20,207   copying colossalai/utils/profiler/legacy/__init__.py -> build/lib/colossalai/utils/profiler/legacy
2023-03-29T02:33:20,213   creating build/lib/colossalai/booster/mixed_precision
2023-03-29T02:33:20,215   copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision
2023-03-29T02:33:20,220   copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision
2023-03-29T02:33:20,224   copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision
2023-03-29T02:33:20,229   copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision
2023-03-29T02:33:20,233   copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision
2023-03-29T02:33:20,237   copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision
2023-03-29T02:33:20,242   creating build/lib/colossalai/booster/plugin
2023-03-29T02:33:20,245   copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin
2023-03-29T02:33:20,249   copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin
2023-03-29T02:33:20,254   copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin
2023-03-29T02:33:20,259   creating build/lib/colossalai/gemini/paramhooks
2023-03-29T02:33:20,261   copying colossalai/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/gemini/paramhooks
2023-03-29T02:33:20,265   copying colossalai/gemini/paramhooks/__init__.py -> build/lib/colossalai/gemini/paramhooks
2023-03-29T02:33:20,270   creating build/lib/colossalai/gemini/ophooks
2023-03-29T02:33:20,272   copying colossalai/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/gemini/ophooks
2023-03-29T02:33:20,275   copying colossalai/gemini/ophooks/utils.py -> build/lib/colossalai/gemini/ophooks
2023-03-29T02:33:20,280   copying colossalai/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/gemini/ophooks
2023-03-29T02:33:20,284   copying colossalai/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/gemini/ophooks
2023-03-29T02:33:20,287   copying colossalai/gemini/ophooks/__init__.py -> build/lib/colossalai/gemini/ophooks
2023-03-29T02:33:20,292   creating build/lib/colossalai/gemini/memory_tracer
2023-03-29T02:33:20,294   copying colossalai/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/gemini/memory_tracer
2023-03-29T02:33:20,298   copying colossalai/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/gemini/memory_tracer
2023-03-29T02:33:20,302   copying colossalai/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/gemini/memory_tracer
2023-03-29T02:33:20,307   copying colossalai/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-03-29T02:33:20,312   copying colossalai/gemini/memory_tracer/utils.py -> build/lib/colossalai/gemini/memory_tracer
2023-03-29T02:33:20,316   copying colossalai/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-03-29T02:33:20,321   copying colossalai/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/gemini/memory_tracer
2023-03-29T02:33:20,325   copying colossalai/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/gemini/memory_tracer
2023-03-29T02:33:20,330   copying colossalai/gemini/memory_tracer/__init__.py -> build/lib/colossalai/gemini/memory_tracer
2023-03-29T02:33:20,335   creating build/lib/colossalai/gemini/chunk
2023-03-29T02:33:20,338   copying colossalai/gemini/chunk/chunk.py -> build/lib/colossalai/gemini/chunk
2023-03-29T02:33:20,345   copying colossalai/gemini/chunk/utils.py -> build/lib/colossalai/gemini/chunk
2023-03-29T02:33:20,349   copying colossalai/gemini/chunk/search_utils.py -> build/lib/colossalai/gemini/chunk
2023-03-29T02:33:20,354   copying colossalai/gemini/chunk/manager.py -> build/lib/colossalai/gemini/chunk
2023-03-29T02:33:20,358   copying colossalai/gemini/chunk/__init__.py -> build/lib/colossalai/gemini/chunk
2023-03-29T02:33:20,395   creating build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,396   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,401   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,405   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,411   copying colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,415   copying colossalai/kernel/cuda_native/csrc/compat.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,419   copying colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,424   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,430   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,434   copying colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,438   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,442   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,447   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,452   copying colossalai/kernel/cuda_native/csrc/type_shim.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,457   copying colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,461   copying colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,465   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,470   copying colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,474   copying colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,480   copying colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,485   copying colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,491   copying colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,498   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,504   copying colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:20,510   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels
2023-03-29T02:33:20,511   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,514   copying colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,520   copying colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,525   copying colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,530   copying colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,534   copying colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,540   copying colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,545   copying colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,550   copying colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,555   copying colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,560   copying colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,564   copying colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,569   copying colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:20,815   /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
2023-03-29T02:33:20,815     setuptools.SetuptoolsDeprecationWarning,
2023-03-29T02:33:20,877   installing to build/bdist.linux-armv7l/wheel
2023-03-29T02:33:20,878   running install
2023-03-29T02:33:20,937   running install_lib
2023-03-29T02:33:21,002   creating build/bdist.linux-armv7l
2023-03-29T02:33:21,004   creating build/bdist.linux-armv7l/wheel
2023-03-29T02:33:21,009   creating build/bdist.linux-armv7l/wheel/colossalai
2023-03-29T02:33:21,013   creating build/bdist.linux-armv7l/wheel/colossalai/_C
2023-03-29T02:33:21,015   copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C
2023-03-29T02:33:21,021   creating build/bdist.linux-armv7l/wheel/colossalai/engine
2023-03-29T02:33:21,024   creating build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-03-29T02:33:21,032   copying build/lib/colossalai/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-03-29T02:33:21,037   copying build/lib/colossalai/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-03-29T02:33:21,045   copying build/lib/colossalai/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-03-29T02:33:21,049   copying build/lib/colossalai/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-03-29T02:33:21,053   copying build/lib/colossalai/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/schedule
2023-03-29T02:33:21,056   copying build/lib/colossalai/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/engine
2023-03-29T02:33:21,062   creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-03-29T02:33:21,064   copying build/lib/colossalai/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-03-29T02:33:21,068   copying build/lib/colossalai/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_accumulation
2023-03-29T02:33:21,074   creating build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-03-29T02:33:21,075   copying build/lib/colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-03-29T02:33:21,079   copying build/lib/colossalai/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-03-29T02:33:21,083   copying build/lib/colossalai/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-03-29T02:33:21,087   copying build/lib/colossalai/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-03-29T02:33:21,090   copying build/lib/colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-03-29T02:33:21,095   copying build/lib/colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-03-29T02:33:21,099   copying build/lib/colossalai/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-03-29T02:33:21,104   copying build/lib/colossalai/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine/gradient_handler
2023-03-29T02:33:21,108   copying build/lib/colossalai/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/engine
2023-03-29T02:33:21,114   creating build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-03-29T02:33:21,116   copying build/lib/colossalai/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-03-29T02:33:21,124   creating build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-03-29T02:33:21,126   copying build/lib/colossalai/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-03-29T02:33:21,139   copying build/lib/colossalai/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-03-29T02:33:21,143   copying build/lib/colossalai/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-03-29T02:33:21,148   copying build/lib/colossalai/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-03-29T02:33:21,153   copying build/lib/colossalai/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-03-29T02:33:21,156   copying build/lib/colossalai/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-03-29T02:33:21,160   copying build/lib/colossalai/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer/hooks
2023-03-29T02:33:21,163   copying build/lib/colossalai/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/trainer
2023-03-29T02:33:21,168   creating build/bdist.linux-armv7l/wheel/colossalai/fx
2023-03-29T02:33:21,170   copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-03-29T02:33:21,174   copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-03-29T02:33:21,180   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-03-29T02:33:21,183   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-03-29T02:33:21,184   copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-03-29T02:33:21,189   copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-03-29T02:33:21,193   copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-03-29T02:33:21,197   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:21,199   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:21,203   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:21,207   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:21,210   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:21,214   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:21,217   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:21,221   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:21,225   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:21,229   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:21,232   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:21,236   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-03-29T02:33:21,239   copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-03-29T02:33:21,244   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:21,245   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:21,249   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:21,253   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:21,256   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:21,260   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:21,263   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:21,266   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:21,270   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:21,274   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-03-29T02:33:21,277   copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-03-29T02:33:21,281   copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-03-29T02:33:21,286   copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-03-29T02:33:21,290   copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-03-29T02:33:21,295   copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-03-29T02:33:21,299   copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-03-29T02:33:21,303   copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-03-29T02:33:21,308   copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-03-29T02:33:21,311   copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-03-29T02:33:21,316   creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-03-29T02:33:21,318   copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-03-29T02:33:21,323   copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-03-29T02:33:21,328   copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-03-29T02:33:21,333   copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-03-29T02:33:21,338   copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-03-29T02:33:21,343   copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-03-29T02:33:21,348   copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-03-29T02:33:21,352   copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-03-29T02:33:21,357   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-03-29T02:33:21,358   copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-03-29T02:33:21,363   copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-03-29T02:33:21,369   copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-03-29T02:33:21,373   copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-03-29T02:33:21,379   copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-03-29T02:33:21,385   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-03-29T02:33:21,388   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-03-29T02:33:21,391   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-03-29T02:33:21,396   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-03-29T02:33:21,400   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-03-29T02:33:21,405   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-03-29T02:33:21,410   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-03-29T02:33:21,413   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-03-29T02:33:21,417   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-03-29T02:33:21,422   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-03-29T02:33:21,426   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-03-29T02:33:21,431   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-03-29T02:33:21,435   copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-03-29T02:33:21,440   copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-03-29T02:33:21,445   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-03-29T02:33:21,449   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:21,451   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:21,456   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:21,460   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:21,465   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:21,469   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:21,487   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:21,493   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:21,497   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-03-29T02:33:21,501   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:21,503   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:21,507   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:21,511   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:21,514   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:21,518   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:21,522   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:21,526   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:21,531   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-03-29T02:33:21,534   copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-03-29T02:33:21,538   copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-03-29T02:33:21,541   copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-03-29T02:33:21,546   creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-03-29T02:33:21,548   copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-03-29T02:33:21,554   copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-03-29T02:33:21,558   copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-03-29T02:33:21,563   copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-03-29T02:33:21,566   copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-03-29T02:33:21,571   creating build/bdist.linux-armv7l/wheel/colossalai/builder
2023-03-29T02:33:21,573   copying build/lib/colossalai/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/builder
2023-03-29T02:33:21,576   copying build/lib/colossalai/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/builder
2023-03-29T02:33:21,581   creating build/bdist.linux-armv7l/wheel/colossalai/testing
2023-03-29T02:33:21,583   copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-03-29T02:33:21,587   copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-03-29T02:33:21,591   copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-03-29T02:33:21,595   copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-03-29T02:33:21,598   copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-03-29T02:33:21,603   creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io
2023-03-29T02:33:21,605   copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io
2023-03-29T02:33:21,610   copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io
2023-03-29T02:33:21,614   copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io
2023-03-29T02:33:21,618   creating build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-03-29T02:33:21,621   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-03-29T02:33:21,623   copying build/lib/colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-03-29T02:33:21,627   copying build/lib/colossalai/kernel/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-03-29T02:33:21,630   copying build/lib/colossalai/kernel/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-03-29T02:33:21,634   copying build/lib/colossalai/kernel/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-03-29T02:33:21,638   copying build/lib/colossalai/kernel/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-03-29T02:33:21,642   copying build/lib/colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-03-29T02:33:21,645   copying build/lib/colossalai/kernel/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-03-29T02:33:21,649   copying build/lib/colossalai/kernel/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-03-29T02:33:21,652   copying build/lib/colossalai/kernel/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-03-29T02:33:21,656   copying build/lib/colossalai/kernel/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-03-29T02:33:21,661   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-03-29T02:33:21,663   copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-03-29T02:33:21,667   copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-03-29T02:33:21,671   copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-03-29T02:33:21,674   copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-03-29T02:33:21,679   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-03-29T02:33:21,682   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,684   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,688   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,694   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,699   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,703   copying build/lib/colossalai/kernel/cuda_native/csrc/compat.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,706   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,710   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,716   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,719   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,723   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,727   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,731   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,736   copying build/lib/colossalai/kernel/cuda_native/csrc/type_shim.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,741   copying build/lib/colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,745   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels
2023-03-29T02:33:21,748   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,750   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,754   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,757   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,761   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,764   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,769   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,772   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,776   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,779   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,783   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,786   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,790   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-03-29T02:33:21,794   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,798   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,801   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,806   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,810   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,815   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,819   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,824   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,829   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-03-29T02:33:21,834   copying build/lib/colossalai/kernel/cuda_native/flash_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-03-29T02:33:21,840   copying build/lib/colossalai/kernel/cuda_native/layer_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-03-29T02:33:21,844   copying build/lib/colossalai/kernel/cuda_native/multihead_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-03-29T02:33:21,848   copying build/lib/colossalai/kernel/cuda_native/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-03-29T02:33:21,853   copying build/lib/colossalai/kernel/cuda_native/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-03-29T02:33:21,856   copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-03-29T02:33:21,860   copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-03-29T02:33:21,864   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-03-29T02:33:21,867   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-03-29T02:33:21,869   copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-03-29T02:33:21,873   copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-03-29T02:33:21,877   copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-03-29T02:33:21,881   copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-03-29T02:33:21,885   copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-03-29T02:33:21,890   copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-03-29T02:33:21,894   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-03-29T02:33:21,896   copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-03-29T02:33:21,901   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-03-29T02:33:21,902   copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-03-29T02:33:21,906   copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-03-29T02:33:21,910   copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-03-29T02:33:21,915   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-03-29T02:33:21,917   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-03-29T02:33:21,922   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-03-29T02:33:21,927   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-03-29T02:33:21,931   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-03-29T02:33:21,936   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-03-29T02:33:21,941   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:21,944   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:21,950   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:21,955   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:21,959   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:21,964   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:21,968   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-03-29T02:33:21,974   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:21,975   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:21,980   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:21,982   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:21,989   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:21,994   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:21,997   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,002   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,006   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,010   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,013   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,017   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,021   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,026   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,030   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,035   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,039   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,043   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,047   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,052   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,056   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,060   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-03-29T02:33:22,064   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,069   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,073   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,076   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,080   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,084   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,087   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,091   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,095   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,099   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,104   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,108   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,112   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,116   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,120   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,124   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,128   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,132   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,136   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,140   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,145   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,149   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,153   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,157   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,161   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,164   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-03-29T02:33:22,168   copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-03-29T02:33:22,171   copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-03-29T02:33:22,177   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-03-29T02:33:22,179   copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-03-29T02:33:22,183   copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-03-29T02:33:22,188   copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-03-29T02:33:22,192   copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-03-29T02:33:22,197   copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-03-29T02:33:22,201   copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-03-29T02:33:22,204   copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-03-29T02:33:22,209   copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-03-29T02:33:22,213   copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-03-29T02:33:22,218   copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-03-29T02:33:22,221   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-03-29T02:33:22,223   copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-03-29T02:33:22,227   copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-03-29T02:33:22,232   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:22,233   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:22,237   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:22,241   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:22,246   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:22,251   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:22,255   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:22,259   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:22,263   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:22,267   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:22,271   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:22,275   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-03-29T02:33:22,278   copying build/lib/colossalai/auto_parallel/meta_profiler/metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-03-29T02:33:22,282   copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-03-29T02:33:22,285   copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-03-29T02:33:22,289   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:22,291   copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:22,294   copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:22,298   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:22,303   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:22,307   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:22,311   copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-03-29T02:33:22,314   copying build/lib/colossalai/constants.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-03-29T02:33:22,318   creating build/bdist.linux-armv7l/wheel/colossalai/registry
2023-03-29T02:33:22,320   copying build/lib/colossalai/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/registry
2023-03-29T02:33:22,324   copying build/lib/colossalai/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/registry
2023-03-29T02:33:22,327   copying build/lib/colossalai/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-03-29T02:33:22,332   creating build/bdist.linux-armv7l/wheel/colossalai/amp
2023-03-29T02:33:22,334   creating build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-03-29T02:33:22,336   copying build/lib/colossalai/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-03-29T02:33:22,340   copying build/lib/colossalai/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-03-29T02:33:22,345   copying build/lib/colossalai/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/torch_amp
2023-03-29T02:33:22,350   creating build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-03-29T02:33:22,351   copying build/lib/colossalai/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-03-29T02:33:22,355   copying build/lib/colossalai/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/apex_amp
2023-03-29T02:33:22,358   copying build/lib/colossalai/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-03-29T02:33:22,363   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-03-29T02:33:22,364   copying build/lib/colossalai/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-03-29T02:33:22,368   copying build/lib/colossalai/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-03-29T02:33:22,373   copying build/lib/colossalai/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-03-29T02:33:22,377   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-03-29T02:33:22,379   copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-03-29T02:33:22,383   copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-03-29T02:33:22,386   copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-03-29T02:33:22,391   copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-03-29T02:33:22,394   copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-03-29T02:33:22,398   copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-03-29T02:33:22,402   creating build/bdist.linux-armv7l/wheel/colossalai/zero
2023-03-29T02:33:22,405   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-03-29T02:33:22,407   copying build/lib/colossalai/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-03-29T02:33:22,410   copying build/lib/colossalai/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-03-29T02:33:22,415   copying build/lib/colossalai/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-03-29T02:33:22,418   copying build/lib/colossalai/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-03-29T02:33:22,423   copying build/lib/colossalai/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_model
2023-03-29T02:33:22,428   creating build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-03-29T02:33:22,429   copying build/lib/colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-03-29T02:33:22,434   copying build/lib/colossalai/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-03-29T02:33:22,437   copying build/lib/colossalai/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-03-29T02:33:22,440   copying build/lib/colossalai/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-03-29T02:33:22,444   copying build/lib/colossalai/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/shard_utils
2023-03-29T02:33:22,448   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-03-29T02:33:22,450   copying build/lib/colossalai/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-03-29T02:33:22,454   copying build/lib/colossalai/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-03-29T02:33:22,457   copying build/lib/colossalai/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_param
2023-03-29T02:33:22,462   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-03-29T02:33:22,463   copying build/lib/colossalai/zero/sharded_optim/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-03-29T02:33:22,496   copying build/lib/colossalai/zero/sharded_optim/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-03-29T02:33:22,500   copying build/lib/colossalai/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-03-29T02:33:22,506   creating build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:22,508   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:22,512   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:22,515   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:22,519   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:22,522   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:22,526   copying build/lib/colossalai/zero/sharded_optim/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim/bookkeeping
2023-03-29T02:33:22,529   copying build/lib/colossalai/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/sharded_optim
2023-03-29T02:33:22,534   creating build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-03-29T02:33:22,535   copying build/lib/colossalai/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-03-29T02:33:22,540   copying build/lib/colossalai/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/init_ctx
2023-03-29T02:33:22,544   creating build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-03-29T02:33:22,546   copying build/lib/colossalai/zero/utils/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-03-29T02:33:22,550   copying build/lib/colossalai/zero/utils/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-03-29T02:33:22,553   copying build/lib/colossalai/zero/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/utils
2023-03-29T02:33:22,557   copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero
2023-03-29T02:33:22,561   creating build/bdist.linux-armv7l/wheel/colossalai/cluster
2023-03-29T02:33:22,563   copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster
2023-03-29T02:33:22,566   copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster
2023-03-29T02:33:22,571   copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster
2023-03-29T02:33:22,575   copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster
2023-03-29T02:33:22,580   creating build/bdist.linux-armv7l/wheel/colossalai/nn
2023-03-29T02:33:22,583   creating build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-03-29T02:33:22,585   copying build/lib/colossalai/nn/_ops/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-03-29T02:33:22,590   copying build/lib/colossalai/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-03-29T02:33:22,594   copying build/lib/colossalai/nn/_ops/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-03-29T02:33:22,599   copying build/lib/colossalai/nn/_ops/batch_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-03-29T02:33:22,602   copying build/lib/colossalai/nn/_ops/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-03-29T02:33:22,606   copying build/lib/colossalai/nn/_ops/embedding_bag.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-03-29T02:33:22,611   copying build/lib/colossalai/nn/_ops/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-03-29T02:33:22,614   copying build/lib/colossalai/nn/_ops/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-03-29T02:33:22,618   copying build/lib/colossalai/nn/_ops/element_wise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-03-29T02:33:22,622   copying build/lib/colossalai/nn/_ops/view.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-03-29T02:33:22,626   copying build/lib/colossalai/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/_ops
2023-03-29T02:33:22,631   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-03-29T02:33:22,633   copying build/lib/colossalai/nn/parallel/gemini_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-03-29T02:33:22,637   copying build/lib/colossalai/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-03-29T02:33:22,642   copying build/lib/colossalai/nn/parallel/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-03-29T02:33:22,646   copying build/lib/colossalai/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-03-29T02:33:22,650   copying build/lib/colossalai/nn/parallel/zero_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-03-29T02:33:22,654   copying build/lib/colossalai/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel
2023-03-29T02:33:22,658   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-03-29T02:33:22,660   copying build/lib/colossalai/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-03-29T02:33:22,664   copying build/lib/colossalai/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-03-29T02:33:22,668   creating build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:22,670   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:22,674   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:22,679   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:22,682   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:22,686   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:22,691   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:22,694   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:22,699   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:22,703   copying build/lib/colossalai/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers/cache_embedding
2023-03-29T02:33:22,706   copying build/lib/colossalai/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-03-29T02:33:22,710   copying build/lib/colossalai/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-03-29T02:33:22,714   copying build/lib/colossalai/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/parallel/layers
2023-03-29T02:33:22,718   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-03-29T02:33:22,721   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-03-29T02:33:22,723   copying build/lib/colossalai/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-03-29T02:33:22,727   copying build/lib/colossalai/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-03-29T02:33:22,734   copying build/lib/colossalai/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-03-29T02:33:22,738   copying build/lib/colossalai/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_1d
2023-03-29T02:33:22,742   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:22,744   copying build/lib/colossalai/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:22,748   copying build/lib/colossalai/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:22,751   copying build/lib/colossalai/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:22,755   copying build/lib/colossalai/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:22,759   copying build/lib/colossalai/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:22,762   copying build/lib/colossalai/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/colossalai_layer
2023-03-29T02:33:22,767   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-03-29T02:33:22,768   copying build/lib/colossalai/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-03-29T02:33:22,772   copying build/lib/colossalai/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-03-29T02:33:22,778   copying build/lib/colossalai/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-03-29T02:33:22,784   copying build/lib/colossalai/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2p5d
2023-03-29T02:33:22,788   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-03-29T02:33:22,790   copying build/lib/colossalai/nn/layer/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-03-29T02:33:22,794   copying build/lib/colossalai/nn/layer/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-03-29T02:33:22,797   copying build/lib/colossalai/nn/layer/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-03-29T02:33:22,802   copying build/lib/colossalai/nn/layer/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-03-29T02:33:22,806   copying build/lib/colossalai/nn/layer/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-03-29T02:33:22,810   copying build/lib/colossalai/nn/layer/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-03-29T02:33:22,814   copying build/lib/colossalai/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-03-29T02:33:22,818   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-03-29T02:33:22,820   copying build/lib/colossalai/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-03-29T02:33:22,824   copying build/lib/colossalai/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/utils
2023-03-29T02:33:22,828   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-03-29T02:33:22,829   copying build/lib/colossalai/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-03-29T02:33:22,834   copying build/lib/colossalai/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/vanilla
2023-03-29T02:33:22,838   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-03-29T02:33:22,840   copying build/lib/colossalai/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-03-29T02:33:22,844   copying build/lib/colossalai/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-03-29T02:33:22,848   copying build/lib/colossalai/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-03-29T02:33:22,852   copying build/lib/colossalai/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_sequence
2023-03-29T02:33:22,856   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-03-29T02:33:22,858   copying build/lib/colossalai/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-03-29T02:33:22,861   copying build/lib/colossalai/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/wrapper
2023-03-29T02:33:22,865   copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-03-29T02:33:22,869   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-03-29T02:33:22,871   copying build/lib/colossalai/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-03-29T02:33:22,874   copying build/lib/colossalai/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-03-29T02:33:22,886   copying build/lib/colossalai/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-03-29T02:33:22,892   copying build/lib/colossalai/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_3d
2023-03-29T02:33:22,896   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-03-29T02:33:22,898   copying build/lib/colossalai/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-03-29T02:33:22,901   copying build/lib/colossalai/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-03-29T02:33:22,908   copying build/lib/colossalai/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-03-29T02:33:22,914   copying build/lib/colossalai/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/parallel_2d
2023-03-29T02:33:22,919   creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,920   copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,925   copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,929   copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,933   copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,937   copying build/lib/colossalai/nn/optimizer/zero_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,942   copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,946   copying build/lib/colossalai/nn/optimizer/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,949   copying build/lib/colossalai/nn/optimizer/colossalai_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,952   copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,956   copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,960   copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,963   copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-03-29T02:33:22,969   creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-03-29T02:33:22,970   copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-03-29T02:33:22,975   copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-03-29T02:33:22,978   copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-03-29T02:33:22,982   copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-03-29T02:33:22,986   copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-03-29T02:33:22,990   copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-03-29T02:33:22,994   copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-03-29T02:33:22,997   copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-03-29T02:33:23,001   copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-03-29T02:33:23,006   creating build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-03-29T02:33:23,008   copying build/lib/colossalai/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-03-29T02:33:23,011   copying build/lib/colossalai/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-03-29T02:33:23,015   copying build/lib/colossalai/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-03-29T02:33:23,018   copying build/lib/colossalai/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-03-29T02:33:23,022   copying build/lib/colossalai/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/metric
2023-03-29T02:33:23,026   copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-03-29T02:33:23,030   creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-03-29T02:33:23,032   copying build/lib/colossalai/nn/loss/loss_moe.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-03-29T02:33:23,035   copying build/lib/colossalai/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-03-29T02:33:23,040   copying build/lib/colossalai/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-03-29T02:33:23,044   copying build/lib/colossalai/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-03-29T02:33:23,048   copying build/lib/colossalai/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-03-29T02:33:23,053   copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-03-29T02:33:23,058   creating build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,060   copying build/lib/colossalai/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,065   copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,071   copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,076   copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,080   copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,085   copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,091   creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-03-29T02:33:23,094   copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-03-29T02:33:23,099   copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-03-29T02:33:23,105   copying build/lib/colossalai/tensor/d_tensor/d_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-03-29T02:33:23,109   copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-03-29T02:33:23,113   copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-03-29T02:33:23,118   copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-03-29T02:33:23,122   copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-03-29T02:33:23,126   copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-03-29T02:33:23,128   copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,135   copying build/lib/colossalai/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,138   copying build/lib/colossalai/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,143   copying build/lib/colossalai/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,147   copying build/lib/colossalai/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,151   copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,156   copying build/lib/colossalai/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,161   copying build/lib/colossalai/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,165   copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-03-29T02:33:23,170   creating build/bdist.linux-armv7l/wheel/colossalai/cli
2023-03-29T02:33:23,173   creating build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-03-29T02:33:23,175   copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-03-29T02:33:23,181   copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-03-29T02:33:23,186   creating build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-03-29T02:33:23,188   copying build/lib/colossalai/cli/benchmark/benchmark.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-03-29T02:33:23,193   copying build/lib/colossalai/cli/benchmark/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-03-29T02:33:23,198   copying build/lib/colossalai/cli/benchmark/models.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-03-29T02:33:23,202   copying build/lib/colossalai/cli/benchmark/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/benchmark
2023-03-29T02:33:23,206   copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-03-29T02:33:23,210   copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-03-29T02:33:23,215   creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-03-29T02:33:23,217   copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-03-29T02:33:23,223   copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-03-29T02:33:23,227   copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-03-29T02:33:23,232   copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-03-29T02:33:23,237   creating build/bdist.linux-armv7l/wheel/colossalai/communication
2023-03-29T02:33:23,240   copying build/lib/colossalai/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-03-29T02:33:23,245   copying build/lib/colossalai/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-03-29T02:33:23,250   copying build/lib/colossalai/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-03-29T02:33:23,255   copying build/lib/colossalai/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-03-29T02:33:23,259   copying build/lib/colossalai/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-03-29T02:33:23,265   copying build/lib/colossalai/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/communication
2023-03-29T02:33:23,270   creating build/bdist.linux-armv7l/wheel/colossalai/device
2023-03-29T02:33:23,272   copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-03-29T02:33:23,277   copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-03-29T02:33:23,282   copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-03-29T02:33:23,287   copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-03-29T02:33:23,293   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-03-29T02:33:23,295   copying build/lib/colossalai/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-03-29T02:33:23,302   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-03-29T02:33:23,304   copying build/lib/colossalai/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-03-29T02:33:23,310   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-03-29T02:33:23,312   copying build/lib/colossalai/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-03-29T02:33:23,317   copying build/lib/colossalai/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware/adaptor
2023-03-29T02:33:23,322   copying build/lib/colossalai/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/middleware
2023-03-29T02:33:23,326   copying build/lib/colossalai/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-03-29T02:33:23,331   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-03-29T02:33:23,334   copying build/lib/colossalai/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-03-29T02:33:23,339   copying build/lib/colossalai/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-03-29T02:33:23,344   copying build/lib/colossalai/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-03-29T02:33:23,351   copying build/lib/colossalai/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/rpc
2023-03-29T02:33:23,355   copying build/lib/colossalai/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-03-29T02:33:23,359   copying build/lib/colossalai/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-03-29T02:33:23,363   copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-03-29T02:33:23,368   creating build/bdist.linux-armv7l/wheel/colossalai/context
2023-03-29T02:33:23,370   copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-03-29T02:33:23,374   creating build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-03-29T02:33:23,376   copying build/lib/colossalai/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-03-29T02:33:23,381   copying build/lib/colossalai/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-03-29T02:33:23,385   copying build/lib/colossalai/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-03-29T02:33:23,388   copying build/lib/colossalai/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-03-29T02:33:23,392   copying build/lib/colossalai/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-03-29T02:33:23,396   copying build/lib/colossalai/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-03-29T02:33:23,401   copying build/lib/colossalai/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-03-29T02:33:23,404   copying build/lib/colossalai/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-03-29T02:33:23,408   copying build/lib/colossalai/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-03-29T02:33:23,411   copying build/lib/colossalai/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-03-29T02:33:23,415   copying build/lib/colossalai/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/process_group_initializer
2023-03-29T02:33:23,418   copying build/lib/colossalai/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-03-29T02:33:23,425   creating build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-03-29T02:33:23,426   copying build/lib/colossalai/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-03-29T02:33:23,430   copying build/lib/colossalai/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-03-29T02:33:23,434   copying build/lib/colossalai/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context/random
2023-03-29T02:33:23,438   copying build/lib/colossalai/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-03-29T02:33:23,442   copying build/lib/colossalai/context/moe_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-03-29T02:33:23,446   copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-03-29T02:33:23,449   copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-03-29T02:33:23,453   copying build/lib/colossalai/core.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-03-29T02:33:23,458   creating build/bdist.linux-armv7l/wheel/colossalai/utils
2023-03-29T02:33:23,461   creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-03-29T02:33:23,463   copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-03-29T02:33:23,468   copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-03-29T02:33:23,472   creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-03-29T02:33:23,474   copying build/lib/colossalai/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-03-29T02:33:23,479   creating build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-03-29T02:33:23,481   copying build/lib/colossalai/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-03-29T02:33:23,485   copying build/lib/colossalai/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-03-29T02:33:23,490   copying build/lib/colossalai/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-03-29T02:33:23,494   copying build/lib/colossalai/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler/legacy
2023-03-29T02:33:23,497   copying build/lib/colossalai/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-03-29T02:33:23,502   copying build/lib/colossalai/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-03-29T02:33:23,506   copying build/lib/colossalai/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/profiler
2023-03-29T02:33:23,510   creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-03-29T02:33:23,512   copying build/lib/colossalai/utils/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-03-29T02:33:23,517   copying build/lib/colossalai/utils/checkpoint_io/distributed.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-03-29T02:33:23,521   copying build/lib/colossalai/utils/checkpoint_io/io.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-03-29T02:33:23,525   copying build/lib/colossalai/utils/checkpoint_io/backend.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-03-29T02:33:23,529   copying build/lib/colossalai/utils/checkpoint_io/writer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-03-29T02:33:23,533   copying build/lib/colossalai/utils/checkpoint_io/convertor.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-03-29T02:33:23,537   copying build/lib/colossalai/utils/checkpoint_io/constant.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-03-29T02:33:23,541   copying build/lib/colossalai/utils/checkpoint_io/reader.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-03-29T02:33:23,545   copying build/lib/colossalai/utils/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-03-29T02:33:23,549   copying build/lib/colossalai/utils/checkpoint_io/meta.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint_io
2023-03-29T02:33:23,554   creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-03-29T02:33:23,556   copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-03-29T02:33:23,560   copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-03-29T02:33:23,564   copying build/lib/colossalai/utils/cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-03-29T02:33:23,567   copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-03-29T02:33:23,572   copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-03-29T02:33:23,577   copying build/lib/colossalai/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-03-29T02:33:23,583   creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-03-29T02:33:23,585   copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-03-29T02:33:23,589   copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-03-29T02:33:23,593   copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-03-29T02:33:23,597   copying build/lib/colossalai/utils/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-03-29T02:33:23,602   creating build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-03-29T02:33:23,604   copying build/lib/colossalai/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-03-29T02:33:23,607   copying build/lib/colossalai/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-03-29T02:33:23,616   copying build/lib/colossalai/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/data_sampler
2023-03-29T02:33:23,619   copying build/lib/colossalai/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-03-29T02:33:23,625   copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-03-29T02:33:23,629   creating build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-03-29T02:33:23,631   copying build/lib/colossalai/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-03-29T02:33:23,635   copying build/lib/colossalai/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-03-29T02:33:23,639   copying build/lib/colossalai/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/checkpoint
2023-03-29T02:33:23,644   creating build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-03-29T02:33:23,645   copying build/lib/colossalai/utils/model/lazy_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-03-29T02:33:23,650   copying build/lib/colossalai/utils/model/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-03-29T02:33:23,656   copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-03-29T02:33:23,660   copying build/lib/colossalai/utils/model/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-03-29T02:33:23,665   copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-03-29T02:33:23,669   creating build/bdist.linux-armv7l/wheel/colossalai/logging
2023-03-29T02:33:23,672   copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-03-29T02:33:23,677   copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-03-29T02:33:23,682   creating build/bdist.linux-armv7l/wheel/colossalai/booster
2023-03-29T02:33:23,684   copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster
2023-03-29T02:33:23,690   creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-03-29T02:33:23,693   copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-03-29T02:33:23,697   copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-03-29T02:33:23,702   copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-03-29T02:33:23,706   copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-03-29T02:33:23,710   copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-03-29T02:33:23,714   copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-03-29T02:33:23,720   creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-03-29T02:33:23,722   copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-03-29T02:33:23,726   copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-03-29T02:33:23,731   copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-03-29T02:33:23,736   copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster
2023-03-29T02:33:23,740   copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster
2023-03-29T02:33:23,745   creating build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-03-29T02:33:23,747   copying build/lib/colossalai/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-03-29T02:33:23,752   copying build/lib/colossalai/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-03-29T02:33:23,757   copying build/lib/colossalai/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-03-29T02:33:23,764   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-03-29T02:33:23,765   copying build/lib/colossalai/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-03-29T02:33:23,769   copying build/lib/colossalai/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/paramhooks
2023-03-29T02:33:23,774   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-03-29T02:33:23,776   copying build/lib/colossalai/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-03-29T02:33:23,780   copying build/lib/colossalai/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-03-29T02:33:23,784   copying build/lib/colossalai/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-03-29T02:33:23,788   copying build/lib/colossalai/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-03-29T02:33:23,792   copying build/lib/colossalai/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/ophooks
2023-03-29T02:33:23,795   copying build/lib/colossalai/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-03-29T02:33:23,800   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-03-29T02:33:23,801   copying build/lib/colossalai/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-03-29T02:33:23,805   copying build/lib/colossalai/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-03-29T02:33:23,809   copying build/lib/colossalai/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-03-29T02:33:23,812   copying build/lib/colossalai/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-03-29T02:33:23,816   copying build/lib/colossalai/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-03-29T02:33:23,820   copying build/lib/colossalai/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-03-29T02:33:23,824   copying build/lib/colossalai/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-03-29T02:33:23,828   copying build/lib/colossalai/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-03-29T02:33:23,831   copying build/lib/colossalai/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/memory_tracer
2023-03-29T02:33:23,836   creating build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-03-29T02:33:23,837   copying build/lib/colossalai/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-03-29T02:33:23,843   copying build/lib/colossalai/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-03-29T02:33:23,846   copying build/lib/colossalai/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-03-29T02:33:23,851   copying build/lib/colossalai/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-03-29T02:33:23,855   copying build/lib/colossalai/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini/chunk
2023-03-29T02:33:23,859   copying build/lib/colossalai/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-03-29T02:33:23,862   copying build/lib/colossalai/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-03-29T02:33:23,867   copying build/lib/colossalai/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-03-29T02:33:23,871   copying build/lib/colossalai/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/gemini
2023-03-29T02:33:23,875   creating build/bdist.linux-armv7l/wheel/colossalai/interface
2023-03-29T02:33:23,877   copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface
2023-03-29T02:33:23,881   copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface
2023-03-29T02:33:23,885   copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface
2023-03-29T02:33:23,888   copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-03-29T02:33:23,892   copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-03-29T02:33:23,897   running install_egg_info
2023-03-29T02:33:24,042   running egg_info
2023-03-29T02:33:24,098   writing colossalai.egg-info/PKG-INFO
2023-03-29T02:33:24,104   writing dependency_links to colossalai.egg-info/dependency_links.txt
2023-03-29T02:33:24,107   writing entry points to colossalai.egg-info/entry_points.txt
2023-03-29T02:33:24,110   writing requirements to colossalai.egg-info/requires.txt
2023-03-29T02:33:24,113   writing top-level names to colossalai.egg-info/top_level.txt
2023-03-29T02:33:24,399   reading manifest file 'colossalai.egg-info/SOURCES.txt'
2023-03-29T02:33:24,497   reading manifest template 'MANIFEST.in'
2023-03-29T02:33:26,681   warning: no files found matching '*.tr' under directory 'colossalai'
2023-03-29T02:33:27,713   warning: no files found matching '*.cc' under directory 'colossalai'
2023-03-29T02:33:28,749   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-03-29T02:33:28,766   adding license file 'LICENSE'
2023-03-29T02:33:28,867   writing manifest file 'colossalai.egg-info/SOURCES.txt'
2023-03-29T02:33:28,873   Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.2.8-py3.7.egg-info
2023-03-29T02:33:28,899   running install_scripts
2023-03-29T02:33:28,948   creating build/bdist.linux-armv7l/wheel/colossalai-0.2.8.dist-info/WHEEL
2023-03-29T02:33:28,953   creating '/tmp/pip-wheel-8qe16anb/colossalai-0.2.8-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2023-03-29T02:33:28,959   adding 'colossalai/__init__.py'
2023-03-29T02:33:28,963   adding 'colossalai/constants.py'
2023-03-29T02:33:28,965   adding 'colossalai/core.py'
2023-03-29T02:33:28,967   adding 'colossalai/global_variables.py'
2023-03-29T02:33:28,973   adding 'colossalai/initialize.py'
2023-03-29T02:33:28,976   adding 'colossalai/version.py'
2023-03-29T02:33:28,979   adding 'colossalai/_C/__init__.py'
2023-03-29T02:33:28,983   adding 'colossalai/amp/__init__.py'
2023-03-29T02:33:28,986   adding 'colossalai/amp/amp_type.py'
2023-03-29T02:33:28,989   adding 'colossalai/amp/apex_amp/__init__.py'
2023-03-29T02:33:28,992   adding 'colossalai/amp/apex_amp/apex_amp.py'
2023-03-29T02:33:28,996   adding 'colossalai/amp/naive_amp/__init__.py'
2023-03-29T02:33:29,000   adding 'colossalai/amp/naive_amp/_fp16_optimizer.py'
2023-03-29T02:33:29,003   adding 'colossalai/amp/naive_amp/_utils.py'
2023-03-29T02:33:29,006   adding 'colossalai/amp/naive_amp/naive_amp.py'
2023-03-29T02:33:29,010   adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py'
2023-03-29T02:33:29,013   adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py'
2023-03-29T02:33:29,015   adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py'
2023-03-29T02:33:29,018   adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py'
2023-03-29T02:33:29,022   adding 'colossalai/amp/torch_amp/__init__.py'
2023-03-29T02:33:29,030   adding 'colossalai/amp/torch_amp/_grad_scaler.py'
2023-03-29T02:33:29,033   adding 'colossalai/amp/torch_amp/torch_amp.py'
2023-03-29T02:33:29,037   adding 'colossalai/auto_parallel/__init__.py'
2023-03-29T02:33:29,040   adding 'colossalai/auto_parallel/checkpoint/__init__.py'
2023-03-29T02:33:29,043   adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py'
2023-03-29T02:33:29,046   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py'
2023-03-29T02:33:29,050   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py'
2023-03-29T02:33:29,055   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py'
2023-03-29T02:33:29,058   adding 'colossalai/auto_parallel/checkpoint/operation.py'
2023-03-29T02:33:29,062   adding 'colossalai/auto_parallel/meta_profiler/__init__.py'
2023-03-29T02:33:29,064   adding 'colossalai/auto_parallel/meta_profiler/constants.py'
2023-03-29T02:33:29,067   adding 'colossalai/auto_parallel/meta_profiler/metainfo.py'
2023-03-29T02:33:29,070   adding 'colossalai/auto_parallel/meta_profiler/registry.py'
2023-03-29T02:33:29,074   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py'
2023-03-29T02:33:29,077   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py'
2023-03-29T02:33:29,080   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py'
2023-03-29T02:33:29,083   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py'
2023-03-29T02:33:29,086   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py'
2023-03-29T02:33:29,091   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py'
2023-03-29T02:33:29,094   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py'
2023-03-29T02:33:29,098   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py'
2023-03-29T02:33:29,101   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py'
2023-03-29T02:33:29,104   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py'
2023-03-29T02:33:29,107   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py'
2023-03-29T02:33:29,111   adding 'colossalai/auto_parallel/offload/__init__.py'
2023-03-29T02:33:29,114   adding 'colossalai/auto_parallel/offload/amp_optimizer.py'
2023-03-29T02:33:29,117   adding 'colossalai/auto_parallel/offload/base_offload_module.py'
2023-03-29T02:33:29,120   adding 'colossalai/auto_parallel/offload/mem_optimize.py'
2023-03-29T02:33:29,123   adding 'colossalai/auto_parallel/offload/region.py'
2023-03-29T02:33:29,129   adding 'colossalai/auto_parallel/offload/region_manager.py'
2023-03-29T02:33:29,133   adding 'colossalai/auto_parallel/offload/runtime.py'
2023-03-29T02:33:29,139   adding 'colossalai/auto_parallel/offload/solver.py'
2023-03-29T02:33:29,144   adding 'colossalai/auto_parallel/offload/training_simulator.py'
2023-03-29T02:33:29,147   adding 'colossalai/auto_parallel/offload/util.py'
2023-03-29T02:33:29,151   adding 'colossalai/auto_parallel/passes/__init__.py'
2023-03-29T02:33:29,154   adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py'
2023-03-29T02:33:29,156   adding 'colossalai/auto_parallel/passes/constants.py'
2023-03-29T02:33:29,159   adding 'colossalai/auto_parallel/passes/meta_info_prop.py'
2023-03-29T02:33:29,163   adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py'
2023-03-29T02:33:29,170   adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py'
2023-03-29T02:33:29,174   adding 'colossalai/auto_parallel/pipeline_shard/__init__.py'
2023-03-29T02:33:29,177   adding 'colossalai/auto_parallel/tensor_shard/__init__.py'
2023-03-29T02:33:29,180   adding 'colossalai/auto_parallel/tensor_shard/constants.py'
2023-03-29T02:33:29,185   adding 'colossalai/auto_parallel/tensor_shard/initialize.py'
2023-03-29T02:33:29,188   adding 'colossalai/auto_parallel/tensor_shard/options.py'
2023-03-29T02:33:29,192   adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py'
2023-03-29T02:33:29,197   adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py'
2023-03-29T02:33:29,200   adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py'
2023-03-29T02:33:29,203   adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py'
2023-03-29T02:33:29,206   adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py'
2023-03-29T02:33:29,209   adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py'
2023-03-29T02:33:29,212   adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py'
2023-03-29T02:33:29,215   adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py'
2023-03-29T02:33:29,219   adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py'
2023-03-29T02:33:29,222   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py'
2023-03-29T02:33:29,225   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py'
2023-03-29T02:33:29,227   adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py'
2023-03-29T02:33:29,232   adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py'
2023-03-29T02:33:29,238   adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py'
2023-03-29T02:33:29,243   adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py'
2023-03-29T02:33:29,246   adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py'
2023-03-29T02:33:29,249   adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py'
2023-03-29T02:33:29,252   adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py'
2023-03-29T02:33:29,254   adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py'
2023-03-29T02:33:29,257   adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py'
2023-03-29T02:33:29,259   adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py'
2023-03-29T02:33:29,262   adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py'
2023-03-29T02:33:29,265   adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py'
2023-03-29T02:33:29,268   adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py'
2023-03-29T02:33:29,270   adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py'
2023-03-29T02:33:29,273   adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py'
2023-03-29T02:33:29,276   adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py'
2023-03-29T02:33:29,278   adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py'
2023-03-29T02:33:29,283   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py'
2023-03-29T02:33:29,287   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py'
2023-03-29T02:33:29,290   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py'
2023-03-29T02:33:29,295   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py'
2023-03-29T02:33:29,299   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py'
2023-03-29T02:33:29,302   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py'
2023-03-29T02:33:29,306   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py'
2023-03-29T02:33:29,310   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py'
2023-03-29T02:33:29,317   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py'
2023-03-29T02:33:29,321   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py'
2023-03-29T02:33:29,324   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py'
2023-03-29T02:33:29,327   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py'
2023-03-29T02:33:29,332   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py'
2023-03-29T02:33:29,335   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py'
2023-03-29T02:33:29,340   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py'
2023-03-29T02:33:29,343   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py'
2023-03-29T02:33:29,346   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py'
2023-03-29T02:33:29,349   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py'
2023-03-29T02:33:29,352   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py'
2023-03-29T02:33:29,356   adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py'
2023-03-29T02:33:29,360   adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py'
2023-03-29T02:33:29,363   adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py'
2023-03-29T02:33:29,369   adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py'
2023-03-29T02:33:29,373   adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py'
2023-03-29T02:33:29,377   adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py'
2023-03-29T02:33:29,380   adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py'
2023-03-29T02:33:29,384   adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py'
2023-03-29T02:33:29,387   adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py'
2023-03-29T02:33:29,391   adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py'
2023-03-29T02:33:29,394   adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py'
2023-03-29T02:33:29,398   adding 'colossalai/booster/__init__.py'
2023-03-29T02:33:29,400   adding 'colossalai/booster/accelerator.py'
2023-03-29T02:33:29,404   adding 'colossalai/booster/booster.py'
2023-03-29T02:33:29,408   adding 'colossalai/booster/mixed_precision/__init__.py'
2023-03-29T02:33:29,410   adding 'colossalai/booster/mixed_precision/bf16.py'
2023-03-29T02:33:29,412   adding 'colossalai/booster/mixed_precision/fp16_apex.py'
2023-03-29T02:33:29,415   adding 'colossalai/booster/mixed_precision/fp16_torch.py'
2023-03-29T02:33:29,418   adding 'colossalai/booster/mixed_precision/fp8.py'
2023-03-29T02:33:29,420   adding 'colossalai/booster/mixed_precision/mixed_precision_base.py'
2023-03-29T02:33:29,424   adding 'colossalai/booster/plugin/__init__.py'
2023-03-29T02:33:29,426   adding 'colossalai/booster/plugin/plugin_base.py'
2023-03-29T02:33:29,430   adding 'colossalai/booster/plugin/torch_ddp_plugin.py'
2023-03-29T02:33:29,433   adding 'colossalai/builder/__init__.py'
2023-03-29T02:33:29,436   adding 'colossalai/builder/builder.py'
2023-03-29T02:33:29,440   adding 'colossalai/checkpoint_io/__init__.py'
2023-03-29T02:33:29,445   adding 'colossalai/checkpoint_io/checkpoint_io_base.py'
2023-03-29T02:33:29,448   adding 'colossalai/checkpoint_io/general_checkpoint_io.py'
2023-03-29T02:33:29,451   adding 'colossalai/cli/__init__.py'
2023-03-29T02:33:29,454   adding 'colossalai/cli/cli.py'
2023-03-29T02:33:29,457   adding 'colossalai/cli/benchmark/__init__.py'
2023-03-29T02:33:29,460   adding 'colossalai/cli/benchmark/benchmark.py'
2023-03-29T02:33:29,463   adding 'colossalai/cli/benchmark/models.py'
2023-03-29T02:33:29,466   adding 'colossalai/cli/benchmark/utils.py'
2023-03-29T02:33:29,470   adding 'colossalai/cli/check/__init__.py'
2023-03-29T02:33:29,473   adding 'colossalai/cli/check/check_installation.py'
2023-03-29T02:33:29,477   adding 'colossalai/cli/launcher/__init__.py'
2023-03-29T02:33:29,480   adding 'colossalai/cli/launcher/hostinfo.py'
2023-03-29T02:33:29,483   adding 'colossalai/cli/launcher/multinode_runner.py'
2023-03-29T02:33:29,488   adding 'colossalai/cli/launcher/run.py'
2023-03-29T02:33:29,503   adding 'colossalai/cluster/__init__.py'
2023-03-29T02:33:29,505   adding 'colossalai/cluster/device_mesh_manager.py'
2023-03-29T02:33:29,509   adding 'colossalai/cluster/dist_coordinator.py'
2023-03-29T02:33:29,512   adding 'colossalai/cluster/process_group_manager.py'
2023-03-29T02:33:29,515   adding 'colossalai/communication/__init__.py'
2023-03-29T02:33:29,519   adding 'colossalai/communication/collective.py'
2023-03-29T02:33:29,524   adding 'colossalai/communication/p2p.py'
2023-03-29T02:33:29,528   adding 'colossalai/communication/p2p_v2.py'
2023-03-29T02:33:29,531   adding 'colossalai/communication/ring.py'
2023-03-29T02:33:29,534   adding 'colossalai/communication/utils.py'
2023-03-29T02:33:29,538   adding 'colossalai/context/__init__.py'
2023-03-29T02:33:29,541   adding 'colossalai/context/config.py'
2023-03-29T02:33:29,544   adding 'colossalai/context/moe_context.py'
2023-03-29T02:33:29,551   adding 'colossalai/context/parallel_context.py'
2023-03-29T02:33:29,554   adding 'colossalai/context/parallel_mode.py'
2023-03-29T02:33:29,556   adding 'colossalai/context/singleton_meta.py'
2023-03-29T02:33:29,560   adding 'colossalai/context/process_group_initializer/__init__.py'
2023-03-29T02:33:29,563   adding 'colossalai/context/process_group_initializer/initializer_1d.py'
2023-03-29T02:33:29,566   adding 'colossalai/context/process_group_initializer/initializer_2d.py'
2023-03-29T02:33:29,571   adding 'colossalai/context/process_group_initializer/initializer_2p5d.py'
2023-03-29T02:33:29,575   adding 'colossalai/context/process_group_initializer/initializer_3d.py'
2023-03-29T02:33:29,578   adding 'colossalai/context/process_group_initializer/initializer_data.py'
2023-03-29T02:33:29,581   adding 'colossalai/context/process_group_initializer/initializer_model.py'
2023-03-29T02:33:29,584   adding 'colossalai/context/process_group_initializer/initializer_pipeline.py'
2023-03-29T02:33:29,587   adding 'colossalai/context/process_group_initializer/initializer_sequence.py'
2023-03-29T02:33:29,589   adding 'colossalai/context/process_group_initializer/initializer_tensor.py'
2023-03-29T02:33:29,592   adding 'colossalai/context/process_group_initializer/process_group_initializer.py'
2023-03-29T02:33:29,595   adding 'colossalai/context/random/__init__.py'
2023-03-29T02:33:29,598   adding 'colossalai/context/random/_helper.py'
2023-03-29T02:33:29,601   adding 'colossalai/context/random/seed_manager.py'
2023-03-29T02:33:29,605   adding 'colossalai/device/__init__.py'
2023-03-29T02:33:29,610   adding 'colossalai/device/alpha_beta_profiler.py'
2023-03-29T02:33:29,614   adding 'colossalai/device/calc_pipeline_strategy.py'
2023-03-29T02:33:29,618   adding 'colossalai/device/device_mesh.py'
2023-03-29T02:33:29,622   adding 'colossalai/engine/__init__.py'
2023-03-29T02:33:29,625   adding 'colossalai/engine/_base_engine.py'
2023-03-29T02:33:29,629   adding 'colossalai/engine/gradient_accumulation/__init__.py'
2023-03-29T02:33:29,633   adding 'colossalai/engine/gradient_accumulation/_gradient_accumulation.py'
2023-03-29T02:33:29,637   adding 'colossalai/engine/gradient_handler/__init__.py'
2023-03-29T02:33:29,639   adding 'colossalai/engine/gradient_handler/_base_gradient_handler.py'
2023-03-29T02:33:29,642   adding 'colossalai/engine/gradient_handler/_data_parallel_gradient_handler.py'
2023-03-29T02:33:29,645   adding 'colossalai/engine/gradient_handler/_moe_gradient_handler.py'
2023-03-29T02:33:29,648   adding 'colossalai/engine/gradient_handler/_pipeline_parallel_gradient_handler.py'
2023-03-29T02:33:29,650   adding 'colossalai/engine/gradient_handler/_sequence_parallel_gradient_handler.py'
2023-03-29T02:33:29,653   adding 'colossalai/engine/gradient_handler/_zero_gradient_handler.py'
2023-03-29T02:33:29,655   adding 'colossalai/engine/gradient_handler/utils.py'
2023-03-29T02:33:29,659   adding 'colossalai/engine/schedule/__init__.py'
2023-03-29T02:33:29,662   adding 'colossalai/engine/schedule/_base_schedule.py'
2023-03-29T02:33:29,665   adding 'colossalai/engine/schedule/_non_pipeline_schedule.py'
2023-03-29T02:33:29,675   adding 'colossalai/engine/schedule/_pipeline_schedule.py'
2023-03-29T02:33:29,679   adding 'colossalai/engine/schedule/_pipeline_schedule_v2.py'
2023-03-29T02:33:29,683   adding 'colossalai/fx/__init__.py'
2023-03-29T02:33:29,686   adding 'colossalai/fx/_compatibility.py'
2023-03-29T02:33:29,691   adding 'colossalai/fx/_meta_regist_12.py'
2023-03-29T02:33:29,694   adding 'colossalai/fx/_meta_regist_13.py'
2023-03-29T02:33:29,698   adding 'colossalai/fx/graph_module.py'
2023-03-29T02:33:29,701   adding 'colossalai/fx/proxy.py'
2023-03-29T02:33:29,704   adding 'colossalai/fx/codegen/__init__.py'
2023-03-29T02:33:29,715   adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py'
2023-03-29T02:33:29,720   adding 'colossalai/fx/passes/__init__.py'
2023-03-29T02:33:29,724   adding 'colossalai/fx/passes/adding_split_node_pass.py'
2023-03-29T02:33:29,729   adding 'colossalai/fx/passes/concrete_info_prop.py'
2023-03-29T02:33:29,734   adding 'colossalai/fx/passes/meta_info_prop.py'
2023-03-29T02:33:29,741   adding 'colossalai/fx/passes/passes_for_gpt2_test.py'
2023-03-29T02:33:29,745   adding 'colossalai/fx/passes/shard_1d_pass.py'
2023-03-29T02:33:29,750   adding 'colossalai/fx/passes/split_module.py'
2023-03-29T02:33:29,753   adding 'colossalai/fx/passes/utils.py'
2023-03-29T02:33:29,757   adding 'colossalai/fx/profiler/__init__.py'
2023-03-29T02:33:29,760   adding 'colossalai/fx/profiler/constants.py'
2023-03-29T02:33:29,763   adding 'colossalai/fx/profiler/dataflow.py'
2023-03-29T02:33:29,766   adding 'colossalai/fx/profiler/memory_utils.py'
2023-03-29T02:33:29,770   adding 'colossalai/fx/profiler/opcount.py'
2023-03-29T02:33:29,775   adding 'colossalai/fx/profiler/profiler.py'
2023-03-29T02:33:29,778   adding 'colossalai/fx/profiler/shard_utils.py'
2023-03-29T02:33:29,782   adding 'colossalai/fx/profiler/tensor.py'
2023-03-29T02:33:29,785   adding 'colossalai/fx/profiler/experimental/__init__.py'
2023-03-29T02:33:29,788   adding 'colossalai/fx/profiler/experimental/constants.py'
2023-03-29T02:33:29,791   adding 'colossalai/fx/profiler/experimental/profiler.py'
2023-03-29T02:33:29,796   adding 'colossalai/fx/profiler/experimental/registry.py'
2023-03-29T02:33:29,798   adding 'colossalai/fx/profiler/experimental/shard_utils.py'
2023-03-29T02:33:29,802   adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py'
2023-03-29T02:33:29,804   adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py'
2023-03-29T02:33:29,807   adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py'
2023-03-29T02:33:29,810   adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py'
2023-03-29T02:33:29,813   adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py'
2023-03-29T02:33:29,815   adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py'
2023-03-29T02:33:29,818   adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py'
2023-03-29T02:33:29,820   adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py'
2023-03-29T02:33:29,823   adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py'
2023-03-29T02:33:29,826   adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py'
2023-03-29T02:33:29,829   adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py'
2023-03-29T02:33:29,832   adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py'
2023-03-29T02:33:29,835   adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py'
2023-03-29T02:33:29,837   adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py'
2023-03-29T02:33:29,840   adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py'
2023-03-29T02:33:29,842   adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py'
2023-03-29T02:33:29,845   adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py'
2023-03-29T02:33:29,847   adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py'
2023-03-29T02:33:29,850   adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py'
2023-03-29T02:33:29,853   adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py'
2023-03-29T02:33:29,856   adding 'colossalai/fx/tracer/__init__.py'
2023-03-29T02:33:29,860   adding 'colossalai/fx/tracer/_meta_trace.py'
2023-03-29T02:33:29,862   adding 'colossalai/fx/tracer/_symbolic_trace.py'
2023-03-29T02:33:29,865   adding 'colossalai/fx/tracer/_tracer_utils.py'
2023-03-29T02:33:29,872   adding 'colossalai/fx/tracer/experimental.py'
2023-03-29T02:33:29,875   adding 'colossalai/fx/tracer/registry.py'
2023-03-29T02:33:29,883   adding 'colossalai/fx/tracer/tracer.py'
2023-03-29T02:33:29,887   adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py'
2023-03-29T02:33:29,890   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py'
2023-03-29T02:33:29,893   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py'
2023-03-29T02:33:29,896   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py'
2023-03-29T02:33:29,899   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py'
2023-03-29T02:33:29,902   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py'
2023-03-29T02:33:29,905   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py'
2023-03-29T02:33:29,908   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py'
2023-03-29T02:33:29,911   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py'
2023-03-29T02:33:29,913   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py'
2023-03-29T02:33:29,917   adding 'colossalai/fx/tracer/meta_patch/__init__.py'
2023-03-29T02:33:29,921   adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py'
2023-03-29T02:33:29,923   adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py'
2023-03-29T02:33:29,926   adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py'
2023-03-29T02:33:29,929   adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py'
2023-03-29T02:33:29,931   adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py'
2023-03-29T02:33:29,934   adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py'
2023-03-29T02:33:29,936   adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py'
2023-03-29T02:33:29,940   adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py'
2023-03-29T02:33:29,943   adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py'
2023-03-29T02:33:29,946   adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py'
2023-03-29T02:33:29,948   adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py'
2023-03-29T02:33:29,951   adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py'
2023-03-29T02:33:29,953   adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py'
2023-03-29T02:33:29,956   adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py'
2023-03-29T02:33:29,959   adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py'
2023-03-29T02:33:29,962   adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py'
2023-03-29T02:33:29,965   adding 'colossalai/gemini/__init__.py'
2023-03-29T02:33:29,968   adding 'colossalai/gemini/gemini_context.py'
2023-03-29T02:33:29,971   adding 'colossalai/gemini/gemini_mgr.py'
2023-03-29T02:33:29,975   adding 'colossalai/gemini/placement_policy.py'
2023-03-29T02:33:29,978   adding 'colossalai/gemini/stateful_tensor.py'
2023-03-29T02:33:29,982   adding 'colossalai/gemini/stateful_tensor_mgr.py'
2023-03-29T02:33:29,985   adding 'colossalai/gemini/tensor_placement_policy.py'
2023-03-29T02:33:29,988   adding 'colossalai/gemini/tensor_utils.py'
2023-03-29T02:33:29,992   adding 'colossalai/gemini/chunk/__init__.py'
2023-03-29T02:33:29,998   adding 'colossalai/gemini/chunk/chunk.py'
2023-03-29T02:33:30,002   adding 'colossalai/gemini/chunk/manager.py'
2023-03-29T02:33:30,006   adding 'colossalai/gemini/chunk/search_utils.py'
2023-03-29T02:33:30,009   adding 'colossalai/gemini/chunk/utils.py'
2023-03-29T02:33:30,013   adding 'colossalai/gemini/memory_tracer/__init__.py'
2023-03-29T02:33:30,015   adding 'colossalai/gemini/memory_tracer/chunk_memstats_collector.py'
2023-03-29T02:33:30,018   adding 'colossalai/gemini/memory_tracer/memory_monitor.py'
2023-03-29T02:33:30,021   adding 'colossalai/gemini/memory_tracer/memory_stats.py'
2023-03-29T02:33:30,024   adding 'colossalai/gemini/memory_tracer/memstats_collector.py'
2023-03-29T02:33:30,027   adding 'colossalai/gemini/memory_tracer/param_runtime_order.py'
2023-03-29T02:33:30,030   adding 'colossalai/gemini/memory_tracer/runtime_mem_tracer.py'
2023-03-29T02:33:30,033   adding 'colossalai/gemini/memory_tracer/static_memstats_collector.py'
2023-03-29T02:33:30,035   adding 'colossalai/gemini/memory_tracer/utils.py'
2023-03-29T02:33:30,039   adding 'colossalai/gemini/ophooks/__init__.py'
2023-03-29T02:33:30,041   adding 'colossalai/gemini/ophooks/_shard_grad_ophook.py'
2023-03-29T02:33:30,044   adding 'colossalai/gemini/ophooks/_shard_param_ophook.py'
2023-03-29T02:33:30,047   adding 'colossalai/gemini/ophooks/runtime_mem_tracer_hook.py'
2023-03-29T02:33:30,050   adding 'colossalai/gemini/ophooks/utils.py'
2023-03-29T02:33:30,053   adding 'colossalai/gemini/paramhooks/__init__.py'
2023-03-29T02:33:30,056   adding 'colossalai/gemini/paramhooks/_param_hookmgr.py'
2023-03-29T02:33:30,059   adding 'colossalai/interface/__init__.py'
2023-03-29T02:33:30,062   adding 'colossalai/interface/model.py'
2023-03-29T02:33:30,065   adding 'colossalai/interface/optimizer.py'
2023-03-29T02:33:30,068   adding 'colossalai/kernel/__init__.py'
2023-03-29T02:33:30,072   adding 'colossalai/kernel/cuda_native/__init__.py'
2023-03-29T02:33:30,078   adding 'colossalai/kernel/cuda_native/flash_attention.py'
2023-03-29T02:33:30,081   adding 'colossalai/kernel/cuda_native/layer_norm.py'
2023-03-29T02:33:30,085   adding 'colossalai/kernel/cuda_native/multihead_attention.py'
2023-03-29T02:33:30,089   adding 'colossalai/kernel/cuda_native/scaled_softmax.py'
2023-03-29T02:33:30,093   adding 'colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp'
2023-03-29T02:33:30,096   adding 'colossalai/kernel/cuda_native/csrc/compat.h'
2023-03-29T02:33:30,100   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.cpp'
2023-03-29T02:33:30,104   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.h'
2023-03-29T02:33:30,107   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp'
2023-03-29T02:33:30,114   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu'
2023-03-29T02:33:30,117   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda.cpp'
2023-03-29T02:33:30,123   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu'
2023-03-29T02:33:30,127   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu'
2023-03-29T02:33:30,130   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh'
2023-03-29T02:33:30,134   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu'
2023-03-29T02:33:30,139   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu'
2023-03-29T02:33:30,142   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu'
2023-03-29T02:33:30,146   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu'
2023-03-29T02:33:30,150   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp'
2023-03-29T02:33:30,154   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h'
2023-03-29T02:33:30,157   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp'
2023-03-29T02:33:30,161   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h'
2023-03-29T02:33:30,165   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu'
2023-03-29T02:33:30,167   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp'
2023-03-29T02:33:30,172   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h'
2023-03-29T02:33:30,175   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu'
2023-03-29T02:33:30,179   adding 'colossalai/kernel/cuda_native/csrc/type_shim.h'
2023-03-29T02:33:30,185   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h'
2023-03-29T02:33:30,187   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/context.h'
2023-03-29T02:33:30,190   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h'
2023-03-29T02:33:30,193   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h'
2023-03-29T02:33:30,195   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h'
2023-03-29T02:33:30,198   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h'
2023-03-29T02:33:30,201   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h'
2023-03-29T02:33:30,204   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h'
2023-03-29T02:33:30,207   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh'
2023-03-29T02:33:30,210   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h'
2023-03-29T02:33:30,212   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h'
2023-03-29T02:33:30,215   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h'
2023-03-29T02:33:30,219   adding 'colossalai/kernel/jit/__init__.py'
2023-03-29T02:33:30,222   adding 'colossalai/kernel/jit/bias_dropout_add.py'
2023-03-29T02:33:30,224   adding 'colossalai/kernel/jit/bias_gelu.py'
2023-03-29T02:33:30,227   adding 'colossalai/kernel/jit/option.py'
2023-03-29T02:33:30,231   adding 'colossalai/kernel/op_builder/__init__.py'
2023-03-29T02:33:30,235   adding 'colossalai/kernel/op_builder/builder.py'
2023-03-29T02:33:30,237   adding 'colossalai/kernel/op_builder/cpu_adam.py'
2023-03-29T02:33:30,240   adding 'colossalai/kernel/op_builder/fused_optim.py'
2023-03-29T02:33:30,243   adding 'colossalai/kernel/op_builder/layernorm.py'
2023-03-29T02:33:30,245   adding 'colossalai/kernel/op_builder/moe.py'
2023-03-29T02:33:30,248   adding 'colossalai/kernel/op_builder/multi_head_attn.py'
2023-03-29T02:33:30,251   adding 'colossalai/kernel/op_builder/scaled_masked_softmax.py'
2023-03-29T02:33:30,253   adding 'colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py'
2023-03-29T02:33:30,257   adding 'colossalai/kernel/op_builder/utils.py'
2023-03-29T02:33:30,261   adding 'colossalai/logging/__init__.py'
2023-03-29T02:33:30,264   adding 'colossalai/logging/logger.py'
2023-03-29T02:33:30,268   adding 'colossalai/nn/__init__.py'
2023-03-29T02:33:30,272   adding 'colossalai/nn/init.py'
2023-03-29T02:33:30,276   adding 'colossalai/nn/_ops/__init__.py'
2023-03-29T02:33:30,279   adding 'colossalai/nn/_ops/_utils.py'
2023-03-29T02:33:30,282   adding 'colossalai/nn/_ops/addmm.py'
2023-03-29T02:33:30,285   adding 'colossalai/nn/_ops/batch_norm.py'
2023-03-29T02:33:30,288   adding 'colossalai/nn/_ops/element_wise.py'
2023-03-29T02:33:30,292   adding 'colossalai/nn/_ops/embedding.py'
2023-03-29T02:33:30,295   adding 'colossalai/nn/_ops/embedding_bag.py'
2023-03-29T02:33:30,297   adding 'colossalai/nn/_ops/layernorm.py'
2023-03-29T02:33:30,301   adding 'colossalai/nn/_ops/linear.py'
2023-03-29T02:33:30,304   adding 'colossalai/nn/_ops/loss.py'
2023-03-29T02:33:30,307   adding 'colossalai/nn/_ops/view.py'
2023-03-29T02:33:30,311   adding 'colossalai/nn/layer/__init__.py'
2023-03-29T02:33:30,314   adding 'colossalai/nn/layer/base_layer.py'
2023-03-29T02:33:30,317   adding 'colossalai/nn/layer/colossalai_layer/__init__.py'
2023-03-29T02:33:30,320   adding 'colossalai/nn/layer/colossalai_layer/_utils.py'
2023-03-29T02:33:30,323   adding 'colossalai/nn/layer/colossalai_layer/dropout.py'
2023-03-29T02:33:30,326   adding 'colossalai/nn/layer/colossalai_layer/embedding.py'
2023-03-29T02:33:30,330   adding 'colossalai/nn/layer/colossalai_layer/linear.py'
2023-03-29T02:33:30,333   adding 'colossalai/nn/layer/colossalai_layer/normalization.py'
2023-03-29T02:33:30,336   adding 'colossalai/nn/layer/moe/__init__.py'
2023-03-29T02:33:30,340   adding 'colossalai/nn/layer/moe/_operation.py'
2023-03-29T02:33:30,343   adding 'colossalai/nn/layer/moe/experts.py'
2023-03-29T02:33:30,347   adding 'colossalai/nn/layer/moe/layers.py'
2023-03-29T02:33:30,351   adding 'colossalai/nn/layer/moe/routers.py'
2023-03-29T02:33:30,354   adding 'colossalai/nn/layer/moe/utils.py'
2023-03-29T02:33:30,358   adding 'colossalai/nn/layer/parallel_1d/__init__.py'
2023-03-29T02:33:30,361   adding 'colossalai/nn/layer/parallel_1d/_operation.py'
2023-03-29T02:33:30,364   adding 'colossalai/nn/layer/parallel_1d/_utils.py'
2023-03-29T02:33:30,373   adding 'colossalai/nn/layer/parallel_1d/layers.py'
2023-03-29T02:33:30,378   adding 'colossalai/nn/layer/parallel_2d/__init__.py'
2023-03-29T02:33:30,384   adding 'colossalai/nn/layer/parallel_2d/_operation.py'
2023-03-29T02:33:30,387   adding 'colossalai/nn/layer/parallel_2d/_utils.py'
2023-03-29T02:33:30,396   adding 'colossalai/nn/layer/parallel_2d/layers.py'
2023-03-29T02:33:30,401   adding 'colossalai/nn/layer/parallel_2p5d/__init__.py'
2023-03-29T02:33:30,408   adding 'colossalai/nn/layer/parallel_2p5d/_operation.py'
2023-03-29T02:33:30,411   adding 'colossalai/nn/layer/parallel_2p5d/_utils.py'
2023-03-29T02:33:30,420   adding 'colossalai/nn/layer/parallel_2p5d/layers.py'
2023-03-29T02:33:30,424   adding 'colossalai/nn/layer/parallel_3d/__init__.py'
2023-03-29T02:33:30,429   adding 'colossalai/nn/layer/parallel_3d/_operation.py'
2023-03-29T02:33:30,433   adding 'colossalai/nn/layer/parallel_3d/_utils.py'
2023-03-29T02:33:30,441   adding 'colossalai/nn/layer/parallel_3d/layers.py'
2023-03-29T02:33:30,445   adding 'colossalai/nn/layer/parallel_sequence/__init__.py'
2023-03-29T02:33:30,448   adding 'colossalai/nn/layer/parallel_sequence/_operation.py'
2023-03-29T02:33:30,451   adding 'colossalai/nn/layer/parallel_sequence/_utils.py'
2023-03-29T02:33:30,455   adding 'colossalai/nn/layer/parallel_sequence/layers.py'
2023-03-29T02:33:30,458   adding 'colossalai/nn/layer/utils/__init__.py'
2023-03-29T02:33:30,461   adding 'colossalai/nn/layer/utils/common.py'
2023-03-29T02:33:30,465   adding 'colossalai/nn/layer/vanilla/__init__.py'
2023-03-29T02:33:30,469   adding 'colossalai/nn/layer/vanilla/layers.py'
2023-03-29T02:33:30,473   adding 'colossalai/nn/layer/wrapper/__init__.py'
2023-03-29T02:33:30,476   adding 'colossalai/nn/layer/wrapper/pipeline_wrapper.py'
2023-03-29T02:33:30,479   adding 'colossalai/nn/loss/__init__.py'
2023-03-29T02:33:30,483   adding 'colossalai/nn/loss/loss_1d.py'
2023-03-29T02:33:30,486   adding 'colossalai/nn/loss/loss_2d.py'
2023-03-29T02:33:30,489   adding 'colossalai/nn/loss/loss_2p5d.py'
2023-03-29T02:33:30,493   adding 'colossalai/nn/loss/loss_3d.py'
2023-03-29T02:33:30,496   adding 'colossalai/nn/loss/loss_moe.py'
2023-03-29T02:33:30,500   adding 'colossalai/nn/lr_scheduler/__init__.py'
2023-03-29T02:33:30,503   adding 'colossalai/nn/lr_scheduler/cosine.py'
2023-03-29T02:33:30,506   adding 'colossalai/nn/lr_scheduler/delayed.py'
2023-03-29T02:33:30,509   adding 'colossalai/nn/lr_scheduler/linear.py'
2023-03-29T02:33:30,511   adding 'colossalai/nn/lr_scheduler/multistep.py'
2023-03-29T02:33:30,515   adding 'colossalai/nn/lr_scheduler/onecycle.py'
2023-03-29T02:33:30,517   adding 'colossalai/nn/lr_scheduler/poly.py'
2023-03-29T02:33:30,520   adding 'colossalai/nn/lr_scheduler/torch.py'
2023-03-29T02:33:30,524   adding 'colossalai/nn/metric/__init__.py'
2023-03-29T02:33:30,526   adding 'colossalai/nn/metric/_utils.py'
2023-03-29T02:33:30,529   adding 'colossalai/nn/metric/accuracy_2d.py'
2023-03-29T02:33:30,531   adding 'colossalai/nn/metric/accuracy_2p5d.py'
2023-03-29T02:33:30,534   adding 'colossalai/nn/metric/accuracy_3d.py'
2023-03-29T02:33:30,537   adding 'colossalai/nn/optimizer/__init__.py'
2023-03-29T02:33:30,540   adding 'colossalai/nn/optimizer/colossalai_optimizer.py'
2023-03-29T02:33:30,544   adding 'colossalai/nn/optimizer/cpu_adam.py'
2023-03-29T02:33:30,548   adding 'colossalai/nn/optimizer/fused_adam.py'
2023-03-29T02:33:30,552   adding 'colossalai/nn/optimizer/fused_lamb.py'
2023-03-29T02:33:30,556   adding 'colossalai/nn/optimizer/fused_sgd.py'
2023-03-29T02:33:30,558   adding 'colossalai/nn/optimizer/gemini_optimizer.py'
2023-03-29T02:33:30,562   adding 'colossalai/nn/optimizer/hybrid_adam.py'
2023-03-29T02:33:30,565   adding 'colossalai/nn/optimizer/lamb.py'
2023-03-29T02:33:30,568   adding 'colossalai/nn/optimizer/lars.py'
2023-03-29T02:33:30,572   adding 'colossalai/nn/optimizer/nvme_optimizer.py'
2023-03-29T02:33:30,576   adding 'colossalai/nn/optimizer/zero_optimizer.py'
2023-03-29T02:33:30,580   adding 'colossalai/nn/parallel/__init__.py'
2023-03-29T02:33:30,589   adding 'colossalai/nn/parallel/data_parallel.py'
2023-03-29T02:33:30,593   adding 'colossalai/nn/parallel/gemini_parallel.py'
2023-03-29T02:33:30,596   adding 'colossalai/nn/parallel/reducer.py'
2023-03-29T02:33:30,599   adding 'colossalai/nn/parallel/utils.py'
2023-03-29T02:33:30,602   adding 'colossalai/nn/parallel/zero_wrapper.py'
2023-03-29T02:33:30,606   adding 'colossalai/nn/parallel/layers/__init__.py'
2023-03-29T02:33:30,608   adding 'colossalai/nn/parallel/layers/colo_module.py'
2023-03-29T02:33:30,611   adding 'colossalai/nn/parallel/layers/embedding.py'
2023-03-29T02:33:30,614   adding 'colossalai/nn/parallel/layers/linear.py'
2023-03-29T02:33:30,617   adding 'colossalai/nn/parallel/layers/module_utils.py'
2023-03-29T02:33:30,621   adding 'colossalai/nn/parallel/layers/cache_embedding/__init__.py'
2023-03-29T02:33:30,623   adding 'colossalai/nn/parallel/layers/cache_embedding/base_embedding.py'
2023-03-29T02:33:30,631   adding 'colossalai/nn/parallel/layers/cache_embedding/cache_mgr.py'
2023-03-29T02:33:30,635   adding 'colossalai/nn/parallel/layers/cache_embedding/cached_embedding.py'
2023-03-29T02:33:30,638   adding 'colossalai/nn/parallel/layers/cache_embedding/copyer.py'
2023-03-29T02:33:30,640   adding 'colossalai/nn/parallel/layers/cache_embedding/embedding_config.py'
2023-03-29T02:33:30,644   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py'
2023-03-29T02:33:30,647   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py'
2023-03-29T02:33:30,651   adding 'colossalai/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py'
2023-03-29T02:33:30,655   adding 'colossalai/pipeline/__init__.py'
2023-03-29T02:33:30,657   adding 'colossalai/pipeline/layer_spec.py'
2023-03-29T02:33:30,662   adding 'colossalai/pipeline/pipelinable.py'
2023-03-29T02:33:30,665   adding 'colossalai/pipeline/pipeline_process_group.py'
2023-03-29T02:33:30,669   adding 'colossalai/pipeline/utils.py'
2023-03-29T02:33:30,673   adding 'colossalai/pipeline/middleware/__init__.py'
2023-03-29T02:33:30,676   adding 'colossalai/pipeline/middleware/topo.py'
2023-03-29T02:33:30,679   adding 'colossalai/pipeline/middleware/adaptor/__init__.py'
2023-03-29T02:33:30,683   adding 'colossalai/pipeline/middleware/adaptor/fx.py'
2023-03-29T02:33:30,687   adding 'colossalai/pipeline/rpc/__init__.py'
2023-03-29T02:33:30,701   adding 'colossalai/pipeline/rpc/_pipeline_base.py'
2023-03-29T02:33:30,707   adding 'colossalai/pipeline/rpc/_pipeline_schedule.py'
2023-03-29T02:33:30,710   adding 'colossalai/pipeline/rpc/utils.py'
2023-03-29T02:33:30,714   adding 'colossalai/registry/__init__.py'
2023-03-29T02:33:30,717   adding 'colossalai/registry/registry.py'
2023-03-29T02:33:30,721   adding 'colossalai/tensor/__init__.py'
2023-03-29T02:33:30,724   adding 'colossalai/tensor/colo_parameter.py'
2023-03-29T02:33:30,729   adding 'colossalai/tensor/colo_tensor.py'
2023-03-29T02:33:30,735   adding 'colossalai/tensor/comm_spec.py'
2023-03-29T02:33:30,738   adding 'colossalai/tensor/compute_spec.py'
2023-03-29T02:33:30,740   adding 'colossalai/tensor/const.py'
2023-03-29T02:33:30,744   adding 'colossalai/tensor/dist_spec_mgr.py'
2023-03-29T02:33:30,747   adding 'colossalai/tensor/distspec.py'
2023-03-29T02:33:30,749   adding 'colossalai/tensor/op_wrapper.py'
2023-03-29T02:33:30,753   adding 'colossalai/tensor/param_op_hook.py'
2023-03-29T02:33:30,757   adding 'colossalai/tensor/process_group.py'
2023-03-29T02:33:30,765   adding 'colossalai/tensor/shape_consistency.py'
2023-03-29T02:33:30,770   adding 'colossalai/tensor/sharding_spec.py'
2023-03-29T02:33:30,773   adding 'colossalai/tensor/tensor_spec.py'
2023-03-29T02:33:30,777   adding 'colossalai/tensor/utils.py'
2023-03-29T02:33:30,781   adding 'colossalai/tensor/d_tensor/__init__.py'
2023-03-29T02:33:30,784   adding 'colossalai/tensor/d_tensor/comm_spec.py'
2023-03-29T02:33:30,788   adding 'colossalai/tensor/d_tensor/d_tensor.py'
2023-03-29T02:33:30,791   adding 'colossalai/tensor/d_tensor/layout.py'
2023-03-29T02:33:30,797   adding 'colossalai/tensor/d_tensor/layout_converter.py'
2023-03-29T02:33:30,800   adding 'colossalai/tensor/d_tensor/misc.py'
2023-03-29T02:33:30,804   adding 'colossalai/tensor/d_tensor/sharding_spec.py'
2023-03-29T02:33:30,807   adding 'colossalai/tensor/d_tensor/utils.py'
2023-03-29T02:33:30,810   adding 'colossalai/testing/__init__.py'
2023-03-29T02:33:30,813   adding 'colossalai/testing/comparison.py'
2023-03-29T02:33:30,816   adding 'colossalai/testing/pytest_wrapper.py'
2023-03-29T02:33:30,818   adding 'colossalai/testing/random.py'
2023-03-29T02:33:30,821   adding 'colossalai/testing/utils.py'
2023-03-29T02:33:30,825   adding 'colossalai/trainer/__init__.py'
2023-03-29T02:33:30,830   adding 'colossalai/trainer/_trainer.py'
2023-03-29T02:33:30,834   adding 'colossalai/trainer/hooks/__init__.py'
2023-03-29T02:33:30,836   adding 'colossalai/trainer/hooks/_base_hook.py'
2023-03-29T02:33:30,839   adding 'colossalai/trainer/hooks/_checkpoint_hook.py'
2023-03-29T02:33:30,842   adding 'colossalai/trainer/hooks/_commons_.py'
2023-03-29T02:33:30,846   adding 'colossalai/trainer/hooks/_log_hook.py'
2023-03-29T02:33:30,849   adding 'colossalai/trainer/hooks/_lr_scheduler_hook.py'
2023-03-29T02:33:30,854   adding 'colossalai/trainer/hooks/_metric_hook.py'
2023-03-29T02:33:30,858   adding 'colossalai/utils/__init__.py'
2023-03-29T02:33:30,862   adding 'colossalai/utils/activation_checkpoint.py'
2023-03-29T02:33:30,866   adding 'colossalai/utils/checkpointing.py'
2023-03-29T02:33:30,872   adding 'colossalai/utils/common.py'
2023-03-29T02:33:30,875   adding 'colossalai/utils/cuda.py'
2023-03-29T02:33:30,879   adding 'colossalai/utils/memory.py'
2023-03-29T02:33:30,882   adding 'colossalai/utils/moe.py'
2023-03-29T02:33:30,885   adding 'colossalai/utils/timer.py'
2023-03-29T02:33:30,888   adding 'colossalai/utils/checkpoint/__init__.py'
2023-03-29T02:33:30,891   adding 'colossalai/utils/checkpoint/module_checkpoint.py'
2023-03-29T02:33:30,894   adding 'colossalai/utils/checkpoint/utils.py'
2023-03-29T02:33:30,897   adding 'colossalai/utils/checkpoint_io/__init__.py'
2023-03-29T02:33:30,900   adding 'colossalai/utils/checkpoint_io/backend.py'
2023-03-29T02:33:30,903   adding 'colossalai/utils/checkpoint_io/constant.py'
2023-03-29T02:33:30,906   adding 'colossalai/utils/checkpoint_io/convertor.py'
2023-03-29T02:33:30,910   adding 'colossalai/utils/checkpoint_io/distributed.py'
2023-03-29T02:33:30,913   adding 'colossalai/utils/checkpoint_io/io.py'
2023-03-29T02:33:30,916   adding 'colossalai/utils/checkpoint_io/meta.py'
2023-03-29T02:33:30,919   adding 'colossalai/utils/checkpoint_io/reader.py'
2023-03-29T02:33:30,923   adding 'colossalai/utils/checkpoint_io/utils.py'
2023-03-29T02:33:30,926   adding 'colossalai/utils/checkpoint_io/writer.py'
2023-03-29T02:33:30,929   adding 'colossalai/utils/data_sampler/__init__.py'
2023-03-29T02:33:30,932   adding 'colossalai/utils/data_sampler/base_sampler.py'
2023-03-29T02:33:30,935   adding 'colossalai/utils/data_sampler/data_parallel_sampler.py'
2023-03-29T02:33:30,939   adding 'colossalai/utils/model/__init__.py'
2023-03-29T02:33:30,942   adding 'colossalai/utils/model/colo_init_context.py'
2023-03-29T02:33:30,949   adding 'colossalai/utils/model/experimental.py'
2023-03-29T02:33:30,954   adding 'colossalai/utils/model/lazy_init_context.py'
2023-03-29T02:33:30,957   adding 'colossalai/utils/model/utils.py'
2023-03-29T02:33:30,960   adding 'colossalai/utils/multi_tensor_apply/__init__.py'
2023-03-29T02:33:30,963   adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py'
2023-03-29T02:33:30,966   adding 'colossalai/utils/profiler/__init__.py'
2023-03-29T02:33:30,968   adding 'colossalai/utils/profiler/extention.py'
2023-03-29T02:33:30,972   adding 'colossalai/utils/profiler/profiler.py'
2023-03-29T02:33:30,975   adding 'colossalai/utils/profiler/stateful_tensor_mem_extention.py'
2023-03-29T02:33:30,979   adding 'colossalai/utils/profiler/legacy/__init__.py'
2023-03-29T02:33:30,983   adding 'colossalai/utils/profiler/legacy/comm_profiler.py'
2023-03-29T02:33:30,986   adding 'colossalai/utils/profiler/legacy/pcie_profiler.py'
2023-03-29T02:33:30,989   adding 'colossalai/utils/profiler/legacy/prof_utils.py'
2023-03-29T02:33:30,993   adding 'colossalai/utils/rank_recorder/__init__.py'
2023-03-29T02:33:30,996   adding 'colossalai/utils/rank_recorder/rank_recorder.py'
2023-03-29T02:33:30,999   adding 'colossalai/utils/tensor_detector/__init__.py'
2023-03-29T02:33:31,003   adding 'colossalai/utils/tensor_detector/tensor_detector.py'
2023-03-29T02:33:31,007   adding 'colossalai/zero/__init__.py'
2023-03-29T02:33:31,010   adding 'colossalai/zero/init_ctx/__init__.py'
2023-03-29T02:33:31,015   adding 'colossalai/zero/init_ctx/init_context.py'
2023-03-29T02:33:31,018   adding 'colossalai/zero/shard_utils/__init__.py'
2023-03-29T02:33:31,021   adding 'colossalai/zero/shard_utils/base_shard_strategy.py'
2023-03-29T02:33:31,023   adding 'colossalai/zero/shard_utils/bucket_tensor_shard_strategy.py'
2023-03-29T02:33:31,026   adding 'colossalai/zero/shard_utils/commons.py'
2023-03-29T02:33:31,029   adding 'colossalai/zero/shard_utils/tensor_shard_strategy.py'
2023-03-29T02:33:31,032   adding 'colossalai/zero/sharded_model/__init__.py'
2023-03-29T02:33:31,035   adding 'colossalai/zero/sharded_model/_utils.py'
2023-03-29T02:33:31,039   adding 'colossalai/zero/sharded_model/reduce_scatter.py'
2023-03-29T02:33:31,047   adding 'colossalai/zero/sharded_model/sharded_model_v2.py'
2023-03-29T02:33:31,050   adding 'colossalai/zero/sharded_model/utils.py'
2023-03-29T02:33:31,054   adding 'colossalai/zero/sharded_optim/__init__.py'
2023-03-29T02:33:31,058   adding 'colossalai/zero/sharded_optim/_utils.py'
2023-03-29T02:33:31,066   adding 'colossalai/zero/sharded_optim/low_level_optim.py'
2023-03-29T02:33:31,072   adding 'colossalai/zero/sharded_optim/sharded_optim_v2.py'
2023-03-29T02:33:31,076   adding 'colossalai/zero/sharded_optim/bookkeeping/__init__.py'
2023-03-29T02:33:31,078   adding 'colossalai/zero/sharded_optim/bookkeeping/base_store.py'
2023-03-29T02:33:31,081   adding 'colossalai/zero/sharded_optim/bookkeeping/bucket_store.py'
2023-03-29T02:33:31,084   adding 'colossalai/zero/sharded_optim/bookkeeping/gradient_store.py'
2023-03-29T02:33:31,086   adding 'colossalai/zero/sharded_optim/bookkeeping/parameter_store.py'
2023-03-29T02:33:31,089   adding 'colossalai/zero/sharded_optim/bookkeeping/tensor_bucket.py'
2023-03-29T02:33:31,093   adding 'colossalai/zero/sharded_param/__init__.py'
2023-03-29T02:33:31,096   adding 'colossalai/zero/sharded_param/sharded_param.py'
2023-03-29T02:33:31,098   adding 'colossalai/zero/sharded_param/sharded_tensor.py'
2023-03-29T02:33:31,101   adding 'colossalai/zero/utils/__init__.py'
2023-03-29T02:33:31,104   adding 'colossalai/zero/utils/gemini_hook.py'
2023-03-29T02:33:31,107   adding 'colossalai/zero/utils/zero_hook.py'
2023-03-29T02:33:31,116   adding 'colossalai-0.2.8.dist-info/LICENSE'
2023-03-29T02:33:31,123   adding 'colossalai-0.2.8.dist-info/METADATA'
2023-03-29T02:33:31,125   adding 'colossalai-0.2.8.dist-info/WHEEL'
2023-03-29T02:33:31,127   adding 'colossalai-0.2.8.dist-info/entry_points.txt'
2023-03-29T02:33:31,129   adding 'colossalai-0.2.8.dist-info/top_level.txt'
2023-03-29T02:33:31,156   adding 'colossalai-0.2.8.dist-info/RECORD'
2023-03-29T02:33:31,201   removing build/bdist.linux-armv7l/wheel
2023-03-29T02:33:31,757   Building wheel for colossalai (setup.py): finished with status 'done'
2023-03-29T02:33:31,792   Created wheel for colossalai: filename=colossalai-0.2.8-py3-none-any.whl size=930923 sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666
2023-03-29T02:33:31,794   Stored in directory: /tmp/pip-ephem-wheel-cache-9x8numt2/wheels/db/bb/33/09528d9d459bd819635e95fc2f8febc05d71fa8bce542fe324
2023-03-29T02:33:31,876 Successfully built colossalai
2023-03-29T02:33:31,946 Removed build tracker: '/tmp/pip-build-tracker-o9f0m8t6'