2023-11-01T06:49:38,496 Created temporary directory: /tmp/pip-build-tracker-snoccdhw
2023-11-01T06:49:38,497 Initialized build tracking at /tmp/pip-build-tracker-snoccdhw
2023-11-01T06:49:38,498 Created build tracker: /tmp/pip-build-tracker-snoccdhw
2023-11-01T06:49:38,498 Entered build tracker: /tmp/pip-build-tracker-snoccdhw
2023-11-01T06:49:38,499 Created temporary directory: /tmp/pip-wheel-9zznhh_6
2023-11-01T06:49:38,502 Created temporary directory: /tmp/pip-ephem-wheel-cache-6dtcli1a
2023-11-01T06:49:38,524 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-11-01T06:49:38,528 2 location(s) to search for versions of colossalai:
2023-11-01T06:49:38,528 * https://pypi.org/simple/colossalai/
2023-11-01T06:49:38,528 * https://www.piwheels.org/simple/colossalai/
2023-11-01T06:49:38,529 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/
2023-11-01T06:49:38,529 Getting page https://pypi.org/simple/colossalai/
2023-11-01T06:49:38,531 Found index url https://pypi.org/simple/
2023-11-01T06:49:38,752 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json
2023-11-01T06:49:38,755   Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0
2023-11-01T06:49:38,756   Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1
2023-11-01T06:49:38,757   Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2
2023-11-01T06:49:38,758   Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3
2023-11-01T06:49:38,759   Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4
2023-11-01T06:49:38,760   Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5
2023-11-01T06:49:38,761   Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6
2023-11-01T06:49:38,762   Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7
2023-11-01T06:49:38,763   Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8
2023-11-01T06:49:38,764   Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0
2023-11-01T06:49:38,765   Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1
2023-11-01T06:49:38,766   Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2
2023-11-01T06:49:38,767   Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3
2023-11-01T06:49:38,768   Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4
2023-11-01T06:49:38,769 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/
2023-11-01T06:49:38,769 Getting page https://www.piwheels.org/simple/colossalai/
2023-11-01T06:49:38,770 Found index url https://www.piwheels.org/simple/
2023-11-01T06:49:38,948 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html
2023-11-01T06:49:38,953   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,954   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,954   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,955   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,955   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,956   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,956   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,957   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,957   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,958   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,959   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,959   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,960   Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6)
2023-11-01T06:49:38,961 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/
2023-11-01T06:49:38,961 Skipping link: not a file: https://pypi.org/simple/colossalai/
2023-11-01T06:49:38,983 Given no hashes to check 1 links for project 'colossalai': discarding no candidates
2023-11-01T06:49:39,003 Collecting colossalai==0.3.4
2023-11-01T06:49:39,005   Created temporary directory: /tmp/pip-unpack-ssdyw_we
2023-11-01T06:49:39,486   Downloading colossalai-0.3.4.tar.gz (985 kB)
2023-11-01T06:49:41,437   Added colossalai==0.3.4 from https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz to build tracker '/tmp/pip-build-tracker-snoccdhw'
2023-11-01T06:49:41,440   Running setup.py (path:/tmp/pip-wheel-9zznhh_6/colossalai_c3fcc54393da492ba870a1028106c2c4/setup.py) egg_info for package colossalai
2023-11-01T06:49:41,440   Created temporary directory: /tmp/pip-pip-egg-info-sd45okpb
2023-11-01T06:49:41,441   Preparing metadata (setup.py): started
2023-11-01T06:49:41,442   Running command python setup.py egg_info
2023-11-01T06:49:42,674   running egg_info
2023-11-01T06:49:42,675   creating /tmp/pip-pip-egg-info-sd45okpb/colossalai.egg-info
2023-11-01T06:49:42,703   writing /tmp/pip-pip-egg-info-sd45okpb/colossalai.egg-info/PKG-INFO
2023-11-01T06:49:42,708   writing dependency_links to /tmp/pip-pip-egg-info-sd45okpb/colossalai.egg-info/dependency_links.txt
2023-11-01T06:49:42,709   writing entry points to /tmp/pip-pip-egg-info-sd45okpb/colossalai.egg-info/entry_points.txt
2023-11-01T06:49:42,711   writing requirements to /tmp/pip-pip-egg-info-sd45okpb/colossalai.egg-info/requires.txt
2023-11-01T06:49:42,712   writing top-level names to /tmp/pip-pip-egg-info-sd45okpb/colossalai.egg-info/top_level.txt
2023-11-01T06:49:42,713   writing manifest file '/tmp/pip-pip-egg-info-sd45okpb/colossalai.egg-info/SOURCES.txt'
2023-11-01T06:49:42,881   reading manifest file '/tmp/pip-pip-egg-info-sd45okpb/colossalai.egg-info/SOURCES.txt'
2023-11-01T06:49:42,883   reading manifest template 'MANIFEST.in'
2023-11-01T06:49:44,098   warning: no files found matching '*.tr' under directory 'colossalai'
2023-11-01T06:49:44,705   warning: no files found matching '*.cc' under directory 'colossalai'
2023-11-01T06:49:45,013   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-11-01T06:49:45,029   adding license file 'LICENSE'
2023-11-01T06:49:45,067   writing manifest file '/tmp/pip-pip-egg-info-sd45okpb/colossalai.egg-info/SOURCES.txt'
2023-11-01T06:49:45,196   Preparing metadata (setup.py): finished with status 'done'
2023-11-01T06:49:45,201   Source in /tmp/pip-wheel-9zznhh_6/colossalai_c3fcc54393da492ba870a1028106c2c4 has version 0.3.4, which satisfies requirement colossalai==0.3.4 from https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz
2023-11-01T06:49:45,202   Removed colossalai==0.3.4 from https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz from build tracker '/tmp/pip-build-tracker-snoccdhw'
2023-11-01T06:49:45,212 Created temporary directory: /tmp/pip-unpack-y44bn3ar
2023-11-01T06:49:45,213 Created temporary directory: /tmp/pip-unpack-jl4kfmpl
2023-11-01T06:49:45,235 Building wheels for collected packages: colossalai
2023-11-01T06:49:45,239   Created temporary directory: /tmp/pip-wheel-f4kyczop
2023-11-01T06:49:45,240   Building wheel for colossalai (setup.py): started
2023-11-01T06:49:45,241   Destination directory: /tmp/pip-wheel-f4kyczop
2023-11-01T06:49:45,241   Running command python setup.py bdist_wheel
2023-11-01T06:49:46,383   running bdist_wheel
2023-11-01T06:49:46,521   running build
2023-11-01T06:49:46,522   running build_py
2023-11-01T06:49:46,551   creating build
2023-11-01T06:49:46,551   creating build/lib
2023-11-01T06:49:46,552   creating build/lib/colossalai
2023-11-01T06:49:46,554   copying colossalai/version.py -> build/lib/colossalai
2023-11-01T06:49:46,555   copying colossalai/__init__.py -> build/lib/colossalai
2023-11-01T06:49:46,557   copying colossalai/initialize.py -> build/lib/colossalai
2023-11-01T06:49:46,560   creating build/lib/colossalai/checkpoint_io
2023-11-01T06:49:46,561   copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io
2023-11-01T06:49:46,563   copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io
2023-11-01T06:49:46,566   copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io
2023-11-01T06:49:46,569   copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io
2023-11-01T06:49:46,572   copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io
2023-11-01T06:49:46,573   copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io
2023-11-01T06:49:46,576   creating build/lib/colossalai/logging
2023-11-01T06:49:46,577   copying colossalai/logging/logger.py -> build/lib/colossalai/logging
2023-11-01T06:49:46,579   copying colossalai/logging/__init__.py -> build/lib/colossalai/logging
2023-11-01T06:49:46,582   creating build/lib/colossalai/shardformer
2023-11-01T06:49:46,583   copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer
2023-11-01T06:49:46,584   copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer
2023-11-01T06:49:46,587   creating build/lib/colossalai/cli
2023-11-01T06:49:46,588   copying colossalai/cli/__init__.py -> build/lib/colossalai/cli
2023-11-01T06:49:46,590   copying colossalai/cli/cli.py -> build/lib/colossalai/cli
2023-11-01T06:49:46,592   creating build/lib/colossalai/interface
2023-11-01T06:49:46,593   copying colossalai/interface/model.py -> build/lib/colossalai/interface
2023-11-01T06:49:46,595   copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface
2023-11-01T06:49:46,597   copying colossalai/interface/__init__.py -> build/lib/colossalai/interface
2023-11-01T06:49:46,599   copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface
2023-11-01T06:49:46,602   creating build/lib/colossalai/lazy
2023-11-01T06:49:46,603   copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy
2023-11-01T06:49:46,605   copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy
2023-11-01T06:49:46,608   copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy
2023-11-01T06:49:46,609   copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy
2023-11-01T06:49:46,612   creating build/lib/colossalai/nn
2023-11-01T06:49:46,613   copying colossalai/nn/init.py -> build/lib/colossalai/nn
2023-11-01T06:49:46,616   copying colossalai/nn/__init__.py -> build/lib/colossalai/nn
2023-11-01T06:49:46,618   creating build/lib/colossalai/utils
2023-11-01T06:49:46,619   copying colossalai/utils/cuda.py -> build/lib/colossalai/utils
2023-11-01T06:49:46,621   copying colossalai/utils/moe.py -> build/lib/colossalai/utils
2023-11-01T06:49:46,623   copying colossalai/utils/timer.py -> build/lib/colossalai/utils
2023-11-01T06:49:46,625   copying colossalai/utils/__init__.py -> build/lib/colossalai/utils
2023-11-01T06:49:46,627   copying colossalai/utils/common.py -> build/lib/colossalai/utils
2023-11-01T06:49:46,629   creating build/lib/colossalai/auto_parallel
2023-11-01T06:49:46,630   copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel
2023-11-01T06:49:46,633   creating build/lib/colossalai/legacy
2023-11-01T06:49:46,634   copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy
2023-11-01T06:49:46,636   copying colossalai/legacy/core.py -> build/lib/colossalai/legacy
2023-11-01T06:49:46,637   copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy
2023-11-01T06:49:46,639   copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy
2023-11-01T06:49:46,641   copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy
2023-11-01T06:49:46,644   creating build/lib/colossalai/kernel
2023-11-01T06:49:46,645   copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel
2023-11-01T06:49:46,647   creating build/lib/colossalai/zero
2023-11-01T06:49:46,648   copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero
2023-11-01T06:49:46,650   copying colossalai/zero/__init__.py -> build/lib/colossalai/zero
2023-11-01T06:49:46,652   creating build/lib/colossalai/_analyzer
2023-11-01T06:49:46,653   copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer
2023-11-01T06:49:46,655   copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer
2023-11-01T06:49:46,657   creating build/lib/colossalai/fx
2023-11-01T06:49:46,658   copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx
2023-11-01T06:49:46,661   copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx
2023-11-01T06:49:46,663   copying colossalai/fx/proxy.py -> build/lib/colossalai/fx
2023-11-01T06:49:46,665   copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx
2023-11-01T06:49:46,667   copying colossalai/fx/__init__.py -> build/lib/colossalai/fx
2023-11-01T06:49:46,670   copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx
2023-11-01T06:49:46,672   creating build/lib/colossalai/_C
2023-11-01T06:49:46,673   copying colossalai/_C/__init__.py -> build/lib/colossalai/_C
2023-11-01T06:49:46,675   creating build/lib/colossalai/cluster
2023-11-01T06:49:46,676   copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster
2023-11-01T06:49:46,679   copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster
2023-11-01T06:49:46,682   copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster
2023-11-01T06:49:46,684   copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster
2023-11-01T06:49:46,688   copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster
2023-11-01T06:49:46,694   creating build/lib/colossalai/inference
2023-11-01T06:49:46,696   copying colossalai/inference/async_manager.py -> build/lib/colossalai/inference
2023-11-01T06:49:46,701   copying colossalai/inference/manager.py -> build/lib/colossalai/inference
2023-11-01T06:49:46,703   copying colossalai/inference/async_engine.py -> build/lib/colossalai/inference
2023-11-01T06:49:46,706   copying colossalai/inference/__init__.py -> build/lib/colossalai/inference
2023-11-01T06:49:46,708   creating build/lib/colossalai/tensor
2023-11-01T06:49:46,709   copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor
2023-11-01T06:49:46,711   copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor
2023-11-01T06:49:46,713   copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor
2023-11-01T06:49:46,715   copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor
2023-11-01T06:49:46,718   copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor
2023-11-01T06:49:46,719   copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor
2023-11-01T06:49:46,722   copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor
2023-11-01T06:49:46,724   copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor
2023-11-01T06:49:46,727   creating build/lib/colossalai/amp
2023-11-01T06:49:46,728   copying colossalai/amp/__init__.py -> build/lib/colossalai/amp
2023-11-01T06:49:46,730   creating build/lib/colossalai/testing
2023-11-01T06:49:46,731   copying colossalai/testing/utils.py -> build/lib/colossalai/testing
2023-11-01T06:49:46,734   copying colossalai/testing/random.py -> build/lib/colossalai/testing
2023-11-01T06:49:46,735   copying colossalai/testing/comparison.py -> build/lib/colossalai/testing
2023-11-01T06:49:46,737   copying colossalai/testing/__init__.py -> build/lib/colossalai/testing
2023-11-01T06:49:46,739   copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing
2023-11-01T06:49:46,741   creating build/lib/colossalai/booster
2023-11-01T06:49:46,742   copying colossalai/booster/booster.py -> build/lib/colossalai/booster
2023-11-01T06:49:46,745   copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster
2023-11-01T06:49:46,746   copying colossalai/booster/__init__.py -> build/lib/colossalai/booster
2023-11-01T06:49:46,748   creating build/lib/colossalai/pipeline
2023-11-01T06:49:46,749   copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline
2023-11-01T06:49:46,751   copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline
2023-11-01T06:49:46,754   copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline
2023-11-01T06:49:46,756   creating build/lib/colossalai/device
2023-11-01T06:49:46,757   copying colossalai/device/device_mesh.py -> build/lib/colossalai/device
2023-11-01T06:49:46,759   copying colossalai/device/__init__.py -> build/lib/colossalai/device
2023-11-01T06:49:46,761   copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device
2023-11-01T06:49:46,763   copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device
2023-11-01T06:49:46,766   creating build/lib/colossalai/context
2023-11-01T06:49:46,767   copying colossalai/context/config.py -> build/lib/colossalai/context
2023-11-01T06:49:46,769   copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context
2023-11-01T06:49:46,770   copying colossalai/context/__init__.py -> build/lib/colossalai/context
2023-11-01T06:49:46,772   copying colossalai/context/moe_context.py -> build/lib/colossalai/context
2023-11-01T06:49:46,775   creating build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,776   copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,778   copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,781   copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,784   copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,786   copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,788   copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,791   copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,794   copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,795   copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,799   copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,801   copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,803   copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,807   copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling
2023-11-01T06:49:46,810   creating build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,811   copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,813   copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,816   copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,818   copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,821   copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,823   copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,825   copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,828   copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,829   copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,832   copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,834   copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,836   copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,839   copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,841   copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies
2023-11-01T06:49:46,844   creating build/lib/colossalai/shardformer/shard
2023-11-01T06:49:46,845   copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard
2023-11-01T06:49:46,847   copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard
2023-11-01T06:49:46,849   copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard
2023-11-01T06:49:46,851   copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard
2023-11-01T06:49:46,853   copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard
2023-11-01T06:49:46,855   creating build/lib/colossalai/shardformer/layer
2023-11-01T06:49:46,856   copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer
2023-11-01T06:49:46,858   copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer
2023-11-01T06:49:46,860   copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer
2023-11-01T06:49:46,863   copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer
2023-11-01T06:49:46,865   copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer
2023-11-01T06:49:46,868   copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer
2023-11-01T06:49:46,870   copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer
2023-11-01T06:49:46,873   copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer
2023-11-01T06:49:46,874   copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer
2023-11-01T06:49:46,877   copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer
2023-11-01T06:49:46,880   creating build/lib/colossalai/cli/launcher
2023-11-01T06:49:46,881   copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher
2023-11-01T06:49:46,883   copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher
2023-11-01T06:49:46,886   copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher
2023-11-01T06:49:46,888   copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher
2023-11-01T06:49:46,890   creating build/lib/colossalai/cli/check
2023-11-01T06:49:46,892   copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check
2023-11-01T06:49:46,894   copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check
2023-11-01T06:49:46,897   creating build/lib/colossalai/nn/lr_scheduler
2023-11-01T06:49:46,898   copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler
2023-11-01T06:49:46,901   copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler
2023-11-01T06:49:46,903   copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler
2023-11-01T06:49:46,905   copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler
2023-11-01T06:49:46,907   copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler
2023-11-01T06:49:46,909   copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler
2023-11-01T06:49:46,912   copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler
2023-11-01T06:49:46,914   copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler
2023-11-01T06:49:46,917   creating build/lib/colossalai/nn/loss
2023-11-01T06:49:46,918   copying colossalai/nn/loss/loss_moe.py -> build/lib/colossalai/nn/loss
2023-11-01T06:49:46,921   copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss
2023-11-01T06:49:46,923   creating build/lib/colossalai/nn/layer
2023-11-01T06:49:46,925   copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer
2023-11-01T06:49:46,927   copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer
2023-11-01T06:49:46,929   creating build/lib/colossalai/nn/optimizer
2023-11-01T06:49:46,930   copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer
2023-11-01T06:49:46,933   copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer
2023-11-01T06:49:46,936   copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer
2023-11-01T06:49:46,938   copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer
2023-11-01T06:49:46,940   copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer
2023-11-01T06:49:46,943   copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer
2023-11-01T06:49:46,946   copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer
2023-11-01T06:49:46,948   copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer
2023-11-01T06:49:46,950   copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer
2023-11-01T06:49:46,953   creating build/lib/colossalai/nn/layer/moe
2023-11-01T06:49:46,954   copying colossalai/nn/layer/moe/utils.py -> build/lib/colossalai/nn/layer/moe
2023-11-01T06:49:46,957   copying colossalai/nn/layer/moe/_operation.py -> build/lib/colossalai/nn/layer/moe
2023-11-01T06:49:46,959   copying colossalai/nn/layer/moe/checkpoint.py -> build/lib/colossalai/nn/layer/moe
2023-11-01T06:49:46,961   copying colossalai/nn/layer/moe/__init__.py -> build/lib/colossalai/nn/layer/moe
2023-11-01T06:49:46,963   copying colossalai/nn/layer/moe/routers.py -> build/lib/colossalai/nn/layer/moe
2023-11-01T06:49:46,966   copying colossalai/nn/layer/moe/layers.py -> build/lib/colossalai/nn/layer/moe
2023-11-01T06:49:46,968   copying colossalai/nn/layer/moe/experts.py -> build/lib/colossalai/nn/layer/moe
2023-11-01T06:49:46,971   creating build/lib/colossalai/utils/multi_tensor_apply
2023-11-01T06:49:46,973   copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-11-01T06:49:46,975   copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply
2023-11-01T06:49:46,977   creating build/lib/colossalai/utils/tensor_detector
2023-11-01T06:49:46,978   copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector
2023-11-01T06:49:46,981   copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector
2023-11-01T06:49:46,984   creating build/lib/colossalai/utils/rank_recorder
2023-11-01T06:49:46,985   copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder
2023-11-01T06:49:46,987   copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder
2023-11-01T06:49:46,989   creating build/lib/colossalai/utils/model
2023-11-01T06:49:46,991   copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model
2023-11-01T06:49:46,993   copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model
2023-11-01T06:49:46,995   creating build/lib/colossalai/auto_parallel/tensor_shard
2023-11-01T06:49:46,997   copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-11-01T06:49:46,999   copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-11-01T06:49:47,001   copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-11-01T06:49:47,003   copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-11-01T06:49:47,006   copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard
2023-11-01T06:49:47,008   creating build/lib/colossalai/auto_parallel/meta_profiler
2023-11-01T06:49:47,009   copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-11-01T06:49:47,012   copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-11-01T06:49:47,014   copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-11-01T06:49:47,016   copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler
2023-11-01T06:49:47,019   creating build/lib/colossalai/auto_parallel/offload
2023-11-01T06:49:47,020   copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload
2023-11-01T06:49:47,022   copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload
2023-11-01T06:49:47,025   copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload
2023-11-01T06:49:47,027   copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload
2023-11-01T06:49:47,030   copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload
2023-11-01T06:49:47,033   copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload
2023-11-01T06:49:47,035   copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload
2023-11-01T06:49:47,037   copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload
2023-11-01T06:49:47,039   copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload
2023-11-01T06:49:47,041   copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload
2023-11-01T06:49:47,045   creating build/lib/colossalai/auto_parallel/passes
2023-11-01T06:49:47,046   copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-11-01T06:49:47,049   copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes
2023-11-01T06:49:47,051   copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-11-01T06:49:47,054   copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes
2023-11-01T06:49:47,056   copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes
2023-11-01T06:49:47,059   copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes
2023-11-01T06:49:47,063   creating build/lib/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:47,064   copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:47,067   copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:47,069   copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:47,070   copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:47,073   copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:47,076   copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:47,080   creating build/lib/colossalai/auto_parallel/pipeline_shard
2023-11-01T06:49:47,082   copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard
2023-11-01T06:49:47,084   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,085   copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,087   copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,089   copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,091   copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,093   copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,096   copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,097   copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,099   copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,102   copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,103   copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,105   copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,107   copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,109   copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,111   copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,113   copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,115   copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,118   copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,120   copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,122   copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,123   copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,125   copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,127   copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,129   copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,131   copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,132   copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,134   copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,136   copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:47,139   creating build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:47,140   copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:47,142   copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:47,144   copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:47,146   copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:47,148   copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:47,150   copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:47,153   creating build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-11-01T06:49:47,154   copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-11-01T06:49:47,156   copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-11-01T06:49:47,158   copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-11-01T06:49:47,161   copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-11-01T06:49:47,163   copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver
2023-11-01T06:49:47,166   creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,167   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,169   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,171   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,173   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,176   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,178   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,180   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,182   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,185   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,188   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,191   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,193   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,196   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,198   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,200   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,203   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,205   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,207   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,209   copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:47,212   creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:47,213   copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:47,215   copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:47,218   copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:47,219   copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:47,221   copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:47,224   copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:47,227   copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:47,229   copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:47,231   copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:47,232   copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:47,235   copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:47,237   creating build/lib/colossalai/legacy/registry
2023-11-01T06:49:47,238   copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry
2023-11-01T06:49:47,240   copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry
2023-11-01T06:49:47,242   creating build/lib/colossalai/legacy/nn
2023-11-01T06:49:47,243   copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn
2023-11-01T06:49:47,245   creating build/lib/colossalai/legacy/communication
2023-11-01T06:49:47,246   copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication
2023-11-01T06:49:47,248   copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication
2023-11-01T06:49:47,251   copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication
2023-11-01T06:49:47,254   copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication
2023-11-01T06:49:47,257   copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication
2023-11-01T06:49:47,260   copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication
2023-11-01T06:49:47,264   creating build/lib/colossalai/legacy/utils
2023-11-01T06:49:47,266   copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils
2023-11-01T06:49:47,269   copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils
2023-11-01T06:49:47,272   copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils
2023-11-01T06:49:47,276   copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils
2023-11-01T06:49:47,278   copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils
2023-11-01T06:49:47,283   creating build/lib/colossalai/legacy/trainer
2023-11-01T06:49:47,284   copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer
2023-11-01T06:49:47,288   copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer
2023-11-01T06:49:47,291   creating build/lib/colossalai/legacy/builder
2023-11-01T06:49:47,293   copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder
2023-11-01T06:49:47,296   copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder
2023-11-01T06:49:47,300   creating build/lib/colossalai/legacy/zero
2023-11-01T06:49:47,301   copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero
2023-11-01T06:49:47,305   creating build/lib/colossalai/legacy/engine
2023-11-01T06:49:47,307   copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine
2023-11-01T06:49:47,309   copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine
2023-11-01T06:49:47,314   creating build/lib/colossalai/legacy/tensor
2023-11-01T06:49:47,316   copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor
2023-11-01T06:49:47,319   copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor
2023-11-01T06:49:47,321   copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor
2023-11-01T06:49:47,325   copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor
2023-11-01T06:49:47,328   copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor
2023-11-01T06:49:47,330   copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor
2023-11-01T06:49:47,334   copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor
2023-11-01T06:49:47,337   copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor
2023-11-01T06:49:47,340   creating build/lib/colossalai/legacy/amp
2023-11-01T06:49:47,342   copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp
2023-11-01T06:49:47,345   copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp
2023-11-01T06:49:47,349   creating build/lib/colossalai/legacy/pipeline
2023-11-01T06:49:47,350   copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline
2023-11-01T06:49:47,353   copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline
2023-11-01T06:49:47,355   copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline
2023-11-01T06:49:47,358   copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline
2023-11-01T06:49:47,360   copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline
2023-11-01T06:49:47,363   creating build/lib/colossalai/legacy/context
2023-11-01T06:49:47,364   copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context
2023-11-01T06:49:47,367   copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context
2023-11-01T06:49:47,369   copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context
2023-11-01T06:49:47,372   creating build/lib/colossalai/legacy/nn/metric
2023-11-01T06:49:47,374   copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric
2023-11-01T06:49:47,376   copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric
2023-11-01T06:49:47,378   copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric
2023-11-01T06:49:47,380   copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric
2023-11-01T06:49:47,382   copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric
2023-11-01T06:49:47,385   creating build/lib/colossalai/legacy/nn/_ops
2023-11-01T06:49:47,386   copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops
2023-11-01T06:49:47,388   copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops
2023-11-01T06:49:47,392   creating build/lib/colossalai/legacy/nn/parallel
2023-11-01T06:49:47,393   copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel
2023-11-01T06:49:47,396   copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel
2023-11-01T06:49:47,398   copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel
2023-11-01T06:49:47,401   creating build/lib/colossalai/legacy/nn/loss
2023-11-01T06:49:47,402   copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss
2023-11-01T06:49:47,405   copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss
2023-11-01T06:49:47,408   copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss
2023-11-01T06:49:47,410   copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss
2023-11-01T06:49:47,413   copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss
2023-11-01T06:49:47,416   creating build/lib/colossalai/legacy/nn/layer
2023-11-01T06:49:47,417   copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer
2023-11-01T06:49:47,419   copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer
2023-11-01T06:49:47,422   creating build/lib/colossalai/legacy/nn/parallel/layers
2023-11-01T06:49:47,423   copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers
2023-11-01T06:49:47,425   copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers
2023-11-01T06:49:47,427   copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers
2023-11-01T06:49:47,429   copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers
2023-11-01T06:49:47,432   copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers
2023-11-01T06:49:47,434   creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:47,436   copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:47,438   copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:47,441   copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:47,443   copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:47,445   copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:47,448   copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:47,450   copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:47,451   copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:47,453   copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:47,456   creating build/lib/colossalai/legacy/nn/layer/wrapper
2023-11-01T06:49:47,457   copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper
2023-11-01T06:49:47,459   copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper
2023-11-01T06:49:47,461   creating build/lib/colossalai/legacy/nn/layer/parallel_1d
2023-11-01T06:49:47,462   copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d
2023-11-01T06:49:47,464   copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d
2023-11-01T06:49:47,466   copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d
2023-11-01T06:49:47,469   copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d
2023-11-01T06:49:47,472   creating build/lib/colossalai/legacy/nn/layer/parallel_2d
2023-11-01T06:49:47,472   copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d
2023-11-01T06:49:47,475   copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d
2023-11-01T06:49:47,477   copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d
2023-11-01T06:49:47,480   copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d
2023-11-01T06:49:47,482   creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d
2023-11-01T06:49:47,483   copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d
2023-11-01T06:49:47,486   copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d
2023-11-01T06:49:47,488   copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d
2023-11-01T06:49:47,491   copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d
2023-11-01T06:49:47,493   creating build/lib/colossalai/legacy/nn/layer/parallel_3d
2023-11-01T06:49:47,494   copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d
2023-11-01T06:49:47,497   copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d
2023-11-01T06:49:47,498   copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d
2023-11-01T06:49:47,501   copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d
2023-11-01T06:49:47,504   creating build/lib/colossalai/legacy/nn/layer/utils
2023-11-01T06:49:47,504   copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils
2023-11-01T06:49:47,506   copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils
2023-11-01T06:49:47,509   creating build/lib/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:47,509   copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:47,511   copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:47,513   copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:47,515   copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:47,517   copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:47,519   copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:47,521   creating build/lib/colossalai/legacy/nn/layer/vanilla
2023-11-01T06:49:47,522   copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla
2023-11-01T06:49:47,524   copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla
2023-11-01T06:49:47,527   creating build/lib/colossalai/legacy/nn/layer/parallel_sequence
2023-11-01T06:49:47,528   copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence
2023-11-01T06:49:47,530   copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence
2023-11-01T06:49:47,532   copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence
2023-11-01T06:49:47,534   copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence
2023-11-01T06:49:47,536   creating build/lib/colossalai/legacy/utils/data_sampler
2023-11-01T06:49:47,537   copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler
2023-11-01T06:49:47,539   copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler
2023-11-01T06:49:47,541   copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler
2023-11-01T06:49:47,543   creating build/lib/colossalai/legacy/utils/checkpoint
2023-11-01T06:49:47,544   copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint
2023-11-01T06:49:47,546   copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint
2023-11-01T06:49:47,548   copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint
2023-11-01T06:49:47,550   creating build/lib/colossalai/legacy/utils/profiler
2023-11-01T06:49:47,550   copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler
2023-11-01T06:49:47,552   copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler
2023-11-01T06:49:47,554   copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler
2023-11-01T06:49:47,556   copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler
2023-11-01T06:49:47,558   creating build/lib/colossalai/legacy/utils/profiler/legacy
2023-11-01T06:49:47,559   copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy
2023-11-01T06:49:47,561   copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy
2023-11-01T06:49:47,563   copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy
2023-11-01T06:49:47,564   copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy
2023-11-01T06:49:47,567   creating build/lib/colossalai/legacy/trainer/hooks
2023-11-01T06:49:47,568   copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks
2023-11-01T06:49:47,571   copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks
2023-11-01T06:49:47,572   copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks
2023-11-01T06:49:47,575   copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks
2023-11-01T06:49:47,577   copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks
2023-11-01T06:49:47,578   copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks
2023-11-01T06:49:47,580   copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks
2023-11-01T06:49:47,582   creating build/lib/colossalai/legacy/zero/sharded_param
2023-11-01T06:49:47,583   copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param
2023-11-01T06:49:47,585   copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param
2023-11-01T06:49:47,587   copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param
2023-11-01T06:49:47,589   creating build/lib/colossalai/legacy/zero/gemini
2023-11-01T06:49:47,590   copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini
2023-11-01T06:49:47,593   copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini
2023-11-01T06:49:47,595   copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini
2023-11-01T06:49:47,597   copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini
2023-11-01T06:49:47,599   copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini
2023-11-01T06:49:47,601   copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini
2023-11-01T06:49:47,603   creating build/lib/colossalai/legacy/zero/sharded_optim
2023-11-01T06:49:47,604   copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim
2023-11-01T06:49:47,606   copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim
2023-11-01T06:49:47,609   creating build/lib/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:47,610   copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:47,612   copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:47,614   copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:47,616   copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:47,618   copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:47,620   copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:47,622   creating build/lib/colossalai/legacy/zero/init_ctx
2023-11-01T06:49:47,623   copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx
2023-11-01T06:49:47,625   copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx
2023-11-01T06:49:47,627   creating build/lib/colossalai/legacy/zero/shard_utils
2023-11-01T06:49:47,628   copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils
2023-11-01T06:49:47,630   copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils
2023-11-01T06:49:47,632   copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils
2023-11-01T06:49:47,634   copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils
2023-11-01T06:49:47,636   copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils
2023-11-01T06:49:47,638   creating build/lib/colossalai/legacy/zero/gemini/ophooks
2023-11-01T06:49:47,639   copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks
2023-11-01T06:49:47,641   copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks
2023-11-01T06:49:47,643   copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks
2023-11-01T06:49:47,646   copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks
2023-11-01T06:49:47,647   copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks
2023-11-01T06:49:47,650   creating build/lib/colossalai/legacy/zero/gemini/paramhooks
2023-11-01T06:49:47,651   copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks
2023-11-01T06:49:47,653   copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks
2023-11-01T06:49:47,655   creating build/lib/colossalai/legacy/engine/gradient_accumulation
2023-11-01T06:49:47,656   copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation
2023-11-01T06:49:47,659   copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation
2023-11-01T06:49:47,661   creating build/lib/colossalai/legacy/engine/schedule
2023-11-01T06:49:47,662   copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule
2023-11-01T06:49:47,664   copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule
2023-11-01T06:49:47,666   copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule
2023-11-01T06:49:47,668   copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule
2023-11-01T06:49:47,670   copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule
2023-11-01T06:49:47,673   creating build/lib/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:47,674   copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:47,676   copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:47,678   copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:47,680   copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:47,681   copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:47,683   copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:47,685   copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:47,686   copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:47,689   creating build/lib/colossalai/legacy/amp/torch_amp
2023-11-01T06:49:47,690   copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp
2023-11-01T06:49:47,693   copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp
2023-11-01T06:49:47,695   copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp
2023-11-01T06:49:47,697   creating build/lib/colossalai/legacy/amp/apex_amp
2023-11-01T06:49:47,698   copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp
2023-11-01T06:49:47,700   copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp
2023-11-01T06:49:47,702   creating build/lib/colossalai/legacy/amp/naive_amp
2023-11-01T06:49:47,703   copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp
2023-11-01T06:49:47,706   copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp
2023-11-01T06:49:47,708   copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp
2023-11-01T06:49:47,710   copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp
2023-11-01T06:49:47,712   creating build/lib/colossalai/legacy/pipeline/middleware
2023-11-01T06:49:47,713   copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware
2023-11-01T06:49:47,715   copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware
2023-11-01T06:49:47,717   creating build/lib/colossalai/legacy/pipeline/rpc
2023-11-01T06:49:47,718   copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc
2023-11-01T06:49:47,721   copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc
2023-11-01T06:49:47,724   copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc
2023-11-01T06:49:47,726   copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc
2023-11-01T06:49:47,729   creating build/lib/colossalai/legacy/pipeline/middleware/adaptor
2023-11-01T06:49:47,730   copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor
2023-11-01T06:49:47,731   copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor
2023-11-01T06:49:47,734   creating build/lib/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:47,735   copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:47,737   copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:47,740   copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:47,741   copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:47,744   copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:47,745   copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:47,748   copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:47,749   copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:47,751   copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:47,753   copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:47,755   copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:47,757   creating build/lib/colossalai/legacy/context/random
2023-11-01T06:49:47,758   copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random
2023-11-01T06:49:47,761   copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random
2023-11-01T06:49:47,763   copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random
2023-11-01T06:49:47,765   creating build/lib/colossalai/kernel/jit
2023-11-01T06:49:47,766   copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit
2023-11-01T06:49:47,768   copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit
2023-11-01T06:49:47,769   copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit
2023-11-01T06:49:47,771   copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit
2023-11-01T06:49:47,773   creating build/lib/colossalai/kernel/cuda_native
2023-11-01T06:49:47,774   copying colossalai/kernel/cuda_native/multihead_attention.py -> build/lib/colossalai/kernel/cuda_native
2023-11-01T06:49:47,777   copying colossalai/kernel/cuda_native/scaled_softmax.py -> build/lib/colossalai/kernel/cuda_native
2023-11-01T06:49:47,779   copying colossalai/kernel/cuda_native/__init__.py -> build/lib/colossalai/kernel/cuda_native
2023-11-01T06:49:47,781   copying colossalai/kernel/cuda_native/layer_norm.py -> build/lib/colossalai/kernel/cuda_native
2023-11-01T06:49:47,784   creating build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,784   copying colossalai/kernel/triton/token_attention_kernel.py -> build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,787   copying colossalai/kernel/triton/context_attention.py -> build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,790   copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,791   copying colossalai/kernel/triton/copy_kv_cache_dest.py -> build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,793   copying colossalai/kernel/triton/int8_rotary_embedding_kernel.py -> build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,795   copying colossalai/kernel/triton/smooth_attention.py -> build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,797   copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,799   copying colossalai/kernel/triton/fused_layernorm.py -> build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,801   copying colossalai/kernel/triton/custom_autotune.py -> build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,804   copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,805   copying colossalai/kernel/triton/gptq_triton.py -> build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,808   copying colossalai/kernel/triton/self_attention_nofusion.py -> build/lib/colossalai/kernel/triton
2023-11-01T06:49:47,811   creating build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,812   copying colossalai/kernel/op_builder/utils.py -> build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,814   copying colossalai/kernel/op_builder/cpu_adam.py -> build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,816   copying colossalai/kernel/op_builder/builder.py -> build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,818   copying colossalai/kernel/op_builder/smoothquant.py -> build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,820   copying colossalai/kernel/op_builder/moe.py -> build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,822   copying colossalai/kernel/op_builder/multi_head_attn.py -> build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,823   copying colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,825   copying colossalai/kernel/op_builder/gptq.py -> build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,827   copying colossalai/kernel/op_builder/layernorm.py -> build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,829   copying colossalai/kernel/op_builder/__init__.py -> build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,830   copying colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,832   copying colossalai/kernel/op_builder/fused_optim.py -> build/lib/colossalai/kernel/op_builder
2023-11-01T06:49:47,835   creating build/lib/colossalai/kernel/cuda_native/mha
2023-11-01T06:49:47,835   copying colossalai/kernel/cuda_native/mha/utils.py -> build/lib/colossalai/kernel/cuda_native/mha
2023-11-01T06:49:47,837   copying colossalai/kernel/cuda_native/mha/flash_attn_2.py -> build/lib/colossalai/kernel/cuda_native/mha
2023-11-01T06:49:47,839   copying colossalai/kernel/cuda_native/mha/mha.py -> build/lib/colossalai/kernel/cuda_native/mha
2023-11-01T06:49:47,841   copying colossalai/kernel/cuda_native/mha/__init__.py -> build/lib/colossalai/kernel/cuda_native/mha
2023-11-01T06:49:47,843   copying colossalai/kernel/cuda_native/mha/mem_eff_attn.py -> build/lib/colossalai/kernel/cuda_native/mha
2023-11-01T06:49:47,846   creating build/lib/colossalai/zero/gemini
2023-11-01T06:49:47,847   copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini
2023-11-01T06:49:47,849   copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini
2023-11-01T06:49:47,852   copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini
2023-11-01T06:49:47,854   copying colossalai/zero/gemini/colo_init_context.py -> build/lib/colossalai/zero/gemini
2023-11-01T06:49:47,856   copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini
2023-11-01T06:49:47,858   copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini
2023-11-01T06:49:47,859   copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini
2023-11-01T06:49:47,862   copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini
2023-11-01T06:49:47,865   creating build/lib/colossalai/zero/low_level
2023-11-01T06:49:47,866   copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level
2023-11-01T06:49:47,868   copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level
2023-11-01T06:49:47,870   copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level
2023-11-01T06:49:47,873   creating build/lib/colossalai/zero/gemini/chunk
2023-11-01T06:49:47,874   copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk
2023-11-01T06:49:47,876   copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk
2023-11-01T06:49:47,878   copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk
2023-11-01T06:49:47,880   copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk
2023-11-01T06:49:47,883   copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk
2023-11-01T06:49:47,885   creating build/lib/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:47,886   copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:47,888   copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:47,889   copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:47,891   copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:47,893   copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:47,895   copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:47,897   copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:47,899   copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:47,900   copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:47,903   creating build/lib/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:47,904   copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:47,906   copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:47,909   copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:47,910   copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:47,912   copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:47,914   copying colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:47,917   creating build/lib/colossalai/_analyzer/_subclasses
2023-11-01T06:49:47,918   copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses
2023-11-01T06:49:47,920   copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses
2023-11-01T06:49:47,922   copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses
2023-11-01T06:49:47,924   copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses
2023-11-01T06:49:47,927   copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses
2023-11-01T06:49:47,929   creating build/lib/colossalai/_analyzer/fx
2023-11-01T06:49:47,930   copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx
2023-11-01T06:49:47,932   copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx
2023-11-01T06:49:47,935   copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx
2023-11-01T06:49:47,937   copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx
2023-11-01T06:49:47,939   copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx
2023-11-01T06:49:47,942   creating build/lib/colossalai/_analyzer/fx/passes
2023-11-01T06:49:47,943   copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes
2023-11-01T06:49:47,945   copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes
2023-11-01T06:49:47,947   copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes
2023-11-01T06:49:47,950   creating build/lib/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:47,951   copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:47,953   copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:47,956   copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:47,958   copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:47,960   copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:47,962   copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:47,965   creating build/lib/colossalai/fx/passes
2023-11-01T06:49:47,966   copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes
2023-11-01T06:49:47,968   copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes
2023-11-01T06:49:47,970   copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes
2023-11-01T06:49:47,973   copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes
2023-11-01T06:49:47,975   copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes
2023-11-01T06:49:47,977   copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes
2023-11-01T06:49:47,980   copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes
2023-11-01T06:49:47,982   copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes
2023-11-01T06:49:47,985   creating build/lib/colossalai/fx/codegen
2023-11-01T06:49:47,986   copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen
2023-11-01T06:49:47,988   copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen
2023-11-01T06:49:47,991   creating build/lib/colossalai/fx/profiler
2023-11-01T06:49:47,993   copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler
2023-11-01T06:49:47,995   copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler
2023-11-01T06:49:47,997   copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler
2023-11-01T06:49:48,000   copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler
2023-11-01T06:49:48,002   copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler
2023-11-01T06:49:48,004   copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler
2023-11-01T06:49:48,006   copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler
2023-11-01T06:49:48,008   copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler
2023-11-01T06:49:48,011   creating build/lib/colossalai/fx/tracer
2023-11-01T06:49:48,012   copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer
2023-11-01T06:49:48,014   copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer
2023-11-01T06:49:48,016   copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer
2023-11-01T06:49:48,017   copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer
2023-11-01T06:49:48,019   copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer
2023-11-01T06:49:48,022   copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer
2023-11-01T06:49:48,024   copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer
2023-11-01T06:49:48,027   creating build/lib/colossalai/fx/profiler/experimental
2023-11-01T06:49:48,028   copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental
2023-11-01T06:49:48,030   copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental
2023-11-01T06:49:48,032   copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental
2023-11-01T06:49:48,034   copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental
2023-11-01T06:49:48,036   copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental
2023-11-01T06:49:48,038   creating build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:48,039   copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:48,041   copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:48,044   copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:48,045   copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:48,047   copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:48,049   copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:48,051   copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:48,052   copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:48,054   copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:48,056   copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:48,058   copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:48,061   creating build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:48,062   copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:48,064   copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:48,066   copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:48,068   copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:48,070   copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:48,072   copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:48,073   copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:48,075   copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:48,077   copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:48,079   creating build/lib/colossalai/fx/tracer/bias_addition_patch
2023-11-01T06:49:48,080   copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch
2023-11-01T06:49:48,083   creating build/lib/colossalai/fx/tracer/meta_patch
2023-11-01T06:49:48,084   copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch
2023-11-01T06:49:48,086   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-11-01T06:49:48,087   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-11-01T06:49:48,089   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-11-01T06:49:48,091   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-11-01T06:49:48,093   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-11-01T06:49:48,095   creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-11-01T06:49:48,096   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-11-01T06:49:48,098   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-11-01T06:49:48,100   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-11-01T06:49:48,103   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-11-01T06:49:48,104   copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-11-01T06:49:48,107   creating build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:48,108   copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:48,110   copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:48,112   copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:48,114   copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:48,116   copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:48,118   copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:48,120   copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:48,122   copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:48,125   creating build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:48,126   copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:48,128   copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:48,130   copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:48,132   copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:48,134   copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:48,136   copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:48,138   copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:48,140   copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:48,142   creating build/lib/colossalai/inference/tensor_parallel
2023-11-01T06:49:48,144   copying colossalai/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/inference/tensor_parallel
2023-11-01T06:49:48,146   copying colossalai/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/inference/tensor_parallel
2023-11-01T06:49:48,148   copying colossalai/inference/tensor_parallel/__init__.py -> build/lib/colossalai/inference/tensor_parallel
2023-11-01T06:49:48,150   copying colossalai/inference/tensor_parallel/engine.py -> build/lib/colossalai/inference/tensor_parallel
2023-11-01T06:49:48,153   creating build/lib/colossalai/inference/dynamic_batching
2023-11-01T06:49:48,154   copying colossalai/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/inference/dynamic_batching
2023-11-01T06:49:48,157   copying colossalai/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/inference/dynamic_batching
2023-11-01T06:49:48,159   copying colossalai/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/inference/dynamic_batching
2023-11-01T06:49:48,161   copying colossalai/inference/dynamic_batching/stats.py -> build/lib/colossalai/inference/dynamic_batching
2023-11-01T06:49:48,163   copying colossalai/inference/dynamic_batching/__init__.py -> build/lib/colossalai/inference/dynamic_batching
2023-11-01T06:49:48,165   copying colossalai/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/inference/dynamic_batching
2023-11-01T06:49:48,167   copying colossalai/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/inference/dynamic_batching
2023-11-01T06:49:48,169   copying colossalai/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/inference/dynamic_batching
2023-11-01T06:49:48,171   copying colossalai/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/inference/dynamic_batching
2023-11-01T06:49:48,174   creating build/lib/colossalai/inference/pipeline
2023-11-01T06:49:48,175   copying colossalai/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/inference/pipeline
2023-11-01T06:49:48,178   copying colossalai/inference/pipeline/__init__.py -> build/lib/colossalai/inference/pipeline
2023-11-01T06:49:48,180   creating build/lib/colossalai/inference/hybridengine
2023-11-01T06:49:48,181   copying colossalai/inference/hybridengine/__init__.py -> build/lib/colossalai/inference/hybridengine
2023-11-01T06:49:48,183   copying colossalai/inference/hybridengine/engine.py -> build/lib/colossalai/inference/hybridengine
2023-11-01T06:49:48,186   creating build/lib/colossalai/inference/tensor_parallel/modeling
2023-11-01T06:49:48,187   copying colossalai/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/inference/tensor_parallel/modeling
2023-11-01T06:49:48,190   copying colossalai/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/inference/tensor_parallel/modeling
2023-11-01T06:49:48,192   copying colossalai/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/inference/tensor_parallel/modeling
2023-11-01T06:49:48,194   copying colossalai/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/inference/tensor_parallel/modeling
2023-11-01T06:49:48,196   copying colossalai/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/inference/tensor_parallel/modeling
2023-11-01T06:49:48,199   creating build/lib/colossalai/inference/tensor_parallel/policies
2023-11-01T06:49:48,200   copying colossalai/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/inference/tensor_parallel/policies
2023-11-01T06:49:48,203   copying colossalai/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/inference/tensor_parallel/policies
2023-11-01T06:49:48,205   copying colossalai/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/inference/tensor_parallel/policies
2023-11-01T06:49:48,207   copying colossalai/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/inference/tensor_parallel/policies
2023-11-01T06:49:48,210   creating build/lib/colossalai/inference/hybridengine/modeling
2023-11-01T06:49:48,211   copying colossalai/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/inference/hybridengine/modeling
2023-11-01T06:49:48,213   copying colossalai/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/inference/hybridengine/modeling
2023-11-01T06:49:48,215   copying colossalai/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/inference/hybridengine/modeling
2023-11-01T06:49:48,218   creating build/lib/colossalai/inference/hybridengine/polices
2023-11-01T06:49:48,219   copying colossalai/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/inference/hybridengine/polices
2023-11-01T06:49:48,222   copying colossalai/inference/hybridengine/polices/llama.py -> build/lib/colossalai/inference/hybridengine/polices
2023-11-01T06:49:48,225   creating build/lib/colossalai/tensor/d_tensor
2023-11-01T06:49:48,227   copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor
2023-11-01T06:49:48,229   copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor
2023-11-01T06:49:48,231   copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor
2023-11-01T06:49:48,234   copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor
2023-11-01T06:49:48,237   copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor
2023-11-01T06:49:48,238   copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor
2023-11-01T06:49:48,240   copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor
2023-11-01T06:49:48,242   copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor
2023-11-01T06:49:48,245   creating build/lib/colossalai/amp/naive_amp
2023-11-01T06:49:48,246   copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp
2023-11-01T06:49:48,248   copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp
2023-11-01T06:49:48,250   creating build/lib/colossalai/amp/naive_amp/grad_scaler
2023-11-01T06:49:48,251   copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-11-01T06:49:48,253   copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-11-01T06:49:48,254   copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-11-01T06:49:48,256   copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler
2023-11-01T06:49:48,259   creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin
2023-11-01T06:49:48,260   copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin
2023-11-01T06:49:48,262   copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin
2023-11-01T06:49:48,263   copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin
2023-11-01T06:49:48,265   copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin
2023-11-01T06:49:48,268   creating build/lib/colossalai/booster/mixed_precision
2023-11-01T06:49:48,269   copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision
2023-11-01T06:49:48,270   copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision
2023-11-01T06:49:48,273   copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision
2023-11-01T06:49:48,274   copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision
2023-11-01T06:49:48,276   copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision
2023-11-01T06:49:48,278   copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision
2023-11-01T06:49:48,280   copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision
2023-11-01T06:49:48,282   creating build/lib/colossalai/booster/plugin
2023-11-01T06:49:48,283   copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin
2023-11-01T06:49:48,285   copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin
2023-11-01T06:49:48,287   copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin
2023-11-01T06:49:48,289   copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin
2023-11-01T06:49:48,292   copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin
2023-11-01T06:49:48,295   copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin
2023-11-01T06:49:48,296   copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin
2023-11-01T06:49:48,298   copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin
2023-11-01T06:49:48,300   copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin
2023-11-01T06:49:48,303   creating build/lib/colossalai/pipeline/schedule
2023-11-01T06:49:48,304   copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule
2023-11-01T06:49:48,306   copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule
2023-11-01T06:49:48,309   copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule
2023-11-01T06:49:48,311   copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule
2023-11-01T06:49:48,312   copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule
2023-11-01T06:49:48,315   copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule
2023-11-01T06:49:48,330   creating build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,331   copying colossalai/kernel/cuda_native/csrc/compat.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,333   copying colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,335   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,337   copying colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,339   copying colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,341   copying colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,344   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,347   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,349   copying colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,351   copying colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,354   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,356   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,358   copying colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,361   copying colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,363   copying colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,366   copying colossalai/kernel/cuda_native/csrc/type_shim.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,368   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,371   copying colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,373   copying colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,376   copying colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,380   copying colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,384   copying colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,387   copying colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/lib/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:48,391   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels
2023-11-01T06:49:48,392   creating build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,393   copying colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,396   copying colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,398   copying colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,400   copying colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,402   copying colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,404   copying colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,406   copying colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,408   copying colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,410   copying colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,412   copying colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,414   copying colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,416   copying colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/lib/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:48,509   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2023-11-01T06:49:48,509   !!

2023-11-01T06:49:48,511           ********************************************************************************
2023-11-01T06:49:48,511           Please avoid running ``setup.py`` directly.
2023-11-01T06:49:48,512           Instead, use pypa/build, pypa/installer or other
2023-11-01T06:49:48,512           standards-based tools.

2023-11-01T06:49:48,513           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2023-11-01T06:49:48,514           ********************************************************************************

2023-11-01T06:49:48,515   !!
2023-11-01T06:49:48,515     self.initialize_options()
2023-11-01T06:49:48,535   installing to build/bdist.linux-armv7l/wheel
2023-11-01T06:49:48,536   running install
2023-11-01T06:49:48,560   running install_lib
2023-11-01T06:49:48,586   creating build/bdist.linux-armv7l
2023-11-01T06:49:48,586   creating build/bdist.linux-armv7l/wheel
2023-11-01T06:49:48,588   creating build/bdist.linux-armv7l/wheel/colossalai
2023-11-01T06:49:48,590   creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io
2023-11-01T06:49:48,591   copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io
2023-11-01T06:49:48,593   copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io
2023-11-01T06:49:48,596   copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io
2023-11-01T06:49:48,599   copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io
2023-11-01T06:49:48,601   copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io
2023-11-01T06:49:48,603   copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io
2023-11-01T06:49:48,606   creating build/bdist.linux-armv7l/wheel/colossalai/logging
2023-11-01T06:49:48,607   copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-11-01T06:49:48,609   copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging
2023-11-01T06:49:48,611   creating build/bdist.linux-armv7l/wheel/colossalai/shardformer
2023-11-01T06:49:48,612   creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,613   copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,616   copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,618   copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,621   copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,623   copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,625   copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,628   copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,631   copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,632   copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,635   copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,637   copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,640   copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,643   copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling
2023-11-01T06:49:48,646   creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,647   copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,649   copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,652   copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,654   copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,656   copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,659   copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,661   copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,663   copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,665   copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,667   copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,669   copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,674   copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,676   copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,678   copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies
2023-11-01T06:49:48,680   copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer
2023-11-01T06:49:48,682   creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard
2023-11-01T06:49:48,683   copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard
2023-11-01T06:49:48,685   copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard
2023-11-01T06:49:48,687   copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard
2023-11-01T06:49:48,689   copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard
2023-11-01T06:49:48,690   copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard
2023-11-01T06:49:48,692   copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer
2023-11-01T06:49:48,695   creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer
2023-11-01T06:49:48,696   copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer
2023-11-01T06:49:48,697   copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer
2023-11-01T06:49:48,699   copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer
2023-11-01T06:49:48,702   copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer
2023-11-01T06:49:48,704   copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer
2023-11-01T06:49:48,706   copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer
2023-11-01T06:49:48,709   copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer
2023-11-01T06:49:48,711   copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer
2023-11-01T06:49:48,712   copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer
2023-11-01T06:49:48,715   copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer
2023-11-01T06:49:48,717   creating build/bdist.linux-armv7l/wheel/colossalai/cli
2023-11-01T06:49:48,719   creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-11-01T06:49:48,720   copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-11-01T06:49:48,722   copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-11-01T06:49:48,724   copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-11-01T06:49:48,726   copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher
2023-11-01T06:49:48,728   copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-11-01T06:49:48,729   creating build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-11-01T06:49:48,730   copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-11-01T06:49:48,733   copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check
2023-11-01T06:49:48,734   copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli
2023-11-01T06:49:48,736   creating build/bdist.linux-armv7l/wheel/colossalai/interface
2023-11-01T06:49:48,737   copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface
2023-11-01T06:49:48,739   copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/interface
2023-11-01T06:49:48,740   copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface
2023-11-01T06:49:48,742   copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface
2023-11-01T06:49:48,744   creating build/bdist.linux-armv7l/wheel/colossalai/lazy
2023-11-01T06:49:48,745   copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy
2023-11-01T06:49:48,748   copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy
2023-11-01T06:49:48,750   copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy
2023-11-01T06:49:48,752   copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy
2023-11-01T06:49:48,754   copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-11-01T06:49:48,756   creating build/bdist.linux-armv7l/wheel/colossalai/nn
2023-11-01T06:49:48,757   creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-11-01T06:49:48,758   copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-11-01T06:49:48,760   copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-11-01T06:49:48,762   copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-11-01T06:49:48,764   copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-11-01T06:49:48,766   copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-11-01T06:49:48,767   copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-11-01T06:49:48,770   copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-11-01T06:49:48,771   copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler
2023-11-01T06:49:48,774   copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-11-01T06:49:48,776   copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn
2023-11-01T06:49:48,778   creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-11-01T06:49:48,779   copying build/lib/colossalai/nn/loss/loss_moe.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-11-01T06:49:48,781   copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss
2023-11-01T06:49:48,784   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-11-01T06:49:48,785   copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-11-01T06:49:48,786   copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer
2023-11-01T06:49:48,788   creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-11-01T06:49:48,789   copying build/lib/colossalai/nn/layer/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-11-01T06:49:48,791   copying build/lib/colossalai/nn/layer/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-11-01T06:49:48,793   copying build/lib/colossalai/nn/layer/moe/checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-11-01T06:49:48,795   copying build/lib/colossalai/nn/layer/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-11-01T06:49:48,796   copying build/lib/colossalai/nn/layer/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-11-01T06:49:48,798   copying build/lib/colossalai/nn/layer/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-11-01T06:49:48,800   copying build/lib/colossalai/nn/layer/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer/moe
2023-11-01T06:49:48,803   creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-11-01T06:49:48,804   copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-11-01T06:49:48,806   copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-11-01T06:49:48,808   copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-11-01T06:49:48,810   copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-11-01T06:49:48,812   copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-11-01T06:49:48,814   copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-11-01T06:49:48,817   copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-11-01T06:49:48,819   copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-11-01T06:49:48,820   copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer
2023-11-01T06:49:48,823   creating build/bdist.linux-armv7l/wheel/colossalai/utils
2023-11-01T06:49:48,824   copying build/lib/colossalai/utils/cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-11-01T06:49:48,826   creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-11-01T06:49:48,827   copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-11-01T06:49:48,829   copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply
2023-11-01T06:49:48,831   creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-11-01T06:49:48,832   copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-11-01T06:49:48,834   copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector
2023-11-01T06:49:48,836   creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-11-01T06:49:48,837   copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-11-01T06:49:48,839   copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder
2023-11-01T06:49:48,841   copying build/lib/colossalai/utils/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-11-01T06:49:48,843   copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-11-01T06:49:48,845   creating build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-11-01T06:49:48,846   copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-11-01T06:49:48,848   copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model
2023-11-01T06:49:48,849   copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-11-01T06:49:48,851   copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils
2023-11-01T06:49:48,853   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-11-01T06:49:48,854   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-11-01T06:49:48,855   copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-11-01T06:49:48,858   copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-11-01T06:49:48,860   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,861   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,863   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,865   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,867   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,869   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,871   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,873   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,875   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,877   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,880   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,881   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,883   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,885   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,887   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,889   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,891   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,894   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,896   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,898   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,900   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,902   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,905   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,907   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,909   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,912   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,914   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,916   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,918   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,921   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy
2023-11-01T06:49:48,923   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,925   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,928   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,930   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,931   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,933   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,935   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,937   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,940   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,941   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,943   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,945   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,947   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,949   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,951   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,952   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,954   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,956   copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler
2023-11-01T06:49:48,959   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:48,960   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:48,962   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:48,964   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:48,966   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:48,968   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:48,970   copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils
2023-11-01T06:49:48,972   copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-11-01T06:49:48,973   copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-11-01T06:49:48,976   copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard
2023-11-01T06:49:48,978   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-11-01T06:49:48,979   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-11-01T06:49:48,981   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-11-01T06:49:48,983   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-11-01T06:49:48,986   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-11-01T06:49:48,987   copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver
2023-11-01T06:49:48,990   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-11-01T06:49:48,991   copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-11-01T06:49:48,993   copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-11-01T06:49:48,995   copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-11-01T06:49:48,997   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:48,998   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:49,000   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:49,003   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:49,005   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:49,006   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:49,009   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:49,011   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:49,013   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:49,015   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:49,017   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:49,019   copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry
2023-11-01T06:49:49,020   copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler
2023-11-01T06:49:49,027   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-11-01T06:49:49,028   copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-11-01T06:49:49,030   copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-11-01T06:49:49,032   copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-11-01T06:49:49,034   copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-11-01T06:49:49,037   copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-11-01T06:49:49,039   copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-11-01T06:49:49,041   copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-11-01T06:49:49,043   copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-11-01T06:49:49,045   copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-11-01T06:49:49,047   copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload
2023-11-01T06:49:49,050   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-11-01T06:49:49,051   copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-11-01T06:49:49,053   copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-11-01T06:49:49,055   copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-11-01T06:49:49,057   copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-11-01T06:49:49,059   copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-11-01T06:49:49,061   copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes
2023-11-01T06:49:49,064   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:49,065   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:49,068   copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:49,070   copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:49,072   copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:49,074   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:49,076   copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint
2023-11-01T06:49:49,078   copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel
2023-11-01T06:49:49,080   creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-11-01T06:49:49,080   copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard
2023-11-01T06:49:49,082   creating build/bdist.linux-armv7l/wheel/colossalai/legacy
2023-11-01T06:49:49,083   copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy
2023-11-01T06:49:49,085   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry
2023-11-01T06:49:49,086   copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry
2023-11-01T06:49:49,088   copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry
2023-11-01T06:49:49,090   copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy
2023-11-01T06:49:49,092   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn
2023-11-01T06:49:49,093   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric
2023-11-01T06:49:49,094   copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric
2023-11-01T06:49:49,096   copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric
2023-11-01T06:49:49,098   copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric
2023-11-01T06:49:49,099   copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric
2023-11-01T06:49:49,101   copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric
2023-11-01T06:49:49,103   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops
2023-11-01T06:49:49,104   copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops
2023-11-01T06:49:49,106   copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops
2023-11-01T06:49:49,108   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel
2023-11-01T06:49:49,109   copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel
2023-11-01T06:49:49,112   copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel
2023-11-01T06:49:49,114   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers
2023-11-01T06:49:49,115   copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers
2023-11-01T06:49:49,117   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:49,118   copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:49,120   copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:49,122   copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:49,125   copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:49,126   copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:49,129   copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:49,131   copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:49,132   copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:49,134   copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding
2023-11-01T06:49:49,137   copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers
2023-11-01T06:49:49,138   copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers
2023-11-01T06:49:49,140   copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers
2023-11-01T06:49:49,142   copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers
2023-11-01T06:49:49,144   copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel
2023-11-01T06:49:49,146   copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn
2023-11-01T06:49:49,148   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss
2023-11-01T06:49:49,149   copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss
2023-11-01T06:49:49,151   copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss
2023-11-01T06:49:49,153   copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss
2023-11-01T06:49:49,155   copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss
2023-11-01T06:49:49,157   copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss
2023-11-01T06:49:49,159   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer
2023-11-01T06:49:49,161   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper
2023-11-01T06:49:49,162   copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper
2023-11-01T06:49:49,164   copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper
2023-11-01T06:49:49,166   copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer
2023-11-01T06:49:49,168   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d
2023-11-01T06:49:49,169   copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d
2023-11-01T06:49:49,171   copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d
2023-11-01T06:49:49,172   copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d
2023-11-01T06:49:49,175   copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d
2023-11-01T06:49:49,178   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d
2023-11-01T06:49:49,178   copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d
2023-11-01T06:49:49,181   copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d
2023-11-01T06:49:49,183   copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d
2023-11-01T06:49:49,186   copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d
2023-11-01T06:49:49,188   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d
2023-11-01T06:49:49,189   copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d
2023-11-01T06:49:49,192   copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d
2023-11-01T06:49:49,193   copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d
2023-11-01T06:49:49,196   copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d
2023-11-01T06:49:49,199   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d
2023-11-01T06:49:49,200   copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d
2023-11-01T06:49:49,202   copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d
2023-11-01T06:49:49,204   copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d
2023-11-01T06:49:49,207   copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d
2023-11-01T06:49:49,209   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils
2023-11-01T06:49:49,210   copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils
2023-11-01T06:49:49,212   copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils
2023-11-01T06:49:49,214   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:49,215   copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:49,217   copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:49,220   copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:49,222   copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:49,224   copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:49,225   copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer
2023-11-01T06:49:49,227   copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer
2023-11-01T06:49:49,229   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla
2023-11-01T06:49:49,230   copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla
2023-11-01T06:49:49,232   copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla
2023-11-01T06:49:49,234   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence
2023-11-01T06:49:49,235   copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence
2023-11-01T06:49:49,237   copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence
2023-11-01T06:49:49,239   copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence
2023-11-01T06:49:49,241   copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence
2023-11-01T06:49:49,243   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication
2023-11-01T06:49:49,244   copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication
2023-11-01T06:49:49,247   copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication
2023-11-01T06:49:49,248   copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication
2023-11-01T06:49:49,251   copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication
2023-11-01T06:49:49,253   copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication
2023-11-01T06:49:49,255   copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication
2023-11-01T06:49:49,258   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils
2023-11-01T06:49:49,259   copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils
2023-11-01T06:49:49,261   copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils
2023-11-01T06:49:49,263   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler
2023-11-01T06:49:49,264   copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler
2023-11-01T06:49:49,266   copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler
2023-11-01T06:49:49,268   copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler
2023-11-01T06:49:49,270   copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils
2023-11-01T06:49:49,273   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint
2023-11-01T06:49:49,274   copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint
2023-11-01T06:49:49,276   copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint
2023-11-01T06:49:49,278   copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint
2023-11-01T06:49:49,280   copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils
2023-11-01T06:49:49,282   copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils
2023-11-01T06:49:49,284   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler
2023-11-01T06:49:49,285   copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler
2023-11-01T06:49:49,287   copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler
2023-11-01T06:49:49,289   copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler
2023-11-01T06:49:49,291   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy
2023-11-01T06:49:49,292   copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy
2023-11-01T06:49:49,294   copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy
2023-11-01T06:49:49,296   copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy
2023-11-01T06:49:49,298   copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy
2023-11-01T06:49:49,300   copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler
2023-11-01T06:49:49,302   copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy
2023-11-01T06:49:49,304   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer
2023-11-01T06:49:49,305   copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer
2023-11-01T06:49:49,308   copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer
2023-11-01T06:49:49,310   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks
2023-11-01T06:49:49,310   copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks
2023-11-01T06:49:49,313   copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks
2023-11-01T06:49:49,315   copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks
2023-11-01T06:49:49,317   copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks
2023-11-01T06:49:49,319   copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks
2023-11-01T06:49:49,321   copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks
2023-11-01T06:49:49,323   copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks
2023-11-01T06:49:49,325   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder
2023-11-01T06:49:49,326   copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder
2023-11-01T06:49:49,328   copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder
2023-11-01T06:49:49,330   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero
2023-11-01T06:49:49,331   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param
2023-11-01T06:49:49,332   copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param
2023-11-01T06:49:49,333   copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param
2023-11-01T06:49:49,335   copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param
2023-11-01T06:49:49,337   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini
2023-11-01T06:49:49,338   copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini
2023-11-01T06:49:49,340   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks
2023-11-01T06:49:49,341   copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks
2023-11-01T06:49:49,344   copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks
2023-11-01T06:49:49,345   copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks
2023-11-01T06:49:49,348   copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks
2023-11-01T06:49:49,349   copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks
2023-11-01T06:49:49,351   copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini
2023-11-01T06:49:49,353   copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini
2023-11-01T06:49:49,354   copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini
2023-11-01T06:49:49,356   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks
2023-11-01T06:49:49,357   copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks
2023-11-01T06:49:49,359   copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks
2023-11-01T06:49:49,361   copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini
2023-11-01T06:49:49,363   copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini
2023-11-01T06:49:49,365   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim
2023-11-01T06:49:49,366   copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim
2023-11-01T06:49:49,368   copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim
2023-11-01T06:49:49,371   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:49,372   copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:49,374   copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:49,377   copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:49,379   copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:49,381   copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:49,382   copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model
2023-11-01T06:49:49,384   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx
2023-11-01T06:49:49,385   copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx
2023-11-01T06:49:49,388   copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx
2023-11-01T06:49:49,389   copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero
2023-11-01T06:49:49,391   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils
2023-11-01T06:49:49,392   copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils
2023-11-01T06:49:49,394   copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils
2023-11-01T06:49:49,396   copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils
2023-11-01T06:49:49,397   copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils
2023-11-01T06:49:49,399   copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils
2023-11-01T06:49:49,401   copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy
2023-11-01T06:49:49,403   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine
2023-11-01T06:49:49,405   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation
2023-11-01T06:49:49,406   copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation
2023-11-01T06:49:49,408   copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation
2023-11-01T06:49:49,410   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule
2023-11-01T06:49:49,411   copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule
2023-11-01T06:49:49,414   copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule
2023-11-01T06:49:49,416   copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule
2023-11-01T06:49:49,417   copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule
2023-11-01T06:49:49,419   copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule
2023-11-01T06:49:49,423   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:49,424   copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:49,425   copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:49,427   copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:49,429   copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:49,430   copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:49,432   copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:49,433   copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:49,435   copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler
2023-11-01T06:49:49,437   copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine
2023-11-01T06:49:49,438   copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine
2023-11-01T06:49:49,440   copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy
2023-11-01T06:49:49,443   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor
2023-11-01T06:49:49,444   copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor
2023-11-01T06:49:49,446   copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor
2023-11-01T06:49:49,448   copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor
2023-11-01T06:49:49,450   copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor
2023-11-01T06:49:49,451   copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor
2023-11-01T06:49:49,453   copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor
2023-11-01T06:49:49,455   copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor
2023-11-01T06:49:49,457   copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor
2023-11-01T06:49:49,460   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp
2023-11-01T06:49:49,461   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp
2023-11-01T06:49:49,462   copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp
2023-11-01T06:49:49,465   copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp
2023-11-01T06:49:49,467   copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp
2023-11-01T06:49:49,470   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp
2023-11-01T06:49:49,471   copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp
2023-11-01T06:49:49,473   copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp
2023-11-01T06:49:49,476   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp
2023-11-01T06:49:49,477   copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp
2023-11-01T06:49:49,480   copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp
2023-11-01T06:49:49,483   copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp
2023-11-01T06:49:49,485   copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp
2023-11-01T06:49:49,487   copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp
2023-11-01T06:49:49,490   copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp
2023-11-01T06:49:49,492   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline
2023-11-01T06:49:49,493   copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline
2023-11-01T06:49:49,496   copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline
2023-11-01T06:49:49,499   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware
2023-11-01T06:49:49,501   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor
2023-11-01T06:49:49,502   copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor
2023-11-01T06:49:49,504   copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor
2023-11-01T06:49:49,507   copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware
2023-11-01T06:49:49,509   copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware
2023-11-01T06:49:49,513   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc
2023-11-01T06:49:49,514   copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc
2023-11-01T06:49:49,517   copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc
2023-11-01T06:49:49,521   copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc
2023-11-01T06:49:49,523   copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc
2023-11-01T06:49:49,526   copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline
2023-11-01T06:49:49,529   copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline
2023-11-01T06:49:49,531   copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline
2023-11-01T06:49:49,535   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context
2023-11-01T06:49:49,537   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:49,538   copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:49,540   copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:49,543   copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:49,546   copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:49,548   copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:49,550   copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:49,553   copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:49,556   copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:49,558   copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:49,560   copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:49,563   copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer
2023-11-01T06:49:49,565   copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context
2023-11-01T06:49:49,566   copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context
2023-11-01T06:49:49,568   creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random
2023-11-01T06:49:49,569   copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random
2023-11-01T06:49:49,572   copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random
2023-11-01T06:49:49,573   copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random
2023-11-01T06:49:49,575   copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context
2023-11-01T06:49:49,578   creating build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-11-01T06:49:49,579   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-11-01T06:49:49,580   copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-11-01T06:49:49,582   copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-11-01T06:49:49,584   copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-11-01T06:49:49,586   copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit
2023-11-01T06:49:49,588   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-11-01T06:49:49,589   copying build/lib/colossalai/kernel/cuda_native/multihead_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-11-01T06:49:49,591   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/mha
2023-11-01T06:49:49,592   copying build/lib/colossalai/kernel/cuda_native/mha/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/mha
2023-11-01T06:49:49,594   copying build/lib/colossalai/kernel/cuda_native/mha/flash_attn_2.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/mha
2023-11-01T06:49:49,596   copying build/lib/colossalai/kernel/cuda_native/mha/mha.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/mha
2023-11-01T06:49:49,598   copying build/lib/colossalai/kernel/cuda_native/mha/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/mha
2023-11-01T06:49:49,599   copying build/lib/colossalai/kernel/cuda_native/mha/mem_eff_attn.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/mha
2023-11-01T06:49:49,601   copying build/lib/colossalai/kernel/cuda_native/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-11-01T06:49:49,603   copying build/lib/colossalai/kernel/cuda_native/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-11-01T06:49:49,605   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,606   copying build/lib/colossalai/kernel/cuda_native/csrc/compat.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,608   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels
2023-11-01T06:49:49,610   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,611   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,612   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,614   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,616   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,618   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,619   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,621   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,624   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/context.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,625   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,627   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,629   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,631   copying build/lib/colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc/kernels/include
2023-11-01T06:49:49,633   copying build/lib/colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,634   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,636   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,638   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,640   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,642   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,645   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,647   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,649   copying build/lib/colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,651   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,653   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,655   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,657   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,659   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,662   copying build/lib/colossalai/kernel/cuda_native/csrc/type_shim.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,664   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,666   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,668   copying build/lib/colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,670   copying build/lib/colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,673   copying build/lib/colossalai/kernel/cuda_native/csrc/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,675   copying build/lib/colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,678   copying build/lib/colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native/csrc
2023-11-01T06:49:49,680   copying build/lib/colossalai/kernel/cuda_native/layer_norm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/cuda_native
2023-11-01T06:49:49,682   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,683   copying build/lib/colossalai/kernel/triton/token_attention_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,686   copying build/lib/colossalai/kernel/triton/context_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,688   copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,689   copying build/lib/colossalai/kernel/triton/copy_kv_cache_dest.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,691   copying build/lib/colossalai/kernel/triton/int8_rotary_embedding_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,693   copying build/lib/colossalai/kernel/triton/smooth_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,695   copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,697   copying build/lib/colossalai/kernel/triton/fused_layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,699   copying build/lib/colossalai/kernel/triton/custom_autotune.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,701   copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,703   copying build/lib/colossalai/kernel/triton/gptq_triton.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,705   copying build/lib/colossalai/kernel/triton/self_attention_nofusion.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton
2023-11-01T06:49:49,707   creating build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,708   copying build/lib/colossalai/kernel/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,711   copying build/lib/colossalai/kernel/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,713   copying build/lib/colossalai/kernel/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,715   copying build/lib/colossalai/kernel/op_builder/smoothquant.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,716   copying build/lib/colossalai/kernel/op_builder/moe.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,718   copying build/lib/colossalai/kernel/op_builder/multi_head_attn.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,720   copying build/lib/colossalai/kernel/op_builder/scaled_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,722   copying build/lib/colossalai/kernel/op_builder/gptq.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,723   copying build/lib/colossalai/kernel/op_builder/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,725   copying build/lib/colossalai/kernel/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,727   copying build/lib/colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,728   copying build/lib/colossalai/kernel/op_builder/fused_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/op_builder
2023-11-01T06:49:49,730   copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel
2023-11-01T06:49:49,732   creating build/bdist.linux-armv7l/wheel/colossalai/zero
2023-11-01T06:49:49,734   creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini
2023-11-01T06:49:49,735   copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini
2023-11-01T06:49:49,737   copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini
2023-11-01T06:49:49,739   copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini
2023-11-01T06:49:49,742   creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk
2023-11-01T06:49:49,743   copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk
2023-11-01T06:49:49,745   copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk
2023-11-01T06:49:49,748   copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk
2023-11-01T06:49:49,750   copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk
2023-11-01T06:49:49,752   copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk
2023-11-01T06:49:49,754   copying build/lib/colossalai/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini
2023-11-01T06:49:49,757   creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:49,757   copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:49,759   copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:49,761   copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:49,763   copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:49,765   copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:49,766   copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:49,768   copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:49,770   copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:49,772   copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer
2023-11-01T06:49:49,774   copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini
2023-11-01T06:49:49,776   copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini
2023-11-01T06:49:49,777   copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini
2023-11-01T06:49:49,780   copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini
2023-11-01T06:49:49,783   copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/zero
2023-11-01T06:49:49,785   copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero
2023-11-01T06:49:49,787   creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level
2023-11-01T06:49:49,788   copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level
2023-11-01T06:49:49,790   copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level
2023-11-01T06:49:49,793   creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:49,794   copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:49,797   copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:49,800   copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:49,802   copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:49,803   copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:49,805   copying build/lib/colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping
2023-11-01T06:49:49,807   copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level
2023-11-01T06:49:49,809   creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer
2023-11-01T06:49:49,810   copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer
2023-11-01T06:49:49,813   creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses
2023-11-01T06:49:49,814   copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses
2023-11-01T06:49:49,817   copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses
2023-11-01T06:49:49,818   copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses
2023-11-01T06:49:49,820   copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses
2023-11-01T06:49:49,822   copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses
2023-11-01T06:49:49,824   copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer
2023-11-01T06:49:49,826   creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx
2023-11-01T06:49:49,828   creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes
2023-11-01T06:49:49,829   copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes
2023-11-01T06:49:49,832   copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes
2023-11-01T06:49:49,834   copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes
2023-11-01T06:49:49,836   copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx
2023-11-01T06:49:49,838   copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx
2023-11-01T06:49:49,841   copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx
2023-11-01T06:49:49,843   copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx
2023-11-01T06:49:49,845   copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx
2023-11-01T06:49:49,848   creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:49,849   copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:49,851   copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:49,853   copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:49,855   copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:49,856   copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:49,858   copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer
2023-11-01T06:49:49,860   copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-11-01T06:49:49,862   creating build/bdist.linux-armv7l/wheel/colossalai/fx
2023-11-01T06:49:49,863   copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-11-01T06:49:49,865   copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-11-01T06:49:49,867   creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-11-01T06:49:49,868   copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-11-01T06:49:49,870   copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-11-01T06:49:49,873   copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-11-01T06:49:49,877   copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-11-01T06:49:49,879   copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-11-01T06:49:49,882   copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-11-01T06:49:49,884   copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-11-01T06:49:49,886   copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes
2023-11-01T06:49:49,889   creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-11-01T06:49:49,890   copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-11-01T06:49:49,892   copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen
2023-11-01T06:49:49,895   copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-11-01T06:49:49,897   copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-11-01T06:49:49,900   copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-11-01T06:49:49,903   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-11-01T06:49:49,904   copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-11-01T06:49:49,906   copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-11-01T06:49:49,909   copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-11-01T06:49:49,911   copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-11-01T06:49:49,913   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-11-01T06:49:49,914   copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-11-01T06:49:49,917   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:49,918   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:49,920   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:49,922   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:49,924   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:49,925   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:49,927   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:49,928   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:49,930   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:49,932   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:49,933   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:49,935   copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module
2023-11-01T06:49:49,937   copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-11-01T06:49:49,939   copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-11-01T06:49:49,941   copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-11-01T06:49:49,943   copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental
2023-11-01T06:49:49,945   creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:49,946   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:49,948   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:49,950   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:49,951   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:49,953   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:49,955   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:49,956   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:49,958   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:49,960   copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function
2023-11-01T06:49:49,962   copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-11-01T06:49:49,964   copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-11-01T06:49:49,966   copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-11-01T06:49:49,968   copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler
2023-11-01T06:49:49,971   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-11-01T06:49:49,972   copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-11-01T06:49:49,974   copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-11-01T06:49:49,976   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-11-01T06:49:49,977   copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch
2023-11-01T06:49:49,979   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-11-01T06:49:49,980   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-11-01T06:49:49,982   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-11-01T06:49:49,983   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-11-01T06:49:49,985   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module
2023-11-01T06:49:49,988   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-11-01T06:49:49,988   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-11-01T06:49:49,990   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-11-01T06:49:49,992   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-11-01T06:49:49,994   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-11-01T06:49:49,996   copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function
2023-11-01T06:49:49,998   copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-11-01T06:49:50,000   copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-11-01T06:49:50,001   copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-11-01T06:49:50,004   copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-11-01T06:49:50,006   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-11-01T06:49:50,007   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:50,008   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:50,010   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:50,012   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:50,014   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:50,016   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:50,018   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:50,020   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:50,021   copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module
2023-11-01T06:49:50,023   copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch
2023-11-01T06:49:50,025   creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:50,026   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:50,028   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:50,030   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:50,031   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:50,033   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:50,035   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:50,037   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:50,038   copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function
2023-11-01T06:49:50,040   copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer
2023-11-01T06:49:50,043   copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx
2023-11-01T06:49:50,045   copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai
2023-11-01T06:49:50,048   creating build/bdist.linux-armv7l/wheel/colossalai/_C
2023-11-01T06:49:50,048   copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C
2023-11-01T06:49:50,050   creating build/bdist.linux-armv7l/wheel/colossalai/cluster
2023-11-01T06:49:50,051   copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster
2023-11-01T06:49:50,053   copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster
2023-11-01T06:49:50,055   copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster
2023-11-01T06:49:50,057   copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster
2023-11-01T06:49:50,059   copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster
2023-11-01T06:49:50,062   creating build/bdist.linux-armv7l/wheel/colossalai/inference
2023-11-01T06:49:50,063   creating build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel
2023-11-01T06:49:50,065   creating build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/modeling
2023-11-01T06:49:50,066   copying build/lib/colossalai/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/modeling
2023-11-01T06:49:50,069   copying build/lib/colossalai/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/modeling
2023-11-01T06:49:50,070   copying build/lib/colossalai/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/modeling
2023-11-01T06:49:50,072   copying build/lib/colossalai/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/modeling
2023-11-01T06:49:50,075   copying build/lib/colossalai/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/modeling
2023-11-01T06:49:50,078   creating build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/policies
2023-11-01T06:49:50,082   copying build/lib/colossalai/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/policies
2023-11-01T06:49:50,085   copying build/lib/colossalai/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/policies
2023-11-01T06:49:50,086   copying build/lib/colossalai/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/policies
2023-11-01T06:49:50,089   copying build/lib/colossalai/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel/policies
2023-11-01T06:49:50,091   copying build/lib/colossalai/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel
2023-11-01T06:49:50,093   copying build/lib/colossalai/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel
2023-11-01T06:49:50,095   copying build/lib/colossalai/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel
2023-11-01T06:49:50,096   copying build/lib/colossalai/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/tensor_parallel
2023-11-01T06:49:50,099   copying build/lib/colossalai/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference
2023-11-01T06:49:50,102   creating build/bdist.linux-armv7l/wheel/colossalai/inference/dynamic_batching
2023-11-01T06:49:50,103   copying build/lib/colossalai/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/dynamic_batching
2023-11-01T06:49:50,105   copying build/lib/colossalai/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/dynamic_batching
2023-11-01T06:49:50,107   copying build/lib/colossalai/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/dynamic_batching
2023-11-01T06:49:50,109   copying build/lib/colossalai/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/dynamic_batching
2023-11-01T06:49:50,110   copying build/lib/colossalai/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/dynamic_batching
2023-11-01T06:49:50,112   copying build/lib/colossalai/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/dynamic_batching
2023-11-01T06:49:50,113   copying build/lib/colossalai/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/dynamic_batching
2023-11-01T06:49:50,116   copying build/lib/colossalai/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/dynamic_batching
2023-11-01T06:49:50,117   copying build/lib/colossalai/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/dynamic_batching
2023-11-01T06:49:50,120   copying build/lib/colossalai/inference/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference
2023-11-01T06:49:50,124   copying build/lib/colossalai/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference
2023-11-01T06:49:50,128   copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference
2023-11-01T06:49:50,134   creating build/bdist.linux-armv7l/wheel/colossalai/inference/pipeline
2023-11-01T06:49:50,136   copying build/lib/colossalai/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/pipeline
2023-11-01T06:49:50,141   copying build/lib/colossalai/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/pipeline
2023-11-01T06:49:50,143   creating build/bdist.linux-armv7l/wheel/colossalai/inference/hybridengine
2023-11-01T06:49:50,145   creating build/bdist.linux-armv7l/wheel/colossalai/inference/hybridengine/modeling
2023-11-01T06:49:50,146   copying build/lib/colossalai/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/hybridengine/modeling
2023-11-01T06:49:50,147   copying build/lib/colossalai/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/hybridengine/modeling
2023-11-01T06:49:50,149   copying build/lib/colossalai/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/hybridengine/modeling
2023-11-01T06:49:50,152   copying build/lib/colossalai/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/hybridengine
2023-11-01T06:49:50,153   copying build/lib/colossalai/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/hybridengine
2023-11-01T06:49:50,156   creating build/bdist.linux-armv7l/wheel/colossalai/inference/hybridengine/polices
2023-11-01T06:49:50,157   copying build/lib/colossalai/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/hybridengine/polices
2023-11-01T06:49:50,159   copying build/lib/colossalai/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/hybridengine/polices
2023-11-01T06:49:50,162   creating build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-11-01T06:49:50,163   copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-11-01T06:49:50,165   copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-11-01T06:49:50,167   copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-11-01T06:49:50,169   copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-11-01T06:49:50,171   copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-11-01T06:49:50,173   copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-11-01T06:49:50,175   copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-11-01T06:49:50,177   copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor
2023-11-01T06:49:50,180   creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-11-01T06:49:50,181   copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-11-01T06:49:50,183   copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-11-01T06:49:50,184   copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-11-01T06:49:50,187   copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-11-01T06:49:50,189   copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-11-01T06:49:50,191   copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-11-01T06:49:50,193   copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-11-01T06:49:50,195   copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor
2023-11-01T06:49:50,198   creating build/bdist.linux-armv7l/wheel/colossalai/amp
2023-11-01T06:49:50,199   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-11-01T06:49:50,200   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-11-01T06:49:50,201   copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-11-01T06:49:50,203   copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-11-01T06:49:50,206   copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-11-01T06:49:50,208   copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler
2023-11-01T06:49:50,212   creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin
2023-11-01T06:49:50,213   copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin
2023-11-01T06:49:50,215   copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin
2023-11-01T06:49:50,217   copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin
2023-11-01T06:49:50,218   copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin
2023-11-01T06:49:50,220   copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-11-01T06:49:50,223   copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp
2023-11-01T06:49:50,224   copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp
2023-11-01T06:49:50,226   creating build/bdist.linux-armv7l/wheel/colossalai/testing
2023-11-01T06:49:50,227   copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-11-01T06:49:50,230   copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-11-01T06:49:50,231   copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-11-01T06:49:50,234   copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-11-01T06:49:50,235   copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing
2023-11-01T06:49:50,237   creating build/bdist.linux-armv7l/wheel/colossalai/booster
2023-11-01T06:49:50,238   copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster
2023-11-01T06:49:50,241   creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-11-01T06:49:50,242   copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-11-01T06:49:50,244   copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-11-01T06:49:50,246   copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-11-01T06:49:50,248   copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-11-01T06:49:50,250   copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-11-01T06:49:50,251   copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-11-01T06:49:50,253   copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision
2023-11-01T06:49:50,255   copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster
2023-11-01T06:49:50,256   copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster
2023-11-01T06:49:50,259   creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-11-01T06:49:50,259   copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-11-01T06:49:50,262   copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-11-01T06:49:50,264   copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-11-01T06:49:50,266   copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-11-01T06:49:50,269   copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-11-01T06:49:50,271   copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-11-01T06:49:50,274   copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-11-01T06:49:50,276   copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-11-01T06:49:50,278   copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin
2023-11-01T06:49:50,282   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-11-01T06:49:50,284   creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule
2023-11-01T06:49:50,286   copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule
2023-11-01T06:49:50,289   copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule
2023-11-01T06:49:50,292   copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule
2023-11-01T06:49:50,294   copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule
2023-11-01T06:49:50,296   copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule
2023-11-01T06:49:50,299   copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule
2023-11-01T06:49:50,301   copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-11-01T06:49:50,304   copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-11-01T06:49:50,306   copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline
2023-11-01T06:49:50,309   creating build/bdist.linux-armv7l/wheel/colossalai/device
2023-11-01T06:49:50,310   copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-11-01T06:49:50,315   copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-11-01T06:49:50,318   copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-11-01T06:49:50,321   copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device
2023-11-01T06:49:50,324   creating build/bdist.linux-armv7l/wheel/colossalai/context
2023-11-01T06:49:50,325   copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-11-01T06:49:50,328   copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-11-01T06:49:50,330   copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-11-01T06:49:50,332   copying build/lib/colossalai/context/moe_context.py -> build/bdist.linux-armv7l/wheel/colossalai/context
2023-11-01T06:49:50,335   running install_egg_info
2023-11-01T06:49:50,376   running egg_info
2023-11-01T06:49:50,402   writing colossalai.egg-info/PKG-INFO
2023-11-01T06:49:50,406   writing dependency_links to colossalai.egg-info/dependency_links.txt
2023-11-01T06:49:50,407   writing entry points to colossalai.egg-info/entry_points.txt
2023-11-01T06:49:50,409   writing requirements to colossalai.egg-info/requires.txt
2023-11-01T06:49:50,410   writing top-level names to colossalai.egg-info/top_level.txt
2023-11-01T06:49:50,566   reading manifest file 'colossalai.egg-info/SOURCES.txt'
2023-11-01T06:49:50,608   reading manifest template 'MANIFEST.in'
2023-11-01T06:49:51,683   warning: no files found matching '*.tr' under directory 'colossalai'
2023-11-01T06:49:52,297   warning: no files found matching '*.cc' under directory 'colossalai'
2023-11-01T06:49:52,600   warning: no files found matching '*.pyi' under directory 'colossalai'
2023-11-01T06:49:52,609   adding license file 'LICENSE'
2023-11-01T06:49:52,646   writing manifest file 'colossalai.egg-info/SOURCES.txt'
2023-11-01T06:49:52,650   Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.3.4-py3.11.egg-info
2023-11-01T06:49:52,664   running install_scripts
2023-11-01T06:49:52,687   creating build/bdist.linux-armv7l/wheel/colossalai-0.3.4.dist-info/WHEEL
2023-11-01T06:49:52,691   creating '/tmp/pip-wheel-f4kyczop/colossalai-0.3.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2023-11-01T06:49:52,694   adding 'colossalai/__init__.py'
2023-11-01T06:49:52,697   adding 'colossalai/initialize.py'
2023-11-01T06:49:52,698   adding 'colossalai/version.py'
2023-11-01T06:49:52,700   adding 'colossalai/_C/__init__.py'
2023-11-01T06:49:52,702   adding 'colossalai/_analyzer/__init__.py'
2023-11-01T06:49:52,704   adding 'colossalai/_analyzer/envs.py'
2023-11-01T06:49:52,706   adding 'colossalai/_analyzer/_subclasses/__init__.py'
2023-11-01T06:49:52,710   adding 'colossalai/_analyzer/_subclasses/_meta_registration.py'
2023-11-01T06:49:52,712   adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py'
2023-11-01T06:49:52,715   adding 'colossalai/_analyzer/_subclasses/flop_tensor.py'
2023-11-01T06:49:52,718   adding 'colossalai/_analyzer/_subclasses/meta_tensor.py'
2023-11-01T06:49:52,720   adding 'colossalai/_analyzer/fx/__init__.py'
2023-11-01T06:49:52,724   adding 'colossalai/_analyzer/fx/codegen.py'
2023-11-01T06:49:52,727   adding 'colossalai/_analyzer/fx/graph_module.py'
2023-11-01T06:49:52,729   adding 'colossalai/_analyzer/fx/node_util.py'
2023-11-01T06:49:52,731   adding 'colossalai/_analyzer/fx/symbolic_profile.py'
2023-11-01T06:49:52,734   adding 'colossalai/_analyzer/fx/passes/__init__.py'
2023-11-01T06:49:52,737   adding 'colossalai/_analyzer/fx/passes/graph_profile.py'
2023-11-01T06:49:52,740   adding 'colossalai/_analyzer/fx/passes/shape_prop.py'
2023-11-01T06:49:52,742   adding 'colossalai/_analyzer/fx/tracer/__init__.py'
2023-11-01T06:49:52,744   adding 'colossalai/_analyzer/fx/tracer/bias_addition.py'
2023-11-01T06:49:52,745   adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py'
2023-11-01T06:49:52,747   adding 'colossalai/_analyzer/fx/tracer/proxy.py'
2023-11-01T06:49:52,749   adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py'
2023-11-01T06:49:52,752   adding 'colossalai/_analyzer/fx/tracer/tracer.py'
2023-11-01T06:49:52,754   adding 'colossalai/amp/__init__.py'
2023-11-01T06:49:52,756   adding 'colossalai/amp/naive_amp/__init__.py'
2023-11-01T06:49:52,758   adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py'
2023-11-01T06:49:52,761   adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py'
2023-11-01T06:49:52,762   adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py'
2023-11-01T06:49:52,764   adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py'
2023-11-01T06:49:52,766   adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py'
2023-11-01T06:49:52,768   adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py'
2023-11-01T06:49:52,770   adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py'
2023-11-01T06:49:52,772   adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py'
2023-11-01T06:49:52,774   adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py'
2023-11-01T06:49:52,776   adding 'colossalai/auto_parallel/__init__.py'
2023-11-01T06:49:52,779   adding 'colossalai/auto_parallel/checkpoint/__init__.py'
2023-11-01T06:49:52,780   adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py'
2023-11-01T06:49:52,783   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py'
2023-11-01T06:49:52,785   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py'
2023-11-01T06:49:52,789   adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py'
2023-11-01T06:49:52,791   adding 'colossalai/auto_parallel/checkpoint/operation.py'
2023-11-01T06:49:52,793   adding 'colossalai/auto_parallel/meta_profiler/__init__.py'
2023-11-01T06:49:52,794   adding 'colossalai/auto_parallel/meta_profiler/constants.py'
2023-11-01T06:49:52,796   adding 'colossalai/auto_parallel/meta_profiler/registry.py'
2023-11-01T06:49:52,798   adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py'
2023-11-01T06:49:52,800   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py'
2023-11-01T06:49:52,802   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py'
2023-11-01T06:49:52,803   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py'
2023-11-01T06:49:52,805   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py'
2023-11-01T06:49:52,807   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py'
2023-11-01T06:49:52,809   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py'
2023-11-01T06:49:52,811   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py'
2023-11-01T06:49:52,813   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py'
2023-11-01T06:49:52,815   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py'
2023-11-01T06:49:52,816   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py'
2023-11-01T06:49:52,818   adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py'
2023-11-01T06:49:52,820   adding 'colossalai/auto_parallel/offload/__init__.py'
2023-11-01T06:49:52,822   adding 'colossalai/auto_parallel/offload/amp_optimizer.py'
2023-11-01T06:49:52,824   adding 'colossalai/auto_parallel/offload/base_offload_module.py'
2023-11-01T06:49:52,825   adding 'colossalai/auto_parallel/offload/mem_optimize.py'
2023-11-01T06:49:52,827   adding 'colossalai/auto_parallel/offload/region.py'
2023-11-01T06:49:52,830   adding 'colossalai/auto_parallel/offload/region_manager.py'
2023-11-01T06:49:52,832   adding 'colossalai/auto_parallel/offload/runtime.py'
2023-11-01T06:49:52,835   adding 'colossalai/auto_parallel/offload/solver.py'
2023-11-01T06:49:52,837   adding 'colossalai/auto_parallel/offload/training_simulator.py'
2023-11-01T06:49:52,839   adding 'colossalai/auto_parallel/offload/util.py'
2023-11-01T06:49:52,841   adding 'colossalai/auto_parallel/passes/__init__.py'
2023-11-01T06:49:52,843   adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py'
2023-11-01T06:49:52,844   adding 'colossalai/auto_parallel/passes/constants.py'
2023-11-01T06:49:52,846   adding 'colossalai/auto_parallel/passes/meta_info_prop.py'
2023-11-01T06:49:52,848   adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py'
2023-11-01T06:49:52,852   adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py'
2023-11-01T06:49:52,854   adding 'colossalai/auto_parallel/pipeline_shard/__init__.py'
2023-11-01T06:49:52,856   adding 'colossalai/auto_parallel/tensor_shard/__init__.py'
2023-11-01T06:49:52,857   adding 'colossalai/auto_parallel/tensor_shard/constants.py'
2023-11-01T06:49:52,860   adding 'colossalai/auto_parallel/tensor_shard/initialize.py'
2023-11-01T06:49:52,862   adding 'colossalai/auto_parallel/tensor_shard/options.py'
2023-11-01T06:49:52,864   adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py'
2023-11-01T06:49:52,866   adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py'
2023-11-01T06:49:52,868   adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py'
2023-11-01T06:49:52,869   adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py'
2023-11-01T06:49:52,871   adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py'
2023-11-01T06:49:52,873   adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py'
2023-11-01T06:49:52,875   adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py'
2023-11-01T06:49:52,877   adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py'
2023-11-01T06:49:52,879   adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py'
2023-11-01T06:49:52,880   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py'
2023-11-01T06:49:52,882   adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py'
2023-11-01T06:49:52,884   adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py'
2023-11-01T06:49:52,886   adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py'
2023-11-01T06:49:52,889   adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py'
2023-11-01T06:49:52,891   adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py'
2023-11-01T06:49:52,893   adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py'
2023-11-01T06:49:52,895   adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py'
2023-11-01T06:49:52,897   adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py'
2023-11-01T06:49:52,898   adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py'
2023-11-01T06:49:52,900   adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py'
2023-11-01T06:49:52,902   adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py'
2023-11-01T06:49:52,903   adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py'
2023-11-01T06:49:52,905   adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py'
2023-11-01T06:49:52,907   adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py'
2023-11-01T06:49:52,908   adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py'
2023-11-01T06:49:52,910   adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py'
2023-11-01T06:49:52,912   adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py'
2023-11-01T06:49:52,913   adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py'
2023-11-01T06:49:52,916   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py'
2023-11-01T06:49:52,918   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py'
2023-11-01T06:49:52,920   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py'
2023-11-01T06:49:52,923   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py'
2023-11-01T06:49:52,925   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py'
2023-11-01T06:49:52,927   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py'
2023-11-01T06:49:52,929   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py'
2023-11-01T06:49:52,931   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py'
2023-11-01T06:49:52,935   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py'
2023-11-01T06:49:52,937   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py'
2023-11-01T06:49:52,939   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py'
2023-11-01T06:49:52,941   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py'
2023-11-01T06:49:52,943   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py'
2023-11-01T06:49:52,945   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py'
2023-11-01T06:49:52,948   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py'
2023-11-01T06:49:52,950   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py'
2023-11-01T06:49:52,952   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py'
2023-11-01T06:49:52,953   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py'
2023-11-01T06:49:52,955   adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py'
2023-11-01T06:49:52,957   adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py'
2023-11-01T06:49:52,960   adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py'
2023-11-01T06:49:52,962   adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py'
2023-11-01T06:49:52,965   adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py'
2023-11-01T06:49:52,967   adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py'
2023-11-01T06:49:52,970   adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py'
2023-11-01T06:49:52,972   adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py'
2023-11-01T06:49:52,974   adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py'
2023-11-01T06:49:52,976   adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py'
2023-11-01T06:49:52,978   adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py'
2023-11-01T06:49:52,980   adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py'
2023-11-01T06:49:52,982   adding 'colossalai/booster/__init__.py'
2023-11-01T06:49:52,983   adding 'colossalai/booster/accelerator.py'
2023-11-01T06:49:52,986   adding 'colossalai/booster/booster.py'
2023-11-01T06:49:52,988   adding 'colossalai/booster/mixed_precision/__init__.py'
2023-11-01T06:49:52,989   adding 'colossalai/booster/mixed_precision/bf16.py'
2023-11-01T06:49:52,991   adding 'colossalai/booster/mixed_precision/fp16_apex.py'
2023-11-01T06:49:52,993   adding 'colossalai/booster/mixed_precision/fp16_naive.py'
2023-11-01T06:49:52,994   adding 'colossalai/booster/mixed_precision/fp16_torch.py'
2023-11-01T06:49:52,996   adding 'colossalai/booster/mixed_precision/fp8.py'
2023-11-01T06:49:52,997   adding 'colossalai/booster/mixed_precision/mixed_precision_base.py'
2023-11-01T06:49:52,999   adding 'colossalai/booster/plugin/__init__.py'
2023-11-01T06:49:53,001   adding 'colossalai/booster/plugin/dp_plugin_base.py'
2023-11-01T06:49:53,004   adding 'colossalai/booster/plugin/gemini_plugin.py'
2023-11-01T06:49:53,008   adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py'
2023-11-01T06:49:53,011   adding 'colossalai/booster/plugin/low_level_zero_plugin.py'
2023-11-01T06:49:53,013   adding 'colossalai/booster/plugin/plugin_base.py'
2023-11-01T06:49:53,014   adding 'colossalai/booster/plugin/pp_plugin_base.py'
2023-11-01T06:49:53,016   adding 'colossalai/booster/plugin/torch_ddp_plugin.py'
2023-11-01T06:49:53,018   adding 'colossalai/booster/plugin/torch_fsdp_plugin.py'
2023-11-01T06:49:53,020   adding 'colossalai/checkpoint_io/__init__.py'
2023-11-01T06:49:53,022   adding 'colossalai/checkpoint_io/checkpoint_io_base.py'
2023-11-01T06:49:53,024   adding 'colossalai/checkpoint_io/general_checkpoint_io.py'
2023-11-01T06:49:53,029   adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py'
2023-11-01T06:49:53,031   adding 'colossalai/checkpoint_io/index_file.py'
2023-11-01T06:49:53,035   adding 'colossalai/checkpoint_io/utils.py'
2023-11-01T06:49:53,037   adding 'colossalai/cli/__init__.py'
2023-11-01T06:49:53,039   adding 'colossalai/cli/cli.py'
2023-11-01T06:49:53,041   adding 'colossalai/cli/check/__init__.py'
2023-11-01T06:49:53,043   adding 'colossalai/cli/check/check_installation.py'
2023-11-01T06:49:53,045   adding 'colossalai/cli/launcher/__init__.py'
2023-11-01T06:49:53,046   adding 'colossalai/cli/launcher/hostinfo.py'
2023-11-01T06:49:53,048   adding 'colossalai/cli/launcher/multinode_runner.py'
2023-11-01T06:49:53,050   adding 'colossalai/cli/launcher/run.py'
2023-11-01T06:49:53,053   adding 'colossalai/cluster/__init__.py'
2023-11-01T06:49:53,054   adding 'colossalai/cluster/device_mesh_manager.py'
2023-11-01T06:49:53,056   adding 'colossalai/cluster/dist_coordinator.py'
2023-11-01T06:49:53,058   adding 'colossalai/cluster/process_group_manager.py'
2023-11-01T06:49:53,060   adding 'colossalai/cluster/process_group_mesh.py'
2023-11-01T06:49:53,062   adding 'colossalai/context/__init__.py'
2023-11-01T06:49:53,064   adding 'colossalai/context/config.py'
2023-11-01T06:49:53,065   adding 'colossalai/context/moe_context.py'
2023-11-01T06:49:53,067   adding 'colossalai/context/singleton_meta.py'
2023-11-01T06:49:53,069   adding 'colossalai/device/__init__.py'
2023-11-01T06:49:53,072   adding 'colossalai/device/alpha_beta_profiler.py'
2023-11-01T06:49:53,074   adding 'colossalai/device/calc_pipeline_strategy.py'
2023-11-01T06:49:53,077   adding 'colossalai/device/device_mesh.py'
2023-11-01T06:49:53,079   adding 'colossalai/fx/__init__.py'
2023-11-01T06:49:53,081   adding 'colossalai/fx/_compatibility.py'
2023-11-01T06:49:53,083   adding 'colossalai/fx/_meta_regist_12.py'
2023-11-01T06:49:53,085   adding 'colossalai/fx/_meta_regist_13.py'
2023-11-01T06:49:53,087   adding 'colossalai/fx/graph_module.py'
2023-11-01T06:49:53,088   adding 'colossalai/fx/proxy.py'
2023-11-01T06:49:53,090   adding 'colossalai/fx/codegen/__init__.py'
2023-11-01T06:49:53,094   adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py'
2023-11-01T06:49:53,096   adding 'colossalai/fx/passes/__init__.py'
2023-11-01T06:49:53,098   adding 'colossalai/fx/passes/adding_split_node_pass.py'
2023-11-01T06:49:53,100   adding 'colossalai/fx/passes/concrete_info_prop.py'
2023-11-01T06:49:53,102   adding 'colossalai/fx/passes/meta_info_prop.py'
2023-11-01T06:49:53,105   adding 'colossalai/fx/passes/passes_for_gpt2_test.py'
2023-11-01T06:49:53,106   adding 'colossalai/fx/passes/shard_1d_pass.py'
2023-11-01T06:49:53,108   adding 'colossalai/fx/passes/split_module.py'
2023-11-01T06:49:53,110   adding 'colossalai/fx/passes/utils.py'
2023-11-01T06:49:53,112   adding 'colossalai/fx/profiler/__init__.py'
2023-11-01T06:49:53,113   adding 'colossalai/fx/profiler/constants.py'
2023-11-01T06:49:53,115   adding 'colossalai/fx/profiler/dataflow.py'
2023-11-01T06:49:53,116   adding 'colossalai/fx/profiler/memory_utils.py'
2023-11-01T06:49:53,118   adding 'colossalai/fx/profiler/opcount.py'
2023-11-01T06:49:53,120   adding 'colossalai/fx/profiler/profiler.py'
2023-11-01T06:49:53,121   adding 'colossalai/fx/profiler/shard_utils.py'
2023-11-01T06:49:53,123   adding 'colossalai/fx/profiler/tensor.py'
2023-11-01T06:49:53,125   adding 'colossalai/fx/profiler/experimental/__init__.py'
2023-11-01T06:49:53,126   adding 'colossalai/fx/profiler/experimental/constants.py'
2023-11-01T06:49:53,127   adding 'colossalai/fx/profiler/experimental/profiler.py'
2023-11-01T06:49:53,129   adding 'colossalai/fx/profiler/experimental/registry.py'
2023-11-01T06:49:53,130   adding 'colossalai/fx/profiler/experimental/shard_utils.py'
2023-11-01T06:49:53,132   adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py'
2023-11-01T06:49:53,133   adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py'
2023-11-01T06:49:53,134   adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py'
2023-11-01T06:49:53,136   adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py'
2023-11-01T06:49:53,137   adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py'
2023-11-01T06:49:53,138   adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py'
2023-11-01T06:49:53,139   adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py'
2023-11-01T06:49:53,140   adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py'
2023-11-01T06:49:53,142   adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py'
2023-11-01T06:49:53,144   adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py'
2023-11-01T06:49:53,145   adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py'
2023-11-01T06:49:53,146   adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py'
2023-11-01T06:49:53,148   adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py'
2023-11-01T06:49:53,149   adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py'
2023-11-01T06:49:53,150   adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py'
2023-11-01T06:49:53,152   adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py'
2023-11-01T06:49:53,153   adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py'
2023-11-01T06:49:53,154   adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py'
2023-11-01T06:49:53,155   adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py'
2023-11-01T06:49:53,157   adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py'
2023-11-01T06:49:53,158   adding 'colossalai/fx/tracer/__init__.py'
2023-11-01T06:49:53,160   adding 'colossalai/fx/tracer/_meta_trace.py'
2023-11-01T06:49:53,161   adding 'colossalai/fx/tracer/_symbolic_trace.py'
2023-11-01T06:49:53,162   adding 'colossalai/fx/tracer/_tracer_utils.py'
2023-11-01T06:49:53,165   adding 'colossalai/fx/tracer/experimental.py'
2023-11-01T06:49:53,167   adding 'colossalai/fx/tracer/registry.py'
2023-11-01T06:49:53,170   adding 'colossalai/fx/tracer/tracer.py'
2023-11-01T06:49:53,172   adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py'
2023-11-01T06:49:53,173   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py'
2023-11-01T06:49:53,174   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py'
2023-11-01T06:49:53,176   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py'
2023-11-01T06:49:53,177   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py'
2023-11-01T06:49:53,178   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py'
2023-11-01T06:49:53,180   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py'
2023-11-01T06:49:53,182   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py'
2023-11-01T06:49:53,183   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py'
2023-11-01T06:49:53,184   adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py'
2023-11-01T06:49:53,186   adding 'colossalai/fx/tracer/meta_patch/__init__.py'
2023-11-01T06:49:53,187   adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py'
2023-11-01T06:49:53,189   adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py'
2023-11-01T06:49:53,190   adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py'
2023-11-01T06:49:53,191   adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py'
2023-11-01T06:49:53,193   adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py'
2023-11-01T06:49:53,194   adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py'
2023-11-01T06:49:53,195   adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py'
2023-11-01T06:49:53,197   adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py'
2023-11-01T06:49:53,198   adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py'
2023-11-01T06:49:53,200   adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py'
2023-11-01T06:49:53,201   adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py'
2023-11-01T06:49:53,202   adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py'
2023-11-01T06:49:53,204   adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py'
2023-11-01T06:49:53,205   adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py'
2023-11-01T06:49:53,206   adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py'
2023-11-01T06:49:53,207   adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py'
2023-11-01T06:49:53,209   adding 'colossalai/inference/__init__.py'
2023-11-01T06:49:53,211   adding 'colossalai/inference/async_engine.py'
2023-11-01T06:49:53,212   adding 'colossalai/inference/async_manager.py'
2023-11-01T06:49:53,214   adding 'colossalai/inference/manager.py'
2023-11-01T06:49:53,216   adding 'colossalai/inference/dynamic_batching/__init__.py'
2023-11-01T06:49:53,217   adding 'colossalai/inference/dynamic_batching/get_tokenizer.py'
2023-11-01T06:49:53,219   adding 'colossalai/inference/dynamic_batching/infer_batch.py'
2023-11-01T06:49:53,221   adding 'colossalai/inference/dynamic_batching/io_struct.py'
2023-11-01T06:49:53,222   adding 'colossalai/inference/dynamic_batching/ray_dist_init.py'
2023-11-01T06:49:53,224   adding 'colossalai/inference/dynamic_batching/ray_init_config.py'
2023-11-01T06:49:53,225   adding 'colossalai/inference/dynamic_batching/req_queue.py'
2023-11-01T06:49:53,226   adding 'colossalai/inference/dynamic_batching/sampling_params.py'
2023-11-01T06:49:53,227   adding 'colossalai/inference/dynamic_batching/stats.py'
2023-11-01T06:49:53,229   adding 'colossalai/inference/hybridengine/__init__.py'
2023-11-01T06:49:53,230   adding 'colossalai/inference/hybridengine/engine.py'
2023-11-01T06:49:53,232   adding 'colossalai/inference/hybridengine/modeling/__init__.py'
2023-11-01T06:49:53,233   adding 'colossalai/inference/hybridengine/modeling/_utils.py'
2023-11-01T06:49:53,236   adding 'colossalai/inference/hybridengine/modeling/llama.py'
2023-11-01T06:49:53,237   adding 'colossalai/inference/hybridengine/polices/__init__.py'
2023-11-01T06:49:53,239   adding 'colossalai/inference/hybridengine/polices/llama.py'
2023-11-01T06:49:53,240   adding 'colossalai/inference/pipeline/__init__.py'
2023-11-01T06:49:53,242   adding 'colossalai/inference/pipeline/microbatch_manager.py'
2023-11-01T06:49:53,244   adding 'colossalai/inference/tensor_parallel/__init__.py'
2023-11-01T06:49:53,245   adding 'colossalai/inference/tensor_parallel/batch_infer_state.py'
2023-11-01T06:49:53,248   adding 'colossalai/inference/tensor_parallel/engine.py'
2023-11-01T06:49:53,249   adding 'colossalai/inference/tensor_parallel/kvcache_manager.py'
2023-11-01T06:49:53,251   adding 'colossalai/inference/tensor_parallel/modeling/__init__.py'
2023-11-01T06:49:53,252   adding 'colossalai/inference/tensor_parallel/modeling/_utils.py'
2023-11-01T06:49:53,255   adding 'colossalai/inference/tensor_parallel/modeling/bloom.py'
2023-11-01T06:49:53,257   adding 'colossalai/inference/tensor_parallel/modeling/chatglm2.py'
2023-11-01T06:49:53,260   adding 'colossalai/inference/tensor_parallel/modeling/llama.py'
2023-11-01T06:49:53,261   adding 'colossalai/inference/tensor_parallel/policies/__init__.py'
2023-11-01T06:49:53,263   adding 'colossalai/inference/tensor_parallel/policies/bloom.py'
2023-11-01T06:49:53,264   adding 'colossalai/inference/tensor_parallel/policies/chatglm2.py'
2023-11-01T06:49:53,265   adding 'colossalai/inference/tensor_parallel/policies/llama.py'
2023-11-01T06:49:53,267   adding 'colossalai/interface/__init__.py'
2023-11-01T06:49:53,268   adding 'colossalai/interface/model.py'
2023-11-01T06:49:53,270   adding 'colossalai/interface/optimizer.py'
2023-11-01T06:49:53,271   adding 'colossalai/interface/pretrained.py'
2023-11-01T06:49:53,273   adding 'colossalai/kernel/__init__.py'
2023-11-01T06:49:53,274   adding 'colossalai/kernel/cuda_native/__init__.py'
2023-11-01T06:49:53,276   adding 'colossalai/kernel/cuda_native/layer_norm.py'
2023-11-01T06:49:53,277   adding 'colossalai/kernel/cuda_native/multihead_attention.py'
2023-11-01T06:49:53,279   adding 'colossalai/kernel/cuda_native/scaled_softmax.py'
2023-11-01T06:49:53,281   adding 'colossalai/kernel/cuda_native/csrc/colossal_C_frontend.cpp'
2023-11-01T06:49:53,282   adding 'colossalai/kernel/cuda_native/csrc/compat.h'
2023-11-01T06:49:53,284   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.cpp'
2023-11-01T06:49:53,286   adding 'colossalai/kernel/cuda_native/csrc/cpu_adam.h'
2023-11-01T06:49:53,287   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp'
2023-11-01T06:49:53,290   adding 'colossalai/kernel/cuda_native/csrc/layer_norm_cuda_kernel.cu'
2023-11-01T06:49:53,292   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda.cpp'
2023-11-01T06:49:53,294   adding 'colossalai/kernel/cuda_native/csrc/moe_cuda_kernel.cu'
2023-11-01T06:49:53,296   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu'
2023-11-01T06:49:53,297   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_apply.cuh'
2023-11-01T06:49:53,299   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_l2norm_kernel.cu'
2023-11-01T06:49:53,301   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu'
2023-11-01T06:49:53,303   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_scale_kernel.cu'
2023-11-01T06:49:53,305   adding 'colossalai/kernel/cuda_native/csrc/multi_tensor_sgd_kernel.cu'
2023-11-01T06:49:53,307   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.cpp'
2023-11-01T06:49:53,309   adding 'colossalai/kernel/cuda_native/csrc/multihead_attention_1d.h'
2023-11-01T06:49:53,310   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.cpp'
2023-11-01T06:49:53,312   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax.h'
2023-11-01T06:49:53,313   adding 'colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu'
2023-11-01T06:49:53,314   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp'
2023-11-01T06:49:53,316   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.h'
2023-11-01T06:49:53,318   adding 'colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu'
2023-11-01T06:49:53,319   adding 'colossalai/kernel/cuda_native/csrc/type_shim.h'
2023-11-01T06:49:53,322   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/block_reduce.h'
2023-11-01T06:49:53,323   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/context.h'
2023-11-01T06:49:53,324   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h'
2023-11-01T06:49:53,326   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cublas_wrappers.h'
2023-11-01T06:49:53,327   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/cuda_util.h'
2023-11-01T06:49:53,328   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/dropout.h'
2023-11-01T06:49:53,329   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/feed_forward.h'
2023-11-01T06:49:53,331   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/kernels.h'
2023-11-01T06:49:53,333   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/ls_cub.cuh'
2023-11-01T06:49:53,334   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/normalize_layer.h'
2023-11-01T06:49:53,335   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/softmax.h'
2023-11-01T06:49:53,336   adding 'colossalai/kernel/cuda_native/csrc/kernels/include/strided_batch_gemm.h'
2023-11-01T06:49:53,338   adding 'colossalai/kernel/cuda_native/mha/__init__.py'
2023-11-01T06:49:53,339   adding 'colossalai/kernel/cuda_native/mha/flash_attn_2.py'
2023-11-01T06:49:53,341   adding 'colossalai/kernel/cuda_native/mha/mem_eff_attn.py'
2023-11-01T06:49:53,342   adding 'colossalai/kernel/cuda_native/mha/mha.py'
2023-11-01T06:49:53,343   adding 'colossalai/kernel/cuda_native/mha/utils.py'
2023-11-01T06:49:53,345   adding 'colossalai/kernel/jit/__init__.py'
2023-11-01T06:49:53,346   adding 'colossalai/kernel/jit/bias_dropout_add.py'
2023-11-01T06:49:53,348   adding 'colossalai/kernel/jit/bias_gelu.py'
2023-11-01T06:49:53,349   adding 'colossalai/kernel/jit/option.py'
2023-11-01T06:49:53,351   adding 'colossalai/kernel/op_builder/__init__.py'
2023-11-01T06:49:53,353   adding 'colossalai/kernel/op_builder/builder.py'
2023-11-01T06:49:53,354   adding 'colossalai/kernel/op_builder/cpu_adam.py'
2023-11-01T06:49:53,355   adding 'colossalai/kernel/op_builder/fused_optim.py'
2023-11-01T06:49:53,356   adding 'colossalai/kernel/op_builder/gptq.py'
2023-11-01T06:49:53,358   adding 'colossalai/kernel/op_builder/layernorm.py'
2023-11-01T06:49:53,359   adding 'colossalai/kernel/op_builder/moe.py'
2023-11-01T06:49:53,360   adding 'colossalai/kernel/op_builder/multi_head_attn.py'
2023-11-01T06:49:53,361   adding 'colossalai/kernel/op_builder/scaled_masked_softmax.py'
2023-11-01T06:49:53,362   adding 'colossalai/kernel/op_builder/scaled_upper_triangle_masked_softmax.py'
2023-11-01T06:49:53,364   adding 'colossalai/kernel/op_builder/smoothquant.py'
2023-11-01T06:49:53,365   adding 'colossalai/kernel/op_builder/utils.py'
2023-11-01T06:49:53,367   adding 'colossalai/kernel/triton/__init__.py'
2023-11-01T06:49:53,369   adding 'colossalai/kernel/triton/context_attention.py'
2023-11-01T06:49:53,370   adding 'colossalai/kernel/triton/copy_kv_cache_dest.py'
2023-11-01T06:49:53,372   adding 'colossalai/kernel/triton/custom_autotune.py'
2023-11-01T06:49:53,373   adding 'colossalai/kernel/triton/fused_layernorm.py'
2023-11-01T06:49:53,375   adding 'colossalai/kernel/triton/gptq_triton.py'
2023-11-01T06:49:53,377   adding 'colossalai/kernel/triton/int8_rotary_embedding_kernel.py'
2023-11-01T06:49:53,378   adding 'colossalai/kernel/triton/qkv_matmul_kernel.py'
2023-11-01T06:49:53,380   adding 'colossalai/kernel/triton/self_attention_nofusion.py'
2023-11-01T06:49:53,382   adding 'colossalai/kernel/triton/smooth_attention.py'
2023-11-01T06:49:53,383   adding 'colossalai/kernel/triton/softmax.py'
2023-11-01T06:49:53,385   adding 'colossalai/kernel/triton/token_attention_kernel.py'
2023-11-01T06:49:53,386   adding 'colossalai/lazy/__init__.py'
2023-11-01T06:49:53,387   adding 'colossalai/lazy/construction.py'
2023-11-01T06:49:53,390   adding 'colossalai/lazy/lazy_init.py'
2023-11-01T06:49:53,393   adding 'colossalai/lazy/pretrained.py'
2023-11-01T06:49:53,394   adding 'colossalai/legacy/__init__.py'
2023-11-01T06:49:53,395   adding 'colossalai/legacy/constants.py'
2023-11-01T06:49:53,397   adding 'colossalai/legacy/core.py'
2023-11-01T06:49:53,398   adding 'colossalai/legacy/global_variables.py'
2023-11-01T06:49:53,400   adding 'colossalai/legacy/initialize.py'
2023-11-01T06:49:53,402   adding 'colossalai/legacy/amp/__init__.py'
2023-11-01T06:49:53,404   adding 'colossalai/legacy/amp/amp_type.py'
2023-11-01T06:49:53,405   adding 'colossalai/legacy/amp/apex_amp/__init__.py'
2023-11-01T06:49:53,407   adding 'colossalai/legacy/amp/apex_amp/apex_amp.py'
2023-11-01T06:49:53,408   adding 'colossalai/legacy/amp/naive_amp/__init__.py'
2023-11-01T06:49:53,410   adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py'
2023-11-01T06:49:53,412   adding 'colossalai/legacy/amp/naive_amp/_utils.py'
2023-11-01T06:49:53,413   adding 'colossalai/legacy/amp/naive_amp/naive_amp.py'
2023-11-01T06:49:53,415   adding 'colossalai/legacy/amp/torch_amp/__init__.py'
2023-11-01T06:49:53,419   adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py'
2023-11-01T06:49:53,420   adding 'colossalai/legacy/amp/torch_amp/torch_amp.py'
2023-11-01T06:49:53,422   adding 'colossalai/legacy/builder/__init__.py'
2023-11-01T06:49:53,423   adding 'colossalai/legacy/builder/builder.py'
2023-11-01T06:49:53,425   adding 'colossalai/legacy/communication/__init__.py'
2023-11-01T06:49:53,427   adding 'colossalai/legacy/communication/collective.py'
2023-11-01T06:49:53,429   adding 'colossalai/legacy/communication/p2p.py'
2023-11-01T06:49:53,431   adding 'colossalai/legacy/communication/p2p_v2.py'
2023-11-01T06:49:53,432   adding 'colossalai/legacy/communication/ring.py'
2023-11-01T06:49:53,433   adding 'colossalai/legacy/communication/utils.py'
2023-11-01T06:49:53,435   adding 'colossalai/legacy/context/__init__.py'
2023-11-01T06:49:53,438   adding 'colossalai/legacy/context/parallel_context.py'
2023-11-01T06:49:53,439   adding 'colossalai/legacy/context/parallel_mode.py'
2023-11-01T06:49:53,441   adding 'colossalai/legacy/context/process_group_initializer/__init__.py'
2023-11-01T06:49:53,442   adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py'
2023-11-01T06:49:53,444   adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py'
2023-11-01T06:49:53,445   adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py'
2023-11-01T06:49:53,447   adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py'
2023-11-01T06:49:53,449   adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py'
2023-11-01T06:49:53,450   adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py'
2023-11-01T06:49:53,452   adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py'
2023-11-01T06:49:53,453   adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py'
2023-11-01T06:49:53,455   adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py'
2023-11-01T06:49:53,456   adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py'
2023-11-01T06:49:53,458   adding 'colossalai/legacy/context/random/__init__.py'
2023-11-01T06:49:53,459   adding 'colossalai/legacy/context/random/_helper.py'
2023-11-01T06:49:53,460   adding 'colossalai/legacy/context/random/seed_manager.py'
2023-11-01T06:49:53,462   adding 'colossalai/legacy/engine/__init__.py'
2023-11-01T06:49:53,464   adding 'colossalai/legacy/engine/_base_engine.py'
2023-11-01T06:49:53,465   adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py'
2023-11-01T06:49:53,467   adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py'
2023-11-01T06:49:53,469   adding 'colossalai/legacy/engine/gradient_handler/__init__.py'
2023-11-01T06:49:53,470   adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py'
2023-11-01T06:49:53,471   adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py'
2023-11-01T06:49:53,472   adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py'
2023-11-01T06:49:53,474   adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py'
2023-11-01T06:49:53,475   adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py'
2023-11-01T06:49:53,476   adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py'
2023-11-01T06:49:53,477   adding 'colossalai/legacy/engine/gradient_handler/utils.py'
2023-11-01T06:49:53,479   adding 'colossalai/legacy/engine/schedule/__init__.py'
2023-11-01T06:49:53,481   adding 'colossalai/legacy/engine/schedule/_base_schedule.py'
2023-11-01T06:49:53,482   adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py'
2023-11-01T06:49:53,486   adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py'
2023-11-01T06:49:53,488   adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py'
2023-11-01T06:49:53,489   adding 'colossalai/legacy/nn/__init__.py'
2023-11-01T06:49:53,491   adding 'colossalai/legacy/nn/_ops/__init__.py'
2023-11-01T06:49:53,493   adding 'colossalai/legacy/nn/_ops/_utils.py'
2023-11-01T06:49:53,494   adding 'colossalai/legacy/nn/layer/__init__.py'
2023-11-01T06:49:53,496   adding 'colossalai/legacy/nn/layer/base_layer.py'
2023-11-01T06:49:53,498   adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py'
2023-11-01T06:49:53,499   adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py'
2023-11-01T06:49:53,500   adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py'
2023-11-01T06:49:53,501   adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py'
2023-11-01T06:49:53,503   adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py'
2023-11-01T06:49:53,504   adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py'
2023-11-01T06:49:53,506   adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py'
2023-11-01T06:49:53,507   adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py'
2023-11-01T06:49:53,509   adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py'
2023-11-01T06:49:53,512   adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py'
2023-11-01T06:49:53,515   adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py'
2023-11-01T06:49:53,517   adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py'
2023-11-01T06:49:53,519   adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py'
2023-11-01T06:49:53,523   adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py'
2023-11-01T06:49:53,525   adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py'
2023-11-01T06:49:53,528   adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py'
2023-11-01T06:49:53,529   adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py'
2023-11-01T06:49:53,533   adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py'
2023-11-01T06:49:53,535   adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py'
2023-11-01T06:49:53,537   adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py'
2023-11-01T06:49:53,539   adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py'
2023-11-01T06:49:53,542   adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py'
2023-11-01T06:49:53,544   adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py'
2023-11-01T06:49:53,545   adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py'
2023-11-01T06:49:53,546   adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py'
2023-11-01T06:49:53,548   adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py'
2023-11-01T06:49:53,550   adding 'colossalai/legacy/nn/layer/utils/__init__.py'
2023-11-01T06:49:53,551   adding 'colossalai/legacy/nn/layer/utils/common.py'
2023-11-01T06:49:53,553   adding 'colossalai/legacy/nn/layer/vanilla/__init__.py'
2023-11-01T06:49:53,555   adding 'colossalai/legacy/nn/layer/vanilla/layers.py'
2023-11-01T06:49:53,557   adding 'colossalai/legacy/nn/layer/wrapper/__init__.py'
2023-11-01T06:49:53,558   adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py'
2023-11-01T06:49:53,560   adding 'colossalai/legacy/nn/loss/__init__.py'
2023-11-01T06:49:53,561   adding 'colossalai/legacy/nn/loss/loss_1d.py'
2023-11-01T06:49:53,563   adding 'colossalai/legacy/nn/loss/loss_2d.py'
2023-11-01T06:49:53,564   adding 'colossalai/legacy/nn/loss/loss_2p5d.py'
2023-11-01T06:49:53,566   adding 'colossalai/legacy/nn/loss/loss_3d.py'
2023-11-01T06:49:53,567   adding 'colossalai/legacy/nn/metric/__init__.py'
2023-11-01T06:49:53,568   adding 'colossalai/legacy/nn/metric/_utils.py'
2023-11-01T06:49:53,570   adding 'colossalai/legacy/nn/metric/accuracy_2d.py'
2023-11-01T06:49:53,571   adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py'
2023-11-01T06:49:53,572   adding 'colossalai/legacy/nn/metric/accuracy_3d.py'
2023-11-01T06:49:53,574   adding 'colossalai/legacy/nn/parallel/__init__.py'
2023-11-01T06:49:53,575   adding 'colossalai/legacy/nn/parallel/data_parallel.py'
2023-11-01T06:49:53,577   adding 'colossalai/legacy/nn/parallel/reducer.py'
2023-11-01T06:49:53,578   adding 'colossalai/legacy/nn/parallel/layers/__init__.py'
2023-11-01T06:49:53,579   adding 'colossalai/legacy/nn/parallel/layers/colo_module.py'
2023-11-01T06:49:53,581   adding 'colossalai/legacy/nn/parallel/layers/embedding.py'
2023-11-01T06:49:53,582   adding 'colossalai/legacy/nn/parallel/layers/linear.py'
2023-11-01T06:49:53,583   adding 'colossalai/legacy/nn/parallel/layers/module_utils.py'
2023-11-01T06:49:53,585   adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py'
2023-11-01T06:49:53,586   adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py'
2023-11-01T06:49:53,589   adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py'
2023-11-01T06:49:53,591   adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py'
2023-11-01T06:49:53,592   adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py'
2023-11-01T06:49:53,594   adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py'
2023-11-01T06:49:53,595   adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py'
2023-11-01T06:49:53,597   adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py'
2023-11-01T06:49:53,599   adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py'
2023-11-01T06:49:53,600   adding 'colossalai/legacy/pipeline/__init__.py'
2023-11-01T06:49:53,602   adding 'colossalai/legacy/pipeline/layer_spec.py'
2023-11-01T06:49:53,604   adding 'colossalai/legacy/pipeline/pipelinable.py'
2023-11-01T06:49:53,606   adding 'colossalai/legacy/pipeline/pipeline_process_group.py'
2023-11-01T06:49:53,608   adding 'colossalai/legacy/pipeline/utils.py'
2023-11-01T06:49:53,609   adding 'colossalai/legacy/pipeline/middleware/__init__.py'
2023-11-01T06:49:53,611   adding 'colossalai/legacy/pipeline/middleware/topo.py'
2023-11-01T06:49:53,613   adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py'
2023-11-01T06:49:53,614   adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py'
2023-11-01T06:49:53,616   adding 'colossalai/legacy/pipeline/rpc/__init__.py'
2023-11-01T06:49:53,622   adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py'
2023-11-01T06:49:53,624   adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py'
2023-11-01T06:49:53,626   adding 'colossalai/legacy/pipeline/rpc/utils.py'
2023-11-01T06:49:53,627   adding 'colossalai/legacy/registry/__init__.py'
2023-11-01T06:49:53,629   adding 'colossalai/legacy/registry/registry.py'
2023-11-01T06:49:53,630   adding 'colossalai/legacy/tensor/__init__.py'
2023-11-01T06:49:53,631   adding 'colossalai/legacy/tensor/compute_spec.py'
2023-11-01T06:49:53,632   adding 'colossalai/legacy/tensor/const.py'
2023-11-01T06:49:53,634   adding 'colossalai/legacy/tensor/dist_spec_mgr.py'
2023-11-01T06:49:53,635   adding 'colossalai/legacy/tensor/distspec.py'
2023-11-01T06:49:53,636   adding 'colossalai/legacy/tensor/op_wrapper.py'
2023-11-01T06:49:53,638   adding 'colossalai/legacy/tensor/process_group.py'
2023-11-01T06:49:53,639   adding 'colossalai/legacy/tensor/tensor_spec.py'
2023-11-01T06:49:53,641   adding 'colossalai/legacy/trainer/__init__.py'
2023-11-01T06:49:53,643   adding 'colossalai/legacy/trainer/_trainer.py'
2023-11-01T06:49:53,645   adding 'colossalai/legacy/trainer/hooks/__init__.py'
2023-11-01T06:49:53,646   adding 'colossalai/legacy/trainer/hooks/_base_hook.py'
2023-11-01T06:49:53,647   adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py'
2023-11-01T06:49:53,648   adding 'colossalai/legacy/trainer/hooks/_commons_.py'
2023-11-01T06:49:53,650   adding 'colossalai/legacy/trainer/hooks/_log_hook.py'
2023-11-01T06:49:53,651   adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py'
2023-11-01T06:49:53,653   adding 'colossalai/legacy/trainer/hooks/_metric_hook.py'
2023-11-01T06:49:53,655   adding 'colossalai/legacy/utils/__init__.py'
2023-11-01T06:49:53,657   adding 'colossalai/legacy/utils/activation_checkpoint.py'
2023-11-01T06:49:53,659   adding 'colossalai/legacy/utils/checkpointing.py'
2023-11-01T06:49:53,661   adding 'colossalai/legacy/utils/common.py'
2023-11-01T06:49:53,663   adding 'colossalai/legacy/utils/memory.py'
2023-11-01T06:49:53,664   adding 'colossalai/legacy/utils/checkpoint/__init__.py'
2023-11-01T06:49:53,666   adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py'
2023-11-01T06:49:53,667   adding 'colossalai/legacy/utils/checkpoint/utils.py'
2023-11-01T06:49:53,669   adding 'colossalai/legacy/utils/data_sampler/__init__.py'
2023-11-01T06:49:53,670   adding 'colossalai/legacy/utils/data_sampler/base_sampler.py'
2023-11-01T06:49:53,672   adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py'
2023-11-01T06:49:53,673   adding 'colossalai/legacy/utils/profiler/__init__.py'
2023-11-01T06:49:53,675   adding 'colossalai/legacy/utils/profiler/extention.py'
2023-11-01T06:49:53,676   adding 'colossalai/legacy/utils/profiler/profiler.py'
2023-11-01T06:49:53,678   adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py'
2023-11-01T06:49:53,679   adding 'colossalai/legacy/utils/profiler/legacy/__init__.py'
2023-11-01T06:49:53,681   adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py'
2023-11-01T06:49:53,683   adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py'
2023-11-01T06:49:53,684   adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py'
2023-11-01T06:49:53,686   adding 'colossalai/legacy/zero/__init__.py'
2023-11-01T06:49:53,688   adding 'colossalai/legacy/zero/gemini/__init__.py'
2023-11-01T06:49:53,689   adding 'colossalai/legacy/zero/gemini/gemini_context.py'
2023-11-01T06:49:53,690   adding 'colossalai/legacy/zero/gemini/stateful_tensor.py'
2023-11-01T06:49:53,692   adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py'
2023-11-01T06:49:53,693   adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py'
2023-11-01T06:49:53,695   adding 'colossalai/legacy/zero/gemini/tensor_utils.py'
2023-11-01T06:49:53,696   adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py'
2023-11-01T06:49:53,698   adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py'
2023-11-01T06:49:53,699   adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py'
2023-11-01T06:49:53,700   adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py'
2023-11-01T06:49:53,702   adding 'colossalai/legacy/zero/gemini/ophooks/utils.py'
2023-11-01T06:49:53,703   adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py'
2023-11-01T06:49:53,704   adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py'
2023-11-01T06:49:53,706   adding 'colossalai/legacy/zero/init_ctx/__init__.py'
2023-11-01T06:49:53,708   adding 'colossalai/legacy/zero/init_ctx/init_context.py'
2023-11-01T06:49:53,709   adding 'colossalai/legacy/zero/shard_utils/__init__.py'
2023-11-01T06:49:53,710   adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py'
2023-11-01T06:49:53,712   adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py'
2023-11-01T06:49:53,713   adding 'colossalai/legacy/zero/shard_utils/commons.py'
2023-11-01T06:49:53,714   adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py'
2023-11-01T06:49:53,716   adding 'colossalai/legacy/zero/sharded_model/__init__.py'
2023-11-01T06:49:53,717   adding 'colossalai/legacy/zero/sharded_model/_utils.py'
2023-11-01T06:49:53,719   adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py'
2023-11-01T06:49:53,722   adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py'
2023-11-01T06:49:53,723   adding 'colossalai/legacy/zero/sharded_model/utils.py'
2023-11-01T06:49:53,725   adding 'colossalai/legacy/zero/sharded_model/zero_hook.py'
2023-11-01T06:49:53,726   adding 'colossalai/legacy/zero/sharded_optim/__init__.py'
2023-11-01T06:49:53,729   adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py'
2023-11-01T06:49:53,730   adding 'colossalai/legacy/zero/sharded_param/__init__.py'
2023-11-01T06:49:53,732   adding 'colossalai/legacy/zero/sharded_param/sharded_param.py'
2023-11-01T06:49:53,733   adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py'
2023-11-01T06:49:53,735   adding 'colossalai/logging/__init__.py'
2023-11-01T06:49:53,736   adding 'colossalai/logging/logger.py'
2023-11-01T06:49:53,738   adding 'colossalai/nn/__init__.py'
2023-11-01T06:49:53,739   adding 'colossalai/nn/init.py'
2023-11-01T06:49:53,741   adding 'colossalai/nn/layer/__init__.py'
2023-11-01T06:49:53,742   adding 'colossalai/nn/layer/utils.py'
2023-11-01T06:49:53,744   adding 'colossalai/nn/layer/moe/__init__.py'
2023-11-01T06:49:53,745   adding 'colossalai/nn/layer/moe/_operation.py'
2023-11-01T06:49:53,747   adding 'colossalai/nn/layer/moe/checkpoint.py'
2023-11-01T06:49:53,748   adding 'colossalai/nn/layer/moe/experts.py'
2023-11-01T06:49:53,750   adding 'colossalai/nn/layer/moe/layers.py'
2023-11-01T06:49:53,752   adding 'colossalai/nn/layer/moe/routers.py'
2023-11-01T06:49:53,753   adding 'colossalai/nn/layer/moe/utils.py'
2023-11-01T06:49:53,755   adding 'colossalai/nn/loss/__init__.py'
2023-11-01T06:49:53,756   adding 'colossalai/nn/loss/loss_moe.py'
2023-11-01T06:49:53,758   adding 'colossalai/nn/lr_scheduler/__init__.py'
2023-11-01T06:49:53,759   adding 'colossalai/nn/lr_scheduler/cosine.py'
2023-11-01T06:49:53,761   adding 'colossalai/nn/lr_scheduler/delayed.py'
2023-11-01T06:49:53,762   adding 'colossalai/nn/lr_scheduler/linear.py'
2023-11-01T06:49:53,763   adding 'colossalai/nn/lr_scheduler/multistep.py'
2023-11-01T06:49:53,765   adding 'colossalai/nn/lr_scheduler/onecycle.py'
2023-11-01T06:49:53,766   adding 'colossalai/nn/lr_scheduler/poly.py'
2023-11-01T06:49:53,767   adding 'colossalai/nn/lr_scheduler/torch.py'
2023-11-01T06:49:53,769   adding 'colossalai/nn/optimizer/__init__.py'
2023-11-01T06:49:53,771   adding 'colossalai/nn/optimizer/cpu_adam.py'
2023-11-01T06:49:53,772   adding 'colossalai/nn/optimizer/fused_adam.py'
2023-11-01T06:49:53,774   adding 'colossalai/nn/optimizer/fused_lamb.py'
2023-11-01T06:49:53,775   adding 'colossalai/nn/optimizer/fused_sgd.py'
2023-11-01T06:49:53,777   adding 'colossalai/nn/optimizer/hybrid_adam.py'
2023-11-01T06:49:53,779   adding 'colossalai/nn/optimizer/lamb.py'
2023-11-01T06:49:53,780   adding 'colossalai/nn/optimizer/lars.py'
2023-11-01T06:49:53,781   adding 'colossalai/nn/optimizer/nvme_optimizer.py'
2023-11-01T06:49:53,783   adding 'colossalai/pipeline/__init__.py'
2023-11-01T06:49:53,785   adding 'colossalai/pipeline/p2p.py'
2023-11-01T06:49:53,786   adding 'colossalai/pipeline/stage_manager.py'
2023-11-01T06:49:53,788   adding 'colossalai/pipeline/schedule/__init__.py'
2023-11-01T06:49:53,789   adding 'colossalai/pipeline/schedule/_utils.py'
2023-11-01T06:49:53,790   adding 'colossalai/pipeline/schedule/base.py'
2023-11-01T06:49:53,792   adding 'colossalai/pipeline/schedule/generate.py'
2023-11-01T06:49:53,794   adding 'colossalai/pipeline/schedule/interleaved_pp.py'
2023-11-01T06:49:53,796   adding 'colossalai/pipeline/schedule/one_f_one_b.py'
2023-11-01T06:49:53,798   adding 'colossalai/shardformer/__init__.py'
2023-11-01T06:49:53,799   adding 'colossalai/shardformer/_utils.py'
2023-11-01T06:49:53,801   adding 'colossalai/shardformer/layer/__init__.py'
2023-11-01T06:49:53,803   adding 'colossalai/shardformer/layer/_operation.py'
2023-11-01T06:49:53,804   adding 'colossalai/shardformer/layer/dropout.py'
2023-11-01T06:49:53,806   adding 'colossalai/shardformer/layer/embedding.py'
2023-11-01T06:49:53,808   adding 'colossalai/shardformer/layer/linear.py'
2023-11-01T06:49:53,810   adding 'colossalai/shardformer/layer/loss.py'
2023-11-01T06:49:53,811   adding 'colossalai/shardformer/layer/normalization.py'
2023-11-01T06:49:53,813   adding 'colossalai/shardformer/layer/parallel_module.py'
2023-11-01T06:49:53,815   adding 'colossalai/shardformer/layer/qkv_fused_linear.py'
2023-11-01T06:49:53,817   adding 'colossalai/shardformer/layer/utils.py'
2023-11-01T06:49:53,819   adding 'colossalai/shardformer/modeling/__init__.py'
2023-11-01T06:49:53,824   adding 'colossalai/shardformer/modeling/bert.py'
2023-11-01T06:49:53,825   adding 'colossalai/shardformer/modeling/blip2.py'
2023-11-01T06:49:53,830   adding 'colossalai/shardformer/modeling/bloom.py'
2023-11-01T06:49:53,832   adding 'colossalai/shardformer/modeling/chatglm2.py'
2023-11-01T06:49:53,837   adding 'colossalai/shardformer/modeling/gpt2.py'
2023-11-01T06:49:53,838   adding 'colossalai/shardformer/modeling/jit.py'
2023-11-01T06:49:53,841   adding 'colossalai/shardformer/modeling/llama.py'
2023-11-01T06:49:53,844   adding 'colossalai/shardformer/modeling/opt.py'
2023-11-01T06:49:53,846   adding 'colossalai/shardformer/modeling/sam.py'
2023-11-01T06:49:53,849   adding 'colossalai/shardformer/modeling/t5.py'
2023-11-01T06:49:53,851   adding 'colossalai/shardformer/modeling/vit.py'
2023-11-01T06:49:53,856   adding 'colossalai/shardformer/modeling/whisper.py'
2023-11-01T06:49:53,858   adding 'colossalai/shardformer/policies/__init__.py'
2023-11-01T06:49:53,859   adding 'colossalai/shardformer/policies/auto_policy.py'
2023-11-01T06:49:53,861   adding 'colossalai/shardformer/policies/base_policy.py'
2023-11-01T06:49:53,863   adding 'colossalai/shardformer/policies/bert.py'
2023-11-01T06:49:53,865   adding 'colossalai/shardformer/policies/blip2.py'
2023-11-01T06:49:53,867   adding 'colossalai/shardformer/policies/bloom.py'
2023-11-01T06:49:53,869   adding 'colossalai/shardformer/policies/chatglm2.py'
2023-11-01T06:49:53,871   adding 'colossalai/shardformer/policies/gpt2.py'
2023-11-01T06:49:53,873   adding 'colossalai/shardformer/policies/llama.py'
2023-11-01T06:49:53,874   adding 'colossalai/shardformer/policies/opt.py'
2023-11-01T06:49:53,876   adding 'colossalai/shardformer/policies/sam.py'
2023-11-01T06:49:53,878   adding 'colossalai/shardformer/policies/t5.py'
2023-11-01T06:49:53,880   adding 'colossalai/shardformer/policies/vit.py'
2023-11-01T06:49:53,882   adding 'colossalai/shardformer/policies/whisper.py'
2023-11-01T06:49:53,884   adding 'colossalai/shardformer/shard/__init__.py'
2023-11-01T06:49:53,885   adding 'colossalai/shardformer/shard/shard_config.py'
2023-11-01T06:49:53,887   adding 'colossalai/shardformer/shard/sharder.py'
2023-11-01T06:49:53,888   adding 'colossalai/shardformer/shard/shardformer.py'
2023-11-01T06:49:53,890   adding 'colossalai/shardformer/shard/utils.py'
2023-11-01T06:49:53,891   adding 'colossalai/tensor/__init__.py'
2023-11-01T06:49:53,893   adding 'colossalai/tensor/colo_parameter.py'
2023-11-01T06:49:53,894   adding 'colossalai/tensor/colo_tensor.py'
2023-11-01T06:49:53,896   adding 'colossalai/tensor/comm_spec.py'
2023-11-01T06:49:53,898   adding 'colossalai/tensor/param_op_hook.py'
2023-11-01T06:49:53,901   adding 'colossalai/tensor/shape_consistency.py'
2023-11-01T06:49:53,903   adding 'colossalai/tensor/sharding_spec.py'
2023-11-01T06:49:53,905   adding 'colossalai/tensor/utils.py'
2023-11-01T06:49:53,907   adding 'colossalai/tensor/d_tensor/__init__.py'
2023-11-01T06:49:53,909   adding 'colossalai/tensor/d_tensor/api.py'
2023-11-01T06:49:53,910   adding 'colossalai/tensor/d_tensor/comm_spec.py'
2023-11-01T06:49:53,912   adding 'colossalai/tensor/d_tensor/layout.py'
2023-11-01T06:49:53,914   adding 'colossalai/tensor/d_tensor/layout_converter.py'
2023-11-01T06:49:53,916   adding 'colossalai/tensor/d_tensor/misc.py'
2023-11-01T06:49:53,917   adding 'colossalai/tensor/d_tensor/sharding_spec.py'
2023-11-01T06:49:53,919   adding 'colossalai/tensor/d_tensor/utils.py'
2023-11-01T06:49:53,920   adding 'colossalai/testing/__init__.py'
2023-11-01T06:49:53,922   adding 'colossalai/testing/comparison.py'
2023-11-01T06:49:53,923   adding 'colossalai/testing/pytest_wrapper.py'
2023-11-01T06:49:53,924   adding 'colossalai/testing/random.py'
2023-11-01T06:49:53,926   adding 'colossalai/testing/utils.py'
2023-11-01T06:49:53,928   adding 'colossalai/utils/__init__.py'
2023-11-01T06:49:53,929   adding 'colossalai/utils/common.py'
2023-11-01T06:49:53,930   adding 'colossalai/utils/cuda.py'
2023-11-01T06:49:53,931   adding 'colossalai/utils/moe.py'
2023-11-01T06:49:53,933   adding 'colossalai/utils/timer.py'
2023-11-01T06:49:53,934   adding 'colossalai/utils/model/__init__.py'
2023-11-01T06:49:53,936   adding 'colossalai/utils/model/utils.py'
2023-11-01T06:49:53,937   adding 'colossalai/utils/multi_tensor_apply/__init__.py'
2023-11-01T06:49:53,939   adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py'
2023-11-01T06:49:53,940   adding 'colossalai/utils/rank_recorder/__init__.py'
2023-11-01T06:49:53,942   adding 'colossalai/utils/rank_recorder/rank_recorder.py'
2023-11-01T06:49:53,943   adding 'colossalai/utils/tensor_detector/__init__.py'
2023-11-01T06:49:53,945   adding 'colossalai/utils/tensor_detector/tensor_detector.py'
2023-11-01T06:49:53,947   adding 'colossalai/zero/__init__.py'
2023-11-01T06:49:53,948   adding 'colossalai/zero/wrapper.py'
2023-11-01T06:49:53,950   adding 'colossalai/zero/gemini/__init__.py'
2023-11-01T06:49:53,952   adding 'colossalai/zero/gemini/colo_init_context.py'
2023-11-01T06:49:53,956   adding 'colossalai/zero/gemini/gemini_ddp.py'
2023-11-01T06:49:53,958   adding 'colossalai/zero/gemini/gemini_hook.py'
2023-11-01T06:49:53,959   adding 'colossalai/zero/gemini/gemini_mgr.py'
2023-11-01T06:49:53,963   adding 'colossalai/zero/gemini/gemini_optimizer.py'
2023-11-01T06:49:53,965   adding 'colossalai/zero/gemini/placement_policy.py'
2023-11-01T06:49:53,966   adding 'colossalai/zero/gemini/utils.py'
2023-11-01T06:49:53,968   adding 'colossalai/zero/gemini/chunk/__init__.py'
2023-11-01T06:49:53,971   adding 'colossalai/zero/gemini/chunk/chunk.py'
2023-11-01T06:49:53,973   adding 'colossalai/zero/gemini/chunk/manager.py'
2023-11-01T06:49:53,975   adding 'colossalai/zero/gemini/chunk/search_utils.py'
2023-11-01T06:49:53,976   adding 'colossalai/zero/gemini/chunk/utils.py'
2023-11-01T06:49:53,978   adding 'colossalai/zero/gemini/memory_tracer/__init__.py'
2023-11-01T06:49:53,979   adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py'
2023-11-01T06:49:53,981   adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py'
2023-11-01T06:49:53,982   adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py'
2023-11-01T06:49:53,983   adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py'
2023-11-01T06:49:53,985   adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py'
2023-11-01T06:49:53,986   adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py'
2023-11-01T06:49:53,987   adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py'
2023-11-01T06:49:53,988   adding 'colossalai/zero/gemini/memory_tracer/utils.py'
2023-11-01T06:49:53,990   adding 'colossalai/zero/low_level/__init__.py'
2023-11-01T06:49:53,992   adding 'colossalai/zero/low_level/_utils.py'
2023-11-01T06:49:53,995   adding 'colossalai/zero/low_level/low_level_optim.py'
2023-11-01T06:49:53,997   adding 'colossalai/zero/low_level/bookkeeping/__init__.py'
2023-11-01T06:49:53,998   adding 'colossalai/zero/low_level/bookkeeping/base_store.py'
2023-11-01T06:49:53,999   adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py'
2023-11-01T06:49:54,000   adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py'
2023-11-01T06:49:54,002   adding 'colossalai/zero/low_level/bookkeeping/parameter_store.py'
2023-11-01T06:49:54,003   adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py'
2023-11-01T06:49:54,007   adding 'colossalai-0.3.4.dist-info/LICENSE'
2023-11-01T06:49:54,010   adding 'colossalai-0.3.4.dist-info/METADATA'
2023-11-01T06:49:54,011   adding 'colossalai-0.3.4.dist-info/WHEEL'
2023-11-01T06:49:54,012   adding 'colossalai-0.3.4.dist-info/entry_points.txt'
2023-11-01T06:49:54,013   adding 'colossalai-0.3.4.dist-info/top_level.txt'
2023-11-01T06:49:54,026   adding 'colossalai-0.3.4.dist-info/RECORD'
2023-11-01T06:49:54,047   removing build/bdist.linux-armv7l/wheel
2023-11-01T06:49:54,348   Building wheel for colossalai (setup.py): finished with status 'done'
2023-11-01T06:49:54,365   Created wheel for colossalai: filename=colossalai-0.3.4-py3-none-any.whl size=1243172 sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8
2023-11-01T06:49:54,367   Stored in directory: /tmp/pip-ephem-wheel-cache-6dtcli1a/wheels/24/71/9e/93a779fa277422c9e0ed81bd0f02131dc098593b55bfe32433
2023-11-01T06:49:54,402 Successfully built colossalai
2023-11-01T06:49:54,445 Removed build tracker: '/tmp/pip-build-tracker-snoccdhw'