2024-02-08T11:41:53,741 Created temporary directory: /tmp/pip-build-tracker-zs4i8dze 2024-02-08T11:41:53,743 Initialized build tracking at /tmp/pip-build-tracker-zs4i8dze 2024-02-08T11:41:53,743 Created build tracker: /tmp/pip-build-tracker-zs4i8dze 2024-02-08T11:41:53,744 Entered build tracker: /tmp/pip-build-tracker-zs4i8dze 2024-02-08T11:41:53,745 Created temporary directory: /tmp/pip-wheel-vilixoz_ 2024-02-08T11:41:53,748 Created temporary directory: /tmp/pip-ephem-wheel-cache-d6znsanc 2024-02-08T11:41:53,772 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-02-08T11:41:53,776 2 location(s) to search for versions of colossalai: 2024-02-08T11:41:53,776 * https://pypi.org/simple/colossalai/ 2024-02-08T11:41:53,776 * https://www.piwheels.org/simple/colossalai/ 2024-02-08T11:41:53,777 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2024-02-08T11:41:53,777 Getting page https://pypi.org/simple/colossalai/ 2024-02-08T11:41:53,779 Found index url https://pypi.org/simple/ 2024-02-08T11:41:53,994 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2024-02-08T11:41:53,998 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2024-02-08T11:41:53,999 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2024-02-08T11:41:54,000 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2024-02-08T11:41:54,001 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2024-02-08T11:41:54,002 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2024-02-08T11:41:54,003 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2024-02-08T11:41:54,004 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2024-02-08T11:41:54,005 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2024-02-08T11:41:54,006 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2024-02-08T11:41:54,007 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2024-02-08T11:41:54,008 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2024-02-08T11:41:54,009 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2024-02-08T11:41:54,010 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2024-02-08T11:41:54,011 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2024-02-08T11:41:54,012 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2024-02-08T11:41:54,013 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2024-02-08T11:41:54,013 Getting page https://www.piwheels.org/simple/colossalai/ 2024-02-08T11:41:54,014 Found index url https://www.piwheels.org/simple/ 2024-02-08T11:41:54,179 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2024-02-08T11:41:54,184 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,185 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,185 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,186 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,186 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,187 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,188 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,188 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,189 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,189 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,190 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,191 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,191 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,192 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-02-08T11:41:54,192 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2024-02-08T11:41:54,193 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2024-02-08T11:41:54,214 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2024-02-08T11:41:54,234 Collecting colossalai==0.3.5 2024-02-08T11:41:54,236 Created temporary directory: /tmp/pip-unpack-xqjfv_5m 2024-02-08T11:41:54,540 Downloading colossalai-0.3.5.tar.gz (1.1 MB) 2024-02-08T11:41:56,729 Added colossalai==0.3.5 from https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz to build tracker '/tmp/pip-build-tracker-zs4i8dze' 2024-02-08T11:41:56,730 Running setup.py (path:/tmp/pip-wheel-vilixoz_/colossalai_5bb9a49533844d89972f673ea0bc69b5/setup.py) egg_info for package colossalai 2024-02-08T11:41:56,732 Created temporary directory: /tmp/pip-pip-egg-info-btdqz656 2024-02-08T11:41:56,732 Preparing metadata (setup.py): started 2024-02-08T11:41:56,734 Running command python setup.py egg_info 2024-02-08T11:41:57,672 running egg_info 2024-02-08T11:41:57,673 creating /tmp/pip-pip-egg-info-btdqz656/colossalai.egg-info 2024-02-08T11:41:57,699 writing /tmp/pip-pip-egg-info-btdqz656/colossalai.egg-info/PKG-INFO 2024-02-08T11:41:57,703 writing dependency_links to /tmp/pip-pip-egg-info-btdqz656/colossalai.egg-info/dependency_links.txt 2024-02-08T11:41:57,705 writing entry points to /tmp/pip-pip-egg-info-btdqz656/colossalai.egg-info/entry_points.txt 2024-02-08T11:41:57,706 writing requirements to /tmp/pip-pip-egg-info-btdqz656/colossalai.egg-info/requires.txt 2024-02-08T11:41:57,708 writing top-level names to /tmp/pip-pip-egg-info-btdqz656/colossalai.egg-info/top_level.txt 2024-02-08T11:41:57,709 writing manifest file '/tmp/pip-pip-egg-info-btdqz656/colossalai.egg-info/SOURCES.txt' 2024-02-08T11:41:57,966 reading manifest file '/tmp/pip-pip-egg-info-btdqz656/colossalai.egg-info/SOURCES.txt' 2024-02-08T11:41:57,967 reading manifest template 'MANIFEST.in' 2024-02-08T11:41:59,149 warning: no files found matching '*.tr' under directory 'colossalai' 2024-02-08T11:41:59,756 warning: no files found matching '*.cc' under directory 'colossalai' 2024-02-08T11:42:00,065 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-02-08T11:42:00,161 warning: no files found matching '*.tr' under directory 'extensions' 2024-02-08T11:42:00,197 warning: no files found matching '*.cc' under directory 'extensions' 2024-02-08T11:42:00,216 warning: no files found matching '*.pyi' under directory 'extensions' 2024-02-08T11:42:00,216 adding license file 'LICENSE' 2024-02-08T11:42:00,243 writing manifest file '/tmp/pip-pip-egg-info-btdqz656/colossalai.egg-info/SOURCES.txt' 2024-02-08T11:42:00,344 Preparing metadata (setup.py): finished with status 'done' 2024-02-08T11:42:00,350 Source in /tmp/pip-wheel-vilixoz_/colossalai_5bb9a49533844d89972f673ea0bc69b5 has version 0.3.5, which satisfies requirement colossalai==0.3.5 from https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz 2024-02-08T11:42:00,351 Removed colossalai==0.3.5 from https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz from build tracker '/tmp/pip-build-tracker-zs4i8dze' 2024-02-08T11:42:00,360 Created temporary directory: /tmp/pip-unpack-65m7n2qm 2024-02-08T11:42:00,361 Created temporary directory: /tmp/pip-unpack-08_608l8 2024-02-08T11:42:00,381 Building wheels for collected packages: colossalai 2024-02-08T11:42:00,385 Created temporary directory: /tmp/pip-wheel-kn4vhu_g 2024-02-08T11:42:00,386 Building wheel for colossalai (setup.py): started 2024-02-08T11:42:00,387 Destination directory: /tmp/pip-wheel-kn4vhu_g 2024-02-08T11:42:00,387 Running command python setup.py bdist_wheel 2024-02-08T11:42:01,250 running bdist_wheel 2024-02-08T11:42:01,381 running build 2024-02-08T11:42:01,381 running build_py 2024-02-08T11:42:01,409 creating build 2024-02-08T11:42:01,409 creating build/lib 2024-02-08T11:42:01,410 creating build/lib/colossalai 2024-02-08T11:42:01,411 copying colossalai/__init__.py -> build/lib/colossalai 2024-02-08T11:42:01,413 copying colossalai/version.py -> build/lib/colossalai 2024-02-08T11:42:01,414 copying colossalai/initialize.py -> build/lib/colossalai 2024-02-08T11:42:01,417 creating build/lib/extensions 2024-02-08T11:42:01,418 copying extensions/cpp_extension.py -> build/lib/extensions 2024-02-08T11:42:01,420 copying extensions/__init__.py -> build/lib/extensions 2024-02-08T11:42:01,422 copying extensions/cuda_extension.py -> build/lib/extensions 2024-02-08T11:42:01,424 copying extensions/utils.py -> build/lib/extensions 2024-02-08T11:42:01,426 copying extensions/base_extension.py -> build/lib/extensions 2024-02-08T11:42:01,427 copying extensions/triton_extension.py -> build/lib/extensions 2024-02-08T11:42:01,430 creating build/lib/colossalai/checkpoint_io 2024-02-08T11:42:01,431 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2024-02-08T11:42:01,432 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-02-08T11:42:01,435 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-02-08T11:42:01,437 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2024-02-08T11:42:01,440 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2024-02-08T11:42:01,443 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2024-02-08T11:42:01,445 creating build/lib/colossalai/device 2024-02-08T11:42:01,446 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2024-02-08T11:42:01,448 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2024-02-08T11:42:01,450 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2024-02-08T11:42:01,453 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2024-02-08T11:42:01,456 creating build/lib/colossalai/utils 2024-02-08T11:42:01,457 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2024-02-08T11:42:01,458 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2024-02-08T11:42:01,460 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2024-02-08T11:42:01,462 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2024-02-08T11:42:01,464 creating build/lib/colossalai/shardformer 2024-02-08T11:42:01,465 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2024-02-08T11:42:01,467 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2024-02-08T11:42:01,469 creating build/lib/colossalai/testing 2024-02-08T11:42:01,470 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2024-02-08T11:42:01,472 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2024-02-08T11:42:01,473 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2024-02-08T11:42:01,475 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2024-02-08T11:42:01,477 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2024-02-08T11:42:01,480 creating build/lib/colossalai/accelerator 2024-02-08T11:42:01,480 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2024-02-08T11:42:01,482 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2024-02-08T11:42:01,485 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2024-02-08T11:42:01,486 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2024-02-08T11:42:01,489 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2024-02-08T11:42:01,491 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2024-02-08T11:42:01,493 creating build/lib/colossalai/booster 2024-02-08T11:42:01,494 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2024-02-08T11:42:01,496 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2024-02-08T11:42:01,498 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2024-02-08T11:42:01,500 creating build/lib/colossalai/amp 2024-02-08T11:42:01,501 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2024-02-08T11:42:01,503 creating build/lib/colossalai/moe 2024-02-08T11:42:01,504 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2024-02-08T11:42:01,506 copying colossalai/moe/checkpoint.py -> build/lib/colossalai/moe 2024-02-08T11:42:01,509 copying colossalai/moe/utils.py -> build/lib/colossalai/moe 2024-02-08T11:42:01,511 copying colossalai/moe/experts.py -> build/lib/colossalai/moe 2024-02-08T11:42:01,513 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2024-02-08T11:42:01,515 copying colossalai/moe/load_balance.py -> build/lib/colossalai/moe 2024-02-08T11:42:01,517 copying colossalai/moe/routers.py -> build/lib/colossalai/moe 2024-02-08T11:42:01,519 copying colossalai/moe/loss.py -> build/lib/colossalai/moe 2024-02-08T11:42:01,521 copying colossalai/moe/manager.py -> build/lib/colossalai/moe 2024-02-08T11:42:01,523 copying colossalai/moe/layers.py -> build/lib/colossalai/moe 2024-02-08T11:42:01,526 creating build/lib/colossalai/legacy 2024-02-08T11:42:01,527 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2024-02-08T11:42:01,529 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2024-02-08T11:42:01,531 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2024-02-08T11:42:01,532 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2024-02-08T11:42:01,535 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2024-02-08T11:42:01,537 creating build/lib/colossalai/_C 2024-02-08T11:42:01,537 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2024-02-08T11:42:01,539 creating build/lib/colossalai/pipeline 2024-02-08T11:42:01,540 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2024-02-08T11:42:01,542 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2024-02-08T11:42:01,544 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2024-02-08T11:42:01,547 creating build/lib/colossalai/cli 2024-02-08T11:42:01,548 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2024-02-08T11:42:01,550 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2024-02-08T11:42:01,552 creating build/lib/colossalai/tensor 2024-02-08T11:42:01,553 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2024-02-08T11:42:01,555 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2024-02-08T11:42:01,557 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2024-02-08T11:42:01,559 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2024-02-08T11:42:01,561 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2024-02-08T11:42:01,563 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2024-02-08T11:42:01,565 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2024-02-08T11:42:01,567 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2024-02-08T11:42:01,570 creating build/lib/colossalai/kernel 2024-02-08T11:42:01,571 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2024-02-08T11:42:01,572 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2024-02-08T11:42:01,574 creating build/lib/colossalai/lazy 2024-02-08T11:42:01,575 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2024-02-08T11:42:01,577 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2024-02-08T11:42:01,579 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2024-02-08T11:42:01,581 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2024-02-08T11:42:01,583 creating build/lib/colossalai/logging 2024-02-08T11:42:01,584 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2024-02-08T11:42:01,586 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2024-02-08T11:42:01,589 creating build/lib/colossalai/auto_parallel 2024-02-08T11:42:01,589 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2024-02-08T11:42:01,591 creating build/lib/colossalai/context 2024-02-08T11:42:01,592 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2024-02-08T11:42:01,594 copying colossalai/context/config.py -> build/lib/colossalai/context 2024-02-08T11:42:01,596 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2024-02-08T11:42:01,598 creating build/lib/colossalai/_analyzer 2024-02-08T11:42:01,598 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2024-02-08T11:42:01,600 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2024-02-08T11:42:01,602 creating build/lib/colossalai/inference 2024-02-08T11:42:01,603 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2024-02-08T11:42:01,605 creating build/lib/colossalai/fx 2024-02-08T11:42:01,606 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2024-02-08T11:42:01,609 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2024-02-08T11:42:01,610 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2024-02-08T11:42:01,612 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2024-02-08T11:42:01,614 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2024-02-08T11:42:01,615 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2024-02-08T11:42:01,618 creating build/lib/colossalai/cluster 2024-02-08T11:42:01,619 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2024-02-08T11:42:01,621 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2024-02-08T11:42:01,623 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2024-02-08T11:42:01,624 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2024-02-08T11:42:01,626 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2024-02-08T11:42:01,629 creating build/lib/colossalai/interface 2024-02-08T11:42:01,630 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2024-02-08T11:42:01,632 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2024-02-08T11:42:01,633 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2024-02-08T11:42:01,635 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2024-02-08T11:42:01,637 creating build/lib/colossalai/zero 2024-02-08T11:42:01,638 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2024-02-08T11:42:01,639 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2024-02-08T11:42:01,642 creating build/lib/colossalai/nn 2024-02-08T11:42:01,642 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2024-02-08T11:42:01,644 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2024-02-08T11:42:01,647 creating build/lib/colossalai/utils/model 2024-02-08T11:42:01,647 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2024-02-08T11:42:01,649 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2024-02-08T11:42:01,651 creating build/lib/colossalai/utils/rank_recorder 2024-02-08T11:42:01,652 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2024-02-08T11:42:01,654 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2024-02-08T11:42:01,656 creating build/lib/colossalai/utils/tensor_detector 2024-02-08T11:42:01,657 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2024-02-08T11:42:01,659 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2024-02-08T11:42:01,661 creating build/lib/colossalai/utils/multi_tensor_apply 2024-02-08T11:42:01,662 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-02-08T11:42:01,664 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-02-08T11:42:01,666 creating build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,667 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,669 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,672 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,673 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,675 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,677 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,680 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,682 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,684 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,686 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,689 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,691 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,693 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,695 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,697 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,700 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,702 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2024-02-08T11:42:01,705 creating build/lib/colossalai/shardformer/shard 2024-02-08T11:42:01,705 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2024-02-08T11:42:01,707 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2024-02-08T11:42:01,709 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2024-02-08T11:42:01,710 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2024-02-08T11:42:01,712 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2024-02-08T11:42:01,714 creating build/lib/colossalai/shardformer/layer 2024-02-08T11:42:01,715 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2024-02-08T11:42:01,717 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2024-02-08T11:42:01,718 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2024-02-08T11:42:01,720 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2024-02-08T11:42:01,722 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2024-02-08T11:42:01,725 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2024-02-08T11:42:01,727 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2024-02-08T11:42:01,730 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2024-02-08T11:42:01,732 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2024-02-08T11:42:01,734 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2024-02-08T11:42:01,736 creating build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,737 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,740 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,743 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,745 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,747 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,751 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,753 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,756 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,758 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,761 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,763 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,765 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,766 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,768 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,771 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,773 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2024-02-08T11:42:01,776 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-02-08T11:42:01,777 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-02-08T11:42:01,779 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-02-08T11:42:01,781 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-02-08T11:42:01,784 creating build/lib/colossalai/booster/mixed_precision 2024-02-08T11:42:01,785 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2024-02-08T11:42:01,787 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2024-02-08T11:42:01,788 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2024-02-08T11:42:01,790 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2024-02-08T11:42:01,792 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2024-02-08T11:42:01,793 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2024-02-08T11:42:01,795 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2024-02-08T11:42:01,797 creating build/lib/colossalai/booster/plugin 2024-02-08T11:42:01,798 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2024-02-08T11:42:01,800 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2024-02-08T11:42:01,802 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2024-02-08T11:42:01,804 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-02-08T11:42:01,806 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-02-08T11:42:01,807 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-02-08T11:42:01,810 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2024-02-08T11:42:01,812 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-02-08T11:42:01,815 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2024-02-08T11:42:01,817 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2024-02-08T11:42:01,819 creating build/lib/colossalai/amp/naive_amp 2024-02-08T11:42:01,820 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2024-02-08T11:42:01,823 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2024-02-08T11:42:01,825 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-02-08T11:42:01,826 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-02-08T11:42:01,827 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-02-08T11:42:01,829 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-02-08T11:42:01,831 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-02-08T11:42:01,833 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2024-02-08T11:42:01,834 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-02-08T11:42:01,836 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-02-08T11:42:01,838 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-02-08T11:42:01,840 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-02-08T11:42:01,842 creating build/lib/colossalai/legacy/communication 2024-02-08T11:42:01,843 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2024-02-08T11:42:01,845 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2024-02-08T11:42:01,846 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2024-02-08T11:42:01,849 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2024-02-08T11:42:01,851 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2024-02-08T11:42:01,853 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2024-02-08T11:42:01,855 creating build/lib/colossalai/legacy/utils 2024-02-08T11:42:01,856 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2024-02-08T11:42:01,858 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2024-02-08T11:42:01,860 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2024-02-08T11:42:01,862 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2024-02-08T11:42:01,864 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2024-02-08T11:42:01,867 creating build/lib/colossalai/legacy/engine 2024-02-08T11:42:01,868 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2024-02-08T11:42:01,870 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2024-02-08T11:42:01,872 creating build/lib/colossalai/legacy/amp 2024-02-08T11:42:01,873 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2024-02-08T11:42:01,875 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2024-02-08T11:42:01,877 creating build/lib/colossalai/legacy/pipeline 2024-02-08T11:42:01,878 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2024-02-08T11:42:01,880 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2024-02-08T11:42:01,882 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2024-02-08T11:42:01,884 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2024-02-08T11:42:01,886 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2024-02-08T11:42:01,889 creating build/lib/colossalai/legacy/tensor 2024-02-08T11:42:01,890 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2024-02-08T11:42:01,892 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2024-02-08T11:42:01,894 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2024-02-08T11:42:01,895 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2024-02-08T11:42:01,897 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2024-02-08T11:42:01,899 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2024-02-08T11:42:01,901 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2024-02-08T11:42:01,902 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2024-02-08T11:42:01,905 creating build/lib/colossalai/legacy/registry 2024-02-08T11:42:01,906 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2024-02-08T11:42:01,908 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2024-02-08T11:42:01,910 creating build/lib/colossalai/legacy/trainer 2024-02-08T11:42:01,911 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2024-02-08T11:42:01,913 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2024-02-08T11:42:01,916 creating build/lib/colossalai/legacy/context 2024-02-08T11:42:01,917 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2024-02-08T11:42:01,918 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2024-02-08T11:42:01,920 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2024-02-08T11:42:01,923 creating build/lib/colossalai/legacy/inference 2024-02-08T11:42:01,924 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2024-02-08T11:42:01,925 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2024-02-08T11:42:01,927 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2024-02-08T11:42:01,929 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2024-02-08T11:42:01,932 creating build/lib/colossalai/legacy/builder 2024-02-08T11:42:01,933 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2024-02-08T11:42:01,935 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2024-02-08T11:42:01,937 creating build/lib/colossalai/legacy/zero 2024-02-08T11:42:01,938 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2024-02-08T11:42:01,940 creating build/lib/colossalai/legacy/nn 2024-02-08T11:42:01,941 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2024-02-08T11:42:01,943 creating build/lib/colossalai/legacy/utils/profiler 2024-02-08T11:42:01,944 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-02-08T11:42:01,946 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-02-08T11:42:01,947 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2024-02-08T11:42:01,949 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2024-02-08T11:42:01,952 creating build/lib/colossalai/legacy/utils/data_sampler 2024-02-08T11:42:01,953 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-02-08T11:42:01,954 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-02-08T11:42:01,956 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-02-08T11:42:01,959 creating build/lib/colossalai/legacy/utils/checkpoint 2024-02-08T11:42:01,960 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-02-08T11:42:01,962 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-02-08T11:42:01,964 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-02-08T11:42:01,967 creating build/lib/colossalai/legacy/utils/profiler/legacy 2024-02-08T11:42:01,968 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-02-08T11:42:01,970 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-02-08T11:42:01,972 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-02-08T11:42:01,974 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-02-08T11:42:01,977 creating build/lib/colossalai/legacy/engine/schedule 2024-02-08T11:42:01,978 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-02-08T11:42:01,980 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2024-02-08T11:42:01,981 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2024-02-08T11:42:01,983 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-02-08T11:42:01,985 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-02-08T11:42:01,989 creating build/lib/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:01,990 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:01,991 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:01,993 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:01,995 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:01,996 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:01,998 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:02,000 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:02,002 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:02,004 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2024-02-08T11:42:02,005 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-02-08T11:42:02,008 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-02-08T11:42:02,011 creating build/lib/colossalai/legacy/amp/naive_amp 2024-02-08T11:42:02,012 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-02-08T11:42:02,014 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-02-08T11:42:02,016 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-02-08T11:42:02,018 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-02-08T11:42:02,020 creating build/lib/colossalai/legacy/amp/apex_amp 2024-02-08T11:42:02,021 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-02-08T11:42:02,023 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-02-08T11:42:02,025 creating build/lib/colossalai/legacy/amp/torch_amp 2024-02-08T11:42:02,026 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-02-08T11:42:02,028 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-02-08T11:42:02,031 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-02-08T11:42:02,033 creating build/lib/colossalai/legacy/pipeline/middleware 2024-02-08T11:42:02,034 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-02-08T11:42:02,036 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-02-08T11:42:02,038 creating build/lib/colossalai/legacy/pipeline/rpc 2024-02-08T11:42:02,039 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-02-08T11:42:02,042 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-02-08T11:42:02,044 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-02-08T11:42:02,046 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-02-08T11:42:02,049 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-02-08T11:42:02,050 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-02-08T11:42:02,052 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-02-08T11:42:02,056 creating build/lib/colossalai/legacy/trainer/hooks 2024-02-08T11:42:02,056 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-02-08T11:42:02,059 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2024-02-08T11:42:02,060 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2024-02-08T11:42:02,062 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-02-08T11:42:02,063 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-02-08T11:42:02,065 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-02-08T11:42:02,068 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-02-08T11:42:02,071 creating build/lib/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:02,075 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:02,077 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:02,079 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:02,081 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:02,082 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:02,084 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:02,086 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:02,088 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:02,090 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:02,092 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:02,094 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:02,096 creating build/lib/colossalai/legacy/context/random 2024-02-08T11:42:02,097 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2024-02-08T11:42:02,099 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2024-02-08T11:42:02,101 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2024-02-08T11:42:02,103 creating build/lib/colossalai/legacy/inference/tensor_parallel 2024-02-08T11:42:02,104 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-02-08T11:42:02,106 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-02-08T11:42:02,108 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-02-08T11:42:02,110 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-02-08T11:42:02,113 creating build/lib/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:02,114 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:02,115 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:02,117 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:02,118 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:02,120 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:02,122 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:02,124 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:02,126 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:02,128 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:02,131 creating build/lib/colossalai/legacy/inference/pipeline 2024-02-08T11:42:02,132 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2024-02-08T11:42:02,134 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2024-02-08T11:42:02,136 creating build/lib/colossalai/legacy/inference/hybridengine 2024-02-08T11:42:02,137 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-02-08T11:42:02,139 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-02-08T11:42:02,141 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-02-08T11:42:02,142 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-02-08T11:42:02,145 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-02-08T11:42:02,146 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-02-08T11:42:02,148 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-02-08T11:42:02,151 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-02-08T11:42:02,152 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-02-08T11:42:02,154 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-02-08T11:42:02,156 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-02-08T11:42:02,158 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-02-08T11:42:02,160 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-02-08T11:42:02,163 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2024-02-08T11:42:02,164 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-02-08T11:42:02,165 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-02-08T11:42:02,168 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-02-08T11:42:02,169 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-02-08T11:42:02,171 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-02-08T11:42:02,172 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-02-08T11:42:02,175 creating build/lib/colossalai/legacy/zero/sharded_optim 2024-02-08T11:42:02,176 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-02-08T11:42:02,178 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-02-08T11:42:02,181 creating build/lib/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:02,182 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:02,185 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:02,187 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:02,188 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:02,190 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:02,192 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:02,195 creating build/lib/colossalai/legacy/zero/sharded_param 2024-02-08T11:42:02,196 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-02-08T11:42:02,198 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-02-08T11:42:02,199 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-02-08T11:42:02,202 creating build/lib/colossalai/legacy/zero/gemini 2024-02-08T11:42:02,202 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-02-08T11:42:02,205 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2024-02-08T11:42:02,206 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-02-08T11:42:02,208 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2024-02-08T11:42:02,210 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2024-02-08T11:42:02,212 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2024-02-08T11:42:02,214 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2024-02-08T11:42:02,216 creating build/lib/colossalai/legacy/zero/shard_utils 2024-02-08T11:42:02,217 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-02-08T11:42:02,219 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-02-08T11:42:02,220 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-02-08T11:42:02,222 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-02-08T11:42:02,224 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-02-08T11:42:02,226 creating build/lib/colossalai/legacy/zero/init_ctx 2024-02-08T11:42:02,227 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-02-08T11:42:02,228 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-02-08T11:42:02,231 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-02-08T11:42:02,232 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-02-08T11:42:02,234 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-02-08T11:42:02,236 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2024-02-08T11:42:02,237 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-02-08T11:42:02,239 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-02-08T11:42:02,241 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-02-08T11:42:02,243 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-02-08T11:42:02,245 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-02-08T11:42:02,247 creating build/lib/colossalai/legacy/nn/loss 2024-02-08T11:42:02,248 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2024-02-08T11:42:02,250 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2024-02-08T11:42:02,252 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2024-02-08T11:42:02,254 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2024-02-08T11:42:02,256 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2024-02-08T11:42:02,259 creating build/lib/colossalai/legacy/nn/parallel 2024-02-08T11:42:02,260 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2024-02-08T11:42:02,261 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2024-02-08T11:42:02,264 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2024-02-08T11:42:02,266 creating build/lib/colossalai/legacy/nn/metric 2024-02-08T11:42:02,267 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2024-02-08T11:42:02,269 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2024-02-08T11:42:02,271 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2024-02-08T11:42:02,273 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2024-02-08T11:42:02,274 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2024-02-08T11:42:02,277 creating build/lib/colossalai/legacy/nn/_ops 2024-02-08T11:42:02,277 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2024-02-08T11:42:02,279 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2024-02-08T11:42:02,282 creating build/lib/colossalai/legacy/nn/layer 2024-02-08T11:42:02,283 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2024-02-08T11:42:02,284 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2024-02-08T11:42:02,287 creating build/lib/colossalai/legacy/nn/parallel/layers 2024-02-08T11:42:02,288 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-02-08T11:42:02,290 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-02-08T11:42:02,291 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-02-08T11:42:02,293 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-02-08T11:42:02,295 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-02-08T11:42:02,297 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:02,298 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:02,301 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:02,304 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:02,306 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:02,308 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:02,309 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:02,312 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:02,314 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:02,315 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:02,318 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-02-08T11:42:02,319 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-02-08T11:42:02,321 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-02-08T11:42:02,323 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-02-08T11:42:02,326 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-02-08T11:42:02,330 creating build/lib/colossalai/legacy/nn/layer/utils 2024-02-08T11:42:02,331 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-02-08T11:42:02,333 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-02-08T11:42:02,335 creating build/lib/colossalai/legacy/nn/layer/wrapper 2024-02-08T11:42:02,336 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-02-08T11:42:02,337 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-02-08T11:42:02,340 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:02,341 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:02,343 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:02,344 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:02,346 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:02,347 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:02,349 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:02,352 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-02-08T11:42:02,353 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-02-08T11:42:02,355 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-02-08T11:42:02,356 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-02-08T11:42:02,359 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-02-08T11:42:02,362 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-02-08T11:42:02,363 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-02-08T11:42:02,365 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-02-08T11:42:02,367 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-02-08T11:42:02,369 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-02-08T11:42:02,373 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-02-08T11:42:02,374 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-02-08T11:42:02,376 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-02-08T11:42:02,377 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-02-08T11:42:02,380 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-02-08T11:42:02,383 creating build/lib/colossalai/legacy/nn/layer/vanilla 2024-02-08T11:42:02,384 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-02-08T11:42:02,386 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-02-08T11:42:02,389 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-02-08T11:42:02,390 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-02-08T11:42:02,391 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-02-08T11:42:02,394 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-02-08T11:42:02,395 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-02-08T11:42:02,399 creating build/lib/colossalai/pipeline/schedule 2024-02-08T11:42:02,399 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2024-02-08T11:42:02,401 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2024-02-08T11:42:02,403 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2024-02-08T11:42:02,405 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2024-02-08T11:42:02,408 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2024-02-08T11:42:02,410 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2024-02-08T11:42:02,412 creating build/lib/colossalai/cli/check 2024-02-08T11:42:02,413 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2024-02-08T11:42:02,415 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2024-02-08T11:42:02,418 creating build/lib/colossalai/cli/launcher 2024-02-08T11:42:02,419 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2024-02-08T11:42:02,421 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2024-02-08T11:42:02,423 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2024-02-08T11:42:02,425 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2024-02-08T11:42:02,427 creating build/lib/colossalai/tensor/moe_tensor 2024-02-08T11:42:02,428 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2024-02-08T11:42:02,429 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2024-02-08T11:42:02,431 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2024-02-08T11:42:02,434 creating build/lib/colossalai/tensor/d_tensor 2024-02-08T11:42:02,434 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2024-02-08T11:42:02,436 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2024-02-08T11:42:02,438 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-02-08T11:42:02,440 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2024-02-08T11:42:02,442 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2024-02-08T11:42:02,444 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2024-02-08T11:42:02,446 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2024-02-08T11:42:02,449 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-02-08T11:42:02,451 creating build/lib/colossalai/kernel/jit 2024-02-08T11:42:02,452 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2024-02-08T11:42:02,454 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2024-02-08T11:42:02,456 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2024-02-08T11:42:02,457 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2024-02-08T11:42:02,460 creating build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,461 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,463 copying colossalai/kernel/triton/fused_layernorm.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,465 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,466 copying colossalai/kernel/triton/copy_kv_cache_dest.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,468 copying colossalai/kernel/triton/int8_rotary_embedding_kernel.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,470 copying colossalai/kernel/triton/context_attention.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,472 copying colossalai/kernel/triton/token_attention_kernel.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,474 copying colossalai/kernel/triton/custom_autotune.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,476 copying colossalai/kernel/triton/gptq_triton.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,478 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,480 copying colossalai/kernel/triton/self_attention_nofusion.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,482 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,484 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,485 copying colossalai/kernel/triton/smooth_attention.py -> build/lib/colossalai/kernel/triton 2024-02-08T11:42:02,488 creating build/lib/colossalai/kernel/extensions 2024-02-08T11:42:02,489 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2024-02-08T11:42:02,491 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2024-02-08T11:42:02,493 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2024-02-08T11:42:02,495 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2024-02-08T11:42:02,497 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2024-02-08T11:42:02,499 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2024-02-08T11:42:02,501 creating build/lib/colossalai/kernel/extensions/cpu_adam 2024-02-08T11:42:02,502 copying colossalai/kernel/extensions/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/cpu_adam 2024-02-08T11:42:02,504 copying colossalai/kernel/extensions/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/cpu_adam 2024-02-08T11:42:02,505 copying colossalai/kernel/extensions/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/cpu_adam 2024-02-08T11:42:02,507 creating build/lib/colossalai/kernel/extensions/layernorm 2024-02-08T11:42:02,508 copying colossalai/kernel/extensions/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/layernorm 2024-02-08T11:42:02,510 copying colossalai/kernel/extensions/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/layernorm 2024-02-08T11:42:02,512 creating build/lib/colossalai/kernel/extensions/moe 2024-02-08T11:42:02,513 copying colossalai/kernel/extensions/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/moe 2024-02-08T11:42:02,515 copying colossalai/kernel/extensions/moe/__init__.py -> build/lib/colossalai/kernel/extensions/moe 2024-02-08T11:42:02,517 creating build/lib/colossalai/kernel/extensions/flash_attention 2024-02-08T11:42:02,518 copying colossalai/kernel/extensions/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/flash_attention 2024-02-08T11:42:02,520 copying colossalai/kernel/extensions/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/flash_attention 2024-02-08T11:42:02,521 copying colossalai/kernel/extensions/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/flash_attention 2024-02-08T11:42:02,523 copying colossalai/kernel/extensions/flash_attention/flash_attention_xformers_cuda.py -> build/lib/colossalai/kernel/extensions/flash_attention 2024-02-08T11:42:02,526 creating build/lib/colossalai/kernel/extensions/csrc 2024-02-08T11:42:02,526 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2024-02-08T11:42:02,528 copying colossalai/kernel/extensions/csrc/scaled_softmax.py -> build/lib/colossalai/kernel/extensions/csrc 2024-02-08T11:42:02,531 creating build/lib/colossalai/kernel/extensions/softmax 2024-02-08T11:42:02,532 copying colossalai/kernel/extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/softmax 2024-02-08T11:42:02,533 copying colossalai/kernel/extensions/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/softmax 2024-02-08T11:42:02,535 copying colossalai/kernel/extensions/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/softmax 2024-02-08T11:42:02,537 creating build/lib/colossalai/kernel/extensions/optimizer 2024-02-08T11:42:02,538 copying colossalai/kernel/extensions/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/optimizer 2024-02-08T11:42:02,540 copying colossalai/kernel/extensions/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/optimizer 2024-02-08T11:42:02,542 creating build/lib/colossalai/auto_parallel/pipeline_shard 2024-02-08T11:42:02,542 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2024-02-08T11:42:02,544 creating build/lib/colossalai/auto_parallel/tensor_shard 2024-02-08T11:42:02,545 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-02-08T11:42:02,547 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-02-08T11:42:02,549 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-02-08T11:42:02,551 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-02-08T11:42:02,553 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-02-08T11:42:02,556 creating build/lib/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:02,556 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:02,559 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:02,561 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:02,563 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:02,565 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:02,567 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:02,569 creating build/lib/colossalai/auto_parallel/meta_profiler 2024-02-08T11:42:02,570 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-02-08T11:42:02,572 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-02-08T11:42:02,574 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-02-08T11:42:02,576 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-02-08T11:42:02,578 creating build/lib/colossalai/auto_parallel/offload 2024-02-08T11:42:02,579 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2024-02-08T11:42:02,581 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2024-02-08T11:42:02,583 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2024-02-08T11:42:02,585 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2024-02-08T11:42:02,587 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2024-02-08T11:42:02,590 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2024-02-08T11:42:02,592 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2024-02-08T11:42:02,594 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2024-02-08T11:42:02,595 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2024-02-08T11:42:02,597 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2024-02-08T11:42:02,599 creating build/lib/colossalai/auto_parallel/passes 2024-02-08T11:42:02,600 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2024-02-08T11:42:02,602 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2024-02-08T11:42:02,604 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-02-08T11:42:02,606 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2024-02-08T11:42:02,607 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-02-08T11:42:02,610 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-02-08T11:42:02,613 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:02,614 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:02,615 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:02,618 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:02,619 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:02,622 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:02,624 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:02,626 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-02-08T11:42:02,627 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-02-08T11:42:02,629 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-02-08T11:42:02,631 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-02-08T11:42:02,634 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-02-08T11:42:02,636 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-02-08T11:42:02,639 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,640 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,642 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,644 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,645 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,647 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,649 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,651 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,652 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,654 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,656 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,657 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,659 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,661 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,663 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,665 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,666 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,669 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,670 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,673 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,675 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,677 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,679 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,681 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,682 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,684 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,686 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,688 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:02,691 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,692 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,694 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,696 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,698 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,699 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,701 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,703 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,706 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,708 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,710 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,712 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,715 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,717 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,719 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,721 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,723 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,725 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,727 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,729 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:02,733 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:02,734 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:02,736 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:02,738 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:02,740 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:02,742 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:02,743 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:02,745 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:02,748 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:02,750 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:02,752 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:02,753 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:02,756 creating build/lib/colossalai/_analyzer/_subclasses 2024-02-08T11:42:02,757 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2024-02-08T11:42:02,759 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-02-08T11:42:02,761 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2024-02-08T11:42:02,763 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-02-08T11:42:02,765 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2024-02-08T11:42:02,768 creating build/lib/colossalai/_analyzer/fx 2024-02-08T11:42:02,769 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2024-02-08T11:42:02,771 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2024-02-08T11:42:02,773 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2024-02-08T11:42:02,775 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2024-02-08T11:42:02,778 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2024-02-08T11:42:02,781 creating build/lib/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:02,782 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:02,784 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:02,786 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:02,788 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:02,790 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:02,792 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:02,795 creating build/lib/colossalai/_analyzer/fx/passes 2024-02-08T11:42:02,796 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2024-02-08T11:42:02,798 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2024-02-08T11:42:02,800 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2024-02-08T11:42:02,802 creating build/lib/colossalai/inference/engine 2024-02-08T11:42:02,803 copying colossalai/inference/engine/microbatch_manager.py -> build/lib/colossalai/inference/engine 2024-02-08T11:42:02,805 copying colossalai/inference/engine/__init__.py -> build/lib/colossalai/inference/engine 2024-02-08T11:42:02,807 copying colossalai/inference/engine/engine.py -> build/lib/colossalai/inference/engine 2024-02-08T11:42:02,809 creating build/lib/colossalai/inference/kv_cache 2024-02-08T11:42:02,810 copying colossalai/inference/kv_cache/batch_infer_state.py -> build/lib/colossalai/inference/kv_cache 2024-02-08T11:42:02,812 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2024-02-08T11:42:02,814 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2024-02-08T11:42:02,817 creating build/lib/colossalai/inference/quant 2024-02-08T11:42:02,817 copying colossalai/inference/quant/__init__.py -> build/lib/colossalai/inference/quant 2024-02-08T11:42:02,820 creating build/lib/colossalai/inference/engine/policies 2024-02-08T11:42:02,821 copying colossalai/inference/engine/policies/bloom.py -> build/lib/colossalai/inference/engine/policies 2024-02-08T11:42:02,823 copying colossalai/inference/engine/policies/__init__.py -> build/lib/colossalai/inference/engine/policies 2024-02-08T11:42:02,824 copying colossalai/inference/engine/policies/chatglm2.py -> build/lib/colossalai/inference/engine/policies 2024-02-08T11:42:02,826 copying colossalai/inference/engine/policies/llama.py -> build/lib/colossalai/inference/engine/policies 2024-02-08T11:42:02,829 creating build/lib/colossalai/inference/engine/modeling 2024-02-08T11:42:02,830 copying colossalai/inference/engine/modeling/bloom.py -> build/lib/colossalai/inference/engine/modeling 2024-02-08T11:42:02,833 copying colossalai/inference/engine/modeling/__init__.py -> build/lib/colossalai/inference/engine/modeling 2024-02-08T11:42:02,834 copying colossalai/inference/engine/modeling/_utils.py -> build/lib/colossalai/inference/engine/modeling 2024-02-08T11:42:02,836 copying colossalai/inference/engine/modeling/chatglm2.py -> build/lib/colossalai/inference/engine/modeling 2024-02-08T11:42:02,839 copying colossalai/inference/engine/modeling/llama.py -> build/lib/colossalai/inference/engine/modeling 2024-02-08T11:42:02,842 creating build/lib/colossalai/inference/quant/smoothquant 2024-02-08T11:42:02,843 copying colossalai/inference/quant/smoothquant/__init__.py -> build/lib/colossalai/inference/quant/smoothquant 2024-02-08T11:42:02,845 creating build/lib/colossalai/inference/quant/gptq 2024-02-08T11:42:02,846 copying colossalai/inference/quant/gptq/gptq_manager.py -> build/lib/colossalai/inference/quant/gptq 2024-02-08T11:42:02,848 copying colossalai/inference/quant/gptq/__init__.py -> build/lib/colossalai/inference/quant/gptq 2024-02-08T11:42:02,850 creating build/lib/colossalai/inference/quant/smoothquant/models 2024-02-08T11:42:02,851 copying colossalai/inference/quant/smoothquant/models/__init__.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-02-08T11:42:02,853 copying colossalai/inference/quant/smoothquant/models/linear.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-02-08T11:42:02,855 copying colossalai/inference/quant/smoothquant/models/base_model.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-02-08T11:42:02,857 copying colossalai/inference/quant/smoothquant/models/llama.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-02-08T11:42:02,860 copying colossalai/inference/quant/smoothquant/models/parallel_linear.py -> build/lib/colossalai/inference/quant/smoothquant/models 2024-02-08T11:42:02,862 creating build/lib/colossalai/inference/quant/gptq/cai_gptq 2024-02-08T11:42:02,863 copying colossalai/inference/quant/gptq/cai_gptq/__init__.py -> build/lib/colossalai/inference/quant/gptq/cai_gptq 2024-02-08T11:42:02,865 copying colossalai/inference/quant/gptq/cai_gptq/gptq_op.py -> build/lib/colossalai/inference/quant/gptq/cai_gptq 2024-02-08T11:42:02,867 copying colossalai/inference/quant/gptq/cai_gptq/cai_quant_linear.py -> build/lib/colossalai/inference/quant/gptq/cai_gptq 2024-02-08T11:42:02,869 creating build/lib/colossalai/fx/codegen 2024-02-08T11:42:02,870 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2024-02-08T11:42:02,872 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2024-02-08T11:42:02,876 creating build/lib/colossalai/fx/profiler 2024-02-08T11:42:02,877 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2024-02-08T11:42:02,879 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2024-02-08T11:42:02,881 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2024-02-08T11:42:02,882 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2024-02-08T11:42:02,884 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2024-02-08T11:42:02,887 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2024-02-08T11:42:02,888 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2024-02-08T11:42:02,891 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2024-02-08T11:42:02,893 creating build/lib/colossalai/fx/tracer 2024-02-08T11:42:02,894 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2024-02-08T11:42:02,896 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2024-02-08T11:42:02,898 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2024-02-08T11:42:02,900 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2024-02-08T11:42:02,902 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2024-02-08T11:42:02,905 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2024-02-08T11:42:02,907 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2024-02-08T11:42:02,909 creating build/lib/colossalai/fx/passes 2024-02-08T11:42:02,910 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2024-02-08T11:42:02,913 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2024-02-08T11:42:02,915 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2024-02-08T11:42:02,917 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2024-02-08T11:42:02,919 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2024-02-08T11:42:02,921 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2024-02-08T11:42:02,924 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2024-02-08T11:42:02,926 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2024-02-08T11:42:02,929 creating build/lib/colossalai/fx/profiler/experimental 2024-02-08T11:42:02,930 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2024-02-08T11:42:02,932 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2024-02-08T11:42:02,934 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2024-02-08T11:42:02,936 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2024-02-08T11:42:02,938 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2024-02-08T11:42:02,940 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:02,941 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:02,943 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:02,945 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:02,946 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:02,948 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:02,950 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:02,951 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:02,953 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:02,955 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:02,957 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:02,958 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:02,960 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:02,962 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:02,963 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:02,965 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:02,967 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:02,968 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:02,971 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:02,972 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:02,974 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:02,976 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:02,978 creating build/lib/colossalai/fx/tracer/meta_patch 2024-02-08T11:42:02,979 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2024-02-08T11:42:02,981 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2024-02-08T11:42:02,982 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2024-02-08T11:42:02,985 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:02,986 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:02,988 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:02,989 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:02,991 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:02,993 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:02,995 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:02,996 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:02,998 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:03,001 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:03,002 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:03,003 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:03,006 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:03,007 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:03,009 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:03,011 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:03,013 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:03,015 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:03,017 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-02-08T11:42:03,018 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-02-08T11:42:03,020 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-02-08T11:42:03,022 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-02-08T11:42:03,024 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-02-08T11:42:03,026 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-02-08T11:42:03,027 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-02-08T11:42:03,029 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-02-08T11:42:03,031 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-02-08T11:42:03,033 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-02-08T11:42:03,035 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-02-08T11:42:03,037 creating build/lib/colossalai/zero/low_level 2024-02-08T11:42:03,038 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2024-02-08T11:42:03,041 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2024-02-08T11:42:03,043 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2024-02-08T11:42:03,045 creating build/lib/colossalai/zero/gemini 2024-02-08T11:42:03,046 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2024-02-08T11:42:03,049 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2024-02-08T11:42:03,051 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2024-02-08T11:42:03,053 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2024-02-08T11:42:03,055 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2024-02-08T11:42:03,057 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2024-02-08T11:42:03,060 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2024-02-08T11:42:03,062 creating build/lib/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:03,063 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:03,065 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:03,067 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:03,070 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:03,071 copying colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:03,073 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:03,076 creating build/lib/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:03,077 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:03,079 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:03,081 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:03,082 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:03,084 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:03,086 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:03,088 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:03,090 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:03,092 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:03,094 creating build/lib/colossalai/zero/gemini/chunk 2024-02-08T11:42:03,095 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2024-02-08T11:42:03,097 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-02-08T11:42:03,099 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2024-02-08T11:42:03,101 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2024-02-08T11:42:03,103 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-02-08T11:42:03,106 creating build/lib/colossalai/nn/loss 2024-02-08T11:42:03,107 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2024-02-08T11:42:03,109 creating build/lib/colossalai/nn/lr_scheduler 2024-02-08T11:42:03,110 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2024-02-08T11:42:03,112 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2024-02-08T11:42:03,113 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2024-02-08T11:42:03,115 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2024-02-08T11:42:03,117 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2024-02-08T11:42:03,119 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2024-02-08T11:42:03,121 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2024-02-08T11:42:03,124 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2024-02-08T11:42:03,127 creating build/lib/colossalai/nn/optimizer 2024-02-08T11:42:03,128 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2024-02-08T11:42:03,130 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2024-02-08T11:42:03,132 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2024-02-08T11:42:03,134 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2024-02-08T11:42:03,136 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2024-02-08T11:42:03,139 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2024-02-08T11:42:03,141 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2024-02-08T11:42:03,143 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2024-02-08T11:42:03,145 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2024-02-08T11:42:03,148 creating build/lib/colossalai/nn/layer 2024-02-08T11:42:03,149 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2024-02-08T11:42:03,150 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2024-02-08T11:42:03,152 copying colossalai/nn/layer/colo_attention.py -> build/lib/colossalai/nn/layer 2024-02-08T11:42:03,154 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2024-02-08T11:42:03,156 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2024-02-08T11:42:03,159 creating build/lib/extensions/cpu_adam 2024-02-08T11:42:03,160 copying extensions/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/cpu_adam 2024-02-08T11:42:03,161 copying extensions/cpu_adam/__init__.py -> build/lib/extensions/cpu_adam 2024-02-08T11:42:03,163 copying extensions/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/cpu_adam 2024-02-08T11:42:03,165 creating build/lib/extensions/layernorm 2024-02-08T11:42:03,166 copying extensions/layernorm/__init__.py -> build/lib/extensions/layernorm 2024-02-08T11:42:03,169 copying extensions/layernorm/layernorm_cuda.py -> build/lib/extensions/layernorm 2024-02-08T11:42:03,171 creating build/lib/extensions/moe 2024-02-08T11:42:03,172 copying extensions/moe/moe_cuda.py -> build/lib/extensions/moe 2024-02-08T11:42:03,174 copying extensions/moe/__init__.py -> build/lib/extensions/moe 2024-02-08T11:42:03,176 creating build/lib/extensions/flash_attention 2024-02-08T11:42:03,177 copying extensions/flash_attention/__init__.py -> build/lib/extensions/flash_attention 2024-02-08T11:42:03,178 copying extensions/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/flash_attention 2024-02-08T11:42:03,180 copying extensions/flash_attention/flash_attention_npu.py -> build/lib/extensions/flash_attention 2024-02-08T11:42:03,182 copying extensions/flash_attention/flash_attention_xformers_cuda.py -> build/lib/extensions/flash_attention 2024-02-08T11:42:03,184 creating build/lib/extensions/csrc 2024-02-08T11:42:03,185 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2024-02-08T11:42:03,186 copying extensions/csrc/scaled_softmax.py -> build/lib/extensions/csrc 2024-02-08T11:42:03,189 creating build/lib/extensions/softmax 2024-02-08T11:42:03,190 copying extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/softmax 2024-02-08T11:42:03,192 copying extensions/softmax/__init__.py -> build/lib/extensions/softmax 2024-02-08T11:42:03,193 copying extensions/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/softmax 2024-02-08T11:42:03,196 creating build/lib/extensions/optimizer 2024-02-08T11:42:03,197 copying extensions/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/optimizer 2024-02-08T11:42:03,198 copying extensions/optimizer/__init__.py -> build/lib/extensions/optimizer 2024-02-08T11:42:03,356 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-02-08T11:42:03,357 !! 2024-02-08T11:42:03,358 ******************************************************************************** 2024-02-08T11:42:03,358 Please avoid running ``setup.py`` directly. 2024-02-08T11:42:03,359 Instead, use pypa/build, pypa/installer or other 2024-02-08T11:42:03,359 standards-based tools. 2024-02-08T11:42:03,360 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-02-08T11:42:03,361 ******************************************************************************** 2024-02-08T11:42:03,362 !! 2024-02-08T11:42:03,363 self.initialize_options() 2024-02-08T11:42:03,382 installing to build/bdist.linux-armv7l/wheel 2024-02-08T11:42:03,382 running install 2024-02-08T11:42:03,406 running install_lib 2024-02-08T11:42:03,431 creating build/bdist.linux-armv7l 2024-02-08T11:42:03,432 creating build/bdist.linux-armv7l/wheel 2024-02-08T11:42:03,433 creating build/bdist.linux-armv7l/wheel/colossalai 2024-02-08T11:42:03,435 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-02-08T11:42:03,436 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-02-08T11:42:03,438 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-02-08T11:42:03,441 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-02-08T11:42:03,443 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-02-08T11:42:03,445 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-02-08T11:42:03,448 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-02-08T11:42:03,451 creating build/bdist.linux-armv7l/wheel/colossalai/device 2024-02-08T11:42:03,452 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-02-08T11:42:03,454 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-02-08T11:42:03,456 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-02-08T11:42:03,459 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-02-08T11:42:03,461 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2024-02-08T11:42:03,463 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-02-08T11:42:03,464 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-02-08T11:42:03,465 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-02-08T11:42:03,467 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-02-08T11:42:03,468 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-02-08T11:42:03,471 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-02-08T11:42:03,473 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-02-08T11:42:03,473 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-02-08T11:42:03,476 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-02-08T11:42:03,477 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-02-08T11:42:03,479 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-02-08T11:42:03,481 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-02-08T11:42:03,482 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-02-08T11:42:03,484 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-02-08T11:42:03,486 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-02-08T11:42:03,488 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-02-08T11:42:03,490 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-02-08T11:42:03,491 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,492 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,495 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,497 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,499 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,501 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,503 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,506 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,508 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,511 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,513 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,515 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,517 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,520 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,522 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,525 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,527 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,529 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-02-08T11:42:03,532 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-02-08T11:42:03,533 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-02-08T11:42:03,535 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-02-08T11:42:03,536 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-02-08T11:42:03,539 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-02-08T11:42:03,540 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-02-08T11:42:03,542 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-02-08T11:42:03,544 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-02-08T11:42:03,547 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-02-08T11:42:03,547 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-02-08T11:42:03,549 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-02-08T11:42:03,551 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-02-08T11:42:03,553 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-02-08T11:42:03,556 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-02-08T11:42:03,558 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-02-08T11:42:03,561 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-02-08T11:42:03,564 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-02-08T11:42:03,566 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-02-08T11:42:03,568 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-02-08T11:42:03,571 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,572 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,575 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,578 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,579 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,582 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,585 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,588 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,591 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,593 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,595 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,598 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,600 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,601 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,604 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-02-08T11:42:03,605 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-02-08T11:42:03,606 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-02-08T11:42:03,608 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-02-08T11:42:03,611 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,614 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,616 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-02-08T11:42:03,619 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2024-02-08T11:42:03,620 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-02-08T11:42:03,622 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-02-08T11:42:03,624 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-02-08T11:42:03,626 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-02-08T11:42:03,628 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-02-08T11:42:03,630 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-02-08T11:42:03,633 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-02-08T11:42:03,634 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-02-08T11:42:03,636 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-02-08T11:42:03,638 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-02-08T11:42:03,640 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-02-08T11:42:03,642 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-02-08T11:42:03,644 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-02-08T11:42:03,646 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2024-02-08T11:42:03,647 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-02-08T11:42:03,648 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-02-08T11:42:03,650 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-02-08T11:42:03,652 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-02-08T11:42:03,654 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-02-08T11:42:03,655 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-02-08T11:42:03,657 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-02-08T11:42:03,659 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-02-08T11:42:03,661 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-02-08T11:42:03,663 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-02-08T11:42:03,666 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-02-08T11:42:03,666 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-02-08T11:42:03,669 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-02-08T11:42:03,671 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-02-08T11:42:03,673 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-02-08T11:42:03,675 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-02-08T11:42:03,676 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-02-08T11:42:03,679 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-02-08T11:42:03,681 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-02-08T11:42:03,684 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-02-08T11:42:03,686 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-02-08T11:42:03,689 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-02-08T11:42:03,691 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2024-02-08T11:42:03,692 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-02-08T11:42:03,694 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-02-08T11:42:03,696 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-02-08T11:42:03,697 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-02-08T11:42:03,699 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-02-08T11:42:03,701 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-02-08T11:42:03,702 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-02-08T11:42:03,704 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-02-08T11:42:03,706 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-02-08T11:42:03,707 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-02-08T11:42:03,708 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-02-08T11:42:03,710 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-02-08T11:42:03,712 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-02-08T11:42:03,714 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2024-02-08T11:42:03,716 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2024-02-08T11:42:03,717 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-02-08T11:42:03,719 copying build/lib/colossalai/moe/checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-02-08T11:42:03,721 copying build/lib/colossalai/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-02-08T11:42:03,724 copying build/lib/colossalai/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-02-08T11:42:03,726 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-02-08T11:42:03,728 copying build/lib/colossalai/moe/load_balance.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-02-08T11:42:03,730 copying build/lib/colossalai/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-02-08T11:42:03,733 copying build/lib/colossalai/moe/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-02-08T11:42:03,735 copying build/lib/colossalai/moe/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-02-08T11:42:03,737 copying build/lib/colossalai/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-02-08T11:42:03,740 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-02-08T11:42:03,741 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-02-08T11:42:03,742 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-02-08T11:42:03,744 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-02-08T11:42:03,746 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-02-08T11:42:03,749 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-02-08T11:42:03,751 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-02-08T11:42:03,752 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-02-08T11:42:03,755 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-02-08T11:42:03,756 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-02-08T11:42:03,759 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-02-08T11:42:03,760 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-02-08T11:42:03,762 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-02-08T11:42:03,763 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-02-08T11:42:03,765 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-02-08T11:42:03,766 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-02-08T11:42:03,768 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-02-08T11:42:03,770 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-02-08T11:42:03,772 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-02-08T11:42:03,774 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-02-08T11:42:03,777 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-02-08T11:42:03,779 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-02-08T11:42:03,780 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-02-08T11:42:03,781 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-02-08T11:42:03,783 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-02-08T11:42:03,786 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-02-08T11:42:03,787 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-02-08T11:42:03,788 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-02-08T11:42:03,790 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-02-08T11:42:03,792 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-02-08T11:42:03,795 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-02-08T11:42:03,797 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-02-08T11:42:03,800 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-02-08T11:42:03,801 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-02-08T11:42:03,802 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-02-08T11:42:03,804 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-02-08T11:42:03,806 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-02-08T11:42:03,808 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-02-08T11:42:03,810 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-02-08T11:42:03,812 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-02-08T11:42:03,814 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-02-08T11:42:03,816 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:03,817 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:03,819 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:03,821 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:03,822 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:03,824 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:03,826 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:03,828 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:03,829 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-02-08T11:42:03,832 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-02-08T11:42:03,833 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-02-08T11:42:03,835 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-02-08T11:42:03,837 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-02-08T11:42:03,839 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-02-08T11:42:03,841 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-02-08T11:42:03,842 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-02-08T11:42:03,843 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-02-08T11:42:03,846 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-02-08T11:42:03,848 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-02-08T11:42:03,850 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-02-08T11:42:03,852 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-02-08T11:42:03,853 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-02-08T11:42:03,855 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-02-08T11:42:03,856 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-02-08T11:42:03,858 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-02-08T11:42:03,860 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-02-08T11:42:03,861 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-02-08T11:42:03,863 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-02-08T11:42:03,865 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-02-08T11:42:03,867 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-02-08T11:42:03,869 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-02-08T11:42:03,870 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-02-08T11:42:03,872 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-02-08T11:42:03,873 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-02-08T11:42:03,875 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-02-08T11:42:03,877 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-02-08T11:42:03,879 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-02-08T11:42:03,881 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-02-08T11:42:03,883 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-02-08T11:42:03,886 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-02-08T11:42:03,887 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-02-08T11:42:03,890 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-02-08T11:42:03,892 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-02-08T11:42:03,894 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-02-08T11:42:03,896 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-02-08T11:42:03,898 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-02-08T11:42:03,901 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-02-08T11:42:03,902 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-02-08T11:42:03,904 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-02-08T11:42:03,906 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-02-08T11:42:03,908 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-02-08T11:42:03,909 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-02-08T11:42:03,911 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-02-08T11:42:03,913 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-02-08T11:42:03,914 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-02-08T11:42:03,917 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-02-08T11:42:03,919 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-02-08T11:42:03,919 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-02-08T11:42:03,921 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-02-08T11:42:03,923 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-02-08T11:42:03,926 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-02-08T11:42:03,927 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-02-08T11:42:03,928 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-02-08T11:42:03,930 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-02-08T11:42:03,932 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-02-08T11:42:03,934 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-02-08T11:42:03,936 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-02-08T11:42:03,938 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-02-08T11:42:03,941 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-02-08T11:42:03,944 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-02-08T11:42:03,945 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-02-08T11:42:03,948 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-02-08T11:42:03,950 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-02-08T11:42:03,952 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:03,953 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:03,955 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:03,957 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:03,959 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:03,961 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:03,963 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:03,964 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:03,966 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:03,968 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:03,970 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:03,973 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-02-08T11:42:03,974 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-02-08T11:42:03,976 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-02-08T11:42:03,979 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-02-08T11:42:03,980 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-02-08T11:42:03,982 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-02-08T11:42:03,984 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-02-08T11:42:03,986 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-02-08T11:42:03,989 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-02-08T11:42:03,990 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-02-08T11:42:03,992 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-02-08T11:42:03,994 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-02-08T11:42:03,995 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-02-08T11:42:03,998 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-02-08T11:42:03,999 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-02-08T11:42:04,001 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-02-08T11:42:04,003 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-02-08T11:42:04,004 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-02-08T11:42:04,007 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-02-08T11:42:04,008 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-02-08T11:42:04,010 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-02-08T11:42:04,013 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-02-08T11:42:04,014 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-02-08T11:42:04,016 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-02-08T11:42:04,018 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-02-08T11:42:04,020 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-02-08T11:42:04,022 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-02-08T11:42:04,025 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:04,026 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:04,028 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:04,030 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:04,031 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:04,033 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:04,035 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:04,037 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:04,039 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:04,042 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-02-08T11:42:04,044 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-02-08T11:42:04,045 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-02-08T11:42:04,047 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-02-08T11:42:04,049 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-02-08T11:42:04,050 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-02-08T11:42:04,053 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-02-08T11:42:04,053 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-02-08T11:42:04,055 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-02-08T11:42:04,061 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-02-08T11:42:04,063 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-02-08T11:42:04,064 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-02-08T11:42:04,066 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-02-08T11:42:04,068 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-02-08T11:42:04,071 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-02-08T11:42:04,073 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-02-08T11:42:04,076 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-02-08T11:42:04,076 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-02-08T11:42:04,078 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-02-08T11:42:04,081 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-02-08T11:42:04,082 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-02-08T11:42:04,083 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-02-08T11:42:04,085 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-02-08T11:42:04,088 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-02-08T11:42:04,090 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:04,091 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:04,094 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:04,096 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:04,098 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:04,100 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:04,102 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-02-08T11:42:04,105 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-02-08T11:42:04,106 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-02-08T11:42:04,108 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-02-08T11:42:04,110 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-02-08T11:42:04,112 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-02-08T11:42:04,113 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-02-08T11:42:04,115 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-02-08T11:42:04,117 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-02-08T11:42:04,119 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-02-08T11:42:04,121 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-02-08T11:42:04,124 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-02-08T11:42:04,125 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-02-08T11:42:04,126 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-02-08T11:42:04,128 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-02-08T11:42:04,130 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-02-08T11:42:04,133 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-02-08T11:42:04,134 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-02-08T11:42:04,136 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-02-08T11:42:04,138 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-02-08T11:42:04,140 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-02-08T11:42:04,142 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-02-08T11:42:04,144 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-02-08T11:42:04,145 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-02-08T11:42:04,147 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-02-08T11:42:04,149 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-02-08T11:42:04,151 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-02-08T11:42:04,153 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-02-08T11:42:04,155 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-02-08T11:42:04,156 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-02-08T11:42:04,157 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-02-08T11:42:04,160 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-02-08T11:42:04,162 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-02-08T11:42:04,163 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-02-08T11:42:04,165 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-02-08T11:42:04,167 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-02-08T11:42:04,169 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-02-08T11:42:04,171 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-02-08T11:42:04,173 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-02-08T11:42:04,175 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-02-08T11:42:04,176 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-02-08T11:42:04,178 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-02-08T11:42:04,181 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-02-08T11:42:04,182 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-02-08T11:42:04,184 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-02-08T11:42:04,186 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-02-08T11:42:04,188 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-02-08T11:42:04,190 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:04,191 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:04,194 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:04,196 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:04,199 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:04,201 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:04,203 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:04,205 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:04,207 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:04,209 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-02-08T11:42:04,211 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-02-08T11:42:04,213 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-02-08T11:42:04,215 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-02-08T11:42:04,216 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-02-08T11:42:04,217 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-02-08T11:42:04,219 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-02-08T11:42:04,221 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-02-08T11:42:04,222 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-02-08T11:42:04,225 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-02-08T11:42:04,225 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-02-08T11:42:04,227 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-02-08T11:42:04,230 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-02-08T11:42:04,231 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-02-08T11:42:04,232 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-02-08T11:42:04,234 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-02-08T11:42:04,236 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-02-08T11:42:04,239 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-02-08T11:42:04,242 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-02-08T11:42:04,243 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-02-08T11:42:04,245 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-02-08T11:42:04,248 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-02-08T11:42:04,249 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-02-08T11:42:04,251 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-02-08T11:42:04,252 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-02-08T11:42:04,255 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:04,256 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:04,258 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:04,260 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:04,261 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:04,263 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:04,265 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-02-08T11:42:04,268 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-02-08T11:42:04,270 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-02-08T11:42:04,271 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-02-08T11:42:04,273 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-02-08T11:42:04,275 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-02-08T11:42:04,277 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-02-08T11:42:04,280 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-02-08T11:42:04,281 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-02-08T11:42:04,283 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-02-08T11:42:04,285 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-02-08T11:42:04,288 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-02-08T11:42:04,291 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-02-08T11:42:04,292 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-02-08T11:42:04,294 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-02-08T11:42:04,296 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-02-08T11:42:04,299 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-02-08T11:42:04,302 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-02-08T11:42:04,303 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-02-08T11:42:04,305 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-02-08T11:42:04,308 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-02-08T11:42:04,309 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-02-08T11:42:04,311 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-02-08T11:42:04,314 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-02-08T11:42:04,316 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-02-08T11:42:04,319 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2024-02-08T11:42:04,320 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C 2024-02-08T11:42:04,322 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-02-08T11:42:04,323 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-02-08T11:42:04,326 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-02-08T11:42:04,326 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-02-08T11:42:04,328 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-02-08T11:42:04,331 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-02-08T11:42:04,333 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-02-08T11:42:04,336 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-02-08T11:42:04,339 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-02-08T11:42:04,340 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-02-08T11:42:04,342 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-02-08T11:42:04,345 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-02-08T11:42:04,347 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2024-02-08T11:42:04,348 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-02-08T11:42:04,350 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-02-08T11:42:04,351 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-02-08T11:42:04,353 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-02-08T11:42:04,356 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-02-08T11:42:04,358 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-02-08T11:42:04,359 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-02-08T11:42:04,362 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-02-08T11:42:04,364 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-02-08T11:42:04,366 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-02-08T11:42:04,369 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-02-08T11:42:04,370 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-02-08T11:42:04,371 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-02-08T11:42:04,373 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-02-08T11:42:04,375 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-02-08T11:42:04,377 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-02-08T11:42:04,379 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-02-08T11:42:04,381 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-02-08T11:42:04,384 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-02-08T11:42:04,386 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-02-08T11:42:04,388 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-02-08T11:42:04,391 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-02-08T11:42:04,392 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-02-08T11:42:04,394 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-02-08T11:42:04,396 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-02-08T11:42:04,398 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-02-08T11:42:04,400 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-02-08T11:42:04,403 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-02-08T11:42:04,405 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-02-08T11:42:04,408 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-02-08T11:42:04,410 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-02-08T11:42:04,413 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-02-08T11:42:04,415 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-02-08T11:42:04,418 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-02-08T11:42:04,419 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-02-08T11:42:04,421 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-02-08T11:42:04,422 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-02-08T11:42:04,424 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-02-08T11:42:04,426 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-02-08T11:42:04,428 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-02-08T11:42:04,430 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,431 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,433 copying build/lib/colossalai/kernel/triton/fused_layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,435 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,437 copying build/lib/colossalai/kernel/triton/copy_kv_cache_dest.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,439 copying build/lib/colossalai/kernel/triton/int8_rotary_embedding_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,441 copying build/lib/colossalai/kernel/triton/context_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,444 copying build/lib/colossalai/kernel/triton/token_attention_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,446 copying build/lib/colossalai/kernel/triton/custom_autotune.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,448 copying build/lib/colossalai/kernel/triton/gptq_triton.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,451 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,453 copying build/lib/colossalai/kernel/triton/self_attention_nofusion.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,455 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,457 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,459 copying build/lib/colossalai/kernel/triton/smooth_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-02-08T11:42:04,462 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-02-08T11:42:04,464 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/cpu_adam 2024-02-08T11:42:04,465 copying build/lib/colossalai/kernel/extensions/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/cpu_adam 2024-02-08T11:42:04,467 copying build/lib/colossalai/kernel/extensions/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/cpu_adam 2024-02-08T11:42:04,468 copying build/lib/colossalai/kernel/extensions/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/cpu_adam 2024-02-08T11:42:04,470 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-02-08T11:42:04,473 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-02-08T11:42:04,474 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-02-08T11:42:04,477 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/layernorm 2024-02-08T11:42:04,478 copying build/lib/colossalai/kernel/extensions/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/layernorm 2024-02-08T11:42:04,480 copying build/lib/colossalai/kernel/extensions/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/layernorm 2024-02-08T11:42:04,482 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/moe 2024-02-08T11:42:04,483 copying build/lib/colossalai/kernel/extensions/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/moe 2024-02-08T11:42:04,485 copying build/lib/colossalai/kernel/extensions/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/moe 2024-02-08T11:42:04,487 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-02-08T11:42:04,490 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-02-08T11:42:04,491 copying build/lib/colossalai/kernel/extensions/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-02-08T11:42:04,493 copying build/lib/colossalai/kernel/extensions/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-02-08T11:42:04,495 copying build/lib/colossalai/kernel/extensions/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-02-08T11:42:04,497 copying build/lib/colossalai/kernel/extensions/flash_attention/flash_attention_xformers_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/flash_attention 2024-02-08T11:42:04,499 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-02-08T11:42:04,500 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-02-08T11:42:04,502 copying build/lib/colossalai/kernel/extensions/csrc/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-02-08T11:42:04,504 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-02-08T11:42:04,507 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/softmax 2024-02-08T11:42:04,507 copying build/lib/colossalai/kernel/extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/softmax 2024-02-08T11:42:04,509 copying build/lib/colossalai/kernel/extensions/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/softmax 2024-02-08T11:42:04,511 copying build/lib/colossalai/kernel/extensions/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/softmax 2024-02-08T11:42:04,513 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/optimizer 2024-02-08T11:42:04,514 copying build/lib/colossalai/kernel/extensions/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/optimizer 2024-02-08T11:42:04,516 copying build/lib/colossalai/kernel/extensions/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/optimizer 2024-02-08T11:42:04,518 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-02-08T11:42:04,520 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-02-08T11:42:04,522 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-02-08T11:42:04,523 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-02-08T11:42:04,525 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-02-08T11:42:04,527 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-02-08T11:42:04,530 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-02-08T11:42:04,533 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2024-02-08T11:42:04,534 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-02-08T11:42:04,536 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-02-08T11:42:04,539 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-02-08T11:42:04,541 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-02-08T11:42:04,542 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-02-08T11:42:04,543 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-02-08T11:42:04,546 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-02-08T11:42:04,548 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:04,549 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:04,552 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:04,555 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:04,558 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:04,561 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:04,563 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-02-08T11:42:04,567 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-02-08T11:42:04,569 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-02-08T11:42:04,571 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-02-08T11:42:04,574 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-02-08T11:42:04,577 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-02-08T11:42:04,581 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-02-08T11:42:04,582 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-02-08T11:42:04,584 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-02-08T11:42:04,588 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-02-08T11:42:04,592 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-02-08T11:42:04,594 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-02-08T11:42:04,599 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,600 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,603 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,606 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,609 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,611 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,614 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,617 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,619 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,622 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,624 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,626 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,629 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,631 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,634 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,636 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,640 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,641 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,644 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,646 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,648 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,650 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,652 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,654 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,657 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,659 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,661 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,664 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,666 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,668 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,670 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,673 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,675 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,677 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,679 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,682 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-02-08T11:42:04,685 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,688 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,690 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,692 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,694 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,697 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,699 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,701 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,703 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,705 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,707 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,709 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-02-08T11:42:04,712 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:04,713 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:04,715 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:04,717 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:04,719 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:04,722 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:04,724 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-02-08T11:42:04,726 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-02-08T11:42:04,727 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-02-08T11:42:04,729 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-02-08T11:42:04,732 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:04,733 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:04,735 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:04,737 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:04,739 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:04,741 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:04,743 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:04,745 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:04,748 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:04,750 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:04,752 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:04,754 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-02-08T11:42:04,757 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-02-08T11:42:04,759 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-02-08T11:42:04,761 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-02-08T11:42:04,762 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-02-08T11:42:04,764 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-02-08T11:42:04,766 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-02-08T11:42:04,768 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-02-08T11:42:04,771 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-02-08T11:42:04,773 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-02-08T11:42:04,776 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-02-08T11:42:04,778 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-02-08T11:42:04,780 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-02-08T11:42:04,782 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-02-08T11:42:04,785 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-02-08T11:42:04,786 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-02-08T11:42:04,788 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-02-08T11:42:04,790 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-02-08T11:42:04,792 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-02-08T11:42:04,794 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-02-08T11:42:04,796 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-02-08T11:42:04,799 creating build/bdist.linux-armv7l/wheel/colossalai/context 2024-02-08T11:42:04,800 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-02-08T11:42:04,802 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-02-08T11:42:04,804 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-02-08T11:42:04,807 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-02-08T11:42:04,808 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-02-08T11:42:04,810 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-02-08T11:42:04,811 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-02-08T11:42:04,813 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-02-08T11:42:04,815 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-02-08T11:42:04,817 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-02-08T11:42:04,819 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-02-08T11:42:04,822 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-02-08T11:42:04,824 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-02-08T11:42:04,825 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-02-08T11:42:04,827 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-02-08T11:42:04,829 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-02-08T11:42:04,831 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-02-08T11:42:04,834 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:04,835 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:04,837 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:04,839 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:04,842 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:04,844 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:04,846 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-02-08T11:42:04,848 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-02-08T11:42:04,851 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-02-08T11:42:04,852 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-02-08T11:42:04,854 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-02-08T11:42:04,856 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-02-08T11:42:04,859 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2024-02-08T11:42:04,861 creating build/bdist.linux-armv7l/wheel/colossalai/inference/engine 2024-02-08T11:42:04,862 creating build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-02-08T11:42:04,863 copying build/lib/colossalai/inference/engine/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-02-08T11:42:04,865 copying build/lib/colossalai/inference/engine/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-02-08T11:42:04,867 copying build/lib/colossalai/inference/engine/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-02-08T11:42:04,869 copying build/lib/colossalai/inference/engine/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/policies 2024-02-08T11:42:04,872 copying build/lib/colossalai/inference/engine/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine 2024-02-08T11:42:04,874 copying build/lib/colossalai/inference/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine 2024-02-08T11:42:04,876 copying build/lib/colossalai/inference/engine/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine 2024-02-08T11:42:04,878 creating build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-02-08T11:42:04,879 copying build/lib/colossalai/inference/engine/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-02-08T11:42:04,882 copying build/lib/colossalai/inference/engine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-02-08T11:42:04,884 copying build/lib/colossalai/inference/engine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-02-08T11:42:04,885 copying build/lib/colossalai/inference/engine/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-02-08T11:42:04,888 copying build/lib/colossalai/inference/engine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/engine/modeling 2024-02-08T11:42:04,891 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-02-08T11:42:04,893 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-02-08T11:42:04,894 copying build/lib/colossalai/inference/kv_cache/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-02-08T11:42:04,896 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-02-08T11:42:04,898 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-02-08T11:42:04,901 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant 2024-02-08T11:42:04,901 copying build/lib/colossalai/inference/quant/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant 2024-02-08T11:42:04,904 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant 2024-02-08T11:42:04,905 copying build/lib/colossalai/inference/quant/smoothquant/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant 2024-02-08T11:42:04,907 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-02-08T11:42:04,908 copying build/lib/colossalai/inference/quant/smoothquant/models/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-02-08T11:42:04,910 copying build/lib/colossalai/inference/quant/smoothquant/models/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-02-08T11:42:04,912 copying build/lib/colossalai/inference/quant/smoothquant/models/base_model.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-02-08T11:42:04,915 copying build/lib/colossalai/inference/quant/smoothquant/models/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-02-08T11:42:04,918 copying build/lib/colossalai/inference/quant/smoothquant/models/parallel_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/smoothquant/models 2024-02-08T11:42:04,920 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq 2024-02-08T11:42:04,921 copying build/lib/colossalai/inference/quant/gptq/gptq_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq 2024-02-08T11:42:04,924 copying build/lib/colossalai/inference/quant/gptq/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq 2024-02-08T11:42:04,926 creating build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq/cai_gptq 2024-02-08T11:42:04,927 copying build/lib/colossalai/inference/quant/gptq/cai_gptq/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq/cai_gptq 2024-02-08T11:42:04,929 copying build/lib/colossalai/inference/quant/gptq/cai_gptq/gptq_op.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq/cai_gptq 2024-02-08T11:42:04,931 copying build/lib/colossalai/inference/quant/gptq/cai_gptq/cai_quant_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/quant/gptq/cai_gptq 2024-02-08T11:42:04,933 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2024-02-08T11:42:04,934 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-02-08T11:42:04,937 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-02-08T11:42:04,939 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-02-08T11:42:04,940 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-02-08T11:42:04,942 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-02-08T11:42:04,945 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-02-08T11:42:04,946 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-02-08T11:42:04,949 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-02-08T11:42:04,951 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-02-08T11:42:04,952 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-02-08T11:42:04,955 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-02-08T11:42:04,956 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-02-08T11:42:04,959 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:04,960 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:04,962 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:04,963 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:04,965 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:04,967 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:04,969 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:04,971 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:04,973 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:04,974 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-02-08T11:42:04,976 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-02-08T11:42:04,978 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-02-08T11:42:04,980 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-02-08T11:42:04,982 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:04,983 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:04,985 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:04,986 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:04,988 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:04,990 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:04,991 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:04,993 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:04,995 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:04,997 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:04,999 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:05,001 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-02-08T11:42:05,003 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-02-08T11:42:05,004 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-02-08T11:42:05,007 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-02-08T11:42:05,009 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-02-08T11:42:05,011 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-02-08T11:42:05,013 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-02-08T11:42:05,015 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-02-08T11:42:05,016 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-02-08T11:42:05,018 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-02-08T11:42:05,020 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-02-08T11:42:05,021 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-02-08T11:42:05,023 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:05,024 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:05,026 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:05,027 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:05,029 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:05,031 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:05,033 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:05,035 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:05,036 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-02-08T11:42:05,039 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:05,040 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:05,042 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:05,044 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:05,045 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:05,047 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:05,049 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:05,051 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:05,053 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-02-08T11:42:05,054 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-02-08T11:42:05,056 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-02-08T11:42:05,059 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-02-08T11:42:05,062 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-02-08T11:42:05,063 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-02-08T11:42:05,064 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-02-08T11:42:05,067 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-02-08T11:42:05,068 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-02-08T11:42:05,070 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-02-08T11:42:05,072 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-02-08T11:42:05,074 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-02-08T11:42:05,075 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-02-08T11:42:05,077 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-02-08T11:42:05,078 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-02-08T11:42:05,080 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-02-08T11:42:05,082 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-02-08T11:42:05,084 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-02-08T11:42:05,086 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-02-08T11:42:05,088 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-02-08T11:42:05,090 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-02-08T11:42:05,092 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-02-08T11:42:05,095 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-02-08T11:42:05,096 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-02-08T11:42:05,098 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-02-08T11:42:05,100 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-02-08T11:42:05,102 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-02-08T11:42:05,104 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-02-08T11:42:05,106 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-02-08T11:42:05,109 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-02-08T11:42:05,111 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-02-08T11:42:05,114 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-02-08T11:42:05,115 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-02-08T11:42:05,117 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-02-08T11:42:05,119 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-02-08T11:42:05,121 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-02-08T11:42:05,123 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-02-08T11:42:05,125 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2024-02-08T11:42:05,126 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-02-08T11:42:05,128 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-02-08T11:42:05,130 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-02-08T11:42:05,132 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-02-08T11:42:05,134 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2024-02-08T11:42:05,135 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-02-08T11:42:05,136 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-02-08T11:42:05,139 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-02-08T11:42:05,141 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-02-08T11:42:05,143 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:05,144 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:05,146 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:05,148 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:05,150 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:05,152 copying build/lib/colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:05,154 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-02-08T11:42:05,156 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-02-08T11:42:05,158 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-02-08T11:42:05,159 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-02-08T11:42:05,162 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:05,163 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:05,165 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:05,167 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:05,169 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:05,170 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:05,172 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:05,174 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:05,176 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:05,178 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-02-08T11:42:05,180 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-02-08T11:42:05,182 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-02-08T11:42:05,184 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-02-08T11:42:05,186 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-02-08T11:42:05,187 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-02-08T11:42:05,189 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-02-08T11:42:05,190 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-02-08T11:42:05,193 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-02-08T11:42:05,195 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-02-08T11:42:05,197 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-02-08T11:42:05,201 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-02-08T11:42:05,203 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-02-08T11:42:05,205 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-02-08T11:42:05,208 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2024-02-08T11:42:05,209 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-02-08T11:42:05,210 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-02-08T11:42:05,212 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-02-08T11:42:05,214 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-02-08T11:42:05,216 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-02-08T11:42:05,217 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-02-08T11:42:05,219 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-02-08T11:42:05,221 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-02-08T11:42:05,223 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-02-08T11:42:05,225 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-02-08T11:42:05,227 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-02-08T11:42:05,229 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-02-08T11:42:05,231 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-02-08T11:42:05,234 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-02-08T11:42:05,235 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-02-08T11:42:05,237 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-02-08T11:42:05,239 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-02-08T11:42:05,241 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-02-08T11:42:05,243 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-02-08T11:42:05,245 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-02-08T11:42:05,247 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-02-08T11:42:05,249 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-02-08T11:42:05,251 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-02-08T11:42:05,254 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-02-08T11:42:05,255 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-02-08T11:42:05,257 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-02-08T11:42:05,259 copying build/lib/colossalai/nn/layer/colo_attention.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-02-08T11:42:05,261 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-02-08T11:42:05,263 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-02-08T11:42:05,266 creating build/bdist.linux-armv7l/wheel/extensions 2024-02-08T11:42:05,267 creating build/bdist.linux-armv7l/wheel/extensions/cpu_adam 2024-02-08T11:42:05,268 copying build/lib/extensions/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/extensions/cpu_adam 2024-02-08T11:42:05,270 copying build/lib/extensions/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/cpu_adam 2024-02-08T11:42:05,272 copying build/lib/extensions/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/extensions/cpu_adam 2024-02-08T11:42:05,274 copying build/lib/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/extensions 2024-02-08T11:42:05,276 copying build/lib/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/extensions 2024-02-08T11:42:05,278 copying build/lib/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/extensions 2024-02-08T11:42:05,280 creating build/bdist.linux-armv7l/wheel/extensions/layernorm 2024-02-08T11:42:05,281 copying build/lib/extensions/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/layernorm 2024-02-08T11:42:05,283 copying build/lib/extensions/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/layernorm 2024-02-08T11:42:05,285 creating build/bdist.linux-armv7l/wheel/extensions/moe 2024-02-08T11:42:05,286 copying build/lib/extensions/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/moe 2024-02-08T11:42:05,288 copying build/lib/extensions/moe/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/moe 2024-02-08T11:42:05,290 copying build/lib/extensions/utils.py -> build/bdist.linux-armv7l/wheel/extensions 2024-02-08T11:42:05,293 creating build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-02-08T11:42:05,294 copying build/lib/extensions/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-02-08T11:42:05,296 copying build/lib/extensions/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-02-08T11:42:05,297 copying build/lib/extensions/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-02-08T11:42:05,299 copying build/lib/extensions/flash_attention/flash_attention_xformers_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/flash_attention 2024-02-08T11:42:05,302 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2024-02-08T11:42:05,303 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/csrc 2024-02-08T11:42:05,305 copying build/lib/extensions/csrc/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/extensions/csrc 2024-02-08T11:42:05,307 copying build/lib/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/extensions 2024-02-08T11:42:05,309 creating build/bdist.linux-armv7l/wheel/extensions/softmax 2024-02-08T11:42:05,310 copying build/lib/extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/softmax 2024-02-08T11:42:05,312 copying build/lib/extensions/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/softmax 2024-02-08T11:42:05,314 copying build/lib/extensions/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/softmax 2024-02-08T11:42:05,316 creating build/bdist.linux-armv7l/wheel/extensions/optimizer 2024-02-08T11:42:05,317 copying build/lib/extensions/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/optimizer 2024-02-08T11:42:05,319 copying build/lib/extensions/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/optimizer 2024-02-08T11:42:05,321 copying build/lib/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/extensions 2024-02-08T11:42:05,322 running install_egg_info 2024-02-08T11:42:05,354 running egg_info 2024-02-08T11:42:05,380 writing colossalai.egg-info/PKG-INFO 2024-02-08T11:42:05,385 writing dependency_links to colossalai.egg-info/dependency_links.txt 2024-02-08T11:42:05,386 writing entry points to colossalai.egg-info/entry_points.txt 2024-02-08T11:42:05,388 writing requirements to colossalai.egg-info/requires.txt 2024-02-08T11:42:05,389 writing top-level names to colossalai.egg-info/top_level.txt 2024-02-08T11:42:05,618 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2024-02-08T11:42:05,663 reading manifest template 'MANIFEST.in' 2024-02-08T11:42:06,910 warning: no files found matching '*.tr' under directory 'colossalai' 2024-02-08T11:42:07,522 warning: no files found matching '*.cc' under directory 'colossalai' 2024-02-08T11:42:07,838 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-02-08T11:42:07,935 warning: no files found matching '*.tr' under directory 'extensions' 2024-02-08T11:42:07,971 warning: no files found matching '*.cc' under directory 'extensions' 2024-02-08T11:42:07,990 warning: no files found matching '*.pyi' under directory 'extensions' 2024-02-08T11:42:07,991 adding license file 'LICENSE' 2024-02-08T11:42:08,031 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2024-02-08T11:42:08,034 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.3.5-py3.11.egg-info 2024-02-08T11:42:08,048 running install_scripts 2024-02-08T11:42:08,075 creating build/bdist.linux-armv7l/wheel/colossalai-0.3.5.dist-info/WHEEL 2024-02-08T11:42:08,078 creating '/tmp/pip-wheel-kn4vhu_g/colossalai-0.3.5-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-02-08T11:42:08,082 adding 'colossalai/__init__.py' 2024-02-08T11:42:08,084 adding 'colossalai/initialize.py' 2024-02-08T11:42:08,085 adding 'colossalai/version.py' 2024-02-08T11:42:08,087 adding 'colossalai/_C/__init__.py' 2024-02-08T11:42:08,089 adding 'colossalai/_analyzer/__init__.py' 2024-02-08T11:42:08,091 adding 'colossalai/_analyzer/envs.py' 2024-02-08T11:42:08,093 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2024-02-08T11:42:08,096 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2024-02-08T11:42:08,098 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2024-02-08T11:42:08,101 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2024-02-08T11:42:08,103 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2024-02-08T11:42:08,105 adding 'colossalai/_analyzer/fx/__init__.py' 2024-02-08T11:42:08,108 adding 'colossalai/_analyzer/fx/codegen.py' 2024-02-08T11:42:08,110 adding 'colossalai/_analyzer/fx/graph_module.py' 2024-02-08T11:42:08,113 adding 'colossalai/_analyzer/fx/node_util.py' 2024-02-08T11:42:08,114 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2024-02-08T11:42:08,116 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2024-02-08T11:42:08,119 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2024-02-08T11:42:08,121 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2024-02-08T11:42:08,123 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2024-02-08T11:42:08,125 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2024-02-08T11:42:08,127 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2024-02-08T11:42:08,129 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2024-02-08T11:42:08,131 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2024-02-08T11:42:08,133 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2024-02-08T11:42:08,135 adding 'colossalai/accelerator/__init__.py' 2024-02-08T11:42:08,137 adding 'colossalai/accelerator/api.py' 2024-02-08T11:42:08,139 adding 'colossalai/accelerator/base_accelerator.py' 2024-02-08T11:42:08,141 adding 'colossalai/accelerator/cpu_accelerator.py' 2024-02-08T11:42:08,144 adding 'colossalai/accelerator/cuda_accelerator.py' 2024-02-08T11:42:08,146 adding 'colossalai/accelerator/npu_accelerator.py' 2024-02-08T11:42:08,148 adding 'colossalai/amp/__init__.py' 2024-02-08T11:42:08,150 adding 'colossalai/amp/naive_amp/__init__.py' 2024-02-08T11:42:08,151 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2024-02-08T11:42:08,153 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2024-02-08T11:42:08,155 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2024-02-08T11:42:08,156 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2024-02-08T11:42:08,157 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2024-02-08T11:42:08,159 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2024-02-08T11:42:08,161 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2024-02-08T11:42:08,162 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2024-02-08T11:42:08,163 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2024-02-08T11:42:08,165 adding 'colossalai/auto_parallel/__init__.py' 2024-02-08T11:42:08,167 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2024-02-08T11:42:08,168 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2024-02-08T11:42:08,170 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2024-02-08T11:42:08,171 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2024-02-08T11:42:08,174 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2024-02-08T11:42:08,175 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2024-02-08T11:42:08,177 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2024-02-08T11:42:08,178 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2024-02-08T11:42:08,180 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2024-02-08T11:42:08,181 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2024-02-08T11:42:08,183 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2024-02-08T11:42:08,184 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2024-02-08T11:42:08,185 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2024-02-08T11:42:08,187 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2024-02-08T11:42:08,188 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2024-02-08T11:42:08,190 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2024-02-08T11:42:08,192 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2024-02-08T11:42:08,193 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2024-02-08T11:42:08,195 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2024-02-08T11:42:08,196 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2024-02-08T11:42:08,197 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2024-02-08T11:42:08,199 adding 'colossalai/auto_parallel/offload/__init__.py' 2024-02-08T11:42:08,201 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2024-02-08T11:42:08,202 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2024-02-08T11:42:08,203 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2024-02-08T11:42:08,205 adding 'colossalai/auto_parallel/offload/region.py' 2024-02-08T11:42:08,207 adding 'colossalai/auto_parallel/offload/region_manager.py' 2024-02-08T11:42:08,209 adding 'colossalai/auto_parallel/offload/runtime.py' 2024-02-08T11:42:08,211 adding 'colossalai/auto_parallel/offload/solver.py' 2024-02-08T11:42:08,214 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2024-02-08T11:42:08,215 adding 'colossalai/auto_parallel/offload/util.py' 2024-02-08T11:42:08,217 adding 'colossalai/auto_parallel/passes/__init__.py' 2024-02-08T11:42:08,218 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2024-02-08T11:42:08,220 adding 'colossalai/auto_parallel/passes/constants.py' 2024-02-08T11:42:08,221 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2024-02-08T11:42:08,223 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2024-02-08T11:42:08,226 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2024-02-08T11:42:08,227 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2024-02-08T11:42:08,229 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2024-02-08T11:42:08,230 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2024-02-08T11:42:08,232 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2024-02-08T11:42:08,234 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2024-02-08T11:42:08,236 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2024-02-08T11:42:08,238 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2024-02-08T11:42:08,239 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2024-02-08T11:42:08,241 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2024-02-08T11:42:08,242 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2024-02-08T11:42:08,244 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2024-02-08T11:42:08,245 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2024-02-08T11:42:08,247 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2024-02-08T11:42:08,248 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2024-02-08T11:42:08,250 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2024-02-08T11:42:08,251 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2024-02-08T11:42:08,252 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2024-02-08T11:42:08,254 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2024-02-08T11:42:08,257 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2024-02-08T11:42:08,259 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2024-02-08T11:42:08,260 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2024-02-08T11:42:08,261 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2024-02-08T11:42:08,263 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2024-02-08T11:42:08,264 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2024-02-08T11:42:08,265 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2024-02-08T11:42:08,266 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2024-02-08T11:42:08,268 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2024-02-08T11:42:08,269 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2024-02-08T11:42:08,270 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2024-02-08T11:42:08,272 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2024-02-08T11:42:08,273 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2024-02-08T11:42:08,275 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2024-02-08T11:42:08,277 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2024-02-08T11:42:08,279 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2024-02-08T11:42:08,282 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2024-02-08T11:42:08,284 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2024-02-08T11:42:08,286 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2024-02-08T11:42:08,289 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2024-02-08T11:42:08,291 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2024-02-08T11:42:08,293 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2024-02-08T11:42:08,295 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2024-02-08T11:42:08,300 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2024-02-08T11:42:08,302 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2024-02-08T11:42:08,304 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2024-02-08T11:42:08,306 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2024-02-08T11:42:08,309 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2024-02-08T11:42:08,311 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2024-02-08T11:42:08,314 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2024-02-08T11:42:08,316 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2024-02-08T11:42:08,317 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2024-02-08T11:42:08,320 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2024-02-08T11:42:08,321 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2024-02-08T11:42:08,324 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2024-02-08T11:42:08,326 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2024-02-08T11:42:08,328 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2024-02-08T11:42:08,332 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2024-02-08T11:42:08,334 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2024-02-08T11:42:08,336 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2024-02-08T11:42:08,338 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2024-02-08T11:42:08,341 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2024-02-08T11:42:08,343 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2024-02-08T11:42:08,345 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2024-02-08T11:42:08,347 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2024-02-08T11:42:08,349 adding 'colossalai/booster/__init__.py' 2024-02-08T11:42:08,350 adding 'colossalai/booster/accelerator.py' 2024-02-08T11:42:08,353 adding 'colossalai/booster/booster.py' 2024-02-08T11:42:08,355 adding 'colossalai/booster/mixed_precision/__init__.py' 2024-02-08T11:42:08,357 adding 'colossalai/booster/mixed_precision/bf16.py' 2024-02-08T11:42:08,359 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2024-02-08T11:42:08,360 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2024-02-08T11:42:08,362 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2024-02-08T11:42:08,363 adding 'colossalai/booster/mixed_precision/fp8.py' 2024-02-08T11:42:08,365 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2024-02-08T11:42:08,367 adding 'colossalai/booster/plugin/__init__.py' 2024-02-08T11:42:08,369 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2024-02-08T11:42:08,373 adding 'colossalai/booster/plugin/gemini_plugin.py' 2024-02-08T11:42:08,378 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2024-02-08T11:42:08,381 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2024-02-08T11:42:08,384 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2024-02-08T11:42:08,385 adding 'colossalai/booster/plugin/plugin_base.py' 2024-02-08T11:42:08,386 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2024-02-08T11:42:08,388 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2024-02-08T11:42:08,389 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2024-02-08T11:42:08,391 adding 'colossalai/checkpoint_io/__init__.py' 2024-02-08T11:42:08,393 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2024-02-08T11:42:08,395 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2024-02-08T11:42:08,399 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2024-02-08T11:42:08,401 adding 'colossalai/checkpoint_io/index_file.py' 2024-02-08T11:42:08,405 adding 'colossalai/checkpoint_io/utils.py' 2024-02-08T11:42:08,406 adding 'colossalai/cli/__init__.py' 2024-02-08T11:42:08,408 adding 'colossalai/cli/cli.py' 2024-02-08T11:42:08,409 adding 'colossalai/cli/check/__init__.py' 2024-02-08T11:42:08,411 adding 'colossalai/cli/check/check_installation.py' 2024-02-08T11:42:08,413 adding 'colossalai/cli/launcher/__init__.py' 2024-02-08T11:42:08,415 adding 'colossalai/cli/launcher/hostinfo.py' 2024-02-08T11:42:08,416 adding 'colossalai/cli/launcher/multinode_runner.py' 2024-02-08T11:42:08,418 adding 'colossalai/cli/launcher/run.py' 2024-02-08T11:42:08,420 adding 'colossalai/cluster/__init__.py' 2024-02-08T11:42:08,421 adding 'colossalai/cluster/device_mesh_manager.py' 2024-02-08T11:42:08,423 adding 'colossalai/cluster/dist_coordinator.py' 2024-02-08T11:42:08,424 adding 'colossalai/cluster/process_group_manager.py' 2024-02-08T11:42:08,426 adding 'colossalai/cluster/process_group_mesh.py' 2024-02-08T11:42:08,428 adding 'colossalai/context/__init__.py' 2024-02-08T11:42:08,429 adding 'colossalai/context/config.py' 2024-02-08T11:42:08,430 adding 'colossalai/context/singleton_meta.py' 2024-02-08T11:42:08,431 adding 'colossalai/device/__init__.py' 2024-02-08T11:42:08,434 adding 'colossalai/device/alpha_beta_profiler.py' 2024-02-08T11:42:08,435 adding 'colossalai/device/calc_pipeline_strategy.py' 2024-02-08T11:42:08,438 adding 'colossalai/device/device_mesh.py' 2024-02-08T11:42:08,440 adding 'colossalai/fx/__init__.py' 2024-02-08T11:42:08,441 adding 'colossalai/fx/_compatibility.py' 2024-02-08T11:42:08,443 adding 'colossalai/fx/_meta_regist_12.py' 2024-02-08T11:42:08,444 adding 'colossalai/fx/_meta_regist_13.py' 2024-02-08T11:42:08,446 adding 'colossalai/fx/graph_module.py' 2024-02-08T11:42:08,447 adding 'colossalai/fx/proxy.py' 2024-02-08T11:42:08,449 adding 'colossalai/fx/codegen/__init__.py' 2024-02-08T11:42:08,453 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2024-02-08T11:42:08,455 adding 'colossalai/fx/passes/__init__.py' 2024-02-08T11:42:08,457 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2024-02-08T11:42:08,459 adding 'colossalai/fx/passes/concrete_info_prop.py' 2024-02-08T11:42:08,461 adding 'colossalai/fx/passes/meta_info_prop.py' 2024-02-08T11:42:08,464 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2024-02-08T11:42:08,465 adding 'colossalai/fx/passes/shard_1d_pass.py' 2024-02-08T11:42:08,467 adding 'colossalai/fx/passes/split_module.py' 2024-02-08T11:42:08,469 adding 'colossalai/fx/passes/utils.py' 2024-02-08T11:42:08,471 adding 'colossalai/fx/profiler/__init__.py' 2024-02-08T11:42:08,472 adding 'colossalai/fx/profiler/constants.py' 2024-02-08T11:42:08,473 adding 'colossalai/fx/profiler/dataflow.py' 2024-02-08T11:42:08,474 adding 'colossalai/fx/profiler/memory_utils.py' 2024-02-08T11:42:08,476 adding 'colossalai/fx/profiler/opcount.py' 2024-02-08T11:42:08,479 adding 'colossalai/fx/profiler/profiler.py' 2024-02-08T11:42:08,480 adding 'colossalai/fx/profiler/shard_utils.py' 2024-02-08T11:42:08,482 adding 'colossalai/fx/profiler/tensor.py' 2024-02-08T11:42:08,483 adding 'colossalai/fx/profiler/experimental/__init__.py' 2024-02-08T11:42:08,485 adding 'colossalai/fx/profiler/experimental/constants.py' 2024-02-08T11:42:08,486 adding 'colossalai/fx/profiler/experimental/profiler.py' 2024-02-08T11:42:08,487 adding 'colossalai/fx/profiler/experimental/registry.py' 2024-02-08T11:42:08,489 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2024-02-08T11:42:08,490 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2024-02-08T11:42:08,492 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2024-02-08T11:42:08,493 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2024-02-08T11:42:08,494 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2024-02-08T11:42:08,495 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2024-02-08T11:42:08,497 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2024-02-08T11:42:08,498 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2024-02-08T11:42:08,499 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2024-02-08T11:42:08,500 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2024-02-08T11:42:08,502 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2024-02-08T11:42:08,503 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2024-02-08T11:42:08,505 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2024-02-08T11:42:08,506 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2024-02-08T11:42:08,507 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2024-02-08T11:42:08,509 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2024-02-08T11:42:08,510 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2024-02-08T11:42:08,511 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2024-02-08T11:42:08,512 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2024-02-08T11:42:08,513 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2024-02-08T11:42:08,514 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2024-02-08T11:42:08,516 adding 'colossalai/fx/tracer/__init__.py' 2024-02-08T11:42:08,517 adding 'colossalai/fx/tracer/_meta_trace.py' 2024-02-08T11:42:08,519 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2024-02-08T11:42:08,520 adding 'colossalai/fx/tracer/_tracer_utils.py' 2024-02-08T11:42:08,523 adding 'colossalai/fx/tracer/experimental.py' 2024-02-08T11:42:08,524 adding 'colossalai/fx/tracer/registry.py' 2024-02-08T11:42:08,527 adding 'colossalai/fx/tracer/tracer.py' 2024-02-08T11:42:08,529 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2024-02-08T11:42:08,531 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2024-02-08T11:42:08,532 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2024-02-08T11:42:08,533 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2024-02-08T11:42:08,535 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2024-02-08T11:42:08,536 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2024-02-08T11:42:08,537 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2024-02-08T11:42:08,539 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2024-02-08T11:42:08,540 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2024-02-08T11:42:08,541 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2024-02-08T11:42:08,543 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2024-02-08T11:42:08,545 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2024-02-08T11:42:08,546 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2024-02-08T11:42:08,547 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2024-02-08T11:42:08,549 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2024-02-08T11:42:08,550 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2024-02-08T11:42:08,551 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2024-02-08T11:42:08,552 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2024-02-08T11:42:08,554 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2024-02-08T11:42:08,556 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2024-02-08T11:42:08,557 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2024-02-08T11:42:08,558 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2024-02-08T11:42:08,559 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2024-02-08T11:42:08,560 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2024-02-08T11:42:08,562 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2024-02-08T11:42:08,563 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2024-02-08T11:42:08,564 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2024-02-08T11:42:08,566 adding 'colossalai/inference/__init__.py' 2024-02-08T11:42:08,568 adding 'colossalai/inference/engine/__init__.py' 2024-02-08T11:42:08,569 adding 'colossalai/inference/engine/engine.py' 2024-02-08T11:42:08,571 adding 'colossalai/inference/engine/microbatch_manager.py' 2024-02-08T11:42:08,573 adding 'colossalai/inference/engine/modeling/__init__.py' 2024-02-08T11:42:08,574 adding 'colossalai/inference/engine/modeling/_utils.py' 2024-02-08T11:42:08,576 adding 'colossalai/inference/engine/modeling/bloom.py' 2024-02-08T11:42:08,579 adding 'colossalai/inference/engine/modeling/chatglm2.py' 2024-02-08T11:42:08,581 adding 'colossalai/inference/engine/modeling/llama.py' 2024-02-08T11:42:08,583 adding 'colossalai/inference/engine/policies/__init__.py' 2024-02-08T11:42:08,584 adding 'colossalai/inference/engine/policies/bloom.py' 2024-02-08T11:42:08,586 adding 'colossalai/inference/engine/policies/chatglm2.py' 2024-02-08T11:42:08,587 adding 'colossalai/inference/engine/policies/llama.py' 2024-02-08T11:42:08,589 adding 'colossalai/inference/kv_cache/__init__.py' 2024-02-08T11:42:08,590 adding 'colossalai/inference/kv_cache/batch_infer_state.py' 2024-02-08T11:42:08,592 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2024-02-08T11:42:08,593 adding 'colossalai/inference/quant/__init__.py' 2024-02-08T11:42:08,595 adding 'colossalai/inference/quant/gptq/__init__.py' 2024-02-08T11:42:08,596 adding 'colossalai/inference/quant/gptq/gptq_manager.py' 2024-02-08T11:42:08,598 adding 'colossalai/inference/quant/gptq/cai_gptq/__init__.py' 2024-02-08T11:42:08,600 adding 'colossalai/inference/quant/gptq/cai_gptq/cai_quant_linear.py' 2024-02-08T11:42:08,601 adding 'colossalai/inference/quant/gptq/cai_gptq/gptq_op.py' 2024-02-08T11:42:08,602 adding 'colossalai/inference/quant/smoothquant/__init__.py' 2024-02-08T11:42:08,604 adding 'colossalai/inference/quant/smoothquant/models/__init__.py' 2024-02-08T11:42:08,607 adding 'colossalai/inference/quant/smoothquant/models/base_model.py' 2024-02-08T11:42:08,608 adding 'colossalai/inference/quant/smoothquant/models/linear.py' 2024-02-08T11:42:08,612 adding 'colossalai/inference/quant/smoothquant/models/llama.py' 2024-02-08T11:42:08,614 adding 'colossalai/inference/quant/smoothquant/models/parallel_linear.py' 2024-02-08T11:42:08,616 adding 'colossalai/interface/__init__.py' 2024-02-08T11:42:08,617 adding 'colossalai/interface/model.py' 2024-02-08T11:42:08,619 adding 'colossalai/interface/optimizer.py' 2024-02-08T11:42:08,620 adding 'colossalai/interface/pretrained.py' 2024-02-08T11:42:08,622 adding 'colossalai/kernel/__init__.py' 2024-02-08T11:42:08,623 adding 'colossalai/kernel/kernel_loader.py' 2024-02-08T11:42:08,625 adding 'colossalai/kernel/extensions/__init__.py' 2024-02-08T11:42:08,626 adding 'colossalai/kernel/extensions/base_extension.py' 2024-02-08T11:42:08,628 adding 'colossalai/kernel/extensions/cpp_extension.py' 2024-02-08T11:42:08,629 adding 'colossalai/kernel/extensions/cuda_extension.py' 2024-02-08T11:42:08,630 adding 'colossalai/kernel/extensions/triton_extension.py' 2024-02-08T11:42:08,632 adding 'colossalai/kernel/extensions/utils.py' 2024-02-08T11:42:08,634 adding 'colossalai/kernel/extensions/cpu_adam/__init__.py' 2024-02-08T11:42:08,636 adding 'colossalai/kernel/extensions/cpu_adam/cpu_adam_arm.py' 2024-02-08T11:42:08,637 adding 'colossalai/kernel/extensions/cpu_adam/cpu_adam_x86.py' 2024-02-08T11:42:08,639 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2024-02-08T11:42:08,640 adding 'colossalai/kernel/extensions/csrc/scaled_softmax.py' 2024-02-08T11:42:08,642 adding 'colossalai/kernel/extensions/flash_attention/__init__.py' 2024-02-08T11:42:08,643 adding 'colossalai/kernel/extensions/flash_attention/flash_attention_dao_cuda.py' 2024-02-08T11:42:08,645 adding 'colossalai/kernel/extensions/flash_attention/flash_attention_npu.py' 2024-02-08T11:42:08,646 adding 'colossalai/kernel/extensions/flash_attention/flash_attention_xformers_cuda.py' 2024-02-08T11:42:08,648 adding 'colossalai/kernel/extensions/layernorm/__init__.py' 2024-02-08T11:42:08,649 adding 'colossalai/kernel/extensions/layernorm/layernorm_cuda.py' 2024-02-08T11:42:08,651 adding 'colossalai/kernel/extensions/moe/__init__.py' 2024-02-08T11:42:08,652 adding 'colossalai/kernel/extensions/moe/moe_cuda.py' 2024-02-08T11:42:08,653 adding 'colossalai/kernel/extensions/optimizer/__init__.py' 2024-02-08T11:42:08,655 adding 'colossalai/kernel/extensions/optimizer/fused_optimizer_cuda.py' 2024-02-08T11:42:08,656 adding 'colossalai/kernel/extensions/softmax/__init__.py' 2024-02-08T11:42:08,657 adding 'colossalai/kernel/extensions/softmax/scaled_masked_softmax_cuda.py' 2024-02-08T11:42:08,658 adding 'colossalai/kernel/extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-02-08T11:42:08,660 adding 'colossalai/kernel/jit/__init__.py' 2024-02-08T11:42:08,661 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2024-02-08T11:42:08,662 adding 'colossalai/kernel/jit/bias_gelu.py' 2024-02-08T11:42:08,664 adding 'colossalai/kernel/jit/option.py' 2024-02-08T11:42:08,665 adding 'colossalai/kernel/triton/__init__.py' 2024-02-08T11:42:08,667 adding 'colossalai/kernel/triton/context_attention.py' 2024-02-08T11:42:08,669 adding 'colossalai/kernel/triton/copy_kv_cache_dest.py' 2024-02-08T11:42:08,670 adding 'colossalai/kernel/triton/custom_autotune.py' 2024-02-08T11:42:08,672 adding 'colossalai/kernel/triton/flash_decoding.py' 2024-02-08T11:42:08,673 adding 'colossalai/kernel/triton/fused_layernorm.py' 2024-02-08T11:42:08,675 adding 'colossalai/kernel/triton/gptq_triton.py' 2024-02-08T11:42:08,677 adding 'colossalai/kernel/triton/int8_rotary_embedding_kernel.py' 2024-02-08T11:42:08,678 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2024-02-08T11:42:08,679 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2024-02-08T11:42:08,681 adding 'colossalai/kernel/triton/self_attention_nofusion.py' 2024-02-08T11:42:08,683 adding 'colossalai/kernel/triton/smooth_attention.py' 2024-02-08T11:42:08,685 adding 'colossalai/kernel/triton/softmax.py' 2024-02-08T11:42:08,686 adding 'colossalai/kernel/triton/token_attention_kernel.py' 2024-02-08T11:42:08,688 adding 'colossalai/lazy/__init__.py' 2024-02-08T11:42:08,689 adding 'colossalai/lazy/construction.py' 2024-02-08T11:42:08,692 adding 'colossalai/lazy/lazy_init.py' 2024-02-08T11:42:08,695 adding 'colossalai/lazy/pretrained.py' 2024-02-08T11:42:08,697 adding 'colossalai/legacy/__init__.py' 2024-02-08T11:42:08,698 adding 'colossalai/legacy/constants.py' 2024-02-08T11:42:08,699 adding 'colossalai/legacy/core.py' 2024-02-08T11:42:08,700 adding 'colossalai/legacy/global_variables.py' 2024-02-08T11:42:08,703 adding 'colossalai/legacy/initialize.py' 2024-02-08T11:42:08,705 adding 'colossalai/legacy/amp/__init__.py' 2024-02-08T11:42:08,706 adding 'colossalai/legacy/amp/amp_type.py' 2024-02-08T11:42:08,708 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2024-02-08T11:42:08,709 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2024-02-08T11:42:08,711 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2024-02-08T11:42:08,713 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2024-02-08T11:42:08,715 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2024-02-08T11:42:08,716 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2024-02-08T11:42:08,718 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2024-02-08T11:42:08,721 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2024-02-08T11:42:08,723 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2024-02-08T11:42:08,725 adding 'colossalai/legacy/builder/__init__.py' 2024-02-08T11:42:08,726 adding 'colossalai/legacy/builder/builder.py' 2024-02-08T11:42:08,728 adding 'colossalai/legacy/communication/__init__.py' 2024-02-08T11:42:08,729 adding 'colossalai/legacy/communication/collective.py' 2024-02-08T11:42:08,732 adding 'colossalai/legacy/communication/p2p.py' 2024-02-08T11:42:08,734 adding 'colossalai/legacy/communication/p2p_v2.py' 2024-02-08T11:42:08,735 adding 'colossalai/legacy/communication/ring.py' 2024-02-08T11:42:08,736 adding 'colossalai/legacy/communication/utils.py' 2024-02-08T11:42:08,738 adding 'colossalai/legacy/context/__init__.py' 2024-02-08T11:42:08,741 adding 'colossalai/legacy/context/parallel_context.py' 2024-02-08T11:42:08,742 adding 'colossalai/legacy/context/parallel_mode.py' 2024-02-08T11:42:08,744 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2024-02-08T11:42:08,746 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2024-02-08T11:42:08,747 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2024-02-08T11:42:08,749 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2024-02-08T11:42:08,751 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2024-02-08T11:42:08,752 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2024-02-08T11:42:08,753 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2024-02-08T11:42:08,755 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2024-02-08T11:42:08,756 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2024-02-08T11:42:08,758 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2024-02-08T11:42:08,759 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2024-02-08T11:42:08,761 adding 'colossalai/legacy/context/random/__init__.py' 2024-02-08T11:42:08,762 adding 'colossalai/legacy/context/random/_helper.py' 2024-02-08T11:42:08,764 adding 'colossalai/legacy/context/random/seed_manager.py' 2024-02-08T11:42:08,765 adding 'colossalai/legacy/engine/__init__.py' 2024-02-08T11:42:08,767 adding 'colossalai/legacy/engine/_base_engine.py' 2024-02-08T11:42:08,769 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2024-02-08T11:42:08,771 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2024-02-08T11:42:08,773 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2024-02-08T11:42:08,774 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2024-02-08T11:42:08,775 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2024-02-08T11:42:08,776 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2024-02-08T11:42:08,778 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2024-02-08T11:42:08,779 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2024-02-08T11:42:08,781 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2024-02-08T11:42:08,782 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2024-02-08T11:42:08,783 adding 'colossalai/legacy/engine/schedule/__init__.py' 2024-02-08T11:42:08,785 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2024-02-08T11:42:08,786 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2024-02-08T11:42:08,790 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2024-02-08T11:42:08,792 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2024-02-08T11:42:08,794 adding 'colossalai/legacy/inference/__init__.py' 2024-02-08T11:42:08,795 adding 'colossalai/legacy/inference/async_engine.py' 2024-02-08T11:42:08,797 adding 'colossalai/legacy/inference/async_manager.py' 2024-02-08T11:42:08,799 adding 'colossalai/legacy/inference/manager.py' 2024-02-08T11:42:08,801 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2024-02-08T11:42:08,802 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2024-02-08T11:42:08,804 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2024-02-08T11:42:08,806 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2024-02-08T11:42:08,807 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2024-02-08T11:42:08,808 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2024-02-08T11:42:08,810 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2024-02-08T11:42:08,811 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2024-02-08T11:42:08,812 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2024-02-08T11:42:08,814 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2024-02-08T11:42:08,815 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2024-02-08T11:42:08,817 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2024-02-08T11:42:08,818 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2024-02-08T11:42:08,821 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2024-02-08T11:42:08,822 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2024-02-08T11:42:08,824 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2024-02-08T11:42:08,825 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2024-02-08T11:42:08,827 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2024-02-08T11:42:08,829 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2024-02-08T11:42:08,830 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2024-02-08T11:42:08,833 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2024-02-08T11:42:08,835 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2024-02-08T11:42:08,836 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2024-02-08T11:42:08,838 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2024-02-08T11:42:08,841 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2024-02-08T11:42:08,843 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2024-02-08T11:42:08,846 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2024-02-08T11:42:08,847 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2024-02-08T11:42:08,849 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2024-02-08T11:42:08,850 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2024-02-08T11:42:08,851 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2024-02-08T11:42:08,853 adding 'colossalai/legacy/nn/__init__.py' 2024-02-08T11:42:08,855 adding 'colossalai/legacy/nn/_ops/__init__.py' 2024-02-08T11:42:08,857 adding 'colossalai/legacy/nn/_ops/_utils.py' 2024-02-08T11:42:08,858 adding 'colossalai/legacy/nn/layer/__init__.py' 2024-02-08T11:42:08,860 adding 'colossalai/legacy/nn/layer/base_layer.py' 2024-02-08T11:42:08,861 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2024-02-08T11:42:08,863 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2024-02-08T11:42:08,864 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2024-02-08T11:42:08,866 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2024-02-08T11:42:08,867 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2024-02-08T11:42:08,869 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2024-02-08T11:42:08,871 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2024-02-08T11:42:08,872 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2024-02-08T11:42:08,873 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2024-02-08T11:42:08,877 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2024-02-08T11:42:08,879 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2024-02-08T11:42:08,882 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2024-02-08T11:42:08,884 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2024-02-08T11:42:08,887 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2024-02-08T11:42:08,889 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2024-02-08T11:42:08,892 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2024-02-08T11:42:08,894 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2024-02-08T11:42:08,897 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2024-02-08T11:42:08,899 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2024-02-08T11:42:08,902 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2024-02-08T11:42:08,903 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2024-02-08T11:42:08,906 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2024-02-08T11:42:08,908 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2024-02-08T11:42:08,910 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2024-02-08T11:42:08,911 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2024-02-08T11:42:08,913 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2024-02-08T11:42:08,914 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2024-02-08T11:42:08,916 adding 'colossalai/legacy/nn/layer/utils/common.py' 2024-02-08T11:42:08,917 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2024-02-08T11:42:08,920 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2024-02-08T11:42:08,921 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2024-02-08T11:42:08,923 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2024-02-08T11:42:08,924 adding 'colossalai/legacy/nn/loss/__init__.py' 2024-02-08T11:42:08,926 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2024-02-08T11:42:08,927 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2024-02-08T11:42:08,929 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2024-02-08T11:42:08,930 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2024-02-08T11:42:08,932 adding 'colossalai/legacy/nn/metric/__init__.py' 2024-02-08T11:42:08,933 adding 'colossalai/legacy/nn/metric/_utils.py' 2024-02-08T11:42:08,934 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2024-02-08T11:42:08,936 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2024-02-08T11:42:08,937 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2024-02-08T11:42:08,939 adding 'colossalai/legacy/nn/parallel/__init__.py' 2024-02-08T11:42:08,940 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2024-02-08T11:42:08,942 adding 'colossalai/legacy/nn/parallel/reducer.py' 2024-02-08T11:42:08,944 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2024-02-08T11:42:08,945 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2024-02-08T11:42:08,946 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2024-02-08T11:42:08,947 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2024-02-08T11:42:08,949 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2024-02-08T11:42:08,951 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2024-02-08T11:42:08,952 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2024-02-08T11:42:08,955 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2024-02-08T11:42:08,957 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2024-02-08T11:42:08,958 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2024-02-08T11:42:08,960 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2024-02-08T11:42:08,961 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2024-02-08T11:42:08,963 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2024-02-08T11:42:08,965 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2024-02-08T11:42:08,966 adding 'colossalai/legacy/pipeline/__init__.py' 2024-02-08T11:42:08,968 adding 'colossalai/legacy/pipeline/layer_spec.py' 2024-02-08T11:42:08,970 adding 'colossalai/legacy/pipeline/pipelinable.py' 2024-02-08T11:42:08,971 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2024-02-08T11:42:08,973 adding 'colossalai/legacy/pipeline/utils.py' 2024-02-08T11:42:08,975 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2024-02-08T11:42:08,976 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2024-02-08T11:42:08,978 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2024-02-08T11:42:08,979 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2024-02-08T11:42:08,981 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2024-02-08T11:42:08,987 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2024-02-08T11:42:08,989 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2024-02-08T11:42:08,991 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2024-02-08T11:42:08,993 adding 'colossalai/legacy/registry/__init__.py' 2024-02-08T11:42:08,994 adding 'colossalai/legacy/registry/registry.py' 2024-02-08T11:42:08,996 adding 'colossalai/legacy/tensor/__init__.py' 2024-02-08T11:42:08,997 adding 'colossalai/legacy/tensor/compute_spec.py' 2024-02-08T11:42:08,998 adding 'colossalai/legacy/tensor/const.py' 2024-02-08T11:42:09,000 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2024-02-08T11:42:09,001 adding 'colossalai/legacy/tensor/distspec.py' 2024-02-08T11:42:09,002 adding 'colossalai/legacy/tensor/op_wrapper.py' 2024-02-08T11:42:09,004 adding 'colossalai/legacy/tensor/process_group.py' 2024-02-08T11:42:09,005 adding 'colossalai/legacy/tensor/tensor_spec.py' 2024-02-08T11:42:09,007 adding 'colossalai/legacy/trainer/__init__.py' 2024-02-08T11:42:09,009 adding 'colossalai/legacy/trainer/_trainer.py' 2024-02-08T11:42:09,011 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2024-02-08T11:42:09,012 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2024-02-08T11:42:09,013 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2024-02-08T11:42:09,014 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2024-02-08T11:42:09,016 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2024-02-08T11:42:09,018 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2024-02-08T11:42:09,020 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2024-02-08T11:42:09,021 adding 'colossalai/legacy/utils/__init__.py' 2024-02-08T11:42:09,023 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2024-02-08T11:42:09,025 adding 'colossalai/legacy/utils/checkpointing.py' 2024-02-08T11:42:09,027 adding 'colossalai/legacy/utils/common.py' 2024-02-08T11:42:09,029 adding 'colossalai/legacy/utils/memory.py' 2024-02-08T11:42:09,031 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2024-02-08T11:42:09,032 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2024-02-08T11:42:09,034 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2024-02-08T11:42:09,036 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2024-02-08T11:42:09,037 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2024-02-08T11:42:09,038 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2024-02-08T11:42:09,040 adding 'colossalai/legacy/utils/profiler/__init__.py' 2024-02-08T11:42:09,041 adding 'colossalai/legacy/utils/profiler/extention.py' 2024-02-08T11:42:09,043 adding 'colossalai/legacy/utils/profiler/profiler.py' 2024-02-08T11:42:09,045 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2024-02-08T11:42:09,046 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2024-02-08T11:42:09,048 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2024-02-08T11:42:09,050 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2024-02-08T11:42:09,051 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2024-02-08T11:42:09,053 adding 'colossalai/legacy/zero/__init__.py' 2024-02-08T11:42:09,055 adding 'colossalai/legacy/zero/gemini/__init__.py' 2024-02-08T11:42:09,057 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2024-02-08T11:42:09,058 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2024-02-08T11:42:09,059 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2024-02-08T11:42:09,061 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2024-02-08T11:42:09,062 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2024-02-08T11:42:09,064 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2024-02-08T11:42:09,065 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2024-02-08T11:42:09,066 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2024-02-08T11:42:09,068 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2024-02-08T11:42:09,069 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2024-02-08T11:42:09,070 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2024-02-08T11:42:09,072 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2024-02-08T11:42:09,073 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2024-02-08T11:42:09,075 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2024-02-08T11:42:09,077 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2024-02-08T11:42:09,079 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2024-02-08T11:42:09,080 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2024-02-08T11:42:09,081 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2024-02-08T11:42:09,082 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2024-02-08T11:42:09,083 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2024-02-08T11:42:09,085 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2024-02-08T11:42:09,086 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2024-02-08T11:42:09,088 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2024-02-08T11:42:09,092 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2024-02-08T11:42:09,093 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2024-02-08T11:42:09,094 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2024-02-08T11:42:09,096 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2024-02-08T11:42:09,099 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2024-02-08T11:42:09,100 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2024-02-08T11:42:09,102 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2024-02-08T11:42:09,103 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2024-02-08T11:42:09,105 adding 'colossalai/logging/__init__.py' 2024-02-08T11:42:09,106 adding 'colossalai/logging/logger.py' 2024-02-08T11:42:09,108 adding 'colossalai/moe/__init__.py' 2024-02-08T11:42:09,110 adding 'colossalai/moe/_operation.py' 2024-02-08T11:42:09,114 adding 'colossalai/moe/checkpoint.py' 2024-02-08T11:42:09,116 adding 'colossalai/moe/experts.py' 2024-02-08T11:42:09,118 adding 'colossalai/moe/layers.py' 2024-02-08T11:42:09,120 adding 'colossalai/moe/load_balance.py' 2024-02-08T11:42:09,122 adding 'colossalai/moe/loss.py' 2024-02-08T11:42:09,124 adding 'colossalai/moe/manager.py' 2024-02-08T11:42:09,126 adding 'colossalai/moe/routers.py' 2024-02-08T11:42:09,128 adding 'colossalai/moe/utils.py' 2024-02-08T11:42:09,130 adding 'colossalai/nn/__init__.py' 2024-02-08T11:42:09,132 adding 'colossalai/nn/init.py' 2024-02-08T11:42:09,133 adding 'colossalai/nn/layer/__init__.py' 2024-02-08T11:42:09,135 adding 'colossalai/nn/layer/colo_attention.py' 2024-02-08T11:42:09,137 adding 'colossalai/nn/layer/layernorm.py' 2024-02-08T11:42:09,138 adding 'colossalai/nn/layer/scaled_softmax.py' 2024-02-08T11:42:09,140 adding 'colossalai/nn/layer/utils.py' 2024-02-08T11:42:09,141 adding 'colossalai/nn/loss/__init__.py' 2024-02-08T11:42:09,143 adding 'colossalai/nn/lr_scheduler/__init__.py' 2024-02-08T11:42:09,145 adding 'colossalai/nn/lr_scheduler/cosine.py' 2024-02-08T11:42:09,146 adding 'colossalai/nn/lr_scheduler/delayed.py' 2024-02-08T11:42:09,148 adding 'colossalai/nn/lr_scheduler/linear.py' 2024-02-08T11:42:09,149 adding 'colossalai/nn/lr_scheduler/multistep.py' 2024-02-08T11:42:09,150 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2024-02-08T11:42:09,151 adding 'colossalai/nn/lr_scheduler/poly.py' 2024-02-08T11:42:09,153 adding 'colossalai/nn/lr_scheduler/torch.py' 2024-02-08T11:42:09,154 adding 'colossalai/nn/optimizer/__init__.py' 2024-02-08T11:42:09,156 adding 'colossalai/nn/optimizer/cpu_adam.py' 2024-02-08T11:42:09,157 adding 'colossalai/nn/optimizer/fused_adam.py' 2024-02-08T11:42:09,159 adding 'colossalai/nn/optimizer/fused_lamb.py' 2024-02-08T11:42:09,161 adding 'colossalai/nn/optimizer/fused_sgd.py' 2024-02-08T11:42:09,163 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2024-02-08T11:42:09,165 adding 'colossalai/nn/optimizer/lamb.py' 2024-02-08T11:42:09,167 adding 'colossalai/nn/optimizer/lars.py' 2024-02-08T11:42:09,169 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2024-02-08T11:42:09,171 adding 'colossalai/pipeline/__init__.py' 2024-02-08T11:42:09,174 adding 'colossalai/pipeline/p2p.py' 2024-02-08T11:42:09,176 adding 'colossalai/pipeline/stage_manager.py' 2024-02-08T11:42:09,178 adding 'colossalai/pipeline/schedule/__init__.py' 2024-02-08T11:42:09,179 adding 'colossalai/pipeline/schedule/_utils.py' 2024-02-08T11:42:09,180 adding 'colossalai/pipeline/schedule/base.py' 2024-02-08T11:42:09,183 adding 'colossalai/pipeline/schedule/generate.py' 2024-02-08T11:42:09,186 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2024-02-08T11:42:09,188 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2024-02-08T11:42:09,190 adding 'colossalai/shardformer/__init__.py' 2024-02-08T11:42:09,192 adding 'colossalai/shardformer/_utils.py' 2024-02-08T11:42:09,193 adding 'colossalai/shardformer/layer/__init__.py' 2024-02-08T11:42:09,196 adding 'colossalai/shardformer/layer/_operation.py' 2024-02-08T11:42:09,197 adding 'colossalai/shardformer/layer/dropout.py' 2024-02-08T11:42:09,200 adding 'colossalai/shardformer/layer/embedding.py' 2024-02-08T11:42:09,202 adding 'colossalai/shardformer/layer/linear.py' 2024-02-08T11:42:09,204 adding 'colossalai/shardformer/layer/loss.py' 2024-02-08T11:42:09,206 adding 'colossalai/shardformer/layer/normalization.py' 2024-02-08T11:42:09,208 adding 'colossalai/shardformer/layer/parallel_module.py' 2024-02-08T11:42:09,211 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2024-02-08T11:42:09,213 adding 'colossalai/shardformer/layer/utils.py' 2024-02-08T11:42:09,215 adding 'colossalai/shardformer/modeling/__init__.py' 2024-02-08T11:42:09,220 adding 'colossalai/shardformer/modeling/bert.py' 2024-02-08T11:42:09,222 adding 'colossalai/shardformer/modeling/blip2.py' 2024-02-08T11:42:09,226 adding 'colossalai/shardformer/modeling/bloom.py' 2024-02-08T11:42:09,229 adding 'colossalai/shardformer/modeling/chatglm2.py' 2024-02-08T11:42:09,232 adding 'colossalai/shardformer/modeling/falcon.py' 2024-02-08T11:42:09,236 adding 'colossalai/shardformer/modeling/gpt2.py' 2024-02-08T11:42:09,240 adding 'colossalai/shardformer/modeling/gptj.py' 2024-02-08T11:42:09,242 adding 'colossalai/shardformer/modeling/jit.py' 2024-02-08T11:42:09,244 adding 'colossalai/shardformer/modeling/llama.py' 2024-02-08T11:42:09,246 adding 'colossalai/shardformer/modeling/mistral.py' 2024-02-08T11:42:09,249 adding 'colossalai/shardformer/modeling/opt.py' 2024-02-08T11:42:09,251 adding 'colossalai/shardformer/modeling/sam.py' 2024-02-08T11:42:09,254 adding 'colossalai/shardformer/modeling/t5.py' 2024-02-08T11:42:09,257 adding 'colossalai/shardformer/modeling/vit.py' 2024-02-08T11:42:09,261 adding 'colossalai/shardformer/modeling/whisper.py' 2024-02-08T11:42:09,263 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2024-02-08T11:42:09,265 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2024-02-08T11:42:09,270 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2024-02-08T11:42:09,273 adding 'colossalai/shardformer/policies/__init__.py' 2024-02-08T11:42:09,274 adding 'colossalai/shardformer/policies/auto_policy.py' 2024-02-08T11:42:09,276 adding 'colossalai/shardformer/policies/base_policy.py' 2024-02-08T11:42:09,278 adding 'colossalai/shardformer/policies/bert.py' 2024-02-08T11:42:09,280 adding 'colossalai/shardformer/policies/blip2.py' 2024-02-08T11:42:09,282 adding 'colossalai/shardformer/policies/bloom.py' 2024-02-08T11:42:09,283 adding 'colossalai/shardformer/policies/chatglm2.py' 2024-02-08T11:42:09,285 adding 'colossalai/shardformer/policies/falcon.py' 2024-02-08T11:42:09,287 adding 'colossalai/shardformer/policies/gpt2.py' 2024-02-08T11:42:09,289 adding 'colossalai/shardformer/policies/gptj.py' 2024-02-08T11:42:09,290 adding 'colossalai/shardformer/policies/llama.py' 2024-02-08T11:42:09,292 adding 'colossalai/shardformer/policies/mistral.py' 2024-02-08T11:42:09,294 adding 'colossalai/shardformer/policies/opt.py' 2024-02-08T11:42:09,295 adding 'colossalai/shardformer/policies/sam.py' 2024-02-08T11:42:09,297 adding 'colossalai/shardformer/policies/t5.py' 2024-02-08T11:42:09,299 adding 'colossalai/shardformer/policies/vit.py' 2024-02-08T11:42:09,301 adding 'colossalai/shardformer/policies/whisper.py' 2024-02-08T11:42:09,303 adding 'colossalai/shardformer/shard/__init__.py' 2024-02-08T11:42:09,304 adding 'colossalai/shardformer/shard/shard_config.py' 2024-02-08T11:42:09,306 adding 'colossalai/shardformer/shard/sharder.py' 2024-02-08T11:42:09,307 adding 'colossalai/shardformer/shard/shardformer.py' 2024-02-08T11:42:09,308 adding 'colossalai/shardformer/shard/utils.py' 2024-02-08T11:42:09,310 adding 'colossalai/tensor/__init__.py' 2024-02-08T11:42:09,311 adding 'colossalai/tensor/colo_parameter.py' 2024-02-08T11:42:09,313 adding 'colossalai/tensor/colo_tensor.py' 2024-02-08T11:42:09,315 adding 'colossalai/tensor/comm_spec.py' 2024-02-08T11:42:09,317 adding 'colossalai/tensor/param_op_hook.py' 2024-02-08T11:42:09,320 adding 'colossalai/tensor/shape_consistency.py' 2024-02-08T11:42:09,322 adding 'colossalai/tensor/sharding_spec.py' 2024-02-08T11:42:09,324 adding 'colossalai/tensor/utils.py' 2024-02-08T11:42:09,326 adding 'colossalai/tensor/d_tensor/__init__.py' 2024-02-08T11:42:09,328 adding 'colossalai/tensor/d_tensor/api.py' 2024-02-08T11:42:09,330 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2024-02-08T11:42:09,331 adding 'colossalai/tensor/d_tensor/layout.py' 2024-02-08T11:42:09,334 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2024-02-08T11:42:09,335 adding 'colossalai/tensor/d_tensor/misc.py' 2024-02-08T11:42:09,337 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2024-02-08T11:42:09,338 adding 'colossalai/tensor/d_tensor/utils.py' 2024-02-08T11:42:09,340 adding 'colossalai/tensor/moe_tensor/__init__.py' 2024-02-08T11:42:09,341 adding 'colossalai/tensor/moe_tensor/api.py' 2024-02-08T11:42:09,342 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2024-02-08T11:42:09,344 adding 'colossalai/testing/__init__.py' 2024-02-08T11:42:09,346 adding 'colossalai/testing/comparison.py' 2024-02-08T11:42:09,347 adding 'colossalai/testing/pytest_wrapper.py' 2024-02-08T11:42:09,348 adding 'colossalai/testing/random.py' 2024-02-08T11:42:09,350 adding 'colossalai/testing/utils.py' 2024-02-08T11:42:09,352 adding 'colossalai/utils/__init__.py' 2024-02-08T11:42:09,353 adding 'colossalai/utils/common.py' 2024-02-08T11:42:09,354 adding 'colossalai/utils/memory.py' 2024-02-08T11:42:09,356 adding 'colossalai/utils/timer.py' 2024-02-08T11:42:09,358 adding 'colossalai/utils/model/__init__.py' 2024-02-08T11:42:09,359 adding 'colossalai/utils/model/utils.py' 2024-02-08T11:42:09,361 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2024-02-08T11:42:09,362 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2024-02-08T11:42:09,364 adding 'colossalai/utils/rank_recorder/__init__.py' 2024-02-08T11:42:09,365 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2024-02-08T11:42:09,367 adding 'colossalai/utils/tensor_detector/__init__.py' 2024-02-08T11:42:09,369 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2024-02-08T11:42:09,370 adding 'colossalai/zero/__init__.py' 2024-02-08T11:42:09,372 adding 'colossalai/zero/wrapper.py' 2024-02-08T11:42:09,374 adding 'colossalai/zero/gemini/__init__.py' 2024-02-08T11:42:09,378 adding 'colossalai/zero/gemini/gemini_ddp.py' 2024-02-08T11:42:09,380 adding 'colossalai/zero/gemini/gemini_hook.py' 2024-02-08T11:42:09,381 adding 'colossalai/zero/gemini/gemini_mgr.py' 2024-02-08T11:42:09,385 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2024-02-08T11:42:09,387 adding 'colossalai/zero/gemini/placement_policy.py' 2024-02-08T11:42:09,389 adding 'colossalai/zero/gemini/utils.py' 2024-02-08T11:42:09,390 adding 'colossalai/zero/gemini/chunk/__init__.py' 2024-02-08T11:42:09,393 adding 'colossalai/zero/gemini/chunk/chunk.py' 2024-02-08T11:42:09,395 adding 'colossalai/zero/gemini/chunk/manager.py' 2024-02-08T11:42:09,397 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2024-02-08T11:42:09,398 adding 'colossalai/zero/gemini/chunk/utils.py' 2024-02-08T11:42:09,400 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2024-02-08T11:42:09,401 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2024-02-08T11:42:09,402 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2024-02-08T11:42:09,404 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2024-02-08T11:42:09,405 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2024-02-08T11:42:09,406 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2024-02-08T11:42:09,407 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2024-02-08T11:42:09,409 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2024-02-08T11:42:09,410 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2024-02-08T11:42:09,412 adding 'colossalai/zero/low_level/__init__.py' 2024-02-08T11:42:09,413 adding 'colossalai/zero/low_level/_utils.py' 2024-02-08T11:42:09,418 adding 'colossalai/zero/low_level/low_level_optim.py' 2024-02-08T11:42:09,420 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2024-02-08T11:42:09,421 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2024-02-08T11:42:09,423 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2024-02-08T11:42:09,424 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2024-02-08T11:42:09,425 adding 'colossalai/zero/low_level/bookkeeping/parameter_store.py' 2024-02-08T11:42:09,426 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2024-02-08T11:42:09,429 adding 'extensions/__init__.py' 2024-02-08T11:42:09,431 adding 'extensions/base_extension.py' 2024-02-08T11:42:09,432 adding 'extensions/cpp_extension.py' 2024-02-08T11:42:09,433 adding 'extensions/cuda_extension.py' 2024-02-08T11:42:09,435 adding 'extensions/triton_extension.py' 2024-02-08T11:42:09,437 adding 'extensions/utils.py' 2024-02-08T11:42:09,438 adding 'extensions/cpu_adam/__init__.py' 2024-02-08T11:42:09,439 adding 'extensions/cpu_adam/cpu_adam_arm.py' 2024-02-08T11:42:09,441 adding 'extensions/cpu_adam/cpu_adam_x86.py' 2024-02-08T11:42:09,442 adding 'extensions/csrc/__init__.py' 2024-02-08T11:42:09,444 adding 'extensions/csrc/scaled_softmax.py' 2024-02-08T11:42:09,446 adding 'extensions/flash_attention/__init__.py' 2024-02-08T11:42:09,447 adding 'extensions/flash_attention/flash_attention_dao_cuda.py' 2024-02-08T11:42:09,448 adding 'extensions/flash_attention/flash_attention_npu.py' 2024-02-08T11:42:09,450 adding 'extensions/flash_attention/flash_attention_xformers_cuda.py' 2024-02-08T11:42:09,452 adding 'extensions/layernorm/__init__.py' 2024-02-08T11:42:09,453 adding 'extensions/layernorm/layernorm_cuda.py' 2024-02-08T11:42:09,455 adding 'extensions/moe/__init__.py' 2024-02-08T11:42:09,456 adding 'extensions/moe/moe_cuda.py' 2024-02-08T11:42:09,458 adding 'extensions/optimizer/__init__.py' 2024-02-08T11:42:09,459 adding 'extensions/optimizer/fused_optimizer_cuda.py' 2024-02-08T11:42:09,461 adding 'extensions/softmax/__init__.py' 2024-02-08T11:42:09,462 adding 'extensions/softmax/scaled_masked_softmax_cuda.py' 2024-02-08T11:42:09,463 adding 'extensions/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-02-08T11:42:09,466 adding 'colossalai-0.3.5.dist-info/LICENSE' 2024-02-08T11:42:09,469 adding 'colossalai-0.3.5.dist-info/METADATA' 2024-02-08T11:42:09,470 adding 'colossalai-0.3.5.dist-info/WHEEL' 2024-02-08T11:42:09,471 adding 'colossalai-0.3.5.dist-info/entry_points.txt' 2024-02-08T11:42:09,472 adding 'colossalai-0.3.5.dist-info/top_level.txt' 2024-02-08T11:42:09,486 adding 'colossalai-0.3.5.dist-info/RECORD' 2024-02-08T11:42:09,510 removing build/bdist.linux-armv7l/wheel 2024-02-08T11:42:09,824 Building wheel for colossalai (setup.py): finished with status 'done' 2024-02-08T11:42:09,840 Created wheel for colossalai: filename=colossalai-0.3.5-py3-none-any.whl size=1345126 sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b 2024-02-08T11:42:09,841 Stored in directory: /tmp/pip-ephem-wheel-cache-d6znsanc/wheels/a6/41/fb/18506c67ad7778a43a7e8cafb8a8c983c9f9d5e82cb311335e 2024-02-08T11:42:09,878 Successfully built colossalai 2024-02-08T11:42:09,925 Removed build tracker: '/tmp/pip-build-tracker-zs4i8dze'