2024-06-28T03:44:44,240 Created temporary directory: /tmp/pip-build-tracker-1i0t853x 2024-06-28T03:44:44,241 Initialized build tracking at /tmp/pip-build-tracker-1i0t853x 2024-06-28T03:44:44,242 Created build tracker: /tmp/pip-build-tracker-1i0t853x 2024-06-28T03:44:44,242 Entered build tracker: /tmp/pip-build-tracker-1i0t853x 2024-06-28T03:44:44,243 Created temporary directory: /tmp/pip-wheel-oryl0xsf 2024-06-28T03:44:44,247 Created temporary directory: /tmp/pip-ephem-wheel-cache-uenwh2b0 2024-06-28T03:44:44,269 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-06-28T03:44:44,272 2 location(s) to search for versions of colossalai: 2024-06-28T03:44:44,272 * https://pypi.org/simple/colossalai/ 2024-06-28T03:44:44,272 * https://www.piwheels.org/simple/colossalai/ 2024-06-28T03:44:44,273 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2024-06-28T03:44:44,274 Getting page https://pypi.org/simple/colossalai/ 2024-06-28T03:44:44,276 Found index url https://pypi.org/simple/ 2024-06-28T03:44:44,489 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2024-06-28T03:44:44,494 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2024-06-28T03:44:44,495 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2024-06-28T03:44:44,496 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2024-06-28T03:44:44,497 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2024-06-28T03:44:44,498 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2024-06-28T03:44:44,499 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2024-06-28T03:44:44,499 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2024-06-28T03:44:44,500 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2024-06-28T03:44:44,501 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2024-06-28T03:44:44,502 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2024-06-28T03:44:44,503 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2024-06-28T03:44:44,504 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2024-06-28T03:44:44,505 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2024-06-28T03:44:44,506 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2024-06-28T03:44:44,507 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2024-06-28T03:44:44,508 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2024-06-28T03:44:44,509 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2024-06-28T03:44:44,510 Found link https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.8 2024-06-28T03:44:44,510 Found link https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.9 2024-06-28T03:44:44,511 Found link https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.0 2024-06-28T03:44:44,512 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2024-06-28T03:44:44,513 Getting page https://www.piwheels.org/simple/colossalai/ 2024-06-28T03:44:44,514 Found index url https://www.piwheels.org/simple/ 2024-06-28T03:44:44,676 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2024-06-28T03:44:44,682 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.9-py3-none-any.whl#sha256=670e4e0d607a0803e8f0a7349996228f4cfa411d817bd631c07b1b2064e7af48 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,683 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.8-py3-none-any.whl#sha256=73a2dba29be661597422944d917c709df77c91843d30ab323f6c740173686dab (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,683 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.7-py3-none-any.whl#sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,684 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,684 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,685 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,686 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,687 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,687 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,687 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,688 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,688 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,689 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,690 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,690 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,691 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,692 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,692 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,693 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-06-28T03:44:44,693 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2024-06-28T03:44:44,694 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2024-06-28T03:44:44,716 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2024-06-28T03:44:44,736 Collecting colossalai==0.4.0 2024-06-28T03:44:44,738 Created temporary directory: /tmp/pip-unpack-3dhsdrl4 2024-06-28T03:44:45,104 Downloading colossalai-0.4.0.tar.gz (1.3 MB) 2024-06-28T03:44:47,472 Added colossalai==0.4.0 from https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz to build tracker '/tmp/pip-build-tracker-1i0t853x' 2024-06-28T03:44:47,474 Running setup.py (path:/tmp/pip-wheel-oryl0xsf/colossalai_0d808c5900644caba0ceddbfaeb5eeb1/setup.py) egg_info for package colossalai 2024-06-28T03:44:47,475 Created temporary directory: /tmp/pip-pip-egg-info-krwa_d97 2024-06-28T03:44:47,475 Preparing metadata (setup.py): started 2024-06-28T03:44:47,476 Running command python setup.py egg_info 2024-06-28T03:44:48,666 running egg_info 2024-06-28T03:44:48,668 creating /tmp/pip-pip-egg-info-krwa_d97/colossalai.egg-info 2024-06-28T03:44:48,693 writing /tmp/pip-pip-egg-info-krwa_d97/colossalai.egg-info/PKG-INFO 2024-06-28T03:44:48,698 writing dependency_links to /tmp/pip-pip-egg-info-krwa_d97/colossalai.egg-info/dependency_links.txt 2024-06-28T03:44:48,700 writing entry points to /tmp/pip-pip-egg-info-krwa_d97/colossalai.egg-info/entry_points.txt 2024-06-28T03:44:48,702 writing requirements to /tmp/pip-pip-egg-info-krwa_d97/colossalai.egg-info/requires.txt 2024-06-28T03:44:48,703 writing top-level names to /tmp/pip-pip-egg-info-krwa_d97/colossalai.egg-info/top_level.txt 2024-06-28T03:44:48,705 writing manifest file '/tmp/pip-pip-egg-info-krwa_d97/colossalai.egg-info/SOURCES.txt' 2024-06-28T03:44:48,972 reading manifest file '/tmp/pip-pip-egg-info-krwa_d97/colossalai.egg-info/SOURCES.txt' 2024-06-28T03:44:48,974 reading manifest template 'MANIFEST.in' 2024-06-28T03:44:50,206 warning: no files found matching '*.tr' under directory 'colossalai' 2024-06-28T03:44:50,806 warning: no files found matching '*.cc' under directory 'colossalai' 2024-06-28T03:44:51,109 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-06-28T03:44:51,241 warning: no files found matching '*.tr' under directory 'extensions' 2024-06-28T03:44:51,292 warning: no files found matching '*.cc' under directory 'extensions' 2024-06-28T03:44:51,317 warning: no files found matching '*.pyi' under directory 'extensions' 2024-06-28T03:44:51,318 adding license file 'LICENSE' 2024-06-28T03:44:51,348 writing manifest file '/tmp/pip-pip-egg-info-krwa_d97/colossalai.egg-info/SOURCES.txt' 2024-06-28T03:44:51,470 Preparing metadata (setup.py): finished with status 'done' 2024-06-28T03:44:51,476 Source in /tmp/pip-wheel-oryl0xsf/colossalai_0d808c5900644caba0ceddbfaeb5eeb1 has version 0.4.0, which satisfies requirement colossalai==0.4.0 from https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz 2024-06-28T03:44:51,477 Removed colossalai==0.4.0 from https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz from build tracker '/tmp/pip-build-tracker-1i0t853x' 2024-06-28T03:44:51,486 Created temporary directory: /tmp/pip-unpack-3v7na6c1 2024-06-28T03:44:51,487 Created temporary directory: /tmp/pip-unpack-xg50w5yu 2024-06-28T03:44:51,520 Building wheels for collected packages: colossalai 2024-06-28T03:44:51,525 Created temporary directory: /tmp/pip-wheel-4dnh92iy 2024-06-28T03:44:51,526 Building wheel for colossalai (setup.py): started 2024-06-28T03:44:51,528 Destination directory: /tmp/pip-wheel-4dnh92iy 2024-06-28T03:44:51,528 Running command python setup.py bdist_wheel 2024-06-28T03:44:52,701 running bdist_wheel 2024-06-28T03:44:52,802 running build 2024-06-28T03:44:52,802 running build_py 2024-06-28T03:44:52,830 creating build 2024-06-28T03:44:52,831 creating build/lib 2024-06-28T03:44:52,832 creating build/lib/colossalai 2024-06-28T03:44:52,833 copying colossalai/initialize.py -> build/lib/colossalai 2024-06-28T03:44:52,835 copying colossalai/version.py -> build/lib/colossalai 2024-06-28T03:44:52,836 copying colossalai/__init__.py -> build/lib/colossalai 2024-06-28T03:44:52,839 creating build/lib/colossalai/shardformer 2024-06-28T03:44:52,840 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2024-06-28T03:44:52,842 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2024-06-28T03:44:52,844 creating build/lib/colossalai/zero 2024-06-28T03:44:52,844 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2024-06-28T03:44:52,847 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2024-06-28T03:44:52,849 creating build/lib/colossalai/utils 2024-06-28T03:44:52,850 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2024-06-28T03:44:52,852 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2024-06-28T03:44:52,854 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2024-06-28T03:44:52,856 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2024-06-28T03:44:52,858 creating build/lib/colossalai/fx 2024-06-28T03:44:52,859 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2024-06-28T03:44:52,861 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2024-06-28T03:44:52,863 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2024-06-28T03:44:52,864 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2024-06-28T03:44:52,867 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2024-06-28T03:44:52,869 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2024-06-28T03:44:52,871 creating build/lib/colossalai/device 2024-06-28T03:44:52,872 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2024-06-28T03:44:52,875 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2024-06-28T03:44:52,878 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2024-06-28T03:44:52,880 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2024-06-28T03:44:52,882 creating build/lib/colossalai/checkpoint_io 2024-06-28T03:44:52,883 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2024-06-28T03:44:52,885 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-06-28T03:44:52,889 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-06-28T03:44:52,891 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2024-06-28T03:44:52,894 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2024-06-28T03:44:52,895 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2024-06-28T03:44:52,898 creating build/lib/colossalai/auto_parallel 2024-06-28T03:44:52,899 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2024-06-28T03:44:52,902 creating build/lib/colossalai/testing 2024-06-28T03:44:52,903 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2024-06-28T03:44:52,905 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2024-06-28T03:44:52,907 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2024-06-28T03:44:52,909 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2024-06-28T03:44:52,911 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2024-06-28T03:44:52,913 creating build/lib/colossalai/_C 2024-06-28T03:44:52,914 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2024-06-28T03:44:52,916 creating build/lib/colossalai/_analyzer 2024-06-28T03:44:52,917 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2024-06-28T03:44:52,919 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2024-06-28T03:44:52,921 creating build/lib/colossalai/logging 2024-06-28T03:44:52,922 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2024-06-28T03:44:52,924 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2024-06-28T03:44:52,927 creating build/lib/colossalai/cli 2024-06-28T03:44:52,927 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2024-06-28T03:44:52,929 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2024-06-28T03:44:52,931 creating build/lib/colossalai/accelerator 2024-06-28T03:44:52,932 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2024-06-28T03:44:52,935 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2024-06-28T03:44:52,936 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2024-06-28T03:44:52,938 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2024-06-28T03:44:52,940 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2024-06-28T03:44:52,943 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2024-06-28T03:44:52,945 creating build/lib/colossalai/interface 2024-06-28T03:44:52,946 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2024-06-28T03:44:52,948 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2024-06-28T03:44:52,949 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2024-06-28T03:44:52,951 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2024-06-28T03:44:52,953 creating build/lib/colossalai/kernel 2024-06-28T03:44:52,954 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2024-06-28T03:44:52,956 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2024-06-28T03:44:52,958 creating build/lib/colossalai/nn 2024-06-28T03:44:52,959 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2024-06-28T03:44:52,962 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2024-06-28T03:44:52,964 creating build/lib/colossalai/context 2024-06-28T03:44:52,965 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2024-06-28T03:44:52,967 copying colossalai/context/config.py -> build/lib/colossalai/context 2024-06-28T03:44:52,968 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2024-06-28T03:44:52,971 creating build/lib/colossalai/tensor 2024-06-28T03:44:52,972 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2024-06-28T03:44:52,974 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2024-06-28T03:44:52,976 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2024-06-28T03:44:52,978 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2024-06-28T03:44:52,981 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2024-06-28T03:44:52,983 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2024-06-28T03:44:52,984 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2024-06-28T03:44:52,987 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2024-06-28T03:44:52,990 creating build/lib/colossalai/cluster 2024-06-28T03:44:52,991 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2024-06-28T03:44:52,993 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2024-06-28T03:44:52,995 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2024-06-28T03:44:52,997 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2024-06-28T03:44:52,999 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2024-06-28T03:44:53,002 creating build/lib/colossalai/booster 2024-06-28T03:44:53,002 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2024-06-28T03:44:53,004 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2024-06-28T03:44:53,006 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2024-06-28T03:44:53,009 creating build/lib/colossalai/lazy 2024-06-28T03:44:53,009 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2024-06-28T03:44:53,012 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2024-06-28T03:44:53,013 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2024-06-28T03:44:53,015 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2024-06-28T03:44:53,018 creating build/lib/colossalai/pipeline 2024-06-28T03:44:53,019 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2024-06-28T03:44:53,021 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2024-06-28T03:44:53,023 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2024-06-28T03:44:53,025 creating build/lib/colossalai/legacy 2024-06-28T03:44:53,026 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2024-06-28T03:44:53,028 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2024-06-28T03:44:53,030 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2024-06-28T03:44:53,032 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2024-06-28T03:44:53,034 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2024-06-28T03:44:53,036 creating build/lib/colossalai/amp 2024-06-28T03:44:53,037 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2024-06-28T03:44:53,039 creating build/lib/colossalai/inference 2024-06-28T03:44:53,040 copying colossalai/inference/config.py -> build/lib/colossalai/inference 2024-06-28T03:44:53,042 copying colossalai/inference/utils.py -> build/lib/colossalai/inference 2024-06-28T03:44:53,044 copying colossalai/inference/logit_processors.py -> build/lib/colossalai/inference 2024-06-28T03:44:53,046 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2024-06-28T03:44:53,048 copying colossalai/inference/sampler.py -> build/lib/colossalai/inference 2024-06-28T03:44:53,050 copying colossalai/inference/batch_bucket.py -> build/lib/colossalai/inference 2024-06-28T03:44:53,053 copying colossalai/inference/struct.py -> build/lib/colossalai/inference 2024-06-28T03:44:53,055 copying colossalai/inference/graph_runner.py -> build/lib/colossalai/inference 2024-06-28T03:44:53,057 copying colossalai/inference/flash_decoding_utils.py -> build/lib/colossalai/inference 2024-06-28T03:44:53,059 creating build/lib/colossalai/quantization 2024-06-28T03:44:53,060 copying colossalai/quantization/bnb.py -> build/lib/colossalai/quantization 2024-06-28T03:44:53,062 copying colossalai/quantization/__init__.py -> build/lib/colossalai/quantization 2024-06-28T03:44:53,064 copying colossalai/quantization/bnb_config.py -> build/lib/colossalai/quantization 2024-06-28T03:44:53,067 creating build/lib/colossalai/moe 2024-06-28T03:44:53,068 copying colossalai/moe/checkpoint.py -> build/lib/colossalai/moe 2024-06-28T03:44:53,071 copying colossalai/moe/loss.py -> build/lib/colossalai/moe 2024-06-28T03:44:53,073 copying colossalai/moe/load_balance.py -> build/lib/colossalai/moe 2024-06-28T03:44:53,076 copying colossalai/moe/utils.py -> build/lib/colossalai/moe 2024-06-28T03:44:53,078 copying colossalai/moe/layers.py -> build/lib/colossalai/moe 2024-06-28T03:44:53,081 copying colossalai/moe/routers.py -> build/lib/colossalai/moe 2024-06-28T03:44:53,083 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2024-06-28T03:44:53,085 copying colossalai/moe/manager.py -> build/lib/colossalai/moe 2024-06-28T03:44:53,087 copying colossalai/moe/experts.py -> build/lib/colossalai/moe 2024-06-28T03:44:53,090 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2024-06-28T03:44:53,093 creating build/lib/colossalai/shardformer/layer 2024-06-28T03:44:53,094 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2024-06-28T03:44:53,096 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2024-06-28T03:44:53,099 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2024-06-28T03:44:53,101 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2024-06-28T03:44:53,103 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2024-06-28T03:44:53,106 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2024-06-28T03:44:53,109 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2024-06-28T03:44:53,111 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2024-06-28T03:44:53,113 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2024-06-28T03:44:53,115 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2024-06-28T03:44:53,117 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2024-06-28T03:44:53,121 creating build/lib/colossalai/shardformer/shard 2024-06-28T03:44:53,122 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2024-06-28T03:44:53,124 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2024-06-28T03:44:53,126 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2024-06-28T03:44:53,127 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2024-06-28T03:44:53,129 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2024-06-28T03:44:53,131 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2024-06-28T03:44:53,134 creating build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,135 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,138 copying colossalai/shardformer/modeling/qwen2.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,141 copying colossalai/shardformer/modeling/command.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,144 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,147 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,150 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,152 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,155 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,158 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,160 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,163 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,166 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,169 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,171 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,174 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,177 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,179 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,182 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2024-06-28T03:44:53,185 creating build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,185 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,188 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,190 copying colossalai/shardformer/policies/qwen2.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,192 copying colossalai/shardformer/policies/command.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,194 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,196 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,199 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,201 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,203 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,206 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,208 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,210 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,212 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,214 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,217 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,219 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,221 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,224 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,226 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2024-06-28T03:44:53,229 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-06-28T03:44:53,230 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-06-28T03:44:53,232 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-06-28T03:44:53,234 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-06-28T03:44:53,237 creating build/lib/colossalai/zero/gemini 2024-06-28T03:44:53,238 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2024-06-28T03:44:53,240 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2024-06-28T03:44:53,242 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2024-06-28T03:44:53,244 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2024-06-28T03:44:53,246 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2024-06-28T03:44:53,249 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2024-06-28T03:44:53,252 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2024-06-28T03:44:53,255 creating build/lib/colossalai/zero/low_level 2024-06-28T03:44:53,255 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2024-06-28T03:44:53,259 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2024-06-28T03:44:53,261 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2024-06-28T03:44:53,263 creating build/lib/colossalai/zero/gemini/chunk 2024-06-28T03:44:53,263 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-06-28T03:44:53,266 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2024-06-28T03:44:53,268 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-06-28T03:44:53,270 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2024-06-28T03:44:53,271 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2024-06-28T03:44:53,274 creating build/lib/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:53,275 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:53,277 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:53,279 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:53,281 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:53,282 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:53,284 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:53,286 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:53,288 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:53,289 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:53,292 creating build/lib/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:53,292 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:53,295 copying colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:53,297 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:53,299 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:53,301 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:53,303 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:53,305 creating build/lib/colossalai/utils/multi_tensor_apply 2024-06-28T03:44:53,306 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-06-28T03:44:53,307 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-06-28T03:44:53,309 creating build/lib/colossalai/utils/model 2024-06-28T03:44:53,311 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2024-06-28T03:44:53,313 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2024-06-28T03:44:53,315 creating build/lib/colossalai/utils/rank_recorder 2024-06-28T03:44:53,316 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2024-06-28T03:44:53,318 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2024-06-28T03:44:53,320 creating build/lib/colossalai/utils/tensor_detector 2024-06-28T03:44:53,321 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2024-06-28T03:44:53,323 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2024-06-28T03:44:53,325 creating build/lib/colossalai/fx/codegen 2024-06-28T03:44:53,326 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2024-06-28T03:44:53,328 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2024-06-28T03:44:53,331 creating build/lib/colossalai/fx/tracer 2024-06-28T03:44:53,332 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2024-06-28T03:44:53,334 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2024-06-28T03:44:53,336 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2024-06-28T03:44:53,338 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2024-06-28T03:44:53,339 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2024-06-28T03:44:53,342 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2024-06-28T03:44:53,344 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2024-06-28T03:44:53,347 creating build/lib/colossalai/fx/profiler 2024-06-28T03:44:53,348 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2024-06-28T03:44:53,349 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2024-06-28T03:44:53,352 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2024-06-28T03:44:53,354 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2024-06-28T03:44:53,356 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2024-06-28T03:44:53,358 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2024-06-28T03:44:53,359 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2024-06-28T03:44:53,362 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2024-06-28T03:44:53,364 creating build/lib/colossalai/fx/passes 2024-06-28T03:44:53,365 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2024-06-28T03:44:53,368 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2024-06-28T03:44:53,370 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2024-06-28T03:44:53,372 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2024-06-28T03:44:53,374 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2024-06-28T03:44:53,376 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2024-06-28T03:44:53,379 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2024-06-28T03:44:53,380 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2024-06-28T03:44:53,383 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2024-06-28T03:44:53,384 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2024-06-28T03:44:53,386 creating build/lib/colossalai/fx/tracer/meta_patch 2024-06-28T03:44:53,387 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2024-06-28T03:44:53,390 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-28T03:44:53,391 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-28T03:44:53,393 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-28T03:44:53,395 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-28T03:44:53,397 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-28T03:44:53,398 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-28T03:44:53,400 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-28T03:44:53,401 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-28T03:44:53,403 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-28T03:44:53,405 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-28T03:44:53,407 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-28T03:44:53,409 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:53,410 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:53,412 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:53,413 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:53,415 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:53,417 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:53,419 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:53,421 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:53,423 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:53,426 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:53,427 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:53,428 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:53,430 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:53,432 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:53,435 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:53,436 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:53,438 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:53,440 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:53,442 creating build/lib/colossalai/fx/profiler/experimental 2024-06-28T03:44:53,443 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2024-06-28T03:44:53,444 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2024-06-28T03:44:53,446 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2024-06-28T03:44:53,448 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2024-06-28T03:44:53,450 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2024-06-28T03:44:53,452 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:53,453 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:53,455 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:53,457 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:53,458 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:53,460 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:53,462 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:53,464 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:53,466 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:53,468 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:53,469 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:53,471 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:53,473 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:53,474 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:53,476 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:53,478 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:53,480 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:53,481 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:53,483 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:53,485 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:53,486 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:53,488 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:53,490 creating build/lib/colossalai/auto_parallel/meta_profiler 2024-06-28T03:44:53,491 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-06-28T03:44:53,492 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-06-28T03:44:53,494 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-06-28T03:44:53,496 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-06-28T03:44:53,498 creating build/lib/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:53,499 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:53,501 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:53,503 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:53,505 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:53,507 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:53,509 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:53,512 creating build/lib/colossalai/auto_parallel/offload 2024-06-28T03:44:53,513 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2024-06-28T03:44:53,515 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2024-06-28T03:44:53,517 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2024-06-28T03:44:53,519 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2024-06-28T03:44:53,521 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2024-06-28T03:44:53,523 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2024-06-28T03:44:53,526 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2024-06-28T03:44:53,528 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2024-06-28T03:44:53,530 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2024-06-28T03:44:53,532 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2024-06-28T03:44:53,535 creating build/lib/colossalai/auto_parallel/tensor_shard 2024-06-28T03:44:53,536 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-06-28T03:44:53,538 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-06-28T03:44:53,540 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-06-28T03:44:53,542 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-06-28T03:44:53,544 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-06-28T03:44:53,546 creating build/lib/colossalai/auto_parallel/pipeline_shard 2024-06-28T03:44:53,547 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2024-06-28T03:44:53,549 creating build/lib/colossalai/auto_parallel/passes 2024-06-28T03:44:53,550 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2024-06-28T03:44:53,552 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-06-28T03:44:53,554 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-06-28T03:44:53,556 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2024-06-28T03:44:53,558 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2024-06-28T03:44:53,559 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-06-28T03:44:53,562 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:53,563 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:53,565 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:53,567 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:53,569 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:53,571 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:53,573 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:53,575 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:53,577 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:53,579 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:53,581 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:53,583 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:53,585 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:53,586 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:53,589 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:53,591 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:53,593 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:53,595 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:53,597 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:53,600 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-06-28T03:44:53,600 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-06-28T03:44:53,603 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-06-28T03:44:53,605 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-06-28T03:44:53,607 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-06-28T03:44:53,609 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-06-28T03:44:53,612 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,613 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,614 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,616 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,618 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,620 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,622 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,624 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,626 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,628 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,630 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,632 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,634 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,636 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,639 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,641 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,643 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,645 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,647 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,648 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,651 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,652 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,654 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,656 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,658 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,659 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,661 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,663 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:53,666 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,666 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,669 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,671 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,673 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,676 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,678 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,680 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,682 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,684 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,686 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,689 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,692 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,694 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,696 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,698 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,700 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,702 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,704 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,706 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:53,709 creating build/lib/colossalai/_analyzer/fx 2024-06-28T03:44:53,709 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2024-06-28T03:44:53,711 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2024-06-28T03:44:53,713 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2024-06-28T03:44:53,715 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2024-06-28T03:44:53,717 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2024-06-28T03:44:53,720 creating build/lib/colossalai/_analyzer/_subclasses 2024-06-28T03:44:53,721 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2024-06-28T03:44:53,723 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-06-28T03:44:53,726 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-06-28T03:44:53,728 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2024-06-28T03:44:53,731 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2024-06-28T03:44:53,733 creating build/lib/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:53,734 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:53,737 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:53,739 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:53,741 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:53,744 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:53,747 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:53,750 creating build/lib/colossalai/_analyzer/fx/passes 2024-06-28T03:44:53,751 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2024-06-28T03:44:53,754 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2024-06-28T03:44:53,757 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2024-06-28T03:44:53,760 creating build/lib/colossalai/cli/check 2024-06-28T03:44:53,761 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2024-06-28T03:44:53,764 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2024-06-28T03:44:53,768 creating build/lib/colossalai/cli/launcher 2024-06-28T03:44:53,769 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2024-06-28T03:44:53,772 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2024-06-28T03:44:53,774 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2024-06-28T03:44:53,777 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2024-06-28T03:44:53,780 creating build/lib/colossalai/kernel/triton 2024-06-28T03:44:53,781 copying colossalai/kernel/triton/kvcache_copy.py -> build/lib/colossalai/kernel/triton 2024-06-28T03:44:53,784 copying colossalai/kernel/triton/rotary_cache_copy.py -> build/lib/colossalai/kernel/triton 2024-06-28T03:44:53,786 copying colossalai/kernel/triton/context_attn_unpad.py -> build/lib/colossalai/kernel/triton 2024-06-28T03:44:53,790 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2024-06-28T03:44:53,793 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2024-06-28T03:44:53,795 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2024-06-28T03:44:53,798 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2024-06-28T03:44:53,801 copying colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-06-28T03:44:53,804 copying colossalai/kernel/triton/rms_layernorm.py -> build/lib/colossalai/kernel/triton 2024-06-28T03:44:53,807 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2024-06-28T03:44:53,809 copying colossalai/kernel/triton/fused_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-06-28T03:44:53,812 creating build/lib/colossalai/kernel/extensions 2024-06-28T03:44:53,814 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2024-06-28T03:44:53,816 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2024-06-28T03:44:53,819 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2024-06-28T03:44:53,821 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2024-06-28T03:44:53,824 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2024-06-28T03:44:53,826 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2024-06-28T03:44:53,829 creating build/lib/colossalai/kernel/jit 2024-06-28T03:44:53,830 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2024-06-28T03:44:53,833 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2024-06-28T03:44:53,835 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2024-06-28T03:44:53,837 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2024-06-28T03:44:53,840 creating build/lib/colossalai/kernel/extensions/csrc 2024-06-28T03:44:53,841 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2024-06-28T03:44:53,843 creating build/lib/colossalai/kernel/extensions/pybind 2024-06-28T03:44:53,845 copying colossalai/kernel/extensions/pybind/__init__.py -> build/lib/colossalai/kernel/extensions/pybind 2024-06-28T03:44:53,847 creating build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-06-28T03:44:53,848 copying colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-06-28T03:44:53,851 copying colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-06-28T03:44:53,854 creating build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-06-28T03:44:53,855 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-06-28T03:44:53,858 copying colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-06-28T03:44:53,860 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-06-28T03:44:53,862 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-06-28T03:44:53,865 creating build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-28T03:44:53,866 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-28T03:44:53,868 copying colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-28T03:44:53,870 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-28T03:44:53,873 creating build/lib/colossalai/kernel/extensions/pybind/inference 2024-06-28T03:44:53,874 copying colossalai/kernel/extensions/pybind/inference/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-06-28T03:44:53,876 copying colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-06-28T03:44:53,879 creating build/lib/colossalai/kernel/extensions/pybind/softmax 2024-06-28T03:44:53,880 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-06-28T03:44:53,882 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-06-28T03:44:53,884 copying colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-06-28T03:44:53,887 creating build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-06-28T03:44:53,888 copying colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-06-28T03:44:53,890 copying colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-06-28T03:44:53,893 creating build/lib/colossalai/kernel/extensions/pybind/moe 2024-06-28T03:44:53,894 copying colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-06-28T03:44:53,896 copying colossalai/kernel/extensions/pybind/moe/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-06-28T03:44:53,899 creating build/lib/colossalai/nn/layer 2024-06-28T03:44:53,900 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2024-06-28T03:44:53,902 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2024-06-28T03:44:53,905 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2024-06-28T03:44:53,907 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2024-06-28T03:44:53,910 creating build/lib/colossalai/nn/lr_scheduler 2024-06-28T03:44:53,911 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-28T03:44:53,914 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-28T03:44:53,916 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-28T03:44:53,919 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-28T03:44:53,921 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-28T03:44:53,923 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-28T03:44:53,925 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-28T03:44:53,927 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2024-06-28T03:44:53,930 creating build/lib/colossalai/nn/loss 2024-06-28T03:44:53,931 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2024-06-28T03:44:53,933 creating build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,934 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,936 copying colossalai/nn/optimizer/came.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,938 copying colossalai/nn/optimizer/distributed_galore.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,941 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,942 copying colossalai/nn/optimizer/distributed_adafactor.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,945 copying colossalai/nn/optimizer/distributed_lamb.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,947 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,949 copying colossalai/nn/optimizer/galore.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,951 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,953 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,955 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,957 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,959 copying colossalai/nn/optimizer/adafactor.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,961 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,963 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,965 copying colossalai/nn/optimizer/distributed_came.py -> build/lib/colossalai/nn/optimizer 2024-06-28T03:44:53,969 creating build/lib/colossalai/tensor/d_tensor 2024-06-28T03:44:53,970 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2024-06-28T03:44:53,972 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2024-06-28T03:44:53,975 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-06-28T03:44:53,977 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2024-06-28T03:44:53,979 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2024-06-28T03:44:53,981 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2024-06-28T03:44:53,983 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-06-28T03:44:53,986 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2024-06-28T03:44:53,988 creating build/lib/colossalai/tensor/padded_tensor 2024-06-28T03:44:53,989 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2024-06-28T03:44:53,991 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2024-06-28T03:44:53,993 creating build/lib/colossalai/tensor/moe_tensor 2024-06-28T03:44:53,994 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2024-06-28T03:44:53,996 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2024-06-28T03:44:53,998 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2024-06-28T03:44:54,000 creating build/lib/colossalai/booster/plugin 2024-06-28T03:44:54,002 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-06-28T03:44:54,006 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2024-06-28T03:44:54,008 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-06-28T03:44:54,009 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2024-06-28T03:44:54,012 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-06-28T03:44:54,014 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-06-28T03:44:54,016 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2024-06-28T03:44:54,018 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2024-06-28T03:44:54,020 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2024-06-28T03:44:54,023 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2024-06-28T03:44:54,026 creating build/lib/colossalai/booster/mixed_precision 2024-06-28T03:44:54,027 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2024-06-28T03:44:54,028 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2024-06-28T03:44:54,030 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2024-06-28T03:44:54,032 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2024-06-28T03:44:54,033 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2024-06-28T03:44:54,035 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2024-06-28T03:44:54,038 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2024-06-28T03:44:54,040 creating build/lib/colossalai/pipeline/schedule 2024-06-28T03:44:54,041 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2024-06-28T03:44:54,044 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2024-06-28T03:44:54,046 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2024-06-28T03:44:54,049 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2024-06-28T03:44:54,050 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2024-06-28T03:44:54,052 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2024-06-28T03:44:54,055 creating build/lib/colossalai/legacy/zero 2024-06-28T03:44:54,056 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2024-06-28T03:44:54,058 creating build/lib/colossalai/legacy/utils 2024-06-28T03:44:54,060 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2024-06-28T03:44:54,062 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2024-06-28T03:44:54,064 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2024-06-28T03:44:54,067 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2024-06-28T03:44:54,069 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2024-06-28T03:44:54,071 creating build/lib/colossalai/legacy/trainer 2024-06-28T03:44:54,073 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2024-06-28T03:44:54,075 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2024-06-28T03:44:54,078 creating build/lib/colossalai/legacy/engine 2024-06-28T03:44:54,079 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2024-06-28T03:44:54,081 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2024-06-28T03:44:54,083 creating build/lib/colossalai/legacy/builder 2024-06-28T03:44:54,084 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2024-06-28T03:44:54,086 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2024-06-28T03:44:54,088 creating build/lib/colossalai/legacy/nn 2024-06-28T03:44:54,089 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2024-06-28T03:44:54,091 creating build/lib/colossalai/legacy/context 2024-06-28T03:44:54,092 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2024-06-28T03:44:54,094 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2024-06-28T03:44:54,096 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2024-06-28T03:44:54,099 creating build/lib/colossalai/legacy/tensor 2024-06-28T03:44:54,100 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2024-06-28T03:44:54,103 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2024-06-28T03:44:54,105 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2024-06-28T03:44:54,106 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2024-06-28T03:44:54,109 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2024-06-28T03:44:54,111 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2024-06-28T03:44:54,112 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2024-06-28T03:44:54,114 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2024-06-28T03:44:54,117 creating build/lib/colossalai/legacy/communication 2024-06-28T03:44:54,118 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2024-06-28T03:44:54,120 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2024-06-28T03:44:54,122 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2024-06-28T03:44:54,125 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2024-06-28T03:44:54,127 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2024-06-28T03:44:54,129 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2024-06-28T03:44:54,132 creating build/lib/colossalai/legacy/pipeline 2024-06-28T03:44:54,133 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2024-06-28T03:44:54,135 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2024-06-28T03:44:54,138 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2024-06-28T03:44:54,140 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2024-06-28T03:44:54,142 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2024-06-28T03:44:54,144 creating build/lib/colossalai/legacy/amp 2024-06-28T03:44:54,145 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2024-06-28T03:44:54,147 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2024-06-28T03:44:54,150 creating build/lib/colossalai/legacy/inference 2024-06-28T03:44:54,151 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2024-06-28T03:44:54,153 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2024-06-28T03:44:54,156 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2024-06-28T03:44:54,157 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2024-06-28T03:44:54,161 creating build/lib/colossalai/legacy/registry 2024-06-28T03:44:54,161 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2024-06-28T03:44:54,163 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2024-06-28T03:44:54,166 creating build/lib/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:54,167 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:54,168 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:54,170 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:54,172 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:54,174 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:54,177 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:54,180 creating build/lib/colossalai/legacy/zero/sharded_optim 2024-06-28T03:44:54,181 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-06-28T03:44:54,183 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-06-28T03:44:54,186 creating build/lib/colossalai/legacy/zero/gemini 2024-06-28T03:44:54,187 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-28T03:44:54,189 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-28T03:44:54,192 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-28T03:44:54,194 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-28T03:44:54,196 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-28T03:44:54,198 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-28T03:44:54,200 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-06-28T03:44:54,202 creating build/lib/colossalai/legacy/zero/init_ctx 2024-06-28T03:44:54,203 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-06-28T03:44:54,205 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-06-28T03:44:54,208 creating build/lib/colossalai/legacy/zero/sharded_param 2024-06-28T03:44:54,209 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-06-28T03:44:54,211 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-06-28T03:44:54,212 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-06-28T03:44:54,215 creating build/lib/colossalai/legacy/zero/shard_utils 2024-06-28T03:44:54,216 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-06-28T03:44:54,218 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-06-28T03:44:54,220 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-06-28T03:44:54,221 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-06-28T03:44:54,223 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-06-28T03:44:54,225 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-06-28T03:44:54,226 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-06-28T03:44:54,228 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-06-28T03:44:54,231 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2024-06-28T03:44:54,232 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-06-28T03:44:54,234 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-06-28T03:44:54,236 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-06-28T03:44:54,238 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-06-28T03:44:54,240 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-06-28T03:44:54,242 creating build/lib/colossalai/legacy/utils/checkpoint 2024-06-28T03:44:54,243 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-06-28T03:44:54,245 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-06-28T03:44:54,247 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-06-28T03:44:54,250 creating build/lib/colossalai/legacy/utils/profiler 2024-06-28T03:44:54,251 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-06-28T03:44:54,253 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-06-28T03:44:54,255 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2024-06-28T03:44:54,257 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2024-06-28T03:44:54,260 creating build/lib/colossalai/legacy/utils/data_sampler 2024-06-28T03:44:54,261 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-06-28T03:44:54,263 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-06-28T03:44:54,265 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-06-28T03:44:54,267 creating build/lib/colossalai/legacy/utils/profiler/legacy 2024-06-28T03:44:54,269 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-06-28T03:44:54,271 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-06-28T03:44:54,273 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-06-28T03:44:54,275 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-06-28T03:44:54,278 creating build/lib/colossalai/legacy/trainer/hooks 2024-06-28T03:44:54,279 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-28T03:44:54,281 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-28T03:44:54,284 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-28T03:44:54,286 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-28T03:44:54,287 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-28T03:44:54,289 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-28T03:44:54,292 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-06-28T03:44:54,294 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2024-06-28T03:44:54,295 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-06-28T03:44:54,298 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-06-28T03:44:54,300 creating build/lib/colossalai/legacy/engine/schedule 2024-06-28T03:44:54,301 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2024-06-28T03:44:54,303 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2024-06-28T03:44:54,305 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-06-28T03:44:54,307 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-06-28T03:44:54,310 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-06-28T03:44:54,313 creating build/lib/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:54,314 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:54,316 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:54,318 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:54,320 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:54,321 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:54,323 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:54,325 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:54,327 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:54,329 creating build/lib/colossalai/legacy/nn/layer 2024-06-28T03:44:54,330 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2024-06-28T03:44:54,332 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2024-06-28T03:44:54,334 creating build/lib/colossalai/legacy/nn/parallel 2024-06-28T03:44:54,335 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2024-06-28T03:44:54,338 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2024-06-28T03:44:54,340 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2024-06-28T03:44:54,342 creating build/lib/colossalai/legacy/nn/loss 2024-06-28T03:44:54,343 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2024-06-28T03:44:54,346 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2024-06-28T03:44:54,348 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2024-06-28T03:44:54,350 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2024-06-28T03:44:54,353 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2024-06-28T03:44:54,355 creating build/lib/colossalai/legacy/nn/_ops 2024-06-28T03:44:54,356 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2024-06-28T03:44:54,358 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2024-06-28T03:44:54,361 creating build/lib/colossalai/legacy/nn/metric 2024-06-28T03:44:54,362 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2024-06-28T03:44:54,364 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2024-06-28T03:44:54,365 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2024-06-28T03:44:54,367 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2024-06-28T03:44:54,369 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2024-06-28T03:44:54,371 creating build/lib/colossalai/legacy/nn/layer/vanilla 2024-06-28T03:44:54,372 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-06-28T03:44:54,375 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-06-28T03:44:54,377 creating build/lib/colossalai/legacy/nn/layer/utils 2024-06-28T03:44:54,378 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-06-28T03:44:54,380 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-06-28T03:44:54,383 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-28T03:44:54,383 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-28T03:44:54,385 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-28T03:44:54,388 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-28T03:44:54,390 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-28T03:44:54,394 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-06-28T03:44:54,395 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-06-28T03:44:54,398 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-06-28T03:44:54,400 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-06-28T03:44:54,403 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-06-28T03:44:54,405 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:54,406 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:54,408 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:54,411 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:54,413 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:54,415 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:54,417 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:54,419 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-06-28T03:44:54,420 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-06-28T03:44:54,422 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-06-28T03:44:54,426 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-06-28T03:44:54,427 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-06-28T03:44:54,431 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-06-28T03:44:54,431 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-06-28T03:44:54,433 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-06-28T03:44:54,436 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-06-28T03:44:54,438 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-06-28T03:44:54,441 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-06-28T03:44:54,442 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-06-28T03:44:54,444 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-06-28T03:44:54,446 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-06-28T03:44:54,448 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-06-28T03:44:54,451 creating build/lib/colossalai/legacy/nn/layer/wrapper 2024-06-28T03:44:54,452 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-06-28T03:44:54,454 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-06-28T03:44:54,456 creating build/lib/colossalai/legacy/nn/parallel/layers 2024-06-28T03:44:54,457 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-06-28T03:44:54,459 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-06-28T03:44:54,461 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-06-28T03:44:54,462 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-06-28T03:44:54,464 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-06-28T03:44:54,467 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:54,468 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:54,470 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:54,472 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:54,475 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:54,476 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:54,479 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:54,481 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:54,483 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:54,485 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:54,487 creating build/lib/colossalai/legacy/context/random 2024-06-28T03:44:54,488 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2024-06-28T03:44:54,491 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2024-06-28T03:44:54,492 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2024-06-28T03:44:54,494 creating build/lib/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:54,496 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:54,498 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:54,500 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:54,501 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:54,503 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:54,505 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:54,506 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:54,509 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:54,511 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:54,513 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:54,515 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:54,518 creating build/lib/colossalai/legacy/pipeline/middleware 2024-06-28T03:44:54,519 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-06-28T03:44:54,521 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-06-28T03:44:54,524 creating build/lib/colossalai/legacy/pipeline/rpc 2024-06-28T03:44:54,525 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-06-28T03:44:54,528 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-06-28T03:44:54,531 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-06-28T03:44:54,533 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-06-28T03:44:54,536 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-06-28T03:44:54,537 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-06-28T03:44:54,540 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-06-28T03:44:54,542 creating build/lib/colossalai/legacy/amp/naive_amp 2024-06-28T03:44:54,543 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-06-28T03:44:54,545 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-06-28T03:44:54,547 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-06-28T03:44:54,549 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-06-28T03:44:54,551 creating build/lib/colossalai/legacy/amp/apex_amp 2024-06-28T03:44:54,552 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-06-28T03:44:54,554 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-06-28T03:44:54,557 creating build/lib/colossalai/legacy/amp/torch_amp 2024-06-28T03:44:54,558 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-06-28T03:44:54,560 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-06-28T03:44:54,562 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-06-28T03:44:54,564 creating build/lib/colossalai/legacy/inference/hybridengine 2024-06-28T03:44:54,565 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-06-28T03:44:54,567 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-06-28T03:44:54,570 creating build/lib/colossalai/legacy/inference/tensor_parallel 2024-06-28T03:44:54,571 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-06-28T03:44:54,573 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-06-28T03:44:54,575 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-06-28T03:44:54,578 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-06-28T03:44:54,581 creating build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:54,582 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:54,584 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:54,585 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:54,587 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:54,590 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:54,592 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:54,593 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:54,595 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:54,597 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:54,600 creating build/lib/colossalai/legacy/inference/pipeline 2024-06-28T03:44:54,601 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2024-06-28T03:44:54,603 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2024-06-28T03:44:54,605 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2024-06-28T03:44:54,606 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-06-28T03:44:54,608 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-06-28T03:44:54,610 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-06-28T03:44:54,611 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-06-28T03:44:54,613 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-06-28T03:44:54,615 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-06-28T03:44:54,618 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-28T03:44:54,619 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-28T03:44:54,621 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-28T03:44:54,623 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-28T03:44:54,625 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-28T03:44:54,628 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-28T03:44:54,631 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-06-28T03:44:54,632 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-06-28T03:44:54,634 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-06-28T03:44:54,637 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-06-28T03:44:54,639 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-06-28T03:44:54,641 creating build/lib/colossalai/amp/naive_amp 2024-06-28T03:44:54,642 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2024-06-28T03:44:54,644 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2024-06-28T03:44:54,648 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2024-06-28T03:44:54,649 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-06-28T03:44:54,652 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-06-28T03:44:54,654 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-06-28T03:44:54,656 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-06-28T03:44:54,659 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-28T03:44:54,660 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-28T03:44:54,662 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-28T03:44:54,664 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-28T03:44:54,666 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-28T03:44:54,668 creating build/lib/colossalai/inference/server 2024-06-28T03:44:54,669 copying colossalai/inference/server/api_server.py -> build/lib/colossalai/inference/server 2024-06-28T03:44:54,672 copying colossalai/inference/server/completion_service.py -> build/lib/colossalai/inference/server 2024-06-28T03:44:54,673 copying colossalai/inference/server/utils.py -> build/lib/colossalai/inference/server 2024-06-28T03:44:54,675 copying colossalai/inference/server/chat_service.py -> build/lib/colossalai/inference/server 2024-06-28T03:44:54,677 copying colossalai/inference/server/__init__.py -> build/lib/colossalai/inference/server 2024-06-28T03:44:54,679 creating build/lib/colossalai/inference/executor 2024-06-28T03:44:54,680 copying colossalai/inference/executor/rpc_worker.py -> build/lib/colossalai/inference/executor 2024-06-28T03:44:54,683 copying colossalai/inference/executor/__init__.py -> build/lib/colossalai/inference/executor 2024-06-28T03:44:54,685 creating build/lib/colossalai/inference/kv_cache 2024-06-28T03:44:54,686 copying colossalai/inference/kv_cache/block_cache.py -> build/lib/colossalai/inference/kv_cache 2024-06-28T03:44:54,688 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2024-06-28T03:44:54,691 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2024-06-28T03:44:54,693 creating build/lib/colossalai/inference/core 2024-06-28T03:44:54,694 copying colossalai/inference/core/request_handler.py -> build/lib/colossalai/inference/core 2024-06-28T03:44:54,697 copying colossalai/inference/core/plugin.py -> build/lib/colossalai/inference/core 2024-06-28T03:44:54,699 copying colossalai/inference/core/async_engine.py -> build/lib/colossalai/inference/core 2024-06-28T03:44:54,702 copying colossalai/inference/core/__init__.py -> build/lib/colossalai/inference/core 2024-06-28T03:44:54,704 copying colossalai/inference/core/engine.py -> build/lib/colossalai/inference/core 2024-06-28T03:44:54,707 copying colossalai/inference/core/rpc_engine.py -> build/lib/colossalai/inference/core 2024-06-28T03:44:54,709 creating build/lib/colossalai/inference/spec 2024-06-28T03:44:54,710 copying colossalai/inference/spec/__init__.py -> build/lib/colossalai/inference/spec 2024-06-28T03:44:54,712 copying colossalai/inference/spec/drafter.py -> build/lib/colossalai/inference/spec 2024-06-28T03:44:54,715 copying colossalai/inference/spec/struct.py -> build/lib/colossalai/inference/spec 2024-06-28T03:44:54,717 creating build/lib/colossalai/inference/modeling 2024-06-28T03:44:54,718 copying colossalai/inference/modeling/__init__.py -> build/lib/colossalai/inference/modeling 2024-06-28T03:44:54,720 creating build/lib/colossalai/inference/modeling/layers 2024-06-28T03:44:54,721 copying colossalai/inference/modeling/layers/__init__.py -> build/lib/colossalai/inference/modeling/layers 2024-06-28T03:44:54,723 copying colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/lib/colossalai/inference/modeling/layers 2024-06-28T03:44:54,725 copying colossalai/inference/modeling/layers/attention.py -> build/lib/colossalai/inference/modeling/layers 2024-06-28T03:44:54,729 creating build/lib/colossalai/inference/modeling/models 2024-06-28T03:44:54,730 copying colossalai/inference/modeling/models/glide_llama.py -> build/lib/colossalai/inference/modeling/models 2024-06-28T03:44:54,733 copying colossalai/inference/modeling/models/nopadding_llama.py -> build/lib/colossalai/inference/modeling/models 2024-06-28T03:44:54,735 copying colossalai/inference/modeling/models/__init__.py -> build/lib/colossalai/inference/modeling/models 2024-06-28T03:44:54,737 copying colossalai/inference/modeling/models/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/models 2024-06-28T03:44:54,740 creating build/lib/colossalai/inference/modeling/backends 2024-06-28T03:44:54,741 copying colossalai/inference/modeling/backends/pre_attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-06-28T03:44:54,743 copying colossalai/inference/modeling/backends/attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-06-28T03:44:54,745 copying colossalai/inference/modeling/backends/__init__.py -> build/lib/colossalai/inference/modeling/backends 2024-06-28T03:44:54,747 creating build/lib/colossalai/inference/modeling/policy 2024-06-28T03:44:54,748 copying colossalai/inference/modeling/policy/glide_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-06-28T03:44:54,750 copying colossalai/inference/modeling/policy/nopadding_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-06-28T03:44:54,752 copying colossalai/inference/modeling/policy/__init__.py -> build/lib/colossalai/inference/modeling/policy 2024-06-28T03:44:54,754 copying colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/policy 2024-06-28T03:44:54,757 creating build/lib/extensions 2024-06-28T03:44:54,758 creating build/lib/extensions/csrc 2024-06-28T03:44:54,759 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2024-06-28T03:44:54,761 creating build/lib/extensions/pybind 2024-06-28T03:44:54,762 copying extensions/pybind/__init__.py -> build/lib/extensions/pybind 2024-06-28T03:44:54,764 creating build/lib/extensions/pybind/layernorm 2024-06-28T03:44:54,765 copying extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/extensions/pybind/layernorm 2024-06-28T03:44:54,766 copying extensions/pybind/layernorm/__init__.py -> build/lib/extensions/pybind/layernorm 2024-06-28T03:44:54,769 creating build/lib/extensions/pybind/flash_attention 2024-06-28T03:44:54,770 copying extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-06-28T03:44:54,772 copying extensions/pybind/flash_attention/__init__.py -> build/lib/extensions/pybind/flash_attention 2024-06-28T03:44:54,773 copying extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-06-28T03:44:54,775 copying extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/extensions/pybind/flash_attention 2024-06-28T03:44:54,777 creating build/lib/extensions/pybind/cpu_adam 2024-06-28T03:44:54,778 copying extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/pybind/cpu_adam 2024-06-28T03:44:54,780 copying extensions/pybind/cpu_adam/__init__.py -> build/lib/extensions/pybind/cpu_adam 2024-06-28T03:44:54,782 copying extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/pybind/cpu_adam 2024-06-28T03:44:54,784 creating build/lib/extensions/pybind/inference 2024-06-28T03:44:54,785 copying extensions/pybind/inference/__init__.py -> build/lib/extensions/pybind/inference 2024-06-28T03:44:54,787 copying extensions/pybind/inference/inference_ops_cuda.py -> build/lib/extensions/pybind/inference 2024-06-28T03:44:54,789 creating build/lib/extensions/pybind/softmax 2024-06-28T03:44:54,790 copying extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-06-28T03:44:54,792 copying extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-06-28T03:44:54,794 copying extensions/pybind/softmax/__init__.py -> build/lib/extensions/pybind/softmax 2024-06-28T03:44:54,797 creating build/lib/extensions/pybind/optimizer 2024-06-28T03:44:54,797 copying extensions/pybind/optimizer/__init__.py -> build/lib/extensions/pybind/optimizer 2024-06-28T03:44:54,800 copying extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/pybind/optimizer 2024-06-28T03:44:54,801 creating build/lib/extensions/pybind/moe 2024-06-28T03:44:54,802 copying extensions/pybind/moe/moe_cuda.py -> build/lib/extensions/pybind/moe 2024-06-28T03:44:54,804 copying extensions/pybind/moe/__init__.py -> build/lib/extensions/pybind/moe 2024-06-28T03:44:54,887 creating build/lib/colossalai/kernel/extensions/csrc/funcs 2024-06-28T03:44:54,888 copying colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-06-28T03:44:54,891 copying colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-06-28T03:44:54,892 copying colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-06-28T03:44:54,894 copying colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-06-28T03:44:54,897 copying colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-06-28T03:44:54,900 creating build/lib/colossalai/kernel/extensions/csrc/kernel 2024-06-28T03:44:54,900 creating build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-06-28T03:44:54,902 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-06-28T03:44:54,905 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-06-28T03:44:54,907 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,908 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,911 copying colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,913 copying colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,915 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,918 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,921 copying colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,923 copying colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,926 copying colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,929 copying colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,931 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,933 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,936 copying colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,939 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,941 copying colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,944 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,947 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,950 copying colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,953 copying colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:54,955 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-28T03:44:54,956 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-28T03:44:54,958 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-28T03:44:54,960 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-28T03:44:54,962 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-28T03:44:54,964 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-06-28T03:44:54,965 copying colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-06-28T03:44:54,967 creating build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-06-28T03:44:54,968 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-06-28T03:44:54,971 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-06-28T03:44:54,973 creating build/lib/colossalai/kernel/extensions/csrc/common 2024-06-28T03:44:54,974 copying colossalai/kernel/extensions/csrc/common/micros.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-06-28T03:44:54,977 copying colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-06-28T03:44:54,979 copying colossalai/kernel/extensions/csrc/common/target.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-06-28T03:44:54,981 copying colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-06-28T03:44:54,983 copying colossalai/kernel/extensions/csrc/common/data_type.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-06-28T03:44:54,986 copying colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-06-28T03:44:54,992 copying colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-06-28T03:44:54,995 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-06-28T03:44:54,997 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-06-28T03:44:55,000 copying colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-06-28T03:44:55,003 copying colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-06-28T03:44:55,112 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-06-28T03:44:55,113 !! 2024-06-28T03:44:55,114 ******************************************************************************** 2024-06-28T03:44:55,115 Please avoid running ``setup.py`` directly. 2024-06-28T03:44:55,115 Instead, use pypa/build, pypa/installer or other 2024-06-28T03:44:55,115 standards-based tools. 2024-06-28T03:44:55,116 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-06-28T03:44:55,117 ******************************************************************************** 2024-06-28T03:44:55,118 !! 2024-06-28T03:44:55,118 self.initialize_options() 2024-06-28T03:44:55,140 installing to build/bdist.linux-armv7l/wheel 2024-06-28T03:44:55,140 running install 2024-06-28T03:44:55,165 running install_lib 2024-06-28T03:44:55,190 creating build/bdist.linux-armv7l 2024-06-28T03:44:55,191 creating build/bdist.linux-armv7l/wheel 2024-06-28T03:44:55,193 creating build/bdist.linux-armv7l/wheel/colossalai 2024-06-28T03:44:55,194 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-06-28T03:44:55,196 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-28T03:44:55,196 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-28T03:44:55,199 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-28T03:44:55,201 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-28T03:44:55,204 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-28T03:44:55,206 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-28T03:44:55,209 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-28T03:44:55,212 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-28T03:44:55,214 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-28T03:44:55,216 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-28T03:44:55,218 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-28T03:44:55,220 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-06-28T03:44:55,223 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-06-28T03:44:55,226 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-28T03:44:55,227 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-28T03:44:55,229 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-28T03:44:55,231 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-28T03:44:55,233 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-28T03:44:55,235 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-28T03:44:55,236 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-06-28T03:44:55,240 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,241 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,244 copying build/lib/colossalai/shardformer/modeling/qwen2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,247 copying build/lib/colossalai/shardformer/modeling/command.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,250 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,253 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-06-28T03:44:55,254 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-06-28T03:44:55,256 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-06-28T03:44:55,258 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-06-28T03:44:55,261 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,264 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,267 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,269 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,272 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,274 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,277 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,280 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,284 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,286 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,289 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,292 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,295 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,298 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-06-28T03:44:55,300 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-06-28T03:44:55,302 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,303 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,305 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,308 copying build/lib/colossalai/shardformer/policies/qwen2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,310 copying build/lib/colossalai/shardformer/policies/command.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,312 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,314 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,317 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,319 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,321 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,323 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,326 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,327 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,329 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,332 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,334 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,336 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,339 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,341 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,344 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-06-28T03:44:55,347 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2024-06-28T03:44:55,348 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-28T03:44:55,350 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-28T03:44:55,352 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-28T03:44:55,354 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-28T03:44:55,356 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-28T03:44:55,358 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-06-28T03:44:55,359 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-06-28T03:44:55,362 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-06-28T03:44:55,364 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-06-28T03:44:55,366 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-06-28T03:44:55,368 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-06-28T03:44:55,372 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:55,373 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:55,375 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:55,377 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:55,379 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:55,381 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:55,383 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:55,385 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:55,387 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:55,389 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-06-28T03:44:55,391 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-28T03:44:55,394 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-28T03:44:55,397 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-06-28T03:44:55,399 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-06-28T03:44:55,401 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-06-28T03:44:55,404 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-06-28T03:44:55,405 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-06-28T03:44:55,408 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-06-28T03:44:55,411 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:55,412 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:55,414 copying build/lib/colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:55,416 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:55,418 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:55,420 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:55,422 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-06-28T03:44:55,424 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-06-28T03:44:55,426 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2024-06-28T03:44:55,428 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-06-28T03:44:55,429 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-06-28T03:44:55,431 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-06-28T03:44:55,433 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-06-28T03:44:55,434 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-06-28T03:44:55,436 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-06-28T03:44:55,437 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-06-28T03:44:55,439 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-06-28T03:44:55,441 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-06-28T03:44:55,442 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-06-28T03:44:55,443 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-06-28T03:44:55,446 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-06-28T03:44:55,448 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-06-28T03:44:55,448 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-06-28T03:44:55,451 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-06-28T03:44:55,452 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-06-28T03:44:55,455 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-28T03:44:55,456 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-28T03:44:55,458 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-28T03:44:55,460 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-06-28T03:44:55,461 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-06-28T03:44:55,463 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-06-28T03:44:55,466 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-28T03:44:55,468 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-28T03:44:55,471 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-28T03:44:55,472 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-28T03:44:55,474 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-28T03:44:55,477 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-06-28T03:44:55,478 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-06-28T03:44:55,480 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-28T03:44:55,481 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-28T03:44:55,484 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-28T03:44:55,486 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-28T03:44:55,488 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-28T03:44:55,489 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-06-28T03:44:55,492 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-28T03:44:55,493 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-28T03:44:55,495 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-28T03:44:55,496 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-28T03:44:55,498 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-06-28T03:44:55,500 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-28T03:44:55,501 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-28T03:44:55,503 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-28T03:44:55,506 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-28T03:44:55,508 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-06-28T03:44:55,509 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:55,510 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:55,512 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:55,514 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:55,516 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:55,518 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:55,520 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:55,521 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:55,523 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-06-28T03:44:55,525 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-06-28T03:44:55,527 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:55,528 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:55,530 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:55,532 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:55,534 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:55,536 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:55,538 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:55,540 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:55,542 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-06-28T03:44:55,544 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-06-28T03:44:55,547 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-28T03:44:55,548 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-28T03:44:55,550 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-28T03:44:55,553 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-28T03:44:55,555 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-06-28T03:44:55,557 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:55,558 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:55,560 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:55,561 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:55,563 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:55,565 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:55,567 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:55,569 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:55,571 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:55,573 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:55,574 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:55,576 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-06-28T03:44:55,578 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-06-28T03:44:55,580 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-06-28T03:44:55,581 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-06-28T03:44:55,584 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:55,584 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:55,586 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:55,588 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:55,590 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:55,592 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:55,594 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:55,596 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:55,598 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:55,600 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-06-28T03:44:55,602 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-06-28T03:44:55,604 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-06-28T03:44:55,606 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-28T03:44:55,608 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-28T03:44:55,611 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-28T03:44:55,613 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-28T03:44:55,615 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-06-28T03:44:55,617 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-28T03:44:55,619 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-28T03:44:55,620 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-28T03:44:55,623 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-28T03:44:55,625 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-28T03:44:55,627 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-28T03:44:55,630 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-28T03:44:55,632 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-28T03:44:55,635 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-28T03:44:55,636 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-06-28T03:44:55,639 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-06-28T03:44:55,641 creating build/bdist.linux-armv7l/wheel/colossalai/device 2024-06-28T03:44:55,642 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-06-28T03:44:55,645 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-06-28T03:44:55,648 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-06-28T03:44:55,650 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-06-28T03:44:55,652 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-28T03:44:55,653 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-28T03:44:55,656 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-28T03:44:55,659 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-28T03:44:55,662 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-28T03:44:55,665 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-28T03:44:55,667 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-06-28T03:44:55,670 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-06-28T03:44:55,671 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-06-28T03:44:55,673 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-06-28T03:44:55,676 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:55,677 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:55,679 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:55,682 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:55,684 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:55,686 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:55,689 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:55,691 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:55,694 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:55,696 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:55,697 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:55,699 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-06-28T03:44:55,702 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-06-28T03:44:55,703 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-06-28T03:44:55,705 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-06-28T03:44:55,708 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:55,709 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:55,711 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:55,713 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:55,715 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:55,718 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:55,721 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-06-28T03:44:55,723 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-28T03:44:55,724 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-28T03:44:55,727 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-28T03:44:55,729 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-28T03:44:55,731 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-28T03:44:55,734 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-28T03:44:55,736 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-28T03:44:55,739 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-28T03:44:55,741 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-28T03:44:55,743 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-28T03:44:55,745 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-06-28T03:44:55,747 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-06-28T03:44:55,748 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-06-28T03:44:55,751 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:55,752 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:55,754 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:55,756 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:55,758 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:55,761 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:55,763 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-06-28T03:44:55,765 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-06-28T03:44:55,766 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-06-28T03:44:55,769 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-06-28T03:44:55,771 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-06-28T03:44:55,774 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-06-28T03:44:55,776 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-06-28T03:44:55,778 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-06-28T03:44:55,781 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-06-28T03:44:55,783 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-06-28T03:44:55,785 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-06-28T03:44:55,788 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,789 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,791 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,792 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,795 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,796 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,798 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,801 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,803 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,805 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,810 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,812 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,814 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,816 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,819 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,821 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,823 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,824 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,827 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,829 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,832 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,834 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,836 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,839 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,841 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,843 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,845 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,848 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,851 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,853 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,856 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,858 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,860 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,862 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,864 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,867 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-06-28T03:44:55,869 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,871 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,873 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,875 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,878 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,879 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,882 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,884 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,886 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,888 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,890 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,892 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-06-28T03:44:55,894 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-06-28T03:44:55,895 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-06-28T03:44:55,896 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-06-28T03:44:55,898 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-28T03:44:55,899 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-28T03:44:55,901 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-28T03:44:55,904 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-28T03:44:55,907 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-28T03:44:55,909 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-28T03:44:55,911 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-06-28T03:44:55,913 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2024-06-28T03:44:55,914 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-06-28T03:44:55,916 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-06-28T03:44:55,919 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-06-28T03:44:55,921 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-06-28T03:44:55,923 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-06-28T03:44:55,926 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2024-06-28T03:44:55,927 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C 2024-06-28T03:44:55,929 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-06-28T03:44:55,930 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-06-28T03:44:55,931 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-06-28T03:44:55,934 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:55,935 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:55,937 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:55,939 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:55,940 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:55,943 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:55,945 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-06-28T03:44:55,947 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-06-28T03:44:55,949 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-06-28T03:44:55,952 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-06-28T03:44:55,953 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-06-28T03:44:55,955 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-06-28T03:44:55,957 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-06-28T03:44:55,959 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-06-28T03:44:55,962 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-06-28T03:44:55,964 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-06-28T03:44:55,967 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-06-28T03:44:55,967 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-06-28T03:44:55,970 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-06-28T03:44:55,973 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-06-28T03:44:55,975 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-06-28T03:44:55,977 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-06-28T03:44:55,978 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-06-28T03:44:55,980 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2024-06-28T03:44:55,981 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-06-28T03:44:55,983 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-06-28T03:44:55,986 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2024-06-28T03:44:55,987 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-06-28T03:44:55,988 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-06-28T03:44:55,991 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-06-28T03:44:55,992 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-06-28T03:44:55,994 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-06-28T03:44:55,996 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-06-28T03:44:55,997 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-06-28T03:44:55,999 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-06-28T03:44:56,001 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-06-28T03:44:56,003 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-06-28T03:44:56,005 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-06-28T03:44:56,007 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-06-28T03:44:56,009 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-28T03:44:56,010 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-28T03:44:56,013 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-28T03:44:56,014 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-28T03:44:56,017 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-28T03:44:56,019 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-28T03:44:56,021 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-06-28T03:44:56,024 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2024-06-28T03:44:56,025 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-06-28T03:44:56,026 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-06-28T03:44:56,028 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-06-28T03:44:56,030 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-06-28T03:44:56,033 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-06-28T03:44:56,034 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-28T03:44:56,035 copying build/lib/colossalai/kernel/triton/kvcache_copy.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-28T03:44:56,038 copying build/lib/colossalai/kernel/triton/rotary_cache_copy.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-28T03:44:56,040 copying build/lib/colossalai/kernel/triton/context_attn_unpad.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-28T03:44:56,043 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-28T03:44:56,045 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-28T03:44:56,048 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-28T03:44:56,050 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-28T03:44:56,054 copying build/lib/colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-28T03:44:56,057 copying build/lib/colossalai/kernel/triton/rms_layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-28T03:44:56,060 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-28T03:44:56,063 copying build/lib/colossalai/kernel/triton/fused_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-06-28T03:44:56,066 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-28T03:44:56,067 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-28T03:44:56,071 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-06-28T03:44:56,072 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-06-28T03:44:56,073 copying build/lib/colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-06-28T03:44:56,077 copying build/lib/colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-06-28T03:44:56,079 copying build/lib/colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-06-28T03:44:56,081 copying build/lib/colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-06-28T03:44:56,084 copying build/lib/colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-06-28T03:44:56,088 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel 2024-06-28T03:44:56,090 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-06-28T03:44:56,091 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-06-28T03:44:56,094 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-06-28T03:44:56,097 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,099 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-28T03:44:56,100 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-28T03:44:56,103 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-28T03:44:56,105 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-28T03:44:56,107 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-06-28T03:44:56,109 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,112 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,115 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,118 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,121 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,124 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,128 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-06-28T03:44:56,129 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-06-28T03:44:56,132 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,135 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,137 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,141 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,143 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,146 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,149 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,152 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,155 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,157 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,160 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,164 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-06-28T03:44:56,167 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-06-28T03:44:56,168 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-06-28T03:44:56,170 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-06-28T03:44:56,173 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-06-28T03:44:56,175 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-06-28T03:44:56,176 copying build/lib/colossalai/kernel/extensions/csrc/common/micros.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-06-28T03:44:56,179 copying build/lib/colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-06-28T03:44:56,181 copying build/lib/colossalai/kernel/extensions/csrc/common/target.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-06-28T03:44:56,183 copying build/lib/colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-06-28T03:44:56,185 copying build/lib/colossalai/kernel/extensions/csrc/common/data_type.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-06-28T03:44:56,187 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-28T03:44:56,190 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-06-28T03:44:56,191 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-06-28T03:44:56,193 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-06-28T03:44:56,196 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-06-28T03:44:56,198 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-06-28T03:44:56,200 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-06-28T03:44:56,202 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-06-28T03:44:56,204 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-06-28T03:44:56,207 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-06-28T03:44:56,209 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-06-28T03:44:56,212 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-28T03:44:56,213 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-28T03:44:56,215 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-28T03:44:56,217 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-06-28T03:44:56,219 copying build/lib/colossalai/kernel/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-06-28T03:44:56,221 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-06-28T03:44:56,223 copying build/lib/colossalai/kernel/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-06-28T03:44:56,225 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-06-28T03:44:56,227 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-06-28T03:44:56,230 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-06-28T03:44:56,231 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-06-28T03:44:56,234 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-06-28T03:44:56,236 copying build/lib/colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-06-28T03:44:56,238 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-06-28T03:44:56,240 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-06-28T03:44:56,243 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-06-28T03:44:56,244 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-06-28T03:44:56,247 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-06-28T03:44:56,249 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-06-28T03:44:56,251 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-06-28T03:44:56,253 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-06-28T03:44:56,255 copying build/lib/colossalai/kernel/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-06-28T03:44:56,257 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-06-28T03:44:56,260 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-28T03:44:56,262 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-28T03:44:56,263 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-28T03:44:56,266 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-06-28T03:44:56,268 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-06-28T03:44:56,270 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-06-28T03:44:56,272 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-06-28T03:44:56,274 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-06-28T03:44:56,276 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-06-28T03:44:56,278 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-06-28T03:44:56,280 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-06-28T03:44:56,283 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2024-06-28T03:44:56,284 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-06-28T03:44:56,286 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-06-28T03:44:56,288 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-06-28T03:44:56,290 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-06-28T03:44:56,292 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-06-28T03:44:56,295 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-28T03:44:56,296 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-28T03:44:56,298 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-28T03:44:56,301 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-28T03:44:56,303 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-28T03:44:56,305 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-28T03:44:56,307 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-28T03:44:56,309 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-28T03:44:56,311 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-06-28T03:44:56,314 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-06-28T03:44:56,315 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-06-28T03:44:56,317 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-06-28T03:44:56,319 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-06-28T03:44:56,322 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,323 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,326 copying build/lib/colossalai/nn/optimizer/came.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,328 copying build/lib/colossalai/nn/optimizer/distributed_galore.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,330 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,332 copying build/lib/colossalai/nn/optimizer/distributed_adafactor.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,335 copying build/lib/colossalai/nn/optimizer/distributed_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,337 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,339 copying build/lib/colossalai/nn/optimizer/galore.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,342 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,344 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,346 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,348 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,351 copying build/lib/colossalai/nn/optimizer/adafactor.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,353 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,355 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,358 copying build/lib/colossalai/nn/optimizer/distributed_came.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-06-28T03:44:56,361 creating build/bdist.linux-armv7l/wheel/colossalai/context 2024-06-28T03:44:56,362 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-06-28T03:44:56,364 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-06-28T03:44:56,366 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-06-28T03:44:56,368 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-28T03:44:56,368 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-28T03:44:56,371 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-28T03:44:56,372 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-28T03:44:56,375 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-28T03:44:56,376 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-28T03:44:56,379 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-28T03:44:56,380 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-28T03:44:56,383 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-28T03:44:56,384 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-28T03:44:56,387 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-06-28T03:44:56,388 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-28T03:44:56,391 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-06-28T03:44:56,392 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-06-28T03:44:56,394 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-06-28T03:44:56,396 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-28T03:44:56,398 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-28T03:44:56,400 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-28T03:44:56,402 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-28T03:44:56,404 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-28T03:44:56,407 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-06-28T03:44:56,408 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-06-28T03:44:56,410 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-06-28T03:44:56,412 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-06-28T03:44:56,414 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-06-28T03:44:56,416 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-06-28T03:44:56,418 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-06-28T03:44:56,419 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-06-28T03:44:56,421 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-06-28T03:44:56,423 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-06-28T03:44:56,425 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-06-28T03:44:56,427 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-06-28T03:44:56,429 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2024-06-28T03:44:56,430 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-06-28T03:44:56,432 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-06-28T03:44:56,433 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-06-28T03:44:56,436 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-28T03:44:56,437 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-28T03:44:56,440 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-28T03:44:56,442 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-28T03:44:56,444 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-28T03:44:56,446 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-28T03:44:56,448 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-28T03:44:56,450 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-28T03:44:56,452 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-28T03:44:56,454 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-28T03:44:56,457 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-06-28T03:44:56,460 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-28T03:44:56,461 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-28T03:44:56,463 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-28T03:44:56,465 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-28T03:44:56,467 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-28T03:44:56,469 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-28T03:44:56,471 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-28T03:44:56,473 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-06-28T03:44:56,475 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-06-28T03:44:56,476 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-06-28T03:44:56,479 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-06-28T03:44:56,482 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-06-28T03:44:56,484 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-06-28T03:44:56,486 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-06-28T03:44:56,487 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-06-28T03:44:56,490 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-28T03:44:56,491 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-28T03:44:56,494 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-28T03:44:56,497 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-28T03:44:56,498 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-28T03:44:56,500 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-28T03:44:56,503 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-06-28T03:44:56,504 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-06-28T03:44:56,507 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-06-28T03:44:56,509 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-06-28T03:44:56,510 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-06-28T03:44:56,512 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-06-28T03:44:56,514 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:56,515 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:56,517 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:56,519 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:56,521 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:56,523 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:56,525 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-06-28T03:44:56,528 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-06-28T03:44:56,529 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-06-28T03:44:56,532 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-06-28T03:44:56,534 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-28T03:44:56,536 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-28T03:44:56,538 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-28T03:44:56,540 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-28T03:44:56,542 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-28T03:44:56,544 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-06-28T03:44:56,545 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-06-28T03:44:56,547 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-06-28T03:44:56,549 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-28T03:44:56,551 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-06-28T03:44:56,551 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-06-28T03:44:56,554 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-06-28T03:44:56,556 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-06-28T03:44:56,558 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-06-28T03:44:56,559 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-06-28T03:44:56,561 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-28T03:44:56,563 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-06-28T03:44:56,564 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-06-28T03:44:56,567 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-06-28T03:44:56,568 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-06-28T03:44:56,569 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-06-28T03:44:56,572 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-06-28T03:44:56,573 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-06-28T03:44:56,575 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-06-28T03:44:56,577 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-06-28T03:44:56,579 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-06-28T03:44:56,580 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-06-28T03:44:56,582 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-06-28T03:44:56,584 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-06-28T03:44:56,586 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-06-28T03:44:56,588 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-06-28T03:44:56,590 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-06-28T03:44:56,591 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-06-28T03:44:56,592 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-06-28T03:44:56,594 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-06-28T03:44:56,596 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-06-28T03:44:56,598 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-06-28T03:44:56,600 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-06-28T03:44:56,603 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-06-28T03:44:56,603 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-06-28T03:44:56,605 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-06-28T03:44:56,607 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-06-28T03:44:56,609 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-06-28T03:44:56,612 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-06-28T03:44:56,613 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-06-28T03:44:56,615 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-06-28T03:44:56,617 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-06-28T03:44:56,619 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-06-28T03:44:56,621 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-06-28T03:44:56,622 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-06-28T03:44:56,624 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-06-28T03:44:56,626 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-06-28T03:44:56,628 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-06-28T03:44:56,631 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-06-28T03:44:56,633 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-06-28T03:44:56,636 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-06-28T03:44:56,637 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-28T03:44:56,638 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-28T03:44:56,641 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-28T03:44:56,643 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-28T03:44:56,644 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-28T03:44:56,646 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-28T03:44:56,648 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-28T03:44:56,650 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-06-28T03:44:56,652 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-06-28T03:44:56,654 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-06-28T03:44:56,656 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-06-28T03:44:56,658 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-06-28T03:44:56,660 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-06-28T03:44:56,661 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-06-28T03:44:56,663 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-06-28T03:44:56,665 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-06-28T03:44:56,666 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-06-28T03:44:56,669 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-06-28T03:44:56,670 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-06-28T03:44:56,672 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-06-28T03:44:56,675 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-06-28T03:44:56,678 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:56,679 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:56,681 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:56,682 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:56,684 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:56,686 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:56,688 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:56,690 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:56,692 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-06-28T03:44:56,693 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-06-28T03:44:56,695 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-06-28T03:44:56,697 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-06-28T03:44:56,700 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-06-28T03:44:56,701 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-06-28T03:44:56,703 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-06-28T03:44:56,705 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-06-28T03:44:56,706 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-06-28T03:44:56,707 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-06-28T03:44:56,708 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-06-28T03:44:56,711 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-06-28T03:44:56,713 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-06-28T03:44:56,714 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-06-28T03:44:56,716 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-06-28T03:44:56,718 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-28T03:44:56,719 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-28T03:44:56,721 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-28T03:44:56,724 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-28T03:44:56,726 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-06-28T03:44:56,730 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-06-28T03:44:56,730 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-06-28T03:44:56,733 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-06-28T03:44:56,736 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-06-28T03:44:56,738 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-06-28T03:44:56,740 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:56,741 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:56,744 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:56,746 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:56,748 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:56,750 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:56,751 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-06-28T03:44:56,754 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-06-28T03:44:56,755 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-06-28T03:44:56,756 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-06-28T03:44:56,759 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-06-28T03:44:56,761 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-06-28T03:44:56,764 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-06-28T03:44:56,765 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-06-28T03:44:56,767 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-06-28T03:44:56,771 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-06-28T03:44:56,772 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-06-28T03:44:56,775 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-06-28T03:44:56,777 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-06-28T03:44:56,778 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-06-28T03:44:56,780 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-06-28T03:44:56,783 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-06-28T03:44:56,784 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-06-28T03:44:56,787 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-06-28T03:44:56,788 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-06-28T03:44:56,790 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-06-28T03:44:56,792 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-06-28T03:44:56,795 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-06-28T03:44:56,796 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-06-28T03:44:56,798 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:56,799 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:56,801 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:56,803 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:56,806 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:56,807 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:56,810 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:56,812 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:56,814 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:56,815 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-06-28T03:44:56,818 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-06-28T03:44:56,820 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-06-28T03:44:56,822 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-06-28T03:44:56,823 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-06-28T03:44:56,825 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-06-28T03:44:56,828 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-06-28T03:44:56,829 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-06-28T03:44:56,832 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-06-28T03:44:56,834 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-06-28T03:44:56,835 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-06-28T03:44:56,837 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-06-28T03:44:56,840 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-06-28T03:44:56,842 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-06-28T03:44:56,844 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-06-28T03:44:56,847 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-06-28T03:44:56,848 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-06-28T03:44:56,850 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-06-28T03:44:56,852 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-06-28T03:44:56,855 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-06-28T03:44:56,856 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-06-28T03:44:56,858 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-06-28T03:44:56,860 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-06-28T03:44:56,862 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-06-28T03:44:56,864 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-06-28T03:44:56,867 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-06-28T03:44:56,868 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-06-28T03:44:56,870 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-06-28T03:44:56,872 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-06-28T03:44:56,876 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-06-28T03:44:56,877 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-06-28T03:44:56,880 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-06-28T03:44:56,882 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-06-28T03:44:56,885 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:56,887 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:56,889 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:56,892 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:56,894 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:56,896 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:56,899 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:56,901 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:56,904 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:56,907 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:56,909 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:56,911 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-06-28T03:44:56,915 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-28T03:44:56,916 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-28T03:44:56,919 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-28T03:44:56,921 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-28T03:44:56,923 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-28T03:44:56,926 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-28T03:44:56,928 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-28T03:44:56,931 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-28T03:44:56,933 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-06-28T03:44:56,935 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-06-28T03:44:56,937 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-06-28T03:44:56,940 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-28T03:44:56,941 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-28T03:44:56,944 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-28T03:44:56,946 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-28T03:44:56,949 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-28T03:44:56,952 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-28T03:44:56,954 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-06-28T03:44:56,956 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-06-28T03:44:56,958 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-06-28T03:44:56,959 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-06-28T03:44:56,961 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-06-28T03:44:56,963 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-06-28T03:44:56,965 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-06-28T03:44:56,967 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-06-28T03:44:56,969 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-06-28T03:44:56,971 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-06-28T03:44:56,974 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-06-28T03:44:56,975 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-06-28T03:44:56,977 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-06-28T03:44:56,981 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-06-28T03:44:56,982 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-06-28T03:44:56,985 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-06-28T03:44:56,987 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-06-28T03:44:56,989 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-06-28T03:44:56,991 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-06-28T03:44:56,992 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-06-28T03:44:56,993 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-06-28T03:44:56,995 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-06-28T03:44:56,998 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-06-28T03:44:57,000 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-06-28T03:44:57,002 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-06-28T03:44:57,003 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-06-28T03:44:57,006 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-06-28T03:44:57,007 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-06-28T03:44:57,009 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-06-28T03:44:57,012 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-06-28T03:44:57,012 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-06-28T03:44:57,015 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-06-28T03:44:57,017 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-06-28T03:44:57,020 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-06-28T03:44:57,021 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-06-28T03:44:57,023 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-06-28T03:44:57,026 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-06-28T03:44:57,027 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-06-28T03:44:57,029 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-06-28T03:44:57,030 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-06-28T03:44:57,033 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-06-28T03:44:57,034 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-06-28T03:44:57,036 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-06-28T03:44:57,037 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-06-28T03:44:57,040 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-06-28T03:44:57,042 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-06-28T03:44:57,044 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-06-28T03:44:57,046 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-06-28T03:44:57,047 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-06-28T03:44:57,049 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-28T03:44:57,050 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-28T03:44:57,052 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-28T03:44:57,054 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-28T03:44:57,056 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-28T03:44:57,059 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-06-28T03:44:57,062 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-06-28T03:44:57,063 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-06-28T03:44:57,066 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-06-28T03:44:57,069 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-06-28T03:44:57,070 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-06-28T03:44:57,071 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-06-28T03:44:57,074 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-06-28T03:44:57,076 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-06-28T03:44:57,078 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:57,079 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:57,081 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:57,083 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:57,084 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:57,087 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:57,088 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:57,090 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:57,092 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:57,094 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-06-28T03:44:57,096 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-06-28T03:44:57,099 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-06-28T03:44:57,100 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-06-28T03:44:57,102 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-06-28T03:44:57,104 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-06-28T03:44:57,105 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-06-28T03:44:57,107 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-06-28T03:44:57,109 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2024-06-28T03:44:57,111 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-06-28T03:44:57,112 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-06-28T03:44:57,114 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-06-28T03:44:57,116 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-06-28T03:44:57,117 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-06-28T03:44:57,119 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-06-28T03:44:57,121 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-06-28T03:44:57,123 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-06-28T03:44:57,125 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-28T03:44:57,126 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-28T03:44:57,128 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-28T03:44:57,130 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-28T03:44:57,131 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-06-28T03:44:57,133 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2024-06-28T03:44:57,135 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-28T03:44:57,136 creating build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-06-28T03:44:57,137 copying build/lib/colossalai/inference/server/api_server.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-06-28T03:44:57,140 copying build/lib/colossalai/inference/server/completion_service.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-06-28T03:44:57,141 copying build/lib/colossalai/inference/server/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-06-28T03:44:57,143 copying build/lib/colossalai/inference/server/chat_service.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-06-28T03:44:57,145 copying build/lib/colossalai/inference/server/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-06-28T03:44:57,147 creating build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-06-28T03:44:57,148 copying build/lib/colossalai/inference/executor/rpc_worker.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-06-28T03:44:57,151 copying build/lib/colossalai/inference/executor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-06-28T03:44:57,153 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-06-28T03:44:57,154 copying build/lib/colossalai/inference/kv_cache/block_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-06-28T03:44:57,156 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-06-28T03:44:57,159 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-06-28T03:44:57,160 copying build/lib/colossalai/inference/config.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-28T03:44:57,164 creating build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-28T03:44:57,165 copying build/lib/colossalai/inference/core/request_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-28T03:44:57,167 copying build/lib/colossalai/inference/core/plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-28T03:44:57,170 copying build/lib/colossalai/inference/core/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-28T03:44:57,172 copying build/lib/colossalai/inference/core/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-28T03:44:57,174 copying build/lib/colossalai/inference/core/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-28T03:44:57,177 copying build/lib/colossalai/inference/core/rpc_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-06-28T03:44:57,179 copying build/lib/colossalai/inference/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-28T03:44:57,182 creating build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-06-28T03:44:57,183 copying build/lib/colossalai/inference/spec/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-06-28T03:44:57,184 copying build/lib/colossalai/inference/spec/drafter.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-06-28T03:44:57,186 copying build/lib/colossalai/inference/spec/struct.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-06-28T03:44:57,188 copying build/lib/colossalai/inference/logit_processors.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-28T03:44:57,191 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-06-28T03:44:57,192 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-06-28T03:44:57,193 copying build/lib/colossalai/inference/modeling/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-06-28T03:44:57,194 copying build/lib/colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-06-28T03:44:57,196 copying build/lib/colossalai/inference/modeling/layers/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-06-28T03:44:57,199 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-06-28T03:44:57,200 copying build/lib/colossalai/inference/modeling/models/glide_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-06-28T03:44:57,203 copying build/lib/colossalai/inference/modeling/models/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-06-28T03:44:57,205 copying build/lib/colossalai/inference/modeling/models/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-06-28T03:44:57,207 copying build/lib/colossalai/inference/modeling/models/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-06-28T03:44:57,209 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-06-28T03:44:57,210 copying build/lib/colossalai/inference/modeling/backends/pre_attention_backend.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-06-28T03:44:57,213 copying build/lib/colossalai/inference/modeling/backends/attention_backend.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-06-28T03:44:57,215 copying build/lib/colossalai/inference/modeling/backends/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-06-28T03:44:57,217 copying build/lib/colossalai/inference/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-06-28T03:44:57,219 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-06-28T03:44:57,220 copying build/lib/colossalai/inference/modeling/policy/glide_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-06-28T03:44:57,222 copying build/lib/colossalai/inference/modeling/policy/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-06-28T03:44:57,224 copying build/lib/colossalai/inference/modeling/policy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-06-28T03:44:57,226 copying build/lib/colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-06-28T03:44:57,229 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-28T03:44:57,231 copying build/lib/colossalai/inference/sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-28T03:44:57,233 copying build/lib/colossalai/inference/batch_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-28T03:44:57,235 copying build/lib/colossalai/inference/struct.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-28T03:44:57,237 copying build/lib/colossalai/inference/graph_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-28T03:44:57,239 copying build/lib/colossalai/inference/flash_decoding_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-06-28T03:44:57,241 creating build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-06-28T03:44:57,242 copying build/lib/colossalai/quantization/bnb.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-06-28T03:44:57,244 copying build/lib/colossalai/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-06-28T03:44:57,246 copying build/lib/colossalai/quantization/bnb_config.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-06-28T03:44:57,248 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-28T03:44:57,249 copying build/lib/colossalai/moe/checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-28T03:44:57,252 copying build/lib/colossalai/moe/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-28T03:44:57,254 copying build/lib/colossalai/moe/load_balance.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-28T03:44:57,257 copying build/lib/colossalai/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-28T03:44:57,258 copying build/lib/colossalai/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-28T03:44:57,261 copying build/lib/colossalai/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-28T03:44:57,264 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-28T03:44:57,266 copying build/lib/colossalai/moe/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-28T03:44:57,268 copying build/lib/colossalai/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-28T03:44:57,270 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-06-28T03:44:57,273 creating build/bdist.linux-armv7l/wheel/extensions 2024-06-28T03:44:57,274 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2024-06-28T03:44:57,275 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/csrc 2024-06-28T03:44:57,277 creating build/bdist.linux-armv7l/wheel/extensions/pybind 2024-06-28T03:44:57,278 creating build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-06-28T03:44:57,279 copying build/lib/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-06-28T03:44:57,281 copying build/lib/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-06-28T03:44:57,284 creating build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-06-28T03:44:57,285 copying build/lib/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-06-28T03:44:57,287 copying build/lib/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-06-28T03:44:57,289 copying build/lib/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-06-28T03:44:57,290 copying build/lib/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-06-28T03:44:57,292 creating build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-06-28T03:44:57,294 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-06-28T03:44:57,296 copying build/lib/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-06-28T03:44:57,297 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-06-28T03:44:57,299 copying build/lib/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind 2024-06-28T03:44:57,301 creating build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-06-28T03:44:57,302 copying build/lib/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-06-28T03:44:57,304 copying build/lib/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-06-28T03:44:57,306 creating build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-06-28T03:44:57,307 copying build/lib/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-06-28T03:44:57,309 copying build/lib/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-06-28T03:44:57,310 copying build/lib/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-06-28T03:44:57,312 creating build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-06-28T03:44:57,313 copying build/lib/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-06-28T03:44:57,315 copying build/lib/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-06-28T03:44:57,317 creating build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-06-28T03:44:57,318 copying build/lib/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-06-28T03:44:57,320 copying build/lib/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-06-28T03:44:57,322 running install_egg_info 2024-06-28T03:44:57,388 running egg_info 2024-06-28T03:44:57,413 writing colossalai.egg-info/PKG-INFO 2024-06-28T03:44:57,418 writing dependency_links to colossalai.egg-info/dependency_links.txt 2024-06-28T03:44:57,420 writing entry points to colossalai.egg-info/entry_points.txt 2024-06-28T03:44:57,421 writing requirements to colossalai.egg-info/requires.txt 2024-06-28T03:44:57,422 writing top-level names to colossalai.egg-info/top_level.txt 2024-06-28T03:44:57,666 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2024-06-28T03:44:57,732 reading manifest template 'MANIFEST.in' 2024-06-28T03:44:58,948 warning: no files found matching '*.tr' under directory 'colossalai' 2024-06-28T03:44:59,557 warning: no files found matching '*.cc' under directory 'colossalai' 2024-06-28T03:44:59,856 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-06-28T03:44:59,984 warning: no files found matching '*.tr' under directory 'extensions' 2024-06-28T03:45:00,036 warning: no files found matching '*.cc' under directory 'extensions' 2024-06-28T03:45:00,062 warning: no files found matching '*.pyi' under directory 'extensions' 2024-06-28T03:45:00,063 adding license file 'LICENSE' 2024-06-28T03:45:00,124 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2024-06-28T03:45:00,127 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.4.0-py3.11.egg-info 2024-06-28T03:45:00,143 running install_scripts 2024-06-28T03:45:00,175 creating build/bdist.linux-armv7l/wheel/colossalai-0.4.0.dist-info/WHEEL 2024-06-28T03:45:00,177 creating '/tmp/pip-wheel-4dnh92iy/colossalai-0.4.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-06-28T03:45:00,180 adding 'colossalai/__init__.py' 2024-06-28T03:45:00,181 adding 'colossalai/initialize.py' 2024-06-28T03:45:00,183 adding 'colossalai/version.py' 2024-06-28T03:45:00,184 adding 'colossalai/_C/__init__.py' 2024-06-28T03:45:00,186 adding 'colossalai/_analyzer/__init__.py' 2024-06-28T03:45:00,187 adding 'colossalai/_analyzer/envs.py' 2024-06-28T03:45:00,189 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2024-06-28T03:45:00,191 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2024-06-28T03:45:00,193 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2024-06-28T03:45:00,195 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2024-06-28T03:45:00,197 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2024-06-28T03:45:00,199 adding 'colossalai/_analyzer/fx/__init__.py' 2024-06-28T03:45:00,201 adding 'colossalai/_analyzer/fx/codegen.py' 2024-06-28T03:45:00,203 adding 'colossalai/_analyzer/fx/graph_module.py' 2024-06-28T03:45:00,205 adding 'colossalai/_analyzer/fx/node_util.py' 2024-06-28T03:45:00,207 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2024-06-28T03:45:00,208 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2024-06-28T03:45:00,210 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2024-06-28T03:45:00,212 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2024-06-28T03:45:00,214 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2024-06-28T03:45:00,215 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2024-06-28T03:45:00,217 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2024-06-28T03:45:00,218 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2024-06-28T03:45:00,220 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2024-06-28T03:45:00,222 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2024-06-28T03:45:00,224 adding 'colossalai/accelerator/__init__.py' 2024-06-28T03:45:00,225 adding 'colossalai/accelerator/api.py' 2024-06-28T03:45:00,227 adding 'colossalai/accelerator/base_accelerator.py' 2024-06-28T03:45:00,228 adding 'colossalai/accelerator/cpu_accelerator.py' 2024-06-28T03:45:00,230 adding 'colossalai/accelerator/cuda_accelerator.py' 2024-06-28T03:45:00,232 adding 'colossalai/accelerator/npu_accelerator.py' 2024-06-28T03:45:00,233 adding 'colossalai/amp/__init__.py' 2024-06-28T03:45:00,235 adding 'colossalai/amp/naive_amp/__init__.py' 2024-06-28T03:45:00,236 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2024-06-28T03:45:00,238 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2024-06-28T03:45:00,239 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2024-06-28T03:45:00,241 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2024-06-28T03:45:00,242 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2024-06-28T03:45:00,244 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2024-06-28T03:45:00,245 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2024-06-28T03:45:00,246 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2024-06-28T03:45:00,248 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2024-06-28T03:45:00,250 adding 'colossalai/auto_parallel/__init__.py' 2024-06-28T03:45:00,251 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2024-06-28T03:45:00,252 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2024-06-28T03:45:00,254 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2024-06-28T03:45:00,256 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2024-06-28T03:45:00,258 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2024-06-28T03:45:00,259 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2024-06-28T03:45:00,261 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2024-06-28T03:45:00,262 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2024-06-28T03:45:00,263 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2024-06-28T03:45:00,265 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2024-06-28T03:45:00,267 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2024-06-28T03:45:00,268 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2024-06-28T03:45:00,269 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2024-06-28T03:45:00,270 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2024-06-28T03:45:00,272 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2024-06-28T03:45:00,274 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2024-06-28T03:45:00,275 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2024-06-28T03:45:00,277 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2024-06-28T03:45:00,278 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2024-06-28T03:45:00,280 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2024-06-28T03:45:00,281 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2024-06-28T03:45:00,282 adding 'colossalai/auto_parallel/offload/__init__.py' 2024-06-28T03:45:00,284 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2024-06-28T03:45:00,285 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2024-06-28T03:45:00,286 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2024-06-28T03:45:00,288 adding 'colossalai/auto_parallel/offload/region.py' 2024-06-28T03:45:00,290 adding 'colossalai/auto_parallel/offload/region_manager.py' 2024-06-28T03:45:00,292 adding 'colossalai/auto_parallel/offload/runtime.py' 2024-06-28T03:45:00,294 adding 'colossalai/auto_parallel/offload/solver.py' 2024-06-28T03:45:00,296 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2024-06-28T03:45:00,298 adding 'colossalai/auto_parallel/offload/util.py' 2024-06-28T03:45:00,299 adding 'colossalai/auto_parallel/passes/__init__.py' 2024-06-28T03:45:00,301 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2024-06-28T03:45:00,302 adding 'colossalai/auto_parallel/passes/constants.py' 2024-06-28T03:45:00,304 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2024-06-28T03:45:00,305 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2024-06-28T03:45:00,308 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2024-06-28T03:45:00,310 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2024-06-28T03:45:00,311 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2024-06-28T03:45:00,313 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2024-06-28T03:45:00,315 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2024-06-28T03:45:00,316 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2024-06-28T03:45:00,318 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2024-06-28T03:45:00,320 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2024-06-28T03:45:00,322 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2024-06-28T03:45:00,323 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2024-06-28T03:45:00,325 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2024-06-28T03:45:00,326 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2024-06-28T03:45:00,327 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2024-06-28T03:45:00,329 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2024-06-28T03:45:00,330 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2024-06-28T03:45:00,332 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2024-06-28T03:45:00,333 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2024-06-28T03:45:00,334 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2024-06-28T03:45:00,336 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2024-06-28T03:45:00,338 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2024-06-28T03:45:00,341 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2024-06-28T03:45:00,342 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2024-06-28T03:45:00,343 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2024-06-28T03:45:00,344 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2024-06-28T03:45:00,346 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2024-06-28T03:45:00,347 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2024-06-28T03:45:00,348 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2024-06-28T03:45:00,349 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2024-06-28T03:45:00,351 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2024-06-28T03:45:00,352 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2024-06-28T03:45:00,353 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2024-06-28T03:45:00,354 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2024-06-28T03:45:00,356 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2024-06-28T03:45:00,357 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2024-06-28T03:45:00,359 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2024-06-28T03:45:00,361 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2024-06-28T03:45:00,362 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2024-06-28T03:45:00,364 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2024-06-28T03:45:00,366 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2024-06-28T03:45:00,367 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2024-06-28T03:45:00,369 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2024-06-28T03:45:00,371 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2024-06-28T03:45:00,374 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2024-06-28T03:45:00,376 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2024-06-28T03:45:00,377 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2024-06-28T03:45:00,379 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2024-06-28T03:45:00,381 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2024-06-28T03:45:00,382 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2024-06-28T03:45:00,384 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2024-06-28T03:45:00,386 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2024-06-28T03:45:00,387 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2024-06-28T03:45:00,389 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2024-06-28T03:45:00,390 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2024-06-28T03:45:00,392 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2024-06-28T03:45:00,394 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2024-06-28T03:45:00,395 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2024-06-28T03:45:00,398 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2024-06-28T03:45:00,400 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2024-06-28T03:45:00,401 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2024-06-28T03:45:00,403 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2024-06-28T03:45:00,404 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2024-06-28T03:45:00,406 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2024-06-28T03:45:00,408 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2024-06-28T03:45:00,409 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2024-06-28T03:45:00,411 adding 'colossalai/booster/__init__.py' 2024-06-28T03:45:00,412 adding 'colossalai/booster/accelerator.py' 2024-06-28T03:45:00,414 adding 'colossalai/booster/booster.py' 2024-06-28T03:45:00,416 adding 'colossalai/booster/mixed_precision/__init__.py' 2024-06-28T03:45:00,417 adding 'colossalai/booster/mixed_precision/bf16.py' 2024-06-28T03:45:00,419 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2024-06-28T03:45:00,420 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2024-06-28T03:45:00,421 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2024-06-28T03:45:00,422 adding 'colossalai/booster/mixed_precision/fp8.py' 2024-06-28T03:45:00,423 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2024-06-28T03:45:00,425 adding 'colossalai/booster/plugin/__init__.py' 2024-06-28T03:45:00,427 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2024-06-28T03:45:00,430 adding 'colossalai/booster/plugin/gemini_plugin.py' 2024-06-28T03:45:00,436 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2024-06-28T03:45:00,439 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2024-06-28T03:45:00,442 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2024-06-28T03:45:00,443 adding 'colossalai/booster/plugin/plugin_base.py' 2024-06-28T03:45:00,444 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2024-06-28T03:45:00,446 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2024-06-28T03:45:00,448 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2024-06-28T03:45:00,450 adding 'colossalai/checkpoint_io/__init__.py' 2024-06-28T03:45:00,451 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2024-06-28T03:45:00,453 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2024-06-28T03:45:00,458 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2024-06-28T03:45:00,459 adding 'colossalai/checkpoint_io/index_file.py' 2024-06-28T03:45:00,463 adding 'colossalai/checkpoint_io/utils.py' 2024-06-28T03:45:00,465 adding 'colossalai/cli/__init__.py' 2024-06-28T03:45:00,466 adding 'colossalai/cli/cli.py' 2024-06-28T03:45:00,468 adding 'colossalai/cli/check/__init__.py' 2024-06-28T03:45:00,470 adding 'colossalai/cli/check/check_installation.py' 2024-06-28T03:45:00,472 adding 'colossalai/cli/launcher/__init__.py' 2024-06-28T03:45:00,473 adding 'colossalai/cli/launcher/hostinfo.py' 2024-06-28T03:45:00,475 adding 'colossalai/cli/launcher/multinode_runner.py' 2024-06-28T03:45:00,477 adding 'colossalai/cli/launcher/run.py' 2024-06-28T03:45:00,478 adding 'colossalai/cluster/__init__.py' 2024-06-28T03:45:00,480 adding 'colossalai/cluster/device_mesh_manager.py' 2024-06-28T03:45:00,482 adding 'colossalai/cluster/dist_coordinator.py' 2024-06-28T03:45:00,483 adding 'colossalai/cluster/process_group_manager.py' 2024-06-28T03:45:00,485 adding 'colossalai/cluster/process_group_mesh.py' 2024-06-28T03:45:00,487 adding 'colossalai/context/__init__.py' 2024-06-28T03:45:00,488 adding 'colossalai/context/config.py' 2024-06-28T03:45:00,489 adding 'colossalai/context/singleton_meta.py' 2024-06-28T03:45:00,491 adding 'colossalai/device/__init__.py' 2024-06-28T03:45:00,493 adding 'colossalai/device/alpha_beta_profiler.py' 2024-06-28T03:45:00,495 adding 'colossalai/device/calc_pipeline_strategy.py' 2024-06-28T03:45:00,497 adding 'colossalai/device/device_mesh.py' 2024-06-28T03:45:00,499 adding 'colossalai/fx/__init__.py' 2024-06-28T03:45:00,500 adding 'colossalai/fx/_compatibility.py' 2024-06-28T03:45:00,503 adding 'colossalai/fx/_meta_regist_12.py' 2024-06-28T03:45:00,504 adding 'colossalai/fx/_meta_regist_13.py' 2024-06-28T03:45:00,506 adding 'colossalai/fx/graph_module.py' 2024-06-28T03:45:00,507 adding 'colossalai/fx/proxy.py' 2024-06-28T03:45:00,509 adding 'colossalai/fx/codegen/__init__.py' 2024-06-28T03:45:00,513 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2024-06-28T03:45:00,515 adding 'colossalai/fx/passes/__init__.py' 2024-06-28T03:45:00,517 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2024-06-28T03:45:00,519 adding 'colossalai/fx/passes/concrete_info_prop.py' 2024-06-28T03:45:00,521 adding 'colossalai/fx/passes/meta_info_prop.py' 2024-06-28T03:45:00,524 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2024-06-28T03:45:00,525 adding 'colossalai/fx/passes/shard_1d_pass.py' 2024-06-28T03:45:00,528 adding 'colossalai/fx/passes/split_module.py' 2024-06-28T03:45:00,529 adding 'colossalai/fx/passes/utils.py' 2024-06-28T03:45:00,531 adding 'colossalai/fx/profiler/__init__.py' 2024-06-28T03:45:00,532 adding 'colossalai/fx/profiler/constants.py' 2024-06-28T03:45:00,534 adding 'colossalai/fx/profiler/dataflow.py' 2024-06-28T03:45:00,535 adding 'colossalai/fx/profiler/memory_utils.py' 2024-06-28T03:45:00,537 adding 'colossalai/fx/profiler/opcount.py' 2024-06-28T03:45:00,539 adding 'colossalai/fx/profiler/profiler.py' 2024-06-28T03:45:00,541 adding 'colossalai/fx/profiler/shard_utils.py' 2024-06-28T03:45:00,542 adding 'colossalai/fx/profiler/tensor.py' 2024-06-28T03:45:00,544 adding 'colossalai/fx/profiler/experimental/__init__.py' 2024-06-28T03:45:00,545 adding 'colossalai/fx/profiler/experimental/constants.py' 2024-06-28T03:45:00,547 adding 'colossalai/fx/profiler/experimental/profiler.py' 2024-06-28T03:45:00,548 adding 'colossalai/fx/profiler/experimental/registry.py' 2024-06-28T03:45:00,549 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2024-06-28T03:45:00,551 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2024-06-28T03:45:00,552 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2024-06-28T03:45:00,553 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2024-06-28T03:45:00,555 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2024-06-28T03:45:00,556 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2024-06-28T03:45:00,557 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2024-06-28T03:45:00,559 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2024-06-28T03:45:00,560 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2024-06-28T03:45:00,561 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2024-06-28T03:45:00,563 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2024-06-28T03:45:00,564 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2024-06-28T03:45:00,566 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2024-06-28T03:45:00,567 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2024-06-28T03:45:00,568 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2024-06-28T03:45:00,570 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2024-06-28T03:45:00,571 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2024-06-28T03:45:00,572 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2024-06-28T03:45:00,573 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2024-06-28T03:45:00,575 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2024-06-28T03:45:00,576 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2024-06-28T03:45:00,577 adding 'colossalai/fx/tracer/__init__.py' 2024-06-28T03:45:00,579 adding 'colossalai/fx/tracer/_meta_trace.py' 2024-06-28T03:45:00,580 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2024-06-28T03:45:00,581 adding 'colossalai/fx/tracer/_tracer_utils.py' 2024-06-28T03:45:00,584 adding 'colossalai/fx/tracer/experimental.py' 2024-06-28T03:45:00,586 adding 'colossalai/fx/tracer/registry.py' 2024-06-28T03:45:00,589 adding 'colossalai/fx/tracer/tracer.py' 2024-06-28T03:45:00,591 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2024-06-28T03:45:00,592 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2024-06-28T03:45:00,594 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2024-06-28T03:45:00,595 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2024-06-28T03:45:00,597 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2024-06-28T03:45:00,598 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2024-06-28T03:45:00,600 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2024-06-28T03:45:00,601 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2024-06-28T03:45:00,602 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2024-06-28T03:45:00,604 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2024-06-28T03:45:00,605 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2024-06-28T03:45:00,607 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2024-06-28T03:45:00,608 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2024-06-28T03:45:00,610 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2024-06-28T03:45:00,611 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2024-06-28T03:45:00,612 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2024-06-28T03:45:00,613 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2024-06-28T03:45:00,615 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2024-06-28T03:45:00,616 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2024-06-28T03:45:00,618 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2024-06-28T03:45:00,619 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2024-06-28T03:45:00,620 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2024-06-28T03:45:00,622 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2024-06-28T03:45:00,623 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2024-06-28T03:45:00,624 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2024-06-28T03:45:00,625 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2024-06-28T03:45:00,627 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2024-06-28T03:45:00,628 adding 'colossalai/inference/__init__.py' 2024-06-28T03:45:00,631 adding 'colossalai/inference/batch_bucket.py' 2024-06-28T03:45:00,634 adding 'colossalai/inference/config.py' 2024-06-28T03:45:00,636 adding 'colossalai/inference/flash_decoding_utils.py' 2024-06-28T03:45:00,637 adding 'colossalai/inference/graph_runner.py' 2024-06-28T03:45:00,639 adding 'colossalai/inference/logit_processors.py' 2024-06-28T03:45:00,640 adding 'colossalai/inference/sampler.py' 2024-06-28T03:45:00,641 adding 'colossalai/inference/struct.py' 2024-06-28T03:45:00,643 adding 'colossalai/inference/utils.py' 2024-06-28T03:45:00,644 adding 'colossalai/inference/core/__init__.py' 2024-06-28T03:45:00,646 adding 'colossalai/inference/core/async_engine.py' 2024-06-28T03:45:00,650 adding 'colossalai/inference/core/engine.py' 2024-06-28T03:45:00,652 adding 'colossalai/inference/core/plugin.py' 2024-06-28T03:45:00,654 adding 'colossalai/inference/core/request_handler.py' 2024-06-28T03:45:00,656 adding 'colossalai/inference/core/rpc_engine.py' 2024-06-28T03:45:00,657 adding 'colossalai/inference/executor/__init__.py' 2024-06-28T03:45:00,659 adding 'colossalai/inference/executor/rpc_worker.py' 2024-06-28T03:45:00,661 adding 'colossalai/inference/kv_cache/__init__.py' 2024-06-28T03:45:00,662 adding 'colossalai/inference/kv_cache/block_cache.py' 2024-06-28T03:45:00,665 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2024-06-28T03:45:00,667 adding 'colossalai/inference/modeling/__init__.py' 2024-06-28T03:45:00,668 adding 'colossalai/inference/modeling/backends/__init__.py' 2024-06-28T03:45:00,670 adding 'colossalai/inference/modeling/backends/attention_backend.py' 2024-06-28T03:45:00,671 adding 'colossalai/inference/modeling/backends/pre_attention_backend.py' 2024-06-28T03:45:00,673 adding 'colossalai/inference/modeling/layers/__init__.py' 2024-06-28T03:45:00,674 adding 'colossalai/inference/modeling/layers/attention.py' 2024-06-28T03:45:00,676 adding 'colossalai/inference/modeling/layers/baichuan_tp_linear.py' 2024-06-28T03:45:00,677 adding 'colossalai/inference/modeling/models/__init__.py' 2024-06-28T03:45:00,680 adding 'colossalai/inference/modeling/models/glide_llama.py' 2024-06-28T03:45:00,681 adding 'colossalai/inference/modeling/models/nopadding_baichuan.py' 2024-06-28T03:45:00,684 adding 'colossalai/inference/modeling/models/nopadding_llama.py' 2024-06-28T03:45:00,686 adding 'colossalai/inference/modeling/policy/__init__.py' 2024-06-28T03:45:00,687 adding 'colossalai/inference/modeling/policy/glide_llama.py' 2024-06-28T03:45:00,689 adding 'colossalai/inference/modeling/policy/nopadding_baichuan.py' 2024-06-28T03:45:00,690 adding 'colossalai/inference/modeling/policy/nopadding_llama.py' 2024-06-28T03:45:00,692 adding 'colossalai/inference/server/__init__.py' 2024-06-28T03:45:00,693 adding 'colossalai/inference/server/api_server.py' 2024-06-28T03:45:00,695 adding 'colossalai/inference/server/chat_service.py' 2024-06-28T03:45:00,696 adding 'colossalai/inference/server/completion_service.py' 2024-06-28T03:45:00,697 adding 'colossalai/inference/server/utils.py' 2024-06-28T03:45:00,699 adding 'colossalai/inference/spec/__init__.py' 2024-06-28T03:45:00,701 adding 'colossalai/inference/spec/drafter.py' 2024-06-28T03:45:00,702 adding 'colossalai/inference/spec/struct.py' 2024-06-28T03:45:00,703 adding 'colossalai/interface/__init__.py' 2024-06-28T03:45:00,705 adding 'colossalai/interface/model.py' 2024-06-28T03:45:00,706 adding 'colossalai/interface/optimizer.py' 2024-06-28T03:45:00,707 adding 'colossalai/interface/pretrained.py' 2024-06-28T03:45:00,709 adding 'colossalai/kernel/__init__.py' 2024-06-28T03:45:00,710 adding 'colossalai/kernel/kernel_loader.py' 2024-06-28T03:45:00,712 adding 'colossalai/kernel/extensions/__init__.py' 2024-06-28T03:45:00,713 adding 'colossalai/kernel/extensions/base_extension.py' 2024-06-28T03:45:00,715 adding 'colossalai/kernel/extensions/cpp_extension.py' 2024-06-28T03:45:00,716 adding 'colossalai/kernel/extensions/cuda_extension.py' 2024-06-28T03:45:00,718 adding 'colossalai/kernel/extensions/triton_extension.py' 2024-06-28T03:45:00,719 adding 'colossalai/kernel/extensions/utils.py' 2024-06-28T03:45:00,721 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2024-06-28T03:45:00,723 adding 'colossalai/kernel/extensions/csrc/common/data_type.h' 2024-06-28T03:45:00,724 adding 'colossalai/kernel/extensions/csrc/common/micros.h' 2024-06-28T03:45:00,725 adding 'colossalai/kernel/extensions/csrc/common/mp_type_traits.h' 2024-06-28T03:45:00,726 adding 'colossalai/kernel/extensions/csrc/common/target.h' 2024-06-28T03:45:00,728 adding 'colossalai/kernel/extensions/csrc/common/vec_type_traits.h' 2024-06-28T03:45:00,730 adding 'colossalai/kernel/extensions/csrc/funcs/binary_functor.h' 2024-06-28T03:45:00,732 adding 'colossalai/kernel/extensions/csrc/funcs/cast_functor.h' 2024-06-28T03:45:00,733 adding 'colossalai/kernel/extensions/csrc/funcs/reduce_function.h' 2024-06-28T03:45:00,734 adding 'colossalai/kernel/extensions/csrc/funcs/ternary_functor.h' 2024-06-28T03:45:00,736 adding 'colossalai/kernel/extensions/csrc/funcs/unary_functor.h' 2024-06-28T03:45:00,738 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp' 2024-06-28T03:45:00,740 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h' 2024-06-28T03:45:00,742 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu' 2024-06-28T03:45:00,743 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu' 2024-06-28T03:45:00,745 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu' 2024-06-28T03:45:00,746 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu' 2024-06-28T03:45:00,750 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu' 2024-06-28T03:45:00,752 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu' 2024-06-28T03:45:00,754 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu' 2024-06-28T03:45:00,757 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu' 2024-06-28T03:45:00,759 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu' 2024-06-28T03:45:00,761 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu' 2024-06-28T03:45:00,762 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh' 2024-06-28T03:45:00,764 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu' 2024-06-28T03:45:00,766 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu' 2024-06-28T03:45:00,768 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu' 2024-06-28T03:45:00,769 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu' 2024-06-28T03:45:00,772 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu' 2024-06-28T03:45:00,774 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu' 2024-06-28T03:45:00,776 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu' 2024-06-28T03:45:00,779 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h' 2024-06-28T03:45:00,781 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h' 2024-06-28T03:45:00,782 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h' 2024-06-28T03:45:00,783 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h' 2024-06-28T03:45:00,784 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h' 2024-06-28T03:45:00,787 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp' 2024-06-28T03:45:00,789 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h' 2024-06-28T03:45:00,791 adding 'colossalai/kernel/extensions/pybind/__init__.py' 2024-06-28T03:45:00,792 adding 'colossalai/kernel/extensions/pybind/cpu_adam/__init__.py' 2024-06-28T03:45:00,794 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-06-28T03:45:00,795 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-06-28T03:45:00,797 adding 'colossalai/kernel/extensions/pybind/flash_attention/__init__.py' 2024-06-28T03:45:00,798 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-06-28T03:45:00,799 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py' 2024-06-28T03:45:00,800 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-06-28T03:45:00,802 adding 'colossalai/kernel/extensions/pybind/inference/__init__.py' 2024-06-28T03:45:00,803 adding 'colossalai/kernel/extensions/pybind/inference/inference.cpp' 2024-06-28T03:45:00,805 adding 'colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py' 2024-06-28T03:45:00,806 adding 'colossalai/kernel/extensions/pybind/layernorm/__init__.py' 2024-06-28T03:45:00,808 adding 'colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp' 2024-06-28T03:45:00,809 adding 'colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py' 2024-06-28T03:45:00,810 adding 'colossalai/kernel/extensions/pybind/moe/__init__.py' 2024-06-28T03:45:00,811 adding 'colossalai/kernel/extensions/pybind/moe/moe.cpp' 2024-06-28T03:45:00,813 adding 'colossalai/kernel/extensions/pybind/moe/moe_cuda.py' 2024-06-28T03:45:00,814 adding 'colossalai/kernel/extensions/pybind/optimizer/__init__.py' 2024-06-28T03:45:00,815 adding 'colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-06-28T03:45:00,816 adding 'colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp' 2024-06-28T03:45:00,818 adding 'colossalai/kernel/extensions/pybind/softmax/__init__.py' 2024-06-28T03:45:00,819 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp' 2024-06-28T03:45:00,821 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-06-28T03:45:00,822 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp' 2024-06-28T03:45:00,823 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-06-28T03:45:00,825 adding 'colossalai/kernel/jit/__init__.py' 2024-06-28T03:45:00,826 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2024-06-28T03:45:00,827 adding 'colossalai/kernel/jit/bias_gelu.py' 2024-06-28T03:45:00,828 adding 'colossalai/kernel/jit/option.py' 2024-06-28T03:45:00,830 adding 'colossalai/kernel/triton/__init__.py' 2024-06-28T03:45:00,833 adding 'colossalai/kernel/triton/context_attn_unpad.py' 2024-06-28T03:45:00,839 adding 'colossalai/kernel/triton/flash_decoding.py' 2024-06-28T03:45:00,841 adding 'colossalai/kernel/triton/fused_rotary_embedding.py' 2024-06-28T03:45:00,843 adding 'colossalai/kernel/triton/kvcache_copy.py' 2024-06-28T03:45:00,844 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2024-06-28T03:45:00,846 adding 'colossalai/kernel/triton/no_pad_rotary_embedding.py' 2024-06-28T03:45:00,848 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2024-06-28T03:45:00,849 adding 'colossalai/kernel/triton/rms_layernorm.py' 2024-06-28T03:45:00,851 adding 'colossalai/kernel/triton/rotary_cache_copy.py' 2024-06-28T03:45:00,852 adding 'colossalai/kernel/triton/softmax.py' 2024-06-28T03:45:00,854 adding 'colossalai/lazy/__init__.py' 2024-06-28T03:45:00,855 adding 'colossalai/lazy/construction.py' 2024-06-28T03:45:00,859 adding 'colossalai/lazy/lazy_init.py' 2024-06-28T03:45:00,861 adding 'colossalai/lazy/pretrained.py' 2024-06-28T03:45:00,863 adding 'colossalai/legacy/__init__.py' 2024-06-28T03:45:00,864 adding 'colossalai/legacy/constants.py' 2024-06-28T03:45:00,865 adding 'colossalai/legacy/core.py' 2024-06-28T03:45:00,866 adding 'colossalai/legacy/global_variables.py' 2024-06-28T03:45:00,869 adding 'colossalai/legacy/initialize.py' 2024-06-28T03:45:00,871 adding 'colossalai/legacy/amp/__init__.py' 2024-06-28T03:45:00,872 adding 'colossalai/legacy/amp/amp_type.py' 2024-06-28T03:45:00,874 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2024-06-28T03:45:00,875 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2024-06-28T03:45:00,876 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2024-06-28T03:45:00,878 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2024-06-28T03:45:00,880 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2024-06-28T03:45:00,881 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2024-06-28T03:45:00,883 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2024-06-28T03:45:00,886 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2024-06-28T03:45:00,888 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2024-06-28T03:45:00,889 adding 'colossalai/legacy/builder/__init__.py' 2024-06-28T03:45:00,890 adding 'colossalai/legacy/builder/builder.py' 2024-06-28T03:45:00,892 adding 'colossalai/legacy/communication/__init__.py' 2024-06-28T03:45:00,894 adding 'colossalai/legacy/communication/collective.py' 2024-06-28T03:45:00,896 adding 'colossalai/legacy/communication/p2p.py' 2024-06-28T03:45:00,898 adding 'colossalai/legacy/communication/p2p_v2.py' 2024-06-28T03:45:00,899 adding 'colossalai/legacy/communication/ring.py' 2024-06-28T03:45:00,900 adding 'colossalai/legacy/communication/utils.py' 2024-06-28T03:45:00,902 adding 'colossalai/legacy/context/__init__.py' 2024-06-28T03:45:00,905 adding 'colossalai/legacy/context/parallel_context.py' 2024-06-28T03:45:00,906 adding 'colossalai/legacy/context/parallel_mode.py' 2024-06-28T03:45:00,908 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2024-06-28T03:45:00,909 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2024-06-28T03:45:00,910 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2024-06-28T03:45:00,912 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2024-06-28T03:45:00,913 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2024-06-28T03:45:00,915 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2024-06-28T03:45:00,916 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2024-06-28T03:45:00,917 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2024-06-28T03:45:00,919 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2024-06-28T03:45:00,920 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2024-06-28T03:45:00,921 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2024-06-28T03:45:00,923 adding 'colossalai/legacy/context/random/__init__.py' 2024-06-28T03:45:00,924 adding 'colossalai/legacy/context/random/_helper.py' 2024-06-28T03:45:00,926 adding 'colossalai/legacy/context/random/seed_manager.py' 2024-06-28T03:45:00,927 adding 'colossalai/legacy/engine/__init__.py' 2024-06-28T03:45:00,929 adding 'colossalai/legacy/engine/_base_engine.py' 2024-06-28T03:45:00,931 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2024-06-28T03:45:00,933 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2024-06-28T03:45:00,934 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2024-06-28T03:45:00,936 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2024-06-28T03:45:00,937 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2024-06-28T03:45:00,938 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2024-06-28T03:45:00,940 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2024-06-28T03:45:00,941 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2024-06-28T03:45:00,942 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2024-06-28T03:45:00,943 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2024-06-28T03:45:00,945 adding 'colossalai/legacy/engine/schedule/__init__.py' 2024-06-28T03:45:00,946 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2024-06-28T03:45:00,948 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2024-06-28T03:45:00,951 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2024-06-28T03:45:00,953 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2024-06-28T03:45:00,955 adding 'colossalai/legacy/inference/__init__.py' 2024-06-28T03:45:00,956 adding 'colossalai/legacy/inference/async_engine.py' 2024-06-28T03:45:00,957 adding 'colossalai/legacy/inference/async_manager.py' 2024-06-28T03:45:00,959 adding 'colossalai/legacy/inference/manager.py' 2024-06-28T03:45:00,961 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2024-06-28T03:45:00,962 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2024-06-28T03:45:00,964 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2024-06-28T03:45:00,966 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2024-06-28T03:45:00,967 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2024-06-28T03:45:00,968 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2024-06-28T03:45:00,970 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2024-06-28T03:45:00,971 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2024-06-28T03:45:00,972 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2024-06-28T03:45:00,974 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2024-06-28T03:45:00,975 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2024-06-28T03:45:00,977 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2024-06-28T03:45:00,978 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2024-06-28T03:45:00,981 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2024-06-28T03:45:00,982 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2024-06-28T03:45:00,984 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2024-06-28T03:45:00,985 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2024-06-28T03:45:00,987 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2024-06-28T03:45:00,989 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2024-06-28T03:45:00,990 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2024-06-28T03:45:00,993 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2024-06-28T03:45:00,995 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2024-06-28T03:45:00,996 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2024-06-28T03:45:00,998 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2024-06-28T03:45:01,001 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2024-06-28T03:45:01,003 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2024-06-28T03:45:01,006 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2024-06-28T03:45:01,008 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2024-06-28T03:45:01,009 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2024-06-28T03:45:01,010 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2024-06-28T03:45:01,012 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2024-06-28T03:45:01,013 adding 'colossalai/legacy/nn/__init__.py' 2024-06-28T03:45:01,015 adding 'colossalai/legacy/nn/_ops/__init__.py' 2024-06-28T03:45:01,016 adding 'colossalai/legacy/nn/_ops/_utils.py' 2024-06-28T03:45:01,018 adding 'colossalai/legacy/nn/layer/__init__.py' 2024-06-28T03:45:01,019 adding 'colossalai/legacy/nn/layer/base_layer.py' 2024-06-28T03:45:01,021 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2024-06-28T03:45:01,022 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2024-06-28T03:45:01,023 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2024-06-28T03:45:01,025 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2024-06-28T03:45:01,026 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2024-06-28T03:45:01,027 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2024-06-28T03:45:01,029 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2024-06-28T03:45:01,030 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2024-06-28T03:45:01,031 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2024-06-28T03:45:01,035 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2024-06-28T03:45:01,037 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2024-06-28T03:45:01,039 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2024-06-28T03:45:01,041 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2024-06-28T03:45:01,044 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2024-06-28T03:45:01,046 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2024-06-28T03:45:01,049 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2024-06-28T03:45:01,051 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2024-06-28T03:45:01,054 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2024-06-28T03:45:01,056 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2024-06-28T03:45:01,058 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2024-06-28T03:45:01,060 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2024-06-28T03:45:01,063 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2024-06-28T03:45:01,065 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2024-06-28T03:45:01,066 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2024-06-28T03:45:01,068 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2024-06-28T03:45:01,069 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2024-06-28T03:45:01,071 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2024-06-28T03:45:01,072 adding 'colossalai/legacy/nn/layer/utils/common.py' 2024-06-28T03:45:01,074 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2024-06-28T03:45:01,076 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2024-06-28T03:45:01,078 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2024-06-28T03:45:01,079 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2024-06-28T03:45:01,081 adding 'colossalai/legacy/nn/loss/__init__.py' 2024-06-28T03:45:01,082 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2024-06-28T03:45:01,084 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2024-06-28T03:45:01,085 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2024-06-28T03:45:01,087 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2024-06-28T03:45:01,089 adding 'colossalai/legacy/nn/metric/__init__.py' 2024-06-28T03:45:01,090 adding 'colossalai/legacy/nn/metric/_utils.py' 2024-06-28T03:45:01,091 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2024-06-28T03:45:01,092 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2024-06-28T03:45:01,093 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2024-06-28T03:45:01,095 adding 'colossalai/legacy/nn/parallel/__init__.py' 2024-06-28T03:45:01,097 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2024-06-28T03:45:01,098 adding 'colossalai/legacy/nn/parallel/reducer.py' 2024-06-28T03:45:01,100 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2024-06-28T03:45:01,101 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2024-06-28T03:45:01,102 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2024-06-28T03:45:01,104 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2024-06-28T03:45:01,105 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2024-06-28T03:45:01,107 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2024-06-28T03:45:01,108 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2024-06-28T03:45:01,111 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2024-06-28T03:45:01,113 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2024-06-28T03:45:01,114 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2024-06-28T03:45:01,115 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2024-06-28T03:45:01,116 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2024-06-28T03:45:01,118 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2024-06-28T03:45:01,119 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2024-06-28T03:45:01,121 adding 'colossalai/legacy/pipeline/__init__.py' 2024-06-28T03:45:01,122 adding 'colossalai/legacy/pipeline/layer_spec.py' 2024-06-28T03:45:01,124 adding 'colossalai/legacy/pipeline/pipelinable.py' 2024-06-28T03:45:01,125 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2024-06-28T03:45:01,127 adding 'colossalai/legacy/pipeline/utils.py' 2024-06-28T03:45:01,129 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2024-06-28T03:45:01,130 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2024-06-28T03:45:01,132 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2024-06-28T03:45:01,133 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2024-06-28T03:45:01,135 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2024-06-28T03:45:01,141 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2024-06-28T03:45:01,143 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2024-06-28T03:45:01,145 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2024-06-28T03:45:01,147 adding 'colossalai/legacy/registry/__init__.py' 2024-06-28T03:45:01,148 adding 'colossalai/legacy/registry/registry.py' 2024-06-28T03:45:01,150 adding 'colossalai/legacy/tensor/__init__.py' 2024-06-28T03:45:01,151 adding 'colossalai/legacy/tensor/compute_spec.py' 2024-06-28T03:45:01,152 adding 'colossalai/legacy/tensor/const.py' 2024-06-28T03:45:01,154 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2024-06-28T03:45:01,155 adding 'colossalai/legacy/tensor/distspec.py' 2024-06-28T03:45:01,156 adding 'colossalai/legacy/tensor/op_wrapper.py' 2024-06-28T03:45:01,158 adding 'colossalai/legacy/tensor/process_group.py' 2024-06-28T03:45:01,159 adding 'colossalai/legacy/tensor/tensor_spec.py' 2024-06-28T03:45:01,161 adding 'colossalai/legacy/trainer/__init__.py' 2024-06-28T03:45:01,163 adding 'colossalai/legacy/trainer/_trainer.py' 2024-06-28T03:45:01,165 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2024-06-28T03:45:01,166 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2024-06-28T03:45:01,167 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2024-06-28T03:45:01,169 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2024-06-28T03:45:01,170 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2024-06-28T03:45:01,172 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2024-06-28T03:45:01,174 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2024-06-28T03:45:01,175 adding 'colossalai/legacy/utils/__init__.py' 2024-06-28T03:45:01,177 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2024-06-28T03:45:01,179 adding 'colossalai/legacy/utils/checkpointing.py' 2024-06-28T03:45:01,181 adding 'colossalai/legacy/utils/common.py' 2024-06-28T03:45:01,183 adding 'colossalai/legacy/utils/memory.py' 2024-06-28T03:45:01,185 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2024-06-28T03:45:01,189 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2024-06-28T03:45:01,190 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2024-06-28T03:45:01,192 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2024-06-28T03:45:01,193 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2024-06-28T03:45:01,194 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2024-06-28T03:45:01,196 adding 'colossalai/legacy/utils/profiler/__init__.py' 2024-06-28T03:45:01,197 adding 'colossalai/legacy/utils/profiler/extention.py' 2024-06-28T03:45:01,199 adding 'colossalai/legacy/utils/profiler/profiler.py' 2024-06-28T03:45:01,200 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2024-06-28T03:45:01,201 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2024-06-28T03:45:01,203 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2024-06-28T03:45:01,205 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2024-06-28T03:45:01,206 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2024-06-28T03:45:01,208 adding 'colossalai/legacy/zero/__init__.py' 2024-06-28T03:45:01,209 adding 'colossalai/legacy/zero/gemini/__init__.py' 2024-06-28T03:45:01,211 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2024-06-28T03:45:01,212 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2024-06-28T03:45:01,213 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2024-06-28T03:45:01,215 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2024-06-28T03:45:01,216 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2024-06-28T03:45:01,217 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2024-06-28T03:45:01,219 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2024-06-28T03:45:01,220 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2024-06-28T03:45:01,222 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2024-06-28T03:45:01,223 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2024-06-28T03:45:01,224 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2024-06-28T03:45:01,226 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2024-06-28T03:45:01,227 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2024-06-28T03:45:01,229 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2024-06-28T03:45:01,231 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2024-06-28T03:45:01,233 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2024-06-28T03:45:01,234 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2024-06-28T03:45:01,235 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2024-06-28T03:45:01,236 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2024-06-28T03:45:01,237 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2024-06-28T03:45:01,239 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2024-06-28T03:45:01,240 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2024-06-28T03:45:01,242 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2024-06-28T03:45:01,246 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2024-06-28T03:45:01,247 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2024-06-28T03:45:01,248 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2024-06-28T03:45:01,250 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2024-06-28T03:45:01,253 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2024-06-28T03:45:01,254 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2024-06-28T03:45:01,256 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2024-06-28T03:45:01,257 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2024-06-28T03:45:01,259 adding 'colossalai/logging/__init__.py' 2024-06-28T03:45:01,260 adding 'colossalai/logging/logger.py' 2024-06-28T03:45:01,262 adding 'colossalai/moe/__init__.py' 2024-06-28T03:45:01,264 adding 'colossalai/moe/_operation.py' 2024-06-28T03:45:01,268 adding 'colossalai/moe/checkpoint.py' 2024-06-28T03:45:01,269 adding 'colossalai/moe/experts.py' 2024-06-28T03:45:01,271 adding 'colossalai/moe/layers.py' 2024-06-28T03:45:01,273 adding 'colossalai/moe/load_balance.py' 2024-06-28T03:45:01,275 adding 'colossalai/moe/loss.py' 2024-06-28T03:45:01,276 adding 'colossalai/moe/manager.py' 2024-06-28T03:45:01,279 adding 'colossalai/moe/routers.py' 2024-06-28T03:45:01,280 adding 'colossalai/moe/utils.py' 2024-06-28T03:45:01,282 adding 'colossalai/nn/__init__.py' 2024-06-28T03:45:01,283 adding 'colossalai/nn/init.py' 2024-06-28T03:45:01,285 adding 'colossalai/nn/layer/__init__.py' 2024-06-28T03:45:01,286 adding 'colossalai/nn/layer/layernorm.py' 2024-06-28T03:45:01,288 adding 'colossalai/nn/layer/scaled_softmax.py' 2024-06-28T03:45:01,289 adding 'colossalai/nn/layer/utils.py' 2024-06-28T03:45:01,290 adding 'colossalai/nn/loss/__init__.py' 2024-06-28T03:45:01,292 adding 'colossalai/nn/lr_scheduler/__init__.py' 2024-06-28T03:45:01,293 adding 'colossalai/nn/lr_scheduler/cosine.py' 2024-06-28T03:45:01,295 adding 'colossalai/nn/lr_scheduler/delayed.py' 2024-06-28T03:45:01,296 adding 'colossalai/nn/lr_scheduler/linear.py' 2024-06-28T03:45:01,297 adding 'colossalai/nn/lr_scheduler/multistep.py' 2024-06-28T03:45:01,299 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2024-06-28T03:45:01,300 adding 'colossalai/nn/lr_scheduler/poly.py' 2024-06-28T03:45:01,301 adding 'colossalai/nn/lr_scheduler/torch.py' 2024-06-28T03:45:01,303 adding 'colossalai/nn/optimizer/__init__.py' 2024-06-28T03:45:01,305 adding 'colossalai/nn/optimizer/adafactor.py' 2024-06-28T03:45:01,306 adding 'colossalai/nn/optimizer/came.py' 2024-06-28T03:45:01,308 adding 'colossalai/nn/optimizer/cpu_adam.py' 2024-06-28T03:45:01,310 adding 'colossalai/nn/optimizer/distributed_adafactor.py' 2024-06-28T03:45:01,313 adding 'colossalai/nn/optimizer/distributed_came.py' 2024-06-28T03:45:01,315 adding 'colossalai/nn/optimizer/distributed_galore.py' 2024-06-28T03:45:01,317 adding 'colossalai/nn/optimizer/distributed_lamb.py' 2024-06-28T03:45:01,319 adding 'colossalai/nn/optimizer/fused_adam.py' 2024-06-28T03:45:01,320 adding 'colossalai/nn/optimizer/fused_lamb.py' 2024-06-28T03:45:01,322 adding 'colossalai/nn/optimizer/fused_sgd.py' 2024-06-28T03:45:01,324 adding 'colossalai/nn/optimizer/galore.py' 2024-06-28T03:45:01,325 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2024-06-28T03:45:01,327 adding 'colossalai/nn/optimizer/lamb.py' 2024-06-28T03:45:01,328 adding 'colossalai/nn/optimizer/lars.py' 2024-06-28T03:45:01,330 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2024-06-28T03:45:01,332 adding 'colossalai/pipeline/__init__.py' 2024-06-28T03:45:01,335 adding 'colossalai/pipeline/p2p.py' 2024-06-28T03:45:01,336 adding 'colossalai/pipeline/stage_manager.py' 2024-06-28T03:45:01,338 adding 'colossalai/pipeline/schedule/__init__.py' 2024-06-28T03:45:01,340 adding 'colossalai/pipeline/schedule/_utils.py' 2024-06-28T03:45:01,341 adding 'colossalai/pipeline/schedule/base.py' 2024-06-28T03:45:01,343 adding 'colossalai/pipeline/schedule/generate.py' 2024-06-28T03:45:01,346 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2024-06-28T03:45:01,349 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2024-06-28T03:45:01,350 adding 'colossalai/quantization/__init__.py' 2024-06-28T03:45:01,352 adding 'colossalai/quantization/bnb.py' 2024-06-28T03:45:01,354 adding 'colossalai/quantization/bnb_config.py' 2024-06-28T03:45:01,355 adding 'colossalai/shardformer/__init__.py' 2024-06-28T03:45:01,357 adding 'colossalai/shardformer/_utils.py' 2024-06-28T03:45:01,359 adding 'colossalai/shardformer/layer/__init__.py' 2024-06-28T03:45:01,362 adding 'colossalai/shardformer/layer/_operation.py' 2024-06-28T03:45:01,364 adding 'colossalai/shardformer/layer/attn.py' 2024-06-28T03:45:01,365 adding 'colossalai/shardformer/layer/dropout.py' 2024-06-28T03:45:01,367 adding 'colossalai/shardformer/layer/embedding.py' 2024-06-28T03:45:01,370 adding 'colossalai/shardformer/layer/linear.py' 2024-06-28T03:45:01,371 adding 'colossalai/shardformer/layer/loss.py' 2024-06-28T03:45:01,373 adding 'colossalai/shardformer/layer/normalization.py' 2024-06-28T03:45:01,375 adding 'colossalai/shardformer/layer/parallel_module.py' 2024-06-28T03:45:01,378 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2024-06-28T03:45:01,379 adding 'colossalai/shardformer/layer/utils.py' 2024-06-28T03:45:01,381 adding 'colossalai/shardformer/modeling/__init__.py' 2024-06-28T03:45:01,386 adding 'colossalai/shardformer/modeling/bert.py' 2024-06-28T03:45:01,388 adding 'colossalai/shardformer/modeling/blip2.py' 2024-06-28T03:45:01,392 adding 'colossalai/shardformer/modeling/bloom.py' 2024-06-28T03:45:01,395 adding 'colossalai/shardformer/modeling/chatglm2.py' 2024-06-28T03:45:01,397 adding 'colossalai/shardformer/modeling/command.py' 2024-06-28T03:45:01,401 adding 'colossalai/shardformer/modeling/falcon.py' 2024-06-28T03:45:01,406 adding 'colossalai/shardformer/modeling/gpt2.py' 2024-06-28T03:45:01,410 adding 'colossalai/shardformer/modeling/gptj.py' 2024-06-28T03:45:01,411 adding 'colossalai/shardformer/modeling/jit.py' 2024-06-28T03:45:01,414 adding 'colossalai/shardformer/modeling/llama.py' 2024-06-28T03:45:01,417 adding 'colossalai/shardformer/modeling/mistral.py' 2024-06-28T03:45:01,421 adding 'colossalai/shardformer/modeling/opt.py' 2024-06-28T03:45:01,424 adding 'colossalai/shardformer/modeling/qwen2.py' 2024-06-28T03:45:01,426 adding 'colossalai/shardformer/modeling/sam.py' 2024-06-28T03:45:01,430 adding 'colossalai/shardformer/modeling/t5.py' 2024-06-28T03:45:01,432 adding 'colossalai/shardformer/modeling/vit.py' 2024-06-28T03:45:01,437 adding 'colossalai/shardformer/modeling/whisper.py' 2024-06-28T03:45:01,439 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2024-06-28T03:45:01,440 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2024-06-28T03:45:01,446 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2024-06-28T03:45:01,448 adding 'colossalai/shardformer/policies/__init__.py' 2024-06-28T03:45:01,449 adding 'colossalai/shardformer/policies/auto_policy.py' 2024-06-28T03:45:01,451 adding 'colossalai/shardformer/policies/base_policy.py' 2024-06-28T03:45:01,453 adding 'colossalai/shardformer/policies/bert.py' 2024-06-28T03:45:01,455 adding 'colossalai/shardformer/policies/blip2.py' 2024-06-28T03:45:01,457 adding 'colossalai/shardformer/policies/bloom.py' 2024-06-28T03:45:01,459 adding 'colossalai/shardformer/policies/chatglm2.py' 2024-06-28T03:45:01,461 adding 'colossalai/shardformer/policies/command.py' 2024-06-28T03:45:01,463 adding 'colossalai/shardformer/policies/falcon.py' 2024-06-28T03:45:01,465 adding 'colossalai/shardformer/policies/gpt2.py' 2024-06-28T03:45:01,467 adding 'colossalai/shardformer/policies/gptj.py' 2024-06-28T03:45:01,469 adding 'colossalai/shardformer/policies/llama.py' 2024-06-28T03:45:01,471 adding 'colossalai/shardformer/policies/mistral.py' 2024-06-28T03:45:01,473 adding 'colossalai/shardformer/policies/opt.py' 2024-06-28T03:45:01,475 adding 'colossalai/shardformer/policies/qwen2.py' 2024-06-28T03:45:01,477 adding 'colossalai/shardformer/policies/sam.py' 2024-06-28T03:45:01,479 adding 'colossalai/shardformer/policies/t5.py' 2024-06-28T03:45:01,481 adding 'colossalai/shardformer/policies/vit.py' 2024-06-28T03:45:01,483 adding 'colossalai/shardformer/policies/whisper.py' 2024-06-28T03:45:01,485 adding 'colossalai/shardformer/shard/__init__.py' 2024-06-28T03:45:01,487 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2024-06-28T03:45:01,488 adding 'colossalai/shardformer/shard/shard_config.py' 2024-06-28T03:45:01,490 adding 'colossalai/shardformer/shard/sharder.py' 2024-06-28T03:45:01,491 adding 'colossalai/shardformer/shard/shardformer.py' 2024-06-28T03:45:01,492 adding 'colossalai/shardformer/shard/utils.py' 2024-06-28T03:45:01,494 adding 'colossalai/tensor/__init__.py' 2024-06-28T03:45:01,495 adding 'colossalai/tensor/colo_parameter.py' 2024-06-28T03:45:01,497 adding 'colossalai/tensor/colo_tensor.py' 2024-06-28T03:45:01,499 adding 'colossalai/tensor/comm_spec.py' 2024-06-28T03:45:01,500 adding 'colossalai/tensor/param_op_hook.py' 2024-06-28T03:45:01,504 adding 'colossalai/tensor/shape_consistency.py' 2024-06-28T03:45:01,506 adding 'colossalai/tensor/sharding_spec.py' 2024-06-28T03:45:01,508 adding 'colossalai/tensor/utils.py' 2024-06-28T03:45:01,509 adding 'colossalai/tensor/d_tensor/__init__.py' 2024-06-28T03:45:01,511 adding 'colossalai/tensor/d_tensor/api.py' 2024-06-28T03:45:01,513 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2024-06-28T03:45:01,514 adding 'colossalai/tensor/d_tensor/layout.py' 2024-06-28T03:45:01,517 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2024-06-28T03:45:01,518 adding 'colossalai/tensor/d_tensor/misc.py' 2024-06-28T03:45:01,520 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2024-06-28T03:45:01,522 adding 'colossalai/tensor/d_tensor/utils.py' 2024-06-28T03:45:01,523 adding 'colossalai/tensor/moe_tensor/__init__.py' 2024-06-28T03:45:01,524 adding 'colossalai/tensor/moe_tensor/api.py' 2024-06-28T03:45:01,526 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2024-06-28T03:45:01,527 adding 'colossalai/tensor/padded_tensor/__init__.py' 2024-06-28T03:45:01,528 adding 'colossalai/tensor/padded_tensor/api.py' 2024-06-28T03:45:01,530 adding 'colossalai/testing/__init__.py' 2024-06-28T03:45:01,532 adding 'colossalai/testing/comparison.py' 2024-06-28T03:45:01,533 adding 'colossalai/testing/pytest_wrapper.py' 2024-06-28T03:45:01,534 adding 'colossalai/testing/random.py' 2024-06-28T03:45:01,536 adding 'colossalai/testing/utils.py' 2024-06-28T03:45:01,538 adding 'colossalai/utils/__init__.py' 2024-06-28T03:45:01,539 adding 'colossalai/utils/common.py' 2024-06-28T03:45:01,540 adding 'colossalai/utils/memory.py' 2024-06-28T03:45:01,542 adding 'colossalai/utils/timer.py' 2024-06-28T03:45:01,543 adding 'colossalai/utils/model/__init__.py' 2024-06-28T03:45:01,545 adding 'colossalai/utils/model/utils.py' 2024-06-28T03:45:01,546 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2024-06-28T03:45:01,548 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2024-06-28T03:45:01,549 adding 'colossalai/utils/rank_recorder/__init__.py' 2024-06-28T03:45:01,551 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2024-06-28T03:45:01,553 adding 'colossalai/utils/tensor_detector/__init__.py' 2024-06-28T03:45:01,554 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2024-06-28T03:45:01,556 adding 'colossalai/zero/__init__.py' 2024-06-28T03:45:01,557 adding 'colossalai/zero/wrapper.py' 2024-06-28T03:45:01,559 adding 'colossalai/zero/gemini/__init__.py' 2024-06-28T03:45:01,564 adding 'colossalai/zero/gemini/gemini_ddp.py' 2024-06-28T03:45:01,566 adding 'colossalai/zero/gemini/gemini_hook.py' 2024-06-28T03:45:01,567 adding 'colossalai/zero/gemini/gemini_mgr.py' 2024-06-28T03:45:01,571 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2024-06-28T03:45:01,573 adding 'colossalai/zero/gemini/placement_policy.py' 2024-06-28T03:45:01,575 adding 'colossalai/zero/gemini/utils.py' 2024-06-28T03:45:01,577 adding 'colossalai/zero/gemini/chunk/__init__.py' 2024-06-28T03:45:01,580 adding 'colossalai/zero/gemini/chunk/chunk.py' 2024-06-28T03:45:01,582 adding 'colossalai/zero/gemini/chunk/manager.py' 2024-06-28T03:45:01,584 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2024-06-28T03:45:01,585 adding 'colossalai/zero/gemini/chunk/utils.py' 2024-06-28T03:45:01,587 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2024-06-28T03:45:01,588 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2024-06-28T03:45:01,589 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2024-06-28T03:45:01,591 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2024-06-28T03:45:01,592 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2024-06-28T03:45:01,593 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2024-06-28T03:45:01,594 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2024-06-28T03:45:01,595 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2024-06-28T03:45:01,597 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2024-06-28T03:45:01,598 adding 'colossalai/zero/low_level/__init__.py' 2024-06-28T03:45:01,600 adding 'colossalai/zero/low_level/_utils.py' 2024-06-28T03:45:01,604 adding 'colossalai/zero/low_level/low_level_optim.py' 2024-06-28T03:45:01,606 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2024-06-28T03:45:01,607 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2024-06-28T03:45:01,609 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2024-06-28T03:45:01,610 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2024-06-28T03:45:01,611 adding 'colossalai/zero/low_level/bookkeeping/parameter_store.py' 2024-06-28T03:45:01,613 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2024-06-28T03:45:01,615 adding 'extensions/csrc/__init__.py' 2024-06-28T03:45:01,617 adding 'extensions/pybind/__init__.py' 2024-06-28T03:45:01,618 adding 'extensions/pybind/cpu_adam/__init__.py' 2024-06-28T03:45:01,619 adding 'extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-06-28T03:45:01,620 adding 'extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-06-28T03:45:01,622 adding 'extensions/pybind/flash_attention/__init__.py' 2024-06-28T03:45:01,623 adding 'extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-06-28T03:45:01,625 adding 'extensions/pybind/flash_attention/flash_attention_npu.py' 2024-06-28T03:45:01,626 adding 'extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-06-28T03:45:01,628 adding 'extensions/pybind/inference/__init__.py' 2024-06-28T03:45:01,629 adding 'extensions/pybind/inference/inference_ops_cuda.py' 2024-06-28T03:45:01,631 adding 'extensions/pybind/layernorm/__init__.py' 2024-06-28T03:45:01,632 adding 'extensions/pybind/layernorm/layernorm_cuda.py' 2024-06-28T03:45:01,634 adding 'extensions/pybind/moe/__init__.py' 2024-06-28T03:45:01,635 adding 'extensions/pybind/moe/moe_cuda.py' 2024-06-28T03:45:01,637 adding 'extensions/pybind/optimizer/__init__.py' 2024-06-28T03:45:01,638 adding 'extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-06-28T03:45:01,640 adding 'extensions/pybind/softmax/__init__.py' 2024-06-28T03:45:01,641 adding 'extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-06-28T03:45:01,642 adding 'extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-06-28T03:45:01,645 adding 'colossalai-0.4.0.dist-info/LICENSE' 2024-06-28T03:45:01,649 adding 'colossalai-0.4.0.dist-info/METADATA' 2024-06-28T03:45:01,650 adding 'colossalai-0.4.0.dist-info/WHEEL' 2024-06-28T03:45:01,651 adding 'colossalai-0.4.0.dist-info/entry_points.txt' 2024-06-28T03:45:01,652 adding 'colossalai-0.4.0.dist-info/top_level.txt' 2024-06-28T03:45:01,667 adding 'colossalai-0.4.0.dist-info/RECORD' 2024-06-28T03:45:01,700 removing build/bdist.linux-armv7l/wheel 2024-06-28T03:45:02,079 Building wheel for colossalai (setup.py): finished with status 'done' 2024-06-28T03:45:02,096 Created wheel for colossalai: filename=colossalai-0.4.0-py3-none-any.whl size=1537796 sha256=bca14360afc924008f910785cbb07e07f1f743e3a7182103caa09a4d6c49d3a7 2024-06-28T03:45:02,098 Stored in directory: /tmp/pip-ephem-wheel-cache-uenwh2b0/wheels/51/a2/0f/28d38dd920ee24f610979b6cd7a2e217f077f5ed8e8836d99b 2024-06-28T03:45:02,138 Successfully built colossalai 2024-06-28T03:45:02,181 Removed build tracker: '/tmp/pip-build-tracker-1i0t853x'