2024-07-17T10:56:45,819 Created temporary directory: /tmp/pip-build-tracker-4cr0k6ih 2024-07-17T10:56:45,821 Initialized build tracking at /tmp/pip-build-tracker-4cr0k6ih 2024-07-17T10:56:45,821 Created build tracker: /tmp/pip-build-tracker-4cr0k6ih 2024-07-17T10:56:45,821 Entered build tracker: /tmp/pip-build-tracker-4cr0k6ih 2024-07-17T10:56:45,822 Created temporary directory: /tmp/pip-wheel-220_cs21 2024-07-17T10:56:45,826 Created temporary directory: /tmp/pip-ephem-wheel-cache-z5s8yy39 2024-07-17T10:56:45,853 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-07-17T10:56:45,856 2 location(s) to search for versions of colossalai: 2024-07-17T10:56:45,856 * https://pypi.org/simple/colossalai/ 2024-07-17T10:56:45,856 * https://www.piwheels.org/simple/colossalai/ 2024-07-17T10:56:45,857 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2024-07-17T10:56:45,857 Getting page https://pypi.org/simple/colossalai/ 2024-07-17T10:56:45,859 Found index url https://pypi.org/simple/ 2024-07-17T10:56:45,911 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2024-07-17T10:56:45,916 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2024-07-17T10:56:45,917 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2024-07-17T10:56:45,917 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2024-07-17T10:56:45,918 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2024-07-17T10:56:45,918 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2024-07-17T10:56:45,919 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2024-07-17T10:56:45,920 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2024-07-17T10:56:45,920 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2024-07-17T10:56:45,921 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2024-07-17T10:56:45,921 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2024-07-17T10:56:45,922 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2024-07-17T10:56:45,922 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2024-07-17T10:56:45,923 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2024-07-17T10:56:45,923 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2024-07-17T10:56:45,924 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2024-07-17T10:56:45,925 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2024-07-17T10:56:45,925 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2024-07-17T10:56:45,926 Found link https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.8 2024-07-17T10:56:45,926 Found link https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.9 2024-07-17T10:56:45,927 Found link https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.0 2024-07-17T10:56:45,927 Found link https://files.pythonhosted.org/packages/3c/cd/206593b5c417a436382ca5e93c0188c031830341ee352c35e020ce83f57c/colossalai-0.4.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.1 2024-07-17T10:56:45,928 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2024-07-17T10:56:45,928 Getting page https://www.piwheels.org/simple/colossalai/ 2024-07-17T10:56:45,929 Found index url https://www.piwheels.org/simple/ 2024-07-17T10:56:46,008 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2024-07-17T10:56:46,018 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.0-py3-none-any.whl#sha256=bca14360afc924008f910785cbb07e07f1f743e3a7182103caa09a4d6c49d3a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,018 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.9-py3-none-any.whl#sha256=670e4e0d607a0803e8f0a7349996228f4cfa411d817bd631c07b1b2064e7af48 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,019 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.8-py3-none-any.whl#sha256=73a2dba29be661597422944d917c709df77c91843d30ab323f6c740173686dab (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,019 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.7-py3-none-any.whl#sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,019 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,020 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,020 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,020 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,020 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,021 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,021 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,021 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,022 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,022 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,022 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,023 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,023 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,023 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,023 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,024 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-17T10:56:46,024 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2024-07-17T10:56:46,024 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2024-07-17T10:56:46,054 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2024-07-17T10:56:46,075 Collecting colossalai==0.4.1 2024-07-17T10:56:46,077 Created temporary directory: /tmp/pip-unpack-k53muj8d 2024-07-17T10:56:46,120 Downloading colossalai-0.4.1.tar.gz (1.3 MB) 2024-07-17T10:56:48,573 Added colossalai==0.4.1 from https://files.pythonhosted.org/packages/3c/cd/206593b5c417a436382ca5e93c0188c031830341ee352c35e020ce83f57c/colossalai-0.4.1.tar.gz to build tracker '/tmp/pip-build-tracker-4cr0k6ih' 2024-07-17T10:56:48,575 Running setup.py (path:/tmp/pip-wheel-220_cs21/colossalai_d6a3b8f44d2b439e9124736d0ecbc6c6/setup.py) egg_info for package colossalai 2024-07-17T10:56:48,576 Created temporary directory: /tmp/pip-pip-egg-info-o8sobf1h 2024-07-17T10:56:48,576 Preparing metadata (setup.py): started 2024-07-17T10:56:48,577 Running command python setup.py egg_info 2024-07-17T10:56:49,814 running egg_info 2024-07-17T10:56:49,815 creating /tmp/pip-pip-egg-info-o8sobf1h/colossalai.egg-info 2024-07-17T10:56:49,839 writing /tmp/pip-pip-egg-info-o8sobf1h/colossalai.egg-info/PKG-INFO 2024-07-17T10:56:49,844 writing dependency_links to /tmp/pip-pip-egg-info-o8sobf1h/colossalai.egg-info/dependency_links.txt 2024-07-17T10:56:49,845 writing entry points to /tmp/pip-pip-egg-info-o8sobf1h/colossalai.egg-info/entry_points.txt 2024-07-17T10:56:49,847 writing requirements to /tmp/pip-pip-egg-info-o8sobf1h/colossalai.egg-info/requires.txt 2024-07-17T10:56:49,848 writing top-level names to /tmp/pip-pip-egg-info-o8sobf1h/colossalai.egg-info/top_level.txt 2024-07-17T10:56:49,850 writing manifest file '/tmp/pip-pip-egg-info-o8sobf1h/colossalai.egg-info/SOURCES.txt' 2024-07-17T10:56:50,135 reading manifest file '/tmp/pip-pip-egg-info-o8sobf1h/colossalai.egg-info/SOURCES.txt' 2024-07-17T10:56:50,136 reading manifest template 'MANIFEST.in' 2024-07-17T10:56:51,433 warning: no files found matching '*.tr' under directory 'colossalai' 2024-07-17T10:56:52,073 warning: no files found matching '*.cc' under directory 'colossalai' 2024-07-17T10:56:52,410 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-07-17T10:56:52,558 warning: no files found matching '*.tr' under directory 'extensions' 2024-07-17T10:56:52,726 warning: no files found matching '*.cc' under directory 'extensions' 2024-07-17T10:56:52,754 warning: no files found matching '*.pyi' under directory 'extensions' 2024-07-17T10:56:52,754 adding license file 'LICENSE' 2024-07-17T10:56:52,791 writing manifest file '/tmp/pip-pip-egg-info-o8sobf1h/colossalai.egg-info/SOURCES.txt' 2024-07-17T10:56:52,887 Preparing metadata (setup.py): finished with status 'done' 2024-07-17T10:56:52,895 Source in /tmp/pip-wheel-220_cs21/colossalai_d6a3b8f44d2b439e9124736d0ecbc6c6 has version 0.4.1, which satisfies requirement colossalai==0.4.1 from https://files.pythonhosted.org/packages/3c/cd/206593b5c417a436382ca5e93c0188c031830341ee352c35e020ce83f57c/colossalai-0.4.1.tar.gz 2024-07-17T10:56:52,896 Removed colossalai==0.4.1 from https://files.pythonhosted.org/packages/3c/cd/206593b5c417a436382ca5e93c0188c031830341ee352c35e020ce83f57c/colossalai-0.4.1.tar.gz from build tracker '/tmp/pip-build-tracker-4cr0k6ih' 2024-07-17T10:56:52,904 Created temporary directory: /tmp/pip-unpack-yihe92qj 2024-07-17T10:56:52,905 Created temporary directory: /tmp/pip-unpack-36nxv_5e 2024-07-17T10:56:52,940 Building wheels for collected packages: colossalai 2024-07-17T10:56:52,946 Created temporary directory: /tmp/pip-wheel-kv4chqpd 2024-07-17T10:56:52,946 Building wheel for colossalai (setup.py): started 2024-07-17T10:56:52,947 Destination directory: /tmp/pip-wheel-kv4chqpd 2024-07-17T10:56:52,948 Running command python setup.py bdist_wheel 2024-07-17T10:56:54,141 running bdist_wheel 2024-07-17T10:56:54,235 running build 2024-07-17T10:56:54,235 running build_py 2024-07-17T10:56:54,262 creating build 2024-07-17T10:56:54,263 creating build/lib 2024-07-17T10:56:54,263 creating build/lib/colossalai 2024-07-17T10:56:54,265 copying colossalai/__init__.py -> build/lib/colossalai 2024-07-17T10:56:54,266 copying colossalai/initialize.py -> build/lib/colossalai 2024-07-17T10:56:54,269 copying colossalai/version.py -> build/lib/colossalai 2024-07-17T10:56:54,271 creating build/lib/colossalai/testing 2024-07-17T10:56:54,272 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2024-07-17T10:56:54,273 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2024-07-17T10:56:54,275 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2024-07-17T10:56:54,277 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2024-07-17T10:56:54,279 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2024-07-17T10:56:54,282 creating build/lib/colossalai/logging 2024-07-17T10:56:54,283 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2024-07-17T10:56:54,284 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2024-07-17T10:56:54,287 creating build/lib/colossalai/shardformer 2024-07-17T10:56:54,288 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2024-07-17T10:56:54,290 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2024-07-17T10:56:54,292 creating build/lib/colossalai/cli 2024-07-17T10:56:54,293 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2024-07-17T10:56:54,294 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2024-07-17T10:56:54,297 creating build/lib/colossalai/moe 2024-07-17T10:56:54,297 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2024-07-17T10:56:54,299 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2024-07-17T10:56:54,301 copying colossalai/moe/load_balance.py -> build/lib/colossalai/moe 2024-07-17T10:56:54,304 copying colossalai/moe/manager.py -> build/lib/colossalai/moe 2024-07-17T10:56:54,306 copying colossalai/moe/utils.py -> build/lib/colossalai/moe 2024-07-17T10:56:54,309 creating build/lib/colossalai/utils 2024-07-17T10:56:54,310 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2024-07-17T10:56:54,311 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2024-07-17T10:56:54,313 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2024-07-17T10:56:54,315 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2024-07-17T10:56:54,317 creating build/lib/colossalai/context 2024-07-17T10:56:54,318 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2024-07-17T10:56:54,319 copying colossalai/context/config.py -> build/lib/colossalai/context 2024-07-17T10:56:54,321 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2024-07-17T10:56:54,323 creating build/lib/colossalai/lazy 2024-07-17T10:56:54,324 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2024-07-17T10:56:54,326 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2024-07-17T10:56:54,328 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2024-07-17T10:56:54,330 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2024-07-17T10:56:54,333 creating build/lib/colossalai/_C 2024-07-17T10:56:54,334 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2024-07-17T10:56:54,336 creating build/lib/colossalai/fx 2024-07-17T10:56:54,337 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2024-07-17T10:56:54,338 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2024-07-17T10:56:54,340 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2024-07-17T10:56:54,341 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2024-07-17T10:56:54,343 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2024-07-17T10:56:54,345 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2024-07-17T10:56:54,348 creating build/lib/colossalai/amp 2024-07-17T10:56:54,349 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2024-07-17T10:56:54,351 creating build/lib/colossalai/booster 2024-07-17T10:56:54,352 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2024-07-17T10:56:54,353 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2024-07-17T10:56:54,356 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2024-07-17T10:56:54,358 creating build/lib/colossalai/zero 2024-07-17T10:56:54,359 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2024-07-17T10:56:54,361 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2024-07-17T10:56:54,364 creating build/lib/colossalai/device 2024-07-17T10:56:54,365 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2024-07-17T10:56:54,368 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2024-07-17T10:56:54,370 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2024-07-17T10:56:54,372 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2024-07-17T10:56:54,375 creating build/lib/colossalai/interface 2024-07-17T10:56:54,376 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2024-07-17T10:56:54,378 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2024-07-17T10:56:54,381 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2024-07-17T10:56:54,383 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2024-07-17T10:56:54,385 creating build/lib/colossalai/quantization 2024-07-17T10:56:54,386 copying colossalai/quantization/__init__.py -> build/lib/colossalai/quantization 2024-07-17T10:56:54,388 copying colossalai/quantization/bnb_config.py -> build/lib/colossalai/quantization 2024-07-17T10:56:54,390 copying colossalai/quantization/bnb.py -> build/lib/colossalai/quantization 2024-07-17T10:56:54,393 creating build/lib/colossalai/nn 2024-07-17T10:56:54,394 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2024-07-17T10:56:54,396 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2024-07-17T10:56:54,399 creating build/lib/colossalai/pipeline 2024-07-17T10:56:54,399 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2024-07-17T10:56:54,401 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2024-07-17T10:56:54,404 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2024-07-17T10:56:54,407 creating build/lib/colossalai/tensor 2024-07-17T10:56:54,407 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2024-07-17T10:56:54,409 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2024-07-17T10:56:54,411 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2024-07-17T10:56:54,414 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2024-07-17T10:56:54,416 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2024-07-17T10:56:54,419 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2024-07-17T10:56:54,421 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2024-07-17T10:56:54,423 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2024-07-17T10:56:54,426 creating build/lib/colossalai/legacy 2024-07-17T10:56:54,427 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2024-07-17T10:56:54,428 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2024-07-17T10:56:54,430 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2024-07-17T10:56:54,432 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2024-07-17T10:56:54,434 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2024-07-17T10:56:54,436 creating build/lib/colossalai/kernel 2024-07-17T10:56:54,437 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2024-07-17T10:56:54,438 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2024-07-17T10:56:54,441 creating build/lib/colossalai/inference 2024-07-17T10:56:54,442 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2024-07-17T10:56:54,443 copying colossalai/inference/config.py -> build/lib/colossalai/inference 2024-07-17T10:56:54,446 copying colossalai/inference/graph_runner.py -> build/lib/colossalai/inference 2024-07-17T10:56:54,447 copying colossalai/inference/batch_bucket.py -> build/lib/colossalai/inference 2024-07-17T10:56:54,450 copying colossalai/inference/flash_decoding_utils.py -> build/lib/colossalai/inference 2024-07-17T10:56:54,451 copying colossalai/inference/logit_processors.py -> build/lib/colossalai/inference 2024-07-17T10:56:54,453 copying colossalai/inference/struct.py -> build/lib/colossalai/inference 2024-07-17T10:56:54,455 copying colossalai/inference/utils.py -> build/lib/colossalai/inference 2024-07-17T10:56:54,457 copying colossalai/inference/sampler.py -> build/lib/colossalai/inference 2024-07-17T10:56:54,460 creating build/lib/colossalai/cluster 2024-07-17T10:56:54,461 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2024-07-17T10:56:54,463 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2024-07-17T10:56:54,465 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2024-07-17T10:56:54,466 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2024-07-17T10:56:54,468 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2024-07-17T10:56:54,471 creating build/lib/colossalai/_analyzer 2024-07-17T10:56:54,471 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2024-07-17T10:56:54,473 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2024-07-17T10:56:54,475 creating build/lib/colossalai/checkpoint_io 2024-07-17T10:56:54,476 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2024-07-17T10:56:54,478 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-07-17T10:56:54,480 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-07-17T10:56:54,486 copying colossalai/checkpoint_io/moe_checkpoint.py -> build/lib/colossalai/checkpoint_io 2024-07-17T10:56:54,491 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2024-07-17T10:56:54,493 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2024-07-17T10:56:54,495 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2024-07-17T10:56:54,498 creating build/lib/colossalai/auto_parallel 2024-07-17T10:56:54,499 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2024-07-17T10:56:54,501 creating build/lib/colossalai/accelerator 2024-07-17T10:56:54,501 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2024-07-17T10:56:54,504 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2024-07-17T10:56:54,505 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2024-07-17T10:56:54,507 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2024-07-17T10:56:54,509 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2024-07-17T10:56:54,511 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2024-07-17T10:56:54,514 creating build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,515 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,517 copying colossalai/shardformer/policies/command.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,520 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,522 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,524 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,526 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,529 copying colossalai/shardformer/policies/mixtral.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,531 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,533 copying colossalai/shardformer/policies/deepseek.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,535 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,538 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,540 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,543 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,546 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,548 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,551 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,553 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,555 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,558 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,561 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,563 copying colossalai/shardformer/policies/qwen2.py -> build/lib/colossalai/shardformer/policies 2024-07-17T10:56:54,566 creating build/lib/colossalai/shardformer/layer 2024-07-17T10:56:54,567 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2024-07-17T10:56:54,570 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2024-07-17T10:56:54,571 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2024-07-17T10:56:54,573 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2024-07-17T10:56:54,576 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2024-07-17T10:56:54,578 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2024-07-17T10:56:54,581 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2024-07-17T10:56:54,583 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2024-07-17T10:56:54,585 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2024-07-17T10:56:54,588 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2024-07-17T10:56:54,589 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2024-07-17T10:56:54,593 creating build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,594 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,595 copying colossalai/shardformer/modeling/command.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,599 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,602 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,603 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,606 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,608 copying colossalai/shardformer/modeling/mixtral.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,611 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,612 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,616 copying colossalai/shardformer/modeling/deepseek.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,618 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,621 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,624 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,627 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,629 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,631 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,634 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,637 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,640 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,645 copying colossalai/shardformer/modeling/qwen2.py -> build/lib/colossalai/shardformer/modeling 2024-07-17T10:56:54,649 creating build/lib/colossalai/shardformer/shard 2024-07-17T10:56:54,650 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2024-07-17T10:56:54,652 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2024-07-17T10:56:54,654 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2024-07-17T10:56:54,656 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2024-07-17T10:56:54,658 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2024-07-17T10:56:54,659 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2024-07-17T10:56:54,662 creating build/lib/colossalai/shardformer/layer/moe 2024-07-17T10:56:54,663 copying colossalai/shardformer/layer/moe/routers.py -> build/lib/colossalai/shardformer/layer/moe 2024-07-17T10:56:54,665 copying colossalai/shardformer/layer/moe/__init__.py -> build/lib/colossalai/shardformer/layer/moe 2024-07-17T10:56:54,666 copying colossalai/shardformer/layer/moe/layers.py -> build/lib/colossalai/shardformer/layer/moe 2024-07-17T10:56:54,669 copying colossalai/shardformer/layer/moe/experts.py -> build/lib/colossalai/shardformer/layer/moe 2024-07-17T10:56:54,671 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-07-17T10:56:54,672 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-07-17T10:56:54,673 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-07-17T10:56:54,677 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-07-17T10:56:54,680 creating build/lib/colossalai/cli/launcher 2024-07-17T10:56:54,681 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2024-07-17T10:56:54,682 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2024-07-17T10:56:54,685 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2024-07-17T10:56:54,686 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2024-07-17T10:56:54,688 creating build/lib/colossalai/cli/check 2024-07-17T10:56:54,689 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2024-07-17T10:56:54,691 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2024-07-17T10:56:54,693 creating build/lib/colossalai/utils/tensor_detector 2024-07-17T10:56:54,694 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2024-07-17T10:56:54,696 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2024-07-17T10:56:54,699 creating build/lib/colossalai/utils/multi_tensor_apply 2024-07-17T10:56:54,699 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-07-17T10:56:54,701 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-07-17T10:56:54,703 creating build/lib/colossalai/utils/model 2024-07-17T10:56:54,704 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2024-07-17T10:56:54,705 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2024-07-17T10:56:54,707 creating build/lib/colossalai/utils/rank_recorder 2024-07-17T10:56:54,708 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2024-07-17T10:56:54,710 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2024-07-17T10:56:54,712 creating build/lib/colossalai/fx/codegen 2024-07-17T10:56:54,713 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2024-07-17T10:56:54,715 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2024-07-17T10:56:54,718 creating build/lib/colossalai/fx/profiler 2024-07-17T10:56:54,719 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2024-07-17T10:56:54,721 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2024-07-17T10:56:54,723 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2024-07-17T10:56:54,726 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2024-07-17T10:56:54,728 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2024-07-17T10:56:54,730 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2024-07-17T10:56:54,732 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2024-07-17T10:56:54,734 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2024-07-17T10:56:54,737 creating build/lib/colossalai/fx/tracer 2024-07-17T10:56:54,738 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2024-07-17T10:56:54,739 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2024-07-17T10:56:54,742 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2024-07-17T10:56:54,745 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2024-07-17T10:56:54,746 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2024-07-17T10:56:54,748 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2024-07-17T10:56:54,750 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2024-07-17T10:56:54,753 creating build/lib/colossalai/fx/passes 2024-07-17T10:56:54,753 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2024-07-17T10:56:54,755 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2024-07-17T10:56:54,757 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2024-07-17T10:56:54,759 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2024-07-17T10:56:54,762 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2024-07-17T10:56:54,764 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2024-07-17T10:56:54,766 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2024-07-17T10:56:54,768 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2024-07-17T10:56:54,771 creating build/lib/colossalai/fx/profiler/experimental 2024-07-17T10:56:54,772 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2024-07-17T10:56:54,774 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2024-07-17T10:56:54,781 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2024-07-17T10:56:54,787 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2024-07-17T10:56:54,789 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2024-07-17T10:56:54,791 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:54,793 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:54,795 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:54,796 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:54,803 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:54,804 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:54,806 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:54,808 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:54,810 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:54,812 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:54,815 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:54,816 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:54,818 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:54,820 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:54,821 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:54,823 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:54,825 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:54,827 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:54,829 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:54,831 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:54,832 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:54,834 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:54,836 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2024-07-17T10:56:54,837 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2024-07-17T10:56:54,839 creating build/lib/colossalai/fx/tracer/meta_patch 2024-07-17T10:56:54,840 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2024-07-17T10:56:54,843 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-17T10:56:54,844 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-17T10:56:54,846 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-17T10:56:54,847 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-17T10:56:54,850 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-17T10:56:54,851 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-17T10:56:54,854 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-17T10:56:54,854 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-17T10:56:54,856 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-17T10:56:54,858 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-17T10:56:54,859 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-17T10:56:54,862 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:54,863 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:54,865 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:54,866 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:54,868 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:54,870 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:54,871 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:54,874 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:54,875 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:54,878 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:54,878 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:54,880 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:54,882 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:54,883 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:54,885 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:54,887 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:54,889 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:54,890 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:54,892 creating build/lib/colossalai/amp/naive_amp 2024-07-17T10:56:54,893 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2024-07-17T10:56:54,895 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2024-07-17T10:56:54,898 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2024-07-17T10:56:54,898 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-07-17T10:56:54,901 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-07-17T10:56:54,903 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-07-17T10:56:54,904 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-07-17T10:56:54,907 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-17T10:56:54,907 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-17T10:56:54,909 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-17T10:56:54,911 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-17T10:56:54,912 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-17T10:56:54,915 creating build/lib/colossalai/booster/mixed_precision 2024-07-17T10:56:54,916 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2024-07-17T10:56:54,917 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2024-07-17T10:56:54,919 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2024-07-17T10:56:54,920 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2024-07-17T10:56:54,922 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2024-07-17T10:56:54,923 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2024-07-17T10:56:54,926 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2024-07-17T10:56:54,928 creating build/lib/colossalai/booster/plugin 2024-07-17T10:56:54,929 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2024-07-17T10:56:54,931 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2024-07-17T10:56:54,933 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2024-07-17T10:56:54,936 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-07-17T10:56:54,938 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-07-17T10:56:54,940 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-07-17T10:56:54,942 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-07-17T10:56:54,945 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2024-07-17T10:56:54,947 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2024-07-17T10:56:54,950 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2024-07-17T10:56:54,953 creating build/lib/colossalai/zero/low_level 2024-07-17T10:56:54,955 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2024-07-17T10:56:54,958 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2024-07-17T10:56:54,961 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2024-07-17T10:56:54,965 copying colossalai/zero/low_level/zero_hook.py -> build/lib/colossalai/zero/low_level 2024-07-17T10:56:54,968 creating build/lib/colossalai/zero/gemini 2024-07-17T10:56:54,969 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2024-07-17T10:56:54,972 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2024-07-17T10:56:54,974 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2024-07-17T10:56:54,977 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2024-07-17T10:56:54,981 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2024-07-17T10:56:54,984 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2024-07-17T10:56:54,988 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2024-07-17T10:56:54,991 creating build/lib/colossalai/zero/low_level/bookkeeping 2024-07-17T10:56:54,992 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-07-17T10:56:54,994 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-07-17T10:56:54,995 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-07-17T10:56:54,997 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-07-17T10:56:55,001 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-07-17T10:56:55,004 creating build/lib/colossalai/zero/gemini/chunk 2024-07-17T10:56:55,005 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2024-07-17T10:56:55,008 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2024-07-17T10:56:55,009 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-07-17T10:56:55,011 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2024-07-17T10:56:55,014 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-07-17T10:56:55,016 creating build/lib/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:55,017 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:55,019 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:55,021 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:55,022 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:55,024 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:55,026 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:55,027 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:55,029 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:55,033 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:55,039 creating build/lib/colossalai/nn/lr_scheduler 2024-07-17T10:56:55,040 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-17T10:56:55,044 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-17T10:56:55,049 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-17T10:56:55,052 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-17T10:56:55,055 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-17T10:56:55,058 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-17T10:56:55,060 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-17T10:56:55,061 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-17T10:56:55,065 creating build/lib/colossalai/nn/layer 2024-07-17T10:56:55,066 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2024-07-17T10:56:55,067 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2024-07-17T10:56:55,071 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2024-07-17T10:56:55,074 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2024-07-17T10:56:55,078 creating build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,079 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,081 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,083 copying colossalai/nn/optimizer/distributed_came.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,087 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,088 copying colossalai/nn/optimizer/distributed_adafactor.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,091 copying colossalai/nn/optimizer/distributed_galore.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,093 copying colossalai/nn/optimizer/came.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,095 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,097 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,099 copying colossalai/nn/optimizer/galore.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,102 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,103 copying colossalai/nn/optimizer/adafactor.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,106 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,108 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,110 copying colossalai/nn/optimizer/distributed_lamb.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,112 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2024-07-17T10:56:55,115 creating build/lib/colossalai/nn/loss 2024-07-17T10:56:55,115 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2024-07-17T10:56:55,118 creating build/lib/colossalai/pipeline/schedule 2024-07-17T10:56:55,118 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2024-07-17T10:56:55,121 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2024-07-17T10:56:55,122 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2024-07-17T10:56:55,125 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2024-07-17T10:56:55,127 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2024-07-17T10:56:55,129 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2024-07-17T10:56:55,132 creating build/lib/colossalai/tensor/padded_tensor 2024-07-17T10:56:55,133 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2024-07-17T10:56:55,134 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2024-07-17T10:56:55,137 creating build/lib/colossalai/tensor/moe_tensor 2024-07-17T10:56:55,137 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2024-07-17T10:56:55,139 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2024-07-17T10:56:55,141 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2024-07-17T10:56:55,143 creating build/lib/colossalai/tensor/d_tensor 2024-07-17T10:56:55,144 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2024-07-17T10:56:55,146 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2024-07-17T10:56:55,148 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2024-07-17T10:56:55,150 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2024-07-17T10:56:55,151 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-07-17T10:56:55,153 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-07-17T10:56:55,155 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2024-07-17T10:56:55,157 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2024-07-17T10:56:55,160 creating build/lib/colossalai/legacy/registry 2024-07-17T10:56:55,161 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2024-07-17T10:56:55,162 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2024-07-17T10:56:55,165 creating build/lib/colossalai/legacy/utils 2024-07-17T10:56:55,166 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2024-07-17T10:56:55,167 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2024-07-17T10:56:55,169 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2024-07-17T10:56:55,172 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2024-07-17T10:56:55,174 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2024-07-17T10:56:55,177 creating build/lib/colossalai/legacy/context 2024-07-17T10:56:55,177 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2024-07-17T10:56:55,179 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2024-07-17T10:56:55,181 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2024-07-17T10:56:55,183 creating build/lib/colossalai/legacy/builder 2024-07-17T10:56:55,184 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2024-07-17T10:56:55,186 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2024-07-17T10:56:55,188 creating build/lib/colossalai/legacy/amp 2024-07-17T10:56:55,189 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2024-07-17T10:56:55,191 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2024-07-17T10:56:55,193 creating build/lib/colossalai/legacy/zero 2024-07-17T10:56:55,193 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2024-07-17T10:56:55,195 creating build/lib/colossalai/legacy/nn 2024-07-17T10:56:55,196 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2024-07-17T10:56:55,198 creating build/lib/colossalai/legacy/pipeline 2024-07-17T10:56:55,199 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2024-07-17T10:56:55,201 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2024-07-17T10:56:55,203 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2024-07-17T10:56:55,205 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2024-07-17T10:56:55,207 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2024-07-17T10:56:55,209 creating build/lib/colossalai/legacy/tensor 2024-07-17T10:56:55,210 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2024-07-17T10:56:55,212 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2024-07-17T10:56:55,214 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2024-07-17T10:56:55,216 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2024-07-17T10:56:55,218 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2024-07-17T10:56:55,219 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2024-07-17T10:56:55,221 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2024-07-17T10:56:55,222 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2024-07-17T10:56:55,225 creating build/lib/colossalai/legacy/communication 2024-07-17T10:56:55,226 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2024-07-17T10:56:55,228 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2024-07-17T10:56:55,230 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2024-07-17T10:56:55,231 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2024-07-17T10:56:55,234 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2024-07-17T10:56:55,236 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2024-07-17T10:56:55,238 creating build/lib/colossalai/legacy/inference 2024-07-17T10:56:55,239 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2024-07-17T10:56:55,241 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2024-07-17T10:56:55,243 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2024-07-17T10:56:55,245 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2024-07-17T10:56:55,248 creating build/lib/colossalai/legacy/trainer 2024-07-17T10:56:55,249 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2024-07-17T10:56:55,250 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2024-07-17T10:56:55,253 creating build/lib/colossalai/legacy/engine 2024-07-17T10:56:55,254 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2024-07-17T10:56:55,255 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2024-07-17T10:56:55,258 creating build/lib/colossalai/legacy/utils/profiler 2024-07-17T10:56:55,259 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2024-07-17T10:56:55,261 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2024-07-17T10:56:55,263 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-07-17T10:56:55,265 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-07-17T10:56:55,267 creating build/lib/colossalai/legacy/utils/checkpoint 2024-07-17T10:56:55,268 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-07-17T10:56:55,270 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-07-17T10:56:55,272 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-07-17T10:56:55,275 creating build/lib/colossalai/legacy/utils/data_sampler 2024-07-17T10:56:55,275 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-07-17T10:56:55,277 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-07-17T10:56:55,279 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-07-17T10:56:55,281 creating build/lib/colossalai/legacy/utils/profiler/legacy 2024-07-17T10:56:55,282 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-07-17T10:56:55,285 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-07-17T10:56:55,287 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-07-17T10:56:55,289 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-07-17T10:56:55,292 creating build/lib/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:55,293 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:55,295 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:55,297 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:55,299 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:55,301 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:55,303 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:55,305 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:55,306 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:55,308 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:55,310 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:55,312 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:55,315 creating build/lib/colossalai/legacy/context/random 2024-07-17T10:56:55,316 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2024-07-17T10:56:55,318 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2024-07-17T10:56:55,320 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2024-07-17T10:56:55,322 creating build/lib/colossalai/legacy/amp/naive_amp 2024-07-17T10:56:55,323 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-07-17T10:56:55,325 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-07-17T10:56:55,327 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-07-17T10:56:55,330 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-07-17T10:56:55,333 creating build/lib/colossalai/legacy/amp/apex_amp 2024-07-17T10:56:55,333 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-07-17T10:56:55,335 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-07-17T10:56:55,337 creating build/lib/colossalai/legacy/amp/torch_amp 2024-07-17T10:56:55,338 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-07-17T10:56:55,340 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-07-17T10:56:55,342 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-07-17T10:56:55,345 creating build/lib/colossalai/legacy/zero/shard_utils 2024-07-17T10:56:55,346 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-07-17T10:56:55,348 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-07-17T10:56:55,349 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-07-17T10:56:55,351 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-07-17T10:56:55,353 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-07-17T10:56:55,355 creating build/lib/colossalai/legacy/zero/sharded_optim 2024-07-17T10:56:55,356 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-07-17T10:56:55,358 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-07-17T10:56:55,361 creating build/lib/colossalai/legacy/zero/gemini 2024-07-17T10:56:55,362 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-17T10:56:55,364 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-17T10:56:55,366 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-17T10:56:55,368 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-17T10:56:55,370 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-17T10:56:55,372 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-17T10:56:55,374 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-17T10:56:55,376 creating build/lib/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:55,377 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:55,379 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:55,381 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:55,383 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:55,386 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:55,388 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:55,390 creating build/lib/colossalai/legacy/zero/init_ctx 2024-07-17T10:56:55,391 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-07-17T10:56:55,393 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-07-17T10:56:55,395 creating build/lib/colossalai/legacy/zero/sharded_param 2024-07-17T10:56:55,396 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-07-17T10:56:55,398 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-07-17T10:56:55,399 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-07-17T10:56:55,402 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-07-17T10:56:55,402 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-07-17T10:56:55,404 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-07-17T10:56:55,406 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2024-07-17T10:56:55,407 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-07-17T10:56:55,409 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-07-17T10:56:55,411 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-07-17T10:56:55,413 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-07-17T10:56:55,415 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-07-17T10:56:55,418 creating build/lib/colossalai/legacy/nn/parallel 2024-07-17T10:56:55,419 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2024-07-17T10:56:55,421 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2024-07-17T10:56:55,422 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2024-07-17T10:56:55,425 creating build/lib/colossalai/legacy/nn/metric 2024-07-17T10:56:55,426 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2024-07-17T10:56:55,427 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2024-07-17T10:56:55,429 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2024-07-17T10:56:55,431 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2024-07-17T10:56:55,433 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2024-07-17T10:56:55,435 creating build/lib/colossalai/legacy/nn/layer 2024-07-17T10:56:55,436 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2024-07-17T10:56:55,438 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2024-07-17T10:56:55,440 creating build/lib/colossalai/legacy/nn/_ops 2024-07-17T10:56:55,441 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2024-07-17T10:56:55,443 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2024-07-17T10:56:55,446 creating build/lib/colossalai/legacy/nn/loss 2024-07-17T10:56:55,446 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2024-07-17T10:56:55,448 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2024-07-17T10:56:55,450 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2024-07-17T10:56:55,452 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2024-07-17T10:56:55,455 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2024-07-17T10:56:55,457 creating build/lib/colossalai/legacy/nn/parallel/layers 2024-07-17T10:56:55,458 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-07-17T10:56:55,460 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-07-17T10:56:55,462 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-07-17T10:56:55,463 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-07-17T10:56:55,465 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-07-17T10:56:55,468 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:55,469 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:55,471 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:55,473 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:55,475 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:55,477 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:55,479 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:55,481 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:55,484 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:55,486 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:55,488 creating build/lib/colossalai/legacy/nn/layer/vanilla 2024-07-17T10:56:55,489 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-07-17T10:56:55,491 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-07-17T10:56:55,494 creating build/lib/colossalai/legacy/nn/layer/wrapper 2024-07-17T10:56:55,495 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-07-17T10:56:55,497 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-07-17T10:56:55,499 creating build/lib/colossalai/legacy/nn/layer/utils 2024-07-17T10:56:55,500 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-07-17T10:56:55,502 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-07-17T10:56:55,504 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-07-17T10:56:55,505 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-07-17T10:56:55,506 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-07-17T10:56:55,508 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-07-17T10:56:55,511 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-07-17T10:56:55,515 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-07-17T10:56:55,516 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-07-17T10:56:55,517 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-07-17T10:56:55,519 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-07-17T10:56:55,522 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-07-17T10:56:55,526 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-07-17T10:56:55,526 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-07-17T10:56:55,528 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-07-17T10:56:55,530 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-07-17T10:56:55,532 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-07-17T10:56:55,535 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-17T10:56:55,536 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-17T10:56:55,538 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-17T10:56:55,540 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-17T10:56:55,543 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-17T10:56:55,546 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-07-17T10:56:55,547 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-07-17T10:56:55,550 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-07-17T10:56:55,551 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-07-17T10:56:55,554 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-07-17T10:56:55,557 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:55,558 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:55,560 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:55,562 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:55,563 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:55,565 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:55,567 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:55,569 creating build/lib/colossalai/legacy/pipeline/middleware 2024-07-17T10:56:55,570 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-07-17T10:56:55,572 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-07-17T10:56:55,575 creating build/lib/colossalai/legacy/pipeline/rpc 2024-07-17T10:56:55,576 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-07-17T10:56:55,578 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-07-17T10:56:55,580 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-07-17T10:56:55,583 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-07-17T10:56:55,586 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-07-17T10:56:55,586 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-07-17T10:56:55,588 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-07-17T10:56:55,591 creating build/lib/colossalai/legacy/inference/hybridengine 2024-07-17T10:56:55,592 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-07-17T10:56:55,593 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-07-17T10:56:55,596 creating build/lib/colossalai/legacy/inference/tensor_parallel 2024-07-17T10:56:55,597 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-07-17T10:56:55,599 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-07-17T10:56:55,601 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-07-17T10:56:55,603 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-07-17T10:56:55,606 creating build/lib/colossalai/legacy/inference/pipeline 2024-07-17T10:56:55,607 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2024-07-17T10:56:55,609 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2024-07-17T10:56:55,611 creating build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:55,612 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:55,614 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:55,616 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:55,617 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:55,619 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:55,621 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:55,623 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:55,625 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:55,627 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:55,630 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-07-17T10:56:55,631 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-07-17T10:56:55,633 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-07-17T10:56:55,635 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-07-17T10:56:55,638 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2024-07-17T10:56:55,638 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-07-17T10:56:55,640 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-07-17T10:56:55,643 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-07-17T10:56:55,644 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-07-17T10:56:55,646 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-07-17T10:56:55,648 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-07-17T10:56:55,650 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-07-17T10:56:55,652 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-17T10:56:55,653 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-17T10:56:55,655 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-17T10:56:55,657 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-17T10:56:55,659 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-17T10:56:55,662 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-17T10:56:55,665 creating build/lib/colossalai/legacy/trainer/hooks 2024-07-17T10:56:55,666 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-17T10:56:55,667 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-17T10:56:55,669 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-17T10:56:55,671 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-17T10:56:55,673 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-17T10:56:55,675 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-17T10:56:55,677 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-17T10:56:55,680 creating build/lib/colossalai/legacy/engine/schedule 2024-07-17T10:56:55,681 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-07-17T10:56:55,683 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2024-07-17T10:56:55,685 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-07-17T10:56:55,687 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-07-17T10:56:55,689 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2024-07-17T10:56:55,692 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2024-07-17T10:56:55,693 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-07-17T10:56:55,694 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-07-17T10:56:55,698 creating build/lib/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:55,698 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:55,701 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:55,702 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:55,704 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:55,706 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:55,707 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:55,709 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:55,711 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:55,714 creating build/lib/colossalai/kernel/triton 2024-07-17T10:56:55,715 copying colossalai/kernel/triton/fused_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-07-17T10:56:55,717 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2024-07-17T10:56:55,718 copying colossalai/kernel/triton/rotary_cache_copy.py -> build/lib/colossalai/kernel/triton 2024-07-17T10:56:55,720 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2024-07-17T10:56:55,723 copying colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-07-17T10:56:55,725 copying colossalai/kernel/triton/context_attn_unpad.py -> build/lib/colossalai/kernel/triton 2024-07-17T10:56:55,728 copying colossalai/kernel/triton/kvcache_copy.py -> build/lib/colossalai/kernel/triton 2024-07-17T10:56:55,730 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2024-07-17T10:56:55,732 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2024-07-17T10:56:55,734 copying colossalai/kernel/triton/rms_layernorm.py -> build/lib/colossalai/kernel/triton 2024-07-17T10:56:55,736 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2024-07-17T10:56:55,739 creating build/lib/colossalai/kernel/jit 2024-07-17T10:56:55,740 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2024-07-17T10:56:55,742 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2024-07-17T10:56:55,743 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2024-07-17T10:56:55,745 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2024-07-17T10:56:55,747 creating build/lib/colossalai/kernel/extensions 2024-07-17T10:56:55,749 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2024-07-17T10:56:55,750 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2024-07-17T10:56:55,752 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2024-07-17T10:56:55,754 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2024-07-17T10:56:55,756 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2024-07-17T10:56:55,758 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2024-07-17T10:56:55,760 creating build/lib/colossalai/kernel/extensions/csrc 2024-07-17T10:56:55,761 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2024-07-17T10:56:55,763 creating build/lib/colossalai/kernel/extensions/pybind 2024-07-17T10:56:55,764 copying colossalai/kernel/extensions/pybind/__init__.py -> build/lib/colossalai/kernel/extensions/pybind 2024-07-17T10:56:55,766 creating build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-07-17T10:56:55,767 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-07-17T10:56:55,769 copying colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-07-17T10:56:55,771 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-07-17T10:56:55,773 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-07-17T10:56:55,775 creating build/lib/colossalai/kernel/extensions/pybind/moe 2024-07-17T10:56:55,776 copying colossalai/kernel/extensions/pybind/moe/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-07-17T10:56:55,778 copying colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-07-17T10:56:55,780 creating build/lib/colossalai/kernel/extensions/pybind/softmax 2024-07-17T10:56:55,781 copying colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-07-17T10:56:55,783 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-07-17T10:56:55,784 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-07-17T10:56:55,787 creating build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-07-17T10:56:55,787 copying colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-07-17T10:56:55,789 copying colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-07-17T10:56:55,791 creating build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-07-17T10:56:55,792 copying colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-07-17T10:56:55,794 copying colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-07-17T10:56:55,797 creating build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-17T10:56:55,798 copying colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-17T10:56:55,800 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-17T10:56:55,801 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-17T10:56:55,804 creating build/lib/colossalai/kernel/extensions/pybind/inference 2024-07-17T10:56:55,805 copying colossalai/kernel/extensions/pybind/inference/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-07-17T10:56:55,806 copying colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-07-17T10:56:55,809 creating build/lib/colossalai/inference/core 2024-07-17T10:56:55,810 copying colossalai/inference/core/__init__.py -> build/lib/colossalai/inference/core 2024-07-17T10:56:55,811 copying colossalai/inference/core/plugin.py -> build/lib/colossalai/inference/core 2024-07-17T10:56:55,813 copying colossalai/inference/core/request_handler.py -> build/lib/colossalai/inference/core 2024-07-17T10:56:55,816 copying colossalai/inference/core/base_engine.py -> build/lib/colossalai/inference/core 2024-07-17T10:56:55,817 copying colossalai/inference/core/async_engine.py -> build/lib/colossalai/inference/core 2024-07-17T10:56:55,820 copying colossalai/inference/core/engine.py -> build/lib/colossalai/inference/core 2024-07-17T10:56:55,822 copying colossalai/inference/core/llm_engine.py -> build/lib/colossalai/inference/core 2024-07-17T10:56:55,824 copying colossalai/inference/core/rpc_engine.py -> build/lib/colossalai/inference/core 2024-07-17T10:56:55,827 copying colossalai/inference/core/diffusion_engine.py -> build/lib/colossalai/inference/core 2024-07-17T10:56:55,829 creating build/lib/colossalai/inference/modeling 2024-07-17T10:56:55,830 copying colossalai/inference/modeling/__init__.py -> build/lib/colossalai/inference/modeling 2024-07-17T10:56:55,832 creating build/lib/colossalai/inference/spec 2024-07-17T10:56:55,833 copying colossalai/inference/spec/__init__.py -> build/lib/colossalai/inference/spec 2024-07-17T10:56:55,835 copying colossalai/inference/spec/drafter.py -> build/lib/colossalai/inference/spec 2024-07-17T10:56:55,837 copying colossalai/inference/spec/struct.py -> build/lib/colossalai/inference/spec 2024-07-17T10:56:55,840 creating build/lib/colossalai/inference/server 2024-07-17T10:56:55,841 copying colossalai/inference/server/__init__.py -> build/lib/colossalai/inference/server 2024-07-17T10:56:55,843 copying colossalai/inference/server/api_server.py -> build/lib/colossalai/inference/server 2024-07-17T10:56:55,846 copying colossalai/inference/server/completion_service.py -> build/lib/colossalai/inference/server 2024-07-17T10:56:55,848 copying colossalai/inference/server/chat_service.py -> build/lib/colossalai/inference/server 2024-07-17T10:56:55,850 copying colossalai/inference/server/utils.py -> build/lib/colossalai/inference/server 2024-07-17T10:56:55,854 creating build/lib/colossalai/inference/executor 2024-07-17T10:56:55,855 copying colossalai/inference/executor/__init__.py -> build/lib/colossalai/inference/executor 2024-07-17T10:56:55,857 copying colossalai/inference/executor/rpc_worker.py -> build/lib/colossalai/inference/executor 2024-07-17T10:56:55,861 creating build/lib/colossalai/inference/kv_cache 2024-07-17T10:56:55,862 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2024-07-17T10:56:55,865 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2024-07-17T10:56:55,869 copying colossalai/inference/kv_cache/block_cache.py -> build/lib/colossalai/inference/kv_cache 2024-07-17T10:56:55,872 creating build/lib/colossalai/inference/modeling/backends 2024-07-17T10:56:55,873 copying colossalai/inference/modeling/backends/__init__.py -> build/lib/colossalai/inference/modeling/backends 2024-07-17T10:56:55,875 copying colossalai/inference/modeling/backends/attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-07-17T10:56:55,878 copying colossalai/inference/modeling/backends/pre_attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-07-17T10:56:55,882 creating build/lib/colossalai/inference/modeling/policy 2024-07-17T10:56:55,883 copying colossalai/inference/modeling/policy/__init__.py -> build/lib/colossalai/inference/modeling/policy 2024-07-17T10:56:55,886 copying colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/policy 2024-07-17T10:56:55,889 copying colossalai/inference/modeling/policy/glide_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-07-17T10:56:55,891 copying colossalai/inference/modeling/policy/nopadding_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-07-17T10:56:55,894 copying colossalai/inference/modeling/policy/pixart_alpha.py -> build/lib/colossalai/inference/modeling/policy 2024-07-17T10:56:55,896 copying colossalai/inference/modeling/policy/stablediffusion3.py -> build/lib/colossalai/inference/modeling/policy 2024-07-17T10:56:55,899 creating build/lib/colossalai/inference/modeling/layers 2024-07-17T10:56:55,901 copying colossalai/inference/modeling/layers/attention.py -> build/lib/colossalai/inference/modeling/layers 2024-07-17T10:56:55,904 copying colossalai/inference/modeling/layers/__init__.py -> build/lib/colossalai/inference/modeling/layers 2024-07-17T10:56:55,906 copying colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/lib/colossalai/inference/modeling/layers 2024-07-17T10:56:55,909 creating build/lib/colossalai/inference/modeling/models 2024-07-17T10:56:55,910 copying colossalai/inference/modeling/models/__init__.py -> build/lib/colossalai/inference/modeling/models 2024-07-17T10:56:55,913 copying colossalai/inference/modeling/models/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/models 2024-07-17T10:56:55,916 copying colossalai/inference/modeling/models/diffusion.py -> build/lib/colossalai/inference/modeling/models 2024-07-17T10:56:55,918 copying colossalai/inference/modeling/models/glide_llama.py -> build/lib/colossalai/inference/modeling/models 2024-07-17T10:56:55,922 copying colossalai/inference/modeling/models/nopadding_llama.py -> build/lib/colossalai/inference/modeling/models 2024-07-17T10:56:55,925 copying colossalai/inference/modeling/models/pixart_alpha.py -> build/lib/colossalai/inference/modeling/models 2024-07-17T10:56:55,928 copying colossalai/inference/modeling/models/stablediffusion3.py -> build/lib/colossalai/inference/modeling/models 2024-07-17T10:56:55,932 creating build/lib/colossalai/_analyzer/fx 2024-07-17T10:56:55,933 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2024-07-17T10:56:55,936 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2024-07-17T10:56:55,938 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2024-07-17T10:56:55,941 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2024-07-17T10:56:55,943 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2024-07-17T10:56:55,947 creating build/lib/colossalai/_analyzer/_subclasses 2024-07-17T10:56:55,948 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2024-07-17T10:56:55,950 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-07-17T10:56:55,952 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2024-07-17T10:56:55,954 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2024-07-17T10:56:55,956 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-07-17T10:56:55,959 creating build/lib/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:55,960 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:55,962 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:55,964 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:55,966 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:55,968 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:55,970 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:55,973 creating build/lib/colossalai/_analyzer/fx/passes 2024-07-17T10:56:55,974 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2024-07-17T10:56:55,975 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2024-07-17T10:56:55,978 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2024-07-17T10:56:55,981 creating build/lib/colossalai/auto_parallel/tensor_shard 2024-07-17T10:56:55,981 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-07-17T10:56:55,983 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-07-17T10:56:55,984 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-07-17T10:56:55,987 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-07-17T10:56:55,989 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-07-17T10:56:55,992 creating build/lib/colossalai/auto_parallel/offload 2024-07-17T10:56:55,993 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2024-07-17T10:56:55,996 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2024-07-17T10:56:55,998 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2024-07-17T10:56:55,999 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2024-07-17T10:56:56,001 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2024-07-17T10:56:56,003 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2024-07-17T10:56:56,005 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2024-07-17T10:56:56,008 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2024-07-17T10:56:56,010 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2024-07-17T10:56:56,012 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2024-07-17T10:56:56,015 creating build/lib/colossalai/auto_parallel/pipeline_shard 2024-07-17T10:56:56,015 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2024-07-17T10:56:56,018 creating build/lib/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:56,019 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:56,021 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:56,022 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:56,024 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:56,027 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:56,029 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:56,032 creating build/lib/colossalai/auto_parallel/passes 2024-07-17T10:56:56,033 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-07-17T10:56:56,035 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2024-07-17T10:56:56,037 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2024-07-17T10:56:56,039 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2024-07-17T10:56:56,042 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-07-17T10:56:56,045 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-07-17T10:56:56,048 creating build/lib/colossalai/auto_parallel/meta_profiler 2024-07-17T10:56:56,049 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-07-17T10:56:56,051 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-07-17T10:56:56,053 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-07-17T10:56:56,055 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-07-17T10:56:56,058 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-07-17T10:56:56,059 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-07-17T10:56:56,061 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-07-17T10:56:56,063 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-07-17T10:56:56,066 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-07-17T10:56:56,068 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-07-17T10:56:56,071 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:56,072 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:56,074 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:56,076 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:56,078 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:56,080 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:56,082 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:56,086 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,087 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,089 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,091 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,092 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,094 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,097 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,099 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,101 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,104 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,106 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,109 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,111 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,113 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,115 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,117 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,119 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,121 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,122 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,124 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,126 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,128 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,130 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,132 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,134 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,137 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,139 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,142 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:56,146 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,147 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,149 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,151 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,153 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,155 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,157 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,159 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,161 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,164 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,165 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,168 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,170 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,172 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,175 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,178 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,179 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,182 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,184 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,186 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:56,189 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:56,190 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:56,192 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:56,194 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:56,196 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:56,197 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:56,200 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:56,202 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:56,204 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:56,206 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:56,208 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:56,210 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:56,213 creating build/lib/extensions 2024-07-17T10:56:56,213 creating build/lib/extensions/csrc 2024-07-17T10:56:56,214 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2024-07-17T10:56:56,216 creating build/lib/extensions/pybind 2024-07-17T10:56:56,217 copying extensions/pybind/__init__.py -> build/lib/extensions/pybind 2024-07-17T10:56:56,219 creating build/lib/extensions/pybind/flash_attention 2024-07-17T10:56:56,220 copying extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-07-17T10:56:56,222 copying extensions/pybind/flash_attention/__init__.py -> build/lib/extensions/pybind/flash_attention 2024-07-17T10:56:56,223 copying extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/extensions/pybind/flash_attention 2024-07-17T10:56:56,225 copying extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-07-17T10:56:56,227 creating build/lib/extensions/pybind/moe 2024-07-17T10:56:56,228 copying extensions/pybind/moe/__init__.py -> build/lib/extensions/pybind/moe 2024-07-17T10:56:56,230 copying extensions/pybind/moe/moe_cuda.py -> build/lib/extensions/pybind/moe 2024-07-17T10:56:56,232 creating build/lib/extensions/pybind/softmax 2024-07-17T10:56:56,233 copying extensions/pybind/softmax/__init__.py -> build/lib/extensions/pybind/softmax 2024-07-17T10:56:56,234 copying extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-07-17T10:56:56,236 copying extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-07-17T10:56:56,238 creating build/lib/extensions/pybind/optimizer 2024-07-17T10:56:56,239 copying extensions/pybind/optimizer/__init__.py -> build/lib/extensions/pybind/optimizer 2024-07-17T10:56:56,240 copying extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/pybind/optimizer 2024-07-17T10:56:56,242 creating build/lib/extensions/pybind/layernorm 2024-07-17T10:56:56,243 copying extensions/pybind/layernorm/__init__.py -> build/lib/extensions/pybind/layernorm 2024-07-17T10:56:56,245 copying extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/extensions/pybind/layernorm 2024-07-17T10:56:56,247 creating build/lib/extensions/pybind/cpu_adam 2024-07-17T10:56:56,248 copying extensions/pybind/cpu_adam/__init__.py -> build/lib/extensions/pybind/cpu_adam 2024-07-17T10:56:56,250 copying extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/pybind/cpu_adam 2024-07-17T10:56:56,251 copying extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/pybind/cpu_adam 2024-07-17T10:56:56,253 creating build/lib/extensions/pybind/inference 2024-07-17T10:56:56,254 copying extensions/pybind/inference/__init__.py -> build/lib/extensions/pybind/inference 2024-07-17T10:56:56,256 copying extensions/pybind/inference/inference_ops_cuda.py -> build/lib/extensions/pybind/inference 2024-07-17T10:56:56,342 creating build/lib/colossalai/kernel/extensions/csrc/funcs 2024-07-17T10:56:56,343 copying colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-07-17T10:56:56,345 copying colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-07-17T10:56:56,348 copying colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-07-17T10:56:56,350 copying colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-07-17T10:56:56,353 copying colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-07-17T10:56:56,355 creating build/lib/colossalai/kernel/extensions/csrc/common 2024-07-17T10:56:56,355 copying colossalai/kernel/extensions/csrc/common/micros.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-07-17T10:56:56,358 copying colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-07-17T10:56:56,360 copying colossalai/kernel/extensions/csrc/common/target.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-07-17T10:56:56,362 copying colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-07-17T10:56:56,364 copying colossalai/kernel/extensions/csrc/common/data_type.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-07-17T10:56:56,366 creating build/lib/colossalai/kernel/extensions/csrc/kernel 2024-07-17T10:56:56,366 creating build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-07-17T10:56:56,367 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-07-17T10:56:56,370 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-07-17T10:56:56,372 creating build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-07-17T10:56:56,373 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-07-17T10:56:56,376 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-07-17T10:56:56,378 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,379 copying colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,381 copying colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,383 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,386 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,388 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,390 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,393 copying colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,396 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,398 copying colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,401 copying colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,404 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,406 copying colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,408 copying colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,411 copying colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,413 copying colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,416 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,419 copying colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,421 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:56,424 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-17T10:56:56,425 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-17T10:56:56,427 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-17T10:56:56,429 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-17T10:56:56,431 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-17T10:56:56,433 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-07-17T10:56:56,434 copying colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-07-17T10:56:56,438 copying colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-07-17T10:56:56,442 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-07-17T10:56:56,444 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-07-17T10:56:56,447 copying colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-07-17T10:56:56,450 copying colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-07-17T10:56:56,454 copying colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-07-17T10:56:56,576 /usr/local/lib/python3.9/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-07-17T10:56:56,576 !! 2024-07-17T10:56:56,577 ******************************************************************************** 2024-07-17T10:56:56,577 Please avoid running ``setup.py`` directly. 2024-07-17T10:56:56,577 Instead, use pypa/build, pypa/installer or other 2024-07-17T10:56:56,577 standards-based tools. 2024-07-17T10:56:56,577 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-07-17T10:56:56,577 ******************************************************************************** 2024-07-17T10:56:56,578 !! 2024-07-17T10:56:56,578 self.initialize_options() 2024-07-17T10:56:56,599 installing to build/bdist.linux-armv7l/wheel 2024-07-17T10:56:56,599 running install 2024-07-17T10:56:56,624 running install_lib 2024-07-17T10:56:56,648 creating build/bdist.linux-armv7l 2024-07-17T10:56:56,649 creating build/bdist.linux-armv7l/wheel 2024-07-17T10:56:56,650 creating build/bdist.linux-armv7l/wheel/colossalai 2024-07-17T10:56:56,652 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2024-07-17T10:56:56,653 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-07-17T10:56:56,655 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-07-17T10:56:56,656 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-07-17T10:56:56,658 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-07-17T10:56:56,660 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-07-17T10:56:56,663 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2024-07-17T10:56:56,663 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-07-17T10:56:56,665 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-07-17T10:56:56,667 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-07-17T10:56:56,669 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-07-17T10:56:56,670 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-07-17T10:56:56,673 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,673 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,676 copying build/lib/colossalai/shardformer/policies/command.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,678 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,681 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,682 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,685 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,687 copying build/lib/colossalai/shardformer/policies/mixtral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,689 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,692 copying build/lib/colossalai/shardformer/policies/deepseek.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,694 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,697 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,699 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,701 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,704 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,706 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,708 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,710 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,713 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,715 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,717 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,720 copying build/lib/colossalai/shardformer/policies/qwen2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-17T10:56:56,722 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-07-17T10:56:56,725 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-17T10:56:56,725 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-17T10:56:56,728 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-17T10:56:56,729 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-17T10:56:56,732 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer/moe 2024-07-17T10:56:56,733 copying build/lib/colossalai/shardformer/layer/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer/moe 2024-07-17T10:56:56,736 copying build/lib/colossalai/shardformer/layer/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer/moe 2024-07-17T10:56:56,738 copying build/lib/colossalai/shardformer/layer/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer/moe 2024-07-17T10:56:56,740 copying build/lib/colossalai/shardformer/layer/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer/moe 2024-07-17T10:56:56,742 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-17T10:56:56,745 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-17T10:56:56,748 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-17T10:56:56,750 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-17T10:56:56,753 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-17T10:56:56,755 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-17T10:56:56,757 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-17T10:56:56,759 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-17T10:56:56,762 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,763 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-07-17T10:56:56,764 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-07-17T10:56:56,766 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-07-17T10:56:56,769 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-07-17T10:56:56,771 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,773 copying build/lib/colossalai/shardformer/modeling/command.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,776 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,779 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,781 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,784 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,788 copying build/lib/colossalai/shardformer/modeling/mixtral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,790 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,792 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,796 copying build/lib/colossalai/shardformer/modeling/deepseek.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,799 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,802 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,806 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,809 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,811 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,814 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,817 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,820 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,823 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,826 copying build/lib/colossalai/shardformer/modeling/qwen2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-17T10:56:56,830 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-17T10:56:56,831 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-17T10:56:56,833 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-17T10:56:56,836 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-17T10:56:56,838 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-17T10:56:56,840 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-17T10:56:56,842 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-17T10:56:56,845 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2024-07-17T10:56:56,846 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-07-17T10:56:56,848 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-07-17T10:56:56,850 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-07-17T10:56:56,851 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-07-17T10:56:56,854 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-07-17T10:56:56,856 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-07-17T10:56:56,858 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-07-17T10:56:56,861 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-07-17T10:56:56,862 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-07-17T10:56:56,864 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-07-17T10:56:56,867 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2024-07-17T10:56:56,868 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-07-17T10:56:56,870 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-07-17T10:56:56,873 copying build/lib/colossalai/moe/load_balance.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-07-17T10:56:56,876 copying build/lib/colossalai/moe/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-07-17T10:56:56,878 copying build/lib/colossalai/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-07-17T10:56:56,881 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2024-07-17T10:56:56,882 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-07-17T10:56:56,884 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-07-17T10:56:56,886 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-07-17T10:56:56,888 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-07-17T10:56:56,891 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-07-17T10:56:56,892 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-07-17T10:56:56,894 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-07-17T10:56:56,896 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-07-17T10:56:56,898 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-07-17T10:56:56,899 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-07-17T10:56:56,901 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-07-17T10:56:56,903 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-07-17T10:56:56,905 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-07-17T10:56:56,908 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-07-17T10:56:56,909 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-07-17T10:56:56,911 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-07-17T10:56:56,913 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-07-17T10:56:56,916 creating build/bdist.linux-armv7l/wheel/colossalai/context 2024-07-17T10:56:56,917 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-07-17T10:56:56,919 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-07-17T10:56:56,921 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-07-17T10:56:56,923 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-07-17T10:56:56,925 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-07-17T10:56:56,927 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-07-17T10:56:56,929 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-07-17T10:56:56,931 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-07-17T10:56:56,935 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2024-07-17T10:56:56,936 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C 2024-07-17T10:56:56,938 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-17T10:56:56,940 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-07-17T10:56:56,941 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-07-17T10:56:56,943 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-07-17T10:56:56,946 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-17T10:56:56,948 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-17T10:56:56,949 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-17T10:56:56,951 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-17T10:56:56,953 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-17T10:56:56,955 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-17T10:56:56,956 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-17T10:56:56,959 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-07-17T10:56:56,960 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-07-17T10:56:56,962 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-07-17T10:56:56,963 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-07-17T10:56:56,966 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:56,967 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:56,969 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:56,970 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:56,972 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:56,974 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:56,975 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:56,977 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:56,979 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:56,980 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-17T10:56:56,982 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-07-17T10:56:56,984 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:56,985 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:56,987 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:56,988 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:56,990 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:56,992 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:56,993 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:56,995 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:56,997 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:56,998 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:57,000 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:57,002 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-17T10:56:57,003 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-07-17T10:56:57,005 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-17T10:56:57,007 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-17T10:56:57,009 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-17T10:56:57,011 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-17T10:56:57,013 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-17T10:56:57,014 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-17T10:56:57,017 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-17T10:56:57,019 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-17T10:56:57,021 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-07-17T10:56:57,022 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-07-17T10:56:57,024 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-17T10:56:57,025 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-17T10:56:57,027 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-17T10:56:57,029 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-17T10:56:57,031 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-17T10:56:57,032 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-17T10:56:57,035 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-17T10:56:57,035 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-17T10:56:57,037 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-17T10:56:57,039 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-17T10:56:57,041 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-17T10:56:57,043 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-07-17T10:56:57,044 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-07-17T10:56:57,046 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:57,047 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:57,049 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:57,051 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:57,053 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:57,054 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:57,056 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:57,058 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:57,060 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-17T10:56:57,062 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:57,063 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:57,065 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:57,066 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:57,068 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:57,070 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:57,072 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:57,074 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:57,075 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-17T10:56:57,077 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-17T10:56:57,079 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-17T10:56:57,081 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-17T10:56:57,082 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-17T10:56:57,085 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-17T10:56:57,085 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-17T10:56:57,087 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-17T10:56:57,089 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-17T10:56:57,092 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-17T10:56:57,094 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-17T10:56:57,096 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-17T10:56:57,099 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-17T10:56:57,101 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-17T10:56:57,103 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-17T10:56:57,105 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-17T10:56:57,107 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-17T10:56:57,109 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-17T10:56:57,111 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2024-07-17T10:56:57,113 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-07-17T10:56:57,114 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-07-17T10:56:57,115 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-07-17T10:56:57,117 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-07-17T10:56:57,119 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-07-17T10:56:57,121 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-07-17T10:56:57,122 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-07-17T10:56:57,124 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-07-17T10:56:57,126 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-17T10:56:57,127 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-17T10:56:57,129 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-17T10:56:57,131 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-17T10:56:57,133 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-17T10:56:57,135 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2024-07-17T10:56:57,137 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2024-07-17T10:56:57,138 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-17T10:56:57,139 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-17T10:56:57,141 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-17T10:56:57,143 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-17T10:56:57,144 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-17T10:56:57,146 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-17T10:56:57,148 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-17T10:56:57,150 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-17T10:56:57,152 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-07-17T10:56:57,154 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-07-17T10:56:57,157 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-07-17T10:56:57,159 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-17T10:56:57,160 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-17T10:56:57,162 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-17T10:56:57,164 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-17T10:56:57,167 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-17T10:56:57,169 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-17T10:56:57,171 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-17T10:56:57,173 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-17T10:56:57,177 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-17T10:56:57,178 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-17T10:56:57,181 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-17T10:56:57,184 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2024-07-17T10:56:57,185 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-07-17T10:56:57,187 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-07-17T10:56:57,188 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-07-17T10:56:57,191 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-07-17T10:56:57,192 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-07-17T10:56:57,194 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-07-17T10:56:57,195 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-07-17T10:56:57,198 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-07-17T10:56:57,200 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-07-17T10:56:57,201 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-07-17T10:56:57,203 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-07-17T10:56:57,206 copying build/lib/colossalai/zero/low_level/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-07-17T10:56:57,207 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-07-17T10:56:57,210 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-17T10:56:57,211 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-17T10:56:57,214 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-17T10:56:57,216 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-07-17T10:56:57,217 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-07-17T10:56:57,220 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-07-17T10:56:57,221 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-07-17T10:56:57,223 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-07-17T10:56:57,226 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-07-17T10:56:57,228 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:57,229 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:57,231 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:57,234 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:57,236 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:57,239 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:57,241 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:57,243 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:57,245 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:57,246 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-17T10:56:57,248 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-17T10:56:57,251 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-17T10:56:57,254 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-17T10:56:57,256 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-17T10:56:57,258 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-17T10:56:57,261 creating build/bdist.linux-armv7l/wheel/colossalai/device 2024-07-17T10:56:57,261 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-07-17T10:56:57,264 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-07-17T10:56:57,266 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-07-17T10:56:57,267 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-07-17T10:56:57,270 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2024-07-17T10:56:57,271 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-07-17T10:56:57,273 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-07-17T10:56:57,275 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-07-17T10:56:57,276 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-07-17T10:56:57,278 creating build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-07-17T10:56:57,279 copying build/lib/colossalai/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-07-17T10:56:57,281 copying build/lib/colossalai/quantization/bnb_config.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-07-17T10:56:57,283 copying build/lib/colossalai/quantization/bnb.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-07-17T10:56:57,286 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2024-07-17T10:56:57,287 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-07-17T10:56:57,289 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-07-17T10:56:57,291 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-17T10:56:57,292 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-17T10:56:57,294 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-17T10:56:57,296 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-17T10:56:57,298 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-17T10:56:57,299 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-17T10:56:57,301 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-17T10:56:57,303 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-17T10:56:57,304 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-17T10:56:57,307 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-07-17T10:56:57,308 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-07-17T10:56:57,309 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-07-17T10:56:57,311 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-07-17T10:56:57,313 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-07-17T10:56:57,315 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,316 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,318 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,320 copying build/lib/colossalai/nn/optimizer/distributed_came.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,323 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,324 copying build/lib/colossalai/nn/optimizer/distributed_adafactor.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,327 copying build/lib/colossalai/nn/optimizer/distributed_galore.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,329 copying build/lib/colossalai/nn/optimizer/came.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,331 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,334 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,336 copying build/lib/colossalai/nn/optimizer/galore.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,338 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,341 copying build/lib/colossalai/nn/optimizer/adafactor.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,344 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,346 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,349 copying build/lib/colossalai/nn/optimizer/distributed_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,352 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-17T10:56:57,355 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-07-17T10:56:57,357 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-07-17T10:56:57,360 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-07-17T10:56:57,361 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-07-17T10:56:57,363 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-17T10:56:57,365 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-17T10:56:57,367 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-17T10:56:57,369 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-17T10:56:57,373 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-17T10:56:57,376 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-17T10:56:57,378 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-17T10:56:57,381 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-07-17T10:56:57,384 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-07-17T10:56:57,388 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-17T10:56:57,389 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-17T10:56:57,391 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-17T10:56:57,394 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-07-17T10:56:57,395 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-07-17T10:56:57,397 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-07-17T10:56:57,399 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-17T10:56:57,404 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-07-17T10:56:57,405 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-07-17T10:56:57,407 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-07-17T10:56:57,409 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-07-17T10:56:57,411 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-17T10:56:57,413 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-17T10:56:57,417 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-17T10:56:57,419 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-17T10:56:57,421 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-17T10:56:57,425 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-17T10:56:57,426 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-17T10:56:57,428 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-17T10:56:57,431 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-17T10:56:57,434 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-17T10:56:57,436 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-17T10:56:57,438 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-17T10:56:57,441 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-17T10:56:57,443 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-17T10:56:57,448 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-07-17T10:56:57,449 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-07-17T10:56:57,451 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-07-17T10:56:57,453 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-07-17T10:56:57,454 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-07-17T10:56:57,456 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-07-17T10:56:57,458 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-07-17T10:56:57,459 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-07-17T10:56:57,461 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-07-17T10:56:57,463 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-07-17T10:56:57,466 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-07-17T10:56:57,467 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-07-17T10:56:57,469 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-07-17T10:56:57,471 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-07-17T10:56:57,473 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-07-17T10:56:57,475 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-07-17T10:56:57,476 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-07-17T10:56:57,477 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-07-17T10:56:57,480 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-07-17T10:56:57,482 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-07-17T10:56:57,484 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-07-17T10:56:57,486 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-07-17T10:56:57,488 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-07-17T10:56:57,489 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-07-17T10:56:57,491 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-07-17T10:56:57,493 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-07-17T10:56:57,495 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-07-17T10:56:57,496 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-07-17T10:56:57,498 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-07-17T10:56:57,499 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-07-17T10:56:57,501 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-07-17T10:56:57,504 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-07-17T10:56:57,506 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-07-17T10:56:57,507 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-07-17T10:56:57,509 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-07-17T10:56:57,511 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:57,512 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:57,515 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:57,516 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:57,518 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:57,520 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:57,522 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:57,523 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:57,525 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:57,527 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:57,529 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:57,530 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-17T10:56:57,533 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-07-17T10:56:57,536 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-07-17T10:56:57,537 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-07-17T10:56:57,538 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-07-17T10:56:57,540 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-07-17T10:56:57,543 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-07-17T10:56:57,543 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-07-17T10:56:57,545 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-07-17T10:56:57,547 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-07-17T10:56:57,549 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-07-17T10:56:57,550 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-07-17T10:56:57,552 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-07-17T10:56:57,554 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-07-17T10:56:57,556 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-07-17T10:56:57,558 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-07-17T10:56:57,561 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-07-17T10:56:57,562 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-07-17T10:56:57,564 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-07-17T10:56:57,566 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-07-17T10:56:57,568 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-07-17T10:56:57,569 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-07-17T10:56:57,570 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-07-17T10:56:57,572 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-07-17T10:56:57,575 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-07-17T10:56:57,577 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-07-17T10:56:57,578 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-07-17T10:56:57,580 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-07-17T10:56:57,581 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-07-17T10:56:57,583 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-07-17T10:56:57,585 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-07-17T10:56:57,586 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-07-17T10:56:57,588 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-07-17T10:56:57,590 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-07-17T10:56:57,591 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-07-17T10:56:57,593 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-07-17T10:56:57,596 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-17T10:56:57,597 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-17T10:56:57,599 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-17T10:56:57,602 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-07-17T10:56:57,603 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-07-17T10:56:57,604 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-07-17T10:56:57,606 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-17T10:56:57,608 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-07-17T10:56:57,609 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-07-17T10:56:57,611 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-07-17T10:56:57,612 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-07-17T10:56:57,615 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-07-17T10:56:57,616 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-07-17T10:56:57,618 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-17T10:56:57,620 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-17T10:56:57,622 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-17T10:56:57,624 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-17T10:56:57,626 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:57,627 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:57,629 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:57,631 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:57,633 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:57,635 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:57,637 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-17T10:56:57,639 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-07-17T10:56:57,640 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-07-17T10:56:57,643 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-07-17T10:56:57,646 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-07-17T10:56:57,647 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-07-17T10:56:57,649 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-07-17T10:56:57,650 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-07-17T10:56:57,653 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-07-17T10:56:57,654 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-07-17T10:56:57,655 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-07-17T10:56:57,657 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-07-17T10:56:57,659 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-07-17T10:56:57,660 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-07-17T10:56:57,662 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-07-17T10:56:57,664 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:57,665 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:57,667 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:57,668 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:57,670 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:57,672 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:57,675 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:57,677 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:57,679 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:57,681 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-17T10:56:57,683 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-07-17T10:56:57,685 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-07-17T10:56:57,686 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-07-17T10:56:57,689 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-07-17T10:56:57,690 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-07-17T10:56:57,693 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-07-17T10:56:57,693 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-07-17T10:56:57,695 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-07-17T10:56:57,697 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-07-17T10:56:57,698 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-07-17T10:56:57,700 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-07-17T10:56:57,702 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-07-17T10:56:57,703 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-07-17T10:56:57,704 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-07-17T10:56:57,706 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-07-17T10:56:57,709 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-07-17T10:56:57,711 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-07-17T10:56:57,713 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-07-17T10:56:57,714 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-07-17T10:56:57,716 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-07-17T10:56:57,718 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-07-17T10:56:57,719 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-07-17T10:56:57,720 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-07-17T10:56:57,723 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-07-17T10:56:57,723 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-07-17T10:56:57,725 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-07-17T10:56:57,727 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-07-17T10:56:57,730 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-07-17T10:56:57,733 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-07-17T10:56:57,734 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-07-17T10:56:57,736 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-07-17T10:56:57,737 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-07-17T10:56:57,741 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-07-17T10:56:57,744 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-07-17T10:56:57,745 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-07-17T10:56:57,746 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-07-17T10:56:57,748 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-07-17T10:56:57,750 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-07-17T10:56:57,753 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-17T10:56:57,754 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-17T10:56:57,756 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-17T10:56:57,757 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-17T10:56:57,761 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-17T10:56:57,764 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-07-17T10:56:57,765 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-07-17T10:56:57,767 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-07-17T10:56:57,769 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-07-17T10:56:57,772 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-07-17T10:56:57,774 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:57,775 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:57,777 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:57,779 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:57,781 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:57,783 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:57,785 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-17T10:56:57,787 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-07-17T10:56:57,788 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-07-17T10:56:57,790 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-07-17T10:56:57,793 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-07-17T10:56:57,794 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-07-17T10:56:57,796 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-07-17T10:56:57,798 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-07-17T10:56:57,800 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-07-17T10:56:57,802 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-07-17T10:56:57,804 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-07-17T10:56:57,805 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-07-17T10:56:57,807 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-07-17T10:56:57,808 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-07-17T10:56:57,810 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-07-17T10:56:57,812 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-07-17T10:56:57,813 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-07-17T10:56:57,815 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-07-17T10:56:57,817 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-07-17T10:56:57,820 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-07-17T10:56:57,821 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-07-17T10:56:57,823 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-07-17T10:56:57,825 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-07-17T10:56:57,829 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-07-17T10:56:57,831 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-07-17T10:56:57,832 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-07-17T10:56:57,835 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-07-17T10:56:57,837 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-17T10:56:57,838 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-17T10:56:57,840 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-17T10:56:57,841 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-17T10:56:57,844 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-17T10:56:57,845 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-17T10:56:57,847 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-17T10:56:57,848 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-17T10:56:57,850 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-17T10:56:57,853 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-17T10:56:57,854 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-17T10:56:57,855 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-17T10:56:57,858 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-17T10:56:57,860 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-17T10:56:57,862 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-17T10:56:57,864 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-17T10:56:57,867 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-07-17T10:56:57,868 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-07-17T10:56:57,869 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-07-17T10:56:57,871 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-07-17T10:56:57,874 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-07-17T10:56:57,875 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-07-17T10:56:57,877 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-07-17T10:56:57,878 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-07-17T10:56:57,880 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-07-17T10:56:57,881 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-07-17T10:56:57,884 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-07-17T10:56:57,886 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-07-17T10:56:57,887 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-07-17T10:56:57,889 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-07-17T10:56:57,891 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-07-17T10:56:57,893 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-07-17T10:56:57,894 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-07-17T10:56:57,896 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-07-17T10:56:57,898 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-07-17T10:56:57,900 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-07-17T10:56:57,901 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-07-17T10:56:57,903 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-17T10:56:57,904 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-17T10:56:57,906 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-17T10:56:57,908 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-17T10:56:57,910 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-17T10:56:57,913 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-17T10:56:57,915 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-07-17T10:56:57,919 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-07-17T10:56:57,921 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-07-17T10:56:57,923 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-07-17T10:56:57,924 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-07-17T10:56:57,926 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-07-17T10:56:57,928 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-07-17T10:56:57,931 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:57,932 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:57,933 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:57,935 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:57,937 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:57,939 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:57,941 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:57,942 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:57,944 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:57,947 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-17T10:56:57,949 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-07-17T10:56:57,951 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-17T10:56:57,952 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-17T10:56:57,953 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-17T10:56:57,956 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-17T10:56:57,958 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-17T10:56:57,959 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-17T10:56:57,961 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-17T10:56:57,963 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-17T10:56:57,965 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-07-17T10:56:57,967 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-07-17T10:56:57,969 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-07-17T10:56:57,970 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-07-17T10:56:57,973 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-07-17T10:56:57,974 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-07-17T10:56:57,977 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-07-17T10:56:57,979 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-07-17T10:56:57,981 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-07-17T10:56:57,983 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-07-17T10:56:57,985 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-07-17T10:56:57,986 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-07-17T10:56:57,988 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-07-17T10:56:57,991 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:57,992 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:57,994 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:57,996 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:57,997 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:57,999 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:58,001 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:58,002 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:58,004 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-17T10:56:58,006 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-07-17T10:56:58,008 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-07-17T10:56:58,009 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-07-17T10:56:58,011 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-07-17T10:56:58,013 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-17T10:56:58,014 copying build/lib/colossalai/kernel/triton/fused_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-17T10:56:58,017 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-17T10:56:58,018 copying build/lib/colossalai/kernel/triton/rotary_cache_copy.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-17T10:56:58,020 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-17T10:56:58,022 copying build/lib/colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-17T10:56:58,025 copying build/lib/colossalai/kernel/triton/context_attn_unpad.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-17T10:56:58,027 copying build/lib/colossalai/kernel/triton/kvcache_copy.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-17T10:56:58,030 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-17T10:56:58,031 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-17T10:56:58,034 copying build/lib/colossalai/kernel/triton/rms_layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-17T10:56:58,036 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-17T10:56:58,038 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-07-17T10:56:58,039 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-07-17T10:56:58,041 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-07-17T10:56:58,043 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-07-17T10:56:58,044 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-07-17T10:56:58,047 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-17T10:56:58,048 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-17T10:56:58,049 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-17T10:56:58,051 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-17T10:56:58,053 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-07-17T10:56:58,055 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-07-17T10:56:58,055 copying build/lib/colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-07-17T10:56:58,057 copying build/lib/colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-07-17T10:56:58,060 copying build/lib/colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-07-17T10:56:58,062 copying build/lib/colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-07-17T10:56:58,065 copying build/lib/colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-07-17T10:56:58,067 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-07-17T10:56:58,069 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-07-17T10:56:58,070 copying build/lib/colossalai/kernel/extensions/csrc/common/micros.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-07-17T10:56:58,073 copying build/lib/colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-07-17T10:56:58,074 copying build/lib/colossalai/kernel/extensions/csrc/common/target.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-07-17T10:56:58,076 copying build/lib/colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-07-17T10:56:58,078 copying build/lib/colossalai/kernel/extensions/csrc/common/data_type.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-07-17T10:56:58,080 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel 2024-07-17T10:56:58,081 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-07-17T10:56:58,083 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-07-17T10:56:58,085 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-07-17T10:56:58,088 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-07-17T10:56:58,088 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-07-17T10:56:58,091 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-07-17T10:56:58,094 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,094 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,097 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-17T10:56:58,098 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-17T10:56:58,099 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-17T10:56:58,101 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-17T10:56:58,103 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-17T10:56:58,104 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,107 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,109 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,112 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,114 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,116 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,119 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,121 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,123 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,126 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,129 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-07-17T10:56:58,129 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-07-17T10:56:58,132 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,133 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,136 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,138 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,141 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,143 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,146 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-17T10:56:58,149 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-17T10:56:58,151 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-17T10:56:58,153 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-07-17T10:56:58,155 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-07-17T10:56:58,156 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-07-17T10:56:58,158 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-07-17T10:56:58,160 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-07-17T10:56:58,162 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-07-17T10:56:58,164 copying build/lib/colossalai/kernel/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-07-17T10:56:58,166 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-07-17T10:56:58,167 copying build/lib/colossalai/kernel/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-07-17T10:56:58,169 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-07-17T10:56:58,171 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-07-17T10:56:58,174 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-07-17T10:56:58,175 copying build/lib/colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-07-17T10:56:58,177 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-07-17T10:56:58,179 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-07-17T10:56:58,181 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-07-17T10:56:58,183 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-07-17T10:56:58,185 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-07-17T10:56:58,186 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-07-17T10:56:58,188 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-07-17T10:56:58,190 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-07-17T10:56:58,193 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-07-17T10:56:58,194 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-07-17T10:56:58,196 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-07-17T10:56:58,198 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-07-17T10:56:58,201 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-17T10:56:58,202 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-17T10:56:58,204 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-17T10:56:58,206 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-17T10:56:58,208 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-07-17T10:56:58,209 copying build/lib/colossalai/kernel/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-07-17T10:56:58,211 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-07-17T10:56:58,213 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-07-17T10:56:58,215 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-17T10:56:58,218 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-07-17T10:56:58,220 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-17T10:56:58,221 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-17T10:56:58,223 copying build/lib/colossalai/inference/config.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-17T10:56:58,226 creating build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-17T10:56:58,227 copying build/lib/colossalai/inference/core/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-17T10:56:58,229 copying build/lib/colossalai/inference/core/plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-17T10:56:58,232 copying build/lib/colossalai/inference/core/request_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-17T10:56:58,235 copying build/lib/colossalai/inference/core/base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-17T10:56:58,237 copying build/lib/colossalai/inference/core/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-17T10:56:58,239 copying build/lib/colossalai/inference/core/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-17T10:56:58,242 copying build/lib/colossalai/inference/core/llm_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-17T10:56:58,244 copying build/lib/colossalai/inference/core/rpc_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-17T10:56:58,247 copying build/lib/colossalai/inference/core/diffusion_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-17T10:56:58,250 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-07-17T10:56:58,251 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-07-17T10:56:58,253 copying build/lib/colossalai/inference/modeling/backends/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-07-17T10:56:58,254 copying build/lib/colossalai/inference/modeling/backends/attention_backend.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-07-17T10:56:58,257 copying build/lib/colossalai/inference/modeling/backends/pre_attention_backend.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-07-17T10:56:58,259 copying build/lib/colossalai/inference/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-07-17T10:56:58,261 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-17T10:56:58,262 copying build/lib/colossalai/inference/modeling/policy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-17T10:56:58,265 copying build/lib/colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-17T10:56:58,267 copying build/lib/colossalai/inference/modeling/policy/glide_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-17T10:56:58,269 copying build/lib/colossalai/inference/modeling/policy/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-17T10:56:58,271 copying build/lib/colossalai/inference/modeling/policy/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-17T10:56:58,273 copying build/lib/colossalai/inference/modeling/policy/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-17T10:56:58,275 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-07-17T10:56:58,277 copying build/lib/colossalai/inference/modeling/layers/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-07-17T10:56:58,279 copying build/lib/colossalai/inference/modeling/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-07-17T10:56:58,281 copying build/lib/colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-07-17T10:56:58,283 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-17T10:56:58,284 copying build/lib/colossalai/inference/modeling/models/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-17T10:56:58,286 copying build/lib/colossalai/inference/modeling/models/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-17T10:56:58,289 copying build/lib/colossalai/inference/modeling/models/diffusion.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-17T10:56:58,291 copying build/lib/colossalai/inference/modeling/models/glide_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-17T10:56:58,293 copying build/lib/colossalai/inference/modeling/models/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-17T10:56:58,296 copying build/lib/colossalai/inference/modeling/models/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-17T10:56:58,299 copying build/lib/colossalai/inference/modeling/models/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-17T10:56:58,301 copying build/lib/colossalai/inference/graph_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-17T10:56:58,304 copying build/lib/colossalai/inference/batch_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-17T10:56:58,307 creating build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-07-17T10:56:58,308 copying build/lib/colossalai/inference/spec/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-07-17T10:56:58,310 copying build/lib/colossalai/inference/spec/drafter.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-07-17T10:56:58,313 copying build/lib/colossalai/inference/spec/struct.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-07-17T10:56:58,315 copying build/lib/colossalai/inference/flash_decoding_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-17T10:56:58,317 creating build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-07-17T10:56:58,318 copying build/lib/colossalai/inference/server/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-07-17T10:56:58,320 copying build/lib/colossalai/inference/server/api_server.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-07-17T10:56:58,323 copying build/lib/colossalai/inference/server/completion_service.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-07-17T10:56:58,325 copying build/lib/colossalai/inference/server/chat_service.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-07-17T10:56:58,327 copying build/lib/colossalai/inference/server/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-07-17T10:56:58,329 copying build/lib/colossalai/inference/logit_processors.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-17T10:56:58,331 copying build/lib/colossalai/inference/struct.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-17T10:56:58,334 creating build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-07-17T10:56:58,335 copying build/lib/colossalai/inference/executor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-07-17T10:56:58,337 copying build/lib/colossalai/inference/executor/rpc_worker.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-07-17T10:56:58,339 copying build/lib/colossalai/inference/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-17T10:56:58,342 copying build/lib/colossalai/inference/sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-17T10:56:58,345 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-07-17T10:56:58,346 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-07-17T10:56:58,348 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-07-17T10:56:58,351 copying build/lib/colossalai/inference/kv_cache/block_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-07-17T10:56:58,354 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-07-17T10:56:58,355 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-07-17T10:56:58,358 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-07-17T10:56:58,360 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-07-17T10:56:58,362 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-07-17T10:56:58,364 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-07-17T10:56:58,367 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-07-17T10:56:58,368 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-07-17T10:56:58,370 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-07-17T10:56:58,371 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-07-17T10:56:58,374 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:58,375 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:58,377 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:58,380 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:58,382 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:58,384 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:58,386 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-17T10:56:58,388 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-07-17T10:56:58,390 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-07-17T10:56:58,393 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-07-17T10:56:58,394 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-07-17T10:56:58,397 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-07-17T10:56:58,399 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-07-17T10:56:58,402 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-07-17T10:56:58,404 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-07-17T10:56:58,407 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-07-17T10:56:58,409 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-07-17T10:56:58,411 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-07-17T10:56:58,413 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-07-17T10:56:58,415 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-07-17T10:56:58,417 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-07-17T10:56:58,420 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-07-17T10:56:58,423 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-17T10:56:58,424 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-17T10:56:58,426 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-17T10:56:58,429 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-17T10:56:58,432 copying build/lib/colossalai/checkpoint_io/moe_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-17T10:56:58,435 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-17T10:56:58,438 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-17T10:56:58,441 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-17T10:56:58,444 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-07-17T10:56:58,445 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-07-17T10:56:58,447 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-07-17T10:56:58,448 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-07-17T10:56:58,450 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-07-17T10:56:58,451 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-07-17T10:56:58,453 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-07-17T10:56:58,456 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-07-17T10:56:58,458 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-07-17T10:56:58,461 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-07-17T10:56:58,463 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-07-17T10:56:58,465 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:58,466 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:58,467 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:58,469 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:58,471 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:58,473 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:58,475 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-17T10:56:58,477 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-07-17T10:56:58,480 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-07-17T10:56:58,482 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,483 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,485 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,487 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,489 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,490 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,493 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,494 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,496 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,498 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,500 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,502 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,503 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,505 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,508 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,510 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,512 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,514 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,516 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,518 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,521 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,523 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,525 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,527 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,529 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,531 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-17T10:56:58,534 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,535 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,537 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,539 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,541 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,543 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,545 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,547 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,548 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,550 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,552 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,554 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,555 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,557 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,559 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,560 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,562 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,564 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,566 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,569 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,571 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,574 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-17T10:56:58,576 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-07-17T10:56:58,580 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-17T10:56:58,581 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-17T10:56:58,583 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-17T10:56:58,586 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-17T10:56:58,587 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-17T10:56:58,589 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-17T10:56:58,591 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-17T10:56:58,594 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-17T10:56:58,596 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-17T10:56:58,598 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-17T10:56:58,600 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-17T10:56:58,602 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-07-17T10:56:58,603 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-07-17T10:56:58,606 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:58,607 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:58,609 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:58,610 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:58,612 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:58,614 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:58,617 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-17T10:56:58,619 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-17T10:56:58,620 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-17T10:56:58,622 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-17T10:56:58,624 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-17T10:56:58,626 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-17T10:56:58,627 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-17T10:56:58,629 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-17T10:56:58,632 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-07-17T10:56:58,633 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-07-17T10:56:58,635 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-07-17T10:56:58,637 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-07-17T10:56:58,638 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-07-17T10:56:58,641 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:58,641 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:58,643 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:58,645 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:58,646 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:58,648 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:58,650 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:58,652 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:58,654 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:58,656 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:58,658 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:58,660 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-17T10:56:58,663 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-17T10:56:58,663 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-17T10:56:58,666 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-17T10:56:58,667 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-17T10:56:58,669 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-17T10:56:58,671 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-17T10:56:58,673 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-17T10:56:58,676 creating build/bdist.linux-armv7l/wheel/extensions 2024-07-17T10:56:58,677 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2024-07-17T10:56:58,678 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/csrc 2024-07-17T10:56:58,680 creating build/bdist.linux-armv7l/wheel/extensions/pybind 2024-07-17T10:56:58,681 creating build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-07-17T10:56:58,682 copying build/lib/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-07-17T10:56:58,684 copying build/lib/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-07-17T10:56:58,686 copying build/lib/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-07-17T10:56:58,688 copying build/lib/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-07-17T10:56:58,689 copying build/lib/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind 2024-07-17T10:56:58,691 creating build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-07-17T10:56:58,692 copying build/lib/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-07-17T10:56:58,694 copying build/lib/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-07-17T10:56:58,696 creating build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-07-17T10:56:58,697 copying build/lib/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-07-17T10:56:58,698 copying build/lib/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-07-17T10:56:58,700 copying build/lib/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-07-17T10:56:58,702 creating build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-07-17T10:56:58,703 copying build/lib/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-07-17T10:56:58,705 copying build/lib/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-07-17T10:56:58,707 creating build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-07-17T10:56:58,707 copying build/lib/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-07-17T10:56:58,710 copying build/lib/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-07-17T10:56:58,712 creating build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-07-17T10:56:58,713 copying build/lib/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-07-17T10:56:58,714 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-07-17T10:56:58,716 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-07-17T10:56:58,718 creating build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-07-17T10:56:58,719 copying build/lib/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-07-17T10:56:58,720 copying build/lib/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-07-17T10:56:58,722 running install_egg_info 2024-07-17T10:56:58,781 running egg_info 2024-07-17T10:56:58,804 writing colossalai.egg-info/PKG-INFO 2024-07-17T10:56:58,809 writing dependency_links to colossalai.egg-info/dependency_links.txt 2024-07-17T10:56:58,810 writing entry points to colossalai.egg-info/entry_points.txt 2024-07-17T10:56:58,812 writing requirements to colossalai.egg-info/requires.txt 2024-07-17T10:56:58,814 writing top-level names to colossalai.egg-info/top_level.txt 2024-07-17T10:56:59,081 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2024-07-17T10:56:59,131 reading manifest template 'MANIFEST.in' 2024-07-17T10:57:00,346 warning: no files found matching '*.tr' under directory 'colossalai' 2024-07-17T10:57:00,972 warning: no files found matching '*.cc' under directory 'colossalai' 2024-07-17T10:57:01,305 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-07-17T10:57:01,437 warning: no files found matching '*.tr' under directory 'extensions' 2024-07-17T10:57:01,491 warning: no files found matching '*.cc' under directory 'extensions' 2024-07-17T10:57:01,518 warning: no files found matching '*.pyi' under directory 'extensions' 2024-07-17T10:57:01,518 adding license file 'LICENSE' 2024-07-17T10:57:01,574 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2024-07-17T10:57:01,577 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.4.1-py3.9.egg-info 2024-07-17T10:57:01,590 running install_scripts 2024-07-17T10:57:01,619 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2024-07-17T10:57:01,624 creating build/bdist.linux-armv7l/wheel/colossalai-0.4.1.dist-info/WHEEL 2024-07-17T10:57:01,627 creating '/tmp/pip-wheel-kv4chqpd/colossalai-0.4.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-07-17T10:57:01,630 adding 'colossalai/__init__.py' 2024-07-17T10:57:01,632 adding 'colossalai/initialize.py' 2024-07-17T10:57:01,633 adding 'colossalai/version.py' 2024-07-17T10:57:01,635 adding 'colossalai/_C/__init__.py' 2024-07-17T10:57:01,637 adding 'colossalai/_analyzer/__init__.py' 2024-07-17T10:57:01,638 adding 'colossalai/_analyzer/envs.py' 2024-07-17T10:57:01,641 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2024-07-17T10:57:01,644 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2024-07-17T10:57:01,646 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2024-07-17T10:57:01,648 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2024-07-17T10:57:01,651 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2024-07-17T10:57:01,653 adding 'colossalai/_analyzer/fx/__init__.py' 2024-07-17T10:57:01,656 adding 'colossalai/_analyzer/fx/codegen.py' 2024-07-17T10:57:01,658 adding 'colossalai/_analyzer/fx/graph_module.py' 2024-07-17T10:57:01,660 adding 'colossalai/_analyzer/fx/node_util.py' 2024-07-17T10:57:01,662 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2024-07-17T10:57:01,664 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2024-07-17T10:57:01,666 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2024-07-17T10:57:01,669 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2024-07-17T10:57:01,671 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2024-07-17T10:57:01,672 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2024-07-17T10:57:01,674 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2024-07-17T10:57:01,675 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2024-07-17T10:57:01,677 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2024-07-17T10:57:01,680 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2024-07-17T10:57:01,682 adding 'colossalai/accelerator/__init__.py' 2024-07-17T10:57:01,684 adding 'colossalai/accelerator/api.py' 2024-07-17T10:57:01,686 adding 'colossalai/accelerator/base_accelerator.py' 2024-07-17T10:57:01,688 adding 'colossalai/accelerator/cpu_accelerator.py' 2024-07-17T10:57:01,690 adding 'colossalai/accelerator/cuda_accelerator.py' 2024-07-17T10:57:01,692 adding 'colossalai/accelerator/npu_accelerator.py' 2024-07-17T10:57:01,694 adding 'colossalai/amp/__init__.py' 2024-07-17T10:57:01,695 adding 'colossalai/amp/naive_amp/__init__.py' 2024-07-17T10:57:01,697 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2024-07-17T10:57:01,699 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2024-07-17T10:57:01,701 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2024-07-17T10:57:01,703 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2024-07-17T10:57:01,704 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2024-07-17T10:57:01,706 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2024-07-17T10:57:01,708 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2024-07-17T10:57:01,709 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2024-07-17T10:57:01,711 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2024-07-17T10:57:01,713 adding 'colossalai/auto_parallel/__init__.py' 2024-07-17T10:57:01,715 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2024-07-17T10:57:01,716 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2024-07-17T10:57:01,718 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2024-07-17T10:57:01,720 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2024-07-17T10:57:01,723 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2024-07-17T10:57:01,725 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2024-07-17T10:57:01,727 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2024-07-17T10:57:01,728 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2024-07-17T10:57:01,730 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2024-07-17T10:57:01,731 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2024-07-17T10:57:01,734 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2024-07-17T10:57:01,736 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2024-07-17T10:57:01,737 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2024-07-17T10:57:01,739 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2024-07-17T10:57:01,741 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2024-07-17T10:57:01,744 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2024-07-17T10:57:01,746 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2024-07-17T10:57:01,748 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2024-07-17T10:57:01,749 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2024-07-17T10:57:01,751 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2024-07-17T10:57:01,753 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2024-07-17T10:57:01,755 adding 'colossalai/auto_parallel/offload/__init__.py' 2024-07-17T10:57:01,757 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2024-07-17T10:57:01,759 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2024-07-17T10:57:01,760 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2024-07-17T10:57:01,762 adding 'colossalai/auto_parallel/offload/region.py' 2024-07-17T10:57:01,765 adding 'colossalai/auto_parallel/offload/region_manager.py' 2024-07-17T10:57:01,767 adding 'colossalai/auto_parallel/offload/runtime.py' 2024-07-17T10:57:01,770 adding 'colossalai/auto_parallel/offload/solver.py' 2024-07-17T10:57:01,772 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2024-07-17T10:57:01,774 adding 'colossalai/auto_parallel/offload/util.py' 2024-07-17T10:57:01,776 adding 'colossalai/auto_parallel/passes/__init__.py' 2024-07-17T10:57:01,778 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2024-07-17T10:57:01,779 adding 'colossalai/auto_parallel/passes/constants.py' 2024-07-17T10:57:01,781 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2024-07-17T10:57:01,783 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2024-07-17T10:57:01,787 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2024-07-17T10:57:01,789 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2024-07-17T10:57:01,791 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2024-07-17T10:57:01,792 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2024-07-17T10:57:01,795 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2024-07-17T10:57:01,797 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2024-07-17T10:57:01,799 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2024-07-17T10:57:01,802 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2024-07-17T10:57:01,803 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2024-07-17T10:57:01,805 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2024-07-17T10:57:01,807 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2024-07-17T10:57:01,809 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2024-07-17T10:57:01,810 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2024-07-17T10:57:01,812 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2024-07-17T10:57:01,814 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2024-07-17T10:57:01,816 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2024-07-17T10:57:01,817 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2024-07-17T10:57:01,818 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2024-07-17T10:57:01,820 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2024-07-17T10:57:01,823 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2024-07-17T10:57:01,825 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2024-07-17T10:57:01,827 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2024-07-17T10:57:01,828 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2024-07-17T10:57:01,829 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2024-07-17T10:57:01,831 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2024-07-17T10:57:01,832 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2024-07-17T10:57:01,833 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2024-07-17T10:57:01,834 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2024-07-17T10:57:01,836 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2024-07-17T10:57:01,837 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2024-07-17T10:57:01,838 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2024-07-17T10:57:01,840 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2024-07-17T10:57:01,841 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2024-07-17T10:57:01,842 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2024-07-17T10:57:01,844 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2024-07-17T10:57:01,846 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2024-07-17T10:57:01,848 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2024-07-17T10:57:01,850 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2024-07-17T10:57:01,852 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2024-07-17T10:57:01,853 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2024-07-17T10:57:01,855 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2024-07-17T10:57:01,856 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2024-07-17T10:57:01,860 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2024-07-17T10:57:01,862 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2024-07-17T10:57:01,863 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2024-07-17T10:57:01,864 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2024-07-17T10:57:01,866 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2024-07-17T10:57:01,868 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2024-07-17T10:57:01,870 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2024-07-17T10:57:01,872 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2024-07-17T10:57:01,873 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2024-07-17T10:57:01,875 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2024-07-17T10:57:01,876 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2024-07-17T10:57:01,878 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2024-07-17T10:57:01,879 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2024-07-17T10:57:01,881 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2024-07-17T10:57:01,884 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2024-07-17T10:57:01,886 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2024-07-17T10:57:01,888 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2024-07-17T10:57:01,889 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2024-07-17T10:57:01,891 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2024-07-17T10:57:01,893 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2024-07-17T10:57:01,894 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2024-07-17T10:57:01,896 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2024-07-17T10:57:01,898 adding 'colossalai/booster/__init__.py' 2024-07-17T10:57:01,899 adding 'colossalai/booster/accelerator.py' 2024-07-17T10:57:01,901 adding 'colossalai/booster/booster.py' 2024-07-17T10:57:01,903 adding 'colossalai/booster/mixed_precision/__init__.py' 2024-07-17T10:57:01,904 adding 'colossalai/booster/mixed_precision/bf16.py' 2024-07-17T10:57:01,906 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2024-07-17T10:57:01,907 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2024-07-17T10:57:01,908 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2024-07-17T10:57:01,909 adding 'colossalai/booster/mixed_precision/fp8.py' 2024-07-17T10:57:01,910 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2024-07-17T10:57:01,912 adding 'colossalai/booster/plugin/__init__.py' 2024-07-17T10:57:01,913 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2024-07-17T10:57:01,917 adding 'colossalai/booster/plugin/gemini_plugin.py' 2024-07-17T10:57:01,924 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2024-07-17T10:57:01,927 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2024-07-17T10:57:01,930 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2024-07-17T10:57:01,931 adding 'colossalai/booster/plugin/plugin_base.py' 2024-07-17T10:57:01,932 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2024-07-17T10:57:01,934 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2024-07-17T10:57:01,936 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2024-07-17T10:57:01,938 adding 'colossalai/checkpoint_io/__init__.py' 2024-07-17T10:57:01,940 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2024-07-17T10:57:01,942 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2024-07-17T10:57:01,946 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2024-07-17T10:57:01,948 adding 'colossalai/checkpoint_io/index_file.py' 2024-07-17T10:57:01,953 adding 'colossalai/checkpoint_io/moe_checkpoint.py' 2024-07-17T10:57:01,957 adding 'colossalai/checkpoint_io/utils.py' 2024-07-17T10:57:01,959 adding 'colossalai/cli/__init__.py' 2024-07-17T10:57:01,960 adding 'colossalai/cli/cli.py' 2024-07-17T10:57:01,962 adding 'colossalai/cli/check/__init__.py' 2024-07-17T10:57:01,964 adding 'colossalai/cli/check/check_installation.py' 2024-07-17T10:57:01,966 adding 'colossalai/cli/launcher/__init__.py' 2024-07-17T10:57:01,967 adding 'colossalai/cli/launcher/hostinfo.py' 2024-07-17T10:57:01,969 adding 'colossalai/cli/launcher/multinode_runner.py' 2024-07-17T10:57:01,971 adding 'colossalai/cli/launcher/run.py' 2024-07-17T10:57:01,972 adding 'colossalai/cluster/__init__.py' 2024-07-17T10:57:01,974 adding 'colossalai/cluster/device_mesh_manager.py' 2024-07-17T10:57:01,975 adding 'colossalai/cluster/dist_coordinator.py' 2024-07-17T10:57:01,977 adding 'colossalai/cluster/process_group_manager.py' 2024-07-17T10:57:01,979 adding 'colossalai/cluster/process_group_mesh.py' 2024-07-17T10:57:01,980 adding 'colossalai/context/__init__.py' 2024-07-17T10:57:01,982 adding 'colossalai/context/config.py' 2024-07-17T10:57:01,983 adding 'colossalai/context/singleton_meta.py' 2024-07-17T10:57:01,985 adding 'colossalai/device/__init__.py' 2024-07-17T10:57:01,988 adding 'colossalai/device/alpha_beta_profiler.py' 2024-07-17T10:57:01,990 adding 'colossalai/device/calc_pipeline_strategy.py' 2024-07-17T10:57:01,996 adding 'colossalai/device/device_mesh.py' 2024-07-17T10:57:01,999 adding 'colossalai/fx/__init__.py' 2024-07-17T10:57:02,000 adding 'colossalai/fx/_compatibility.py' 2024-07-17T10:57:02,004 adding 'colossalai/fx/_meta_regist_12.py' 2024-07-17T10:57:02,006 adding 'colossalai/fx/_meta_regist_13.py' 2024-07-17T10:57:02,009 adding 'colossalai/fx/graph_module.py' 2024-07-17T10:57:02,011 adding 'colossalai/fx/proxy.py' 2024-07-17T10:57:02,013 adding 'colossalai/fx/codegen/__init__.py' 2024-07-17T10:57:02,020 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2024-07-17T10:57:02,023 adding 'colossalai/fx/passes/__init__.py' 2024-07-17T10:57:02,026 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2024-07-17T10:57:02,029 adding 'colossalai/fx/passes/concrete_info_prop.py' 2024-07-17T10:57:02,033 adding 'colossalai/fx/passes/meta_info_prop.py' 2024-07-17T10:57:02,037 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2024-07-17T10:57:02,040 adding 'colossalai/fx/passes/shard_1d_pass.py' 2024-07-17T10:57:02,044 adding 'colossalai/fx/passes/split_module.py' 2024-07-17T10:57:02,046 adding 'colossalai/fx/passes/utils.py' 2024-07-17T10:57:02,049 adding 'colossalai/fx/profiler/__init__.py' 2024-07-17T10:57:02,050 adding 'colossalai/fx/profiler/constants.py' 2024-07-17T10:57:02,053 adding 'colossalai/fx/profiler/dataflow.py' 2024-07-17T10:57:02,055 adding 'colossalai/fx/profiler/memory_utils.py' 2024-07-17T10:57:02,057 adding 'colossalai/fx/profiler/opcount.py' 2024-07-17T10:57:02,061 adding 'colossalai/fx/profiler/profiler.py' 2024-07-17T10:57:02,063 adding 'colossalai/fx/profiler/shard_utils.py' 2024-07-17T10:57:02,065 adding 'colossalai/fx/profiler/tensor.py' 2024-07-17T10:57:02,067 adding 'colossalai/fx/profiler/experimental/__init__.py' 2024-07-17T10:57:02,069 adding 'colossalai/fx/profiler/experimental/constants.py' 2024-07-17T10:57:02,072 adding 'colossalai/fx/profiler/experimental/profiler.py' 2024-07-17T10:57:02,073 adding 'colossalai/fx/profiler/experimental/registry.py' 2024-07-17T10:57:02,076 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2024-07-17T10:57:02,078 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2024-07-17T10:57:02,080 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2024-07-17T10:57:02,082 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2024-07-17T10:57:02,084 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2024-07-17T10:57:02,086 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2024-07-17T10:57:02,087 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2024-07-17T10:57:02,089 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2024-07-17T10:57:02,090 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2024-07-17T10:57:02,091 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2024-07-17T10:57:02,093 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2024-07-17T10:57:02,094 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2024-07-17T10:57:02,096 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2024-07-17T10:57:02,097 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2024-07-17T10:57:02,098 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2024-07-17T10:57:02,099 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2024-07-17T10:57:02,101 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2024-07-17T10:57:02,102 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2024-07-17T10:57:02,103 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2024-07-17T10:57:02,104 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2024-07-17T10:57:02,106 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2024-07-17T10:57:02,107 adding 'colossalai/fx/tracer/__init__.py' 2024-07-17T10:57:02,109 adding 'colossalai/fx/tracer/_meta_trace.py' 2024-07-17T10:57:02,110 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2024-07-17T10:57:02,111 adding 'colossalai/fx/tracer/_tracer_utils.py' 2024-07-17T10:57:02,115 adding 'colossalai/fx/tracer/experimental.py' 2024-07-17T10:57:02,116 adding 'colossalai/fx/tracer/registry.py' 2024-07-17T10:57:02,119 adding 'colossalai/fx/tracer/tracer.py' 2024-07-17T10:57:02,121 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2024-07-17T10:57:02,123 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2024-07-17T10:57:02,124 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2024-07-17T10:57:02,125 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2024-07-17T10:57:02,127 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2024-07-17T10:57:02,128 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2024-07-17T10:57:02,130 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2024-07-17T10:57:02,131 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2024-07-17T10:57:02,132 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2024-07-17T10:57:02,133 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2024-07-17T10:57:02,135 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2024-07-17T10:57:02,137 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2024-07-17T10:57:02,138 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2024-07-17T10:57:02,139 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2024-07-17T10:57:02,141 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2024-07-17T10:57:02,142 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2024-07-17T10:57:02,143 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2024-07-17T10:57:02,145 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2024-07-17T10:57:02,146 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2024-07-17T10:57:02,148 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2024-07-17T10:57:02,149 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2024-07-17T10:57:02,150 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2024-07-17T10:57:02,151 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2024-07-17T10:57:02,153 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2024-07-17T10:57:02,154 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2024-07-17T10:57:02,155 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2024-07-17T10:57:02,157 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2024-07-17T10:57:02,159 adding 'colossalai/inference/__init__.py' 2024-07-17T10:57:02,162 adding 'colossalai/inference/batch_bucket.py' 2024-07-17T10:57:02,164 adding 'colossalai/inference/config.py' 2024-07-17T10:57:02,166 adding 'colossalai/inference/flash_decoding_utils.py' 2024-07-17T10:57:02,167 adding 'colossalai/inference/graph_runner.py' 2024-07-17T10:57:02,169 adding 'colossalai/inference/logit_processors.py' 2024-07-17T10:57:02,170 adding 'colossalai/inference/sampler.py' 2024-07-17T10:57:02,172 adding 'colossalai/inference/struct.py' 2024-07-17T10:57:02,174 adding 'colossalai/inference/utils.py' 2024-07-17T10:57:02,175 adding 'colossalai/inference/core/__init__.py' 2024-07-17T10:57:02,178 adding 'colossalai/inference/core/async_engine.py' 2024-07-17T10:57:02,179 adding 'colossalai/inference/core/base_engine.py' 2024-07-17T10:57:02,181 adding 'colossalai/inference/core/diffusion_engine.py' 2024-07-17T10:57:02,182 adding 'colossalai/inference/core/engine.py' 2024-07-17T10:57:02,187 adding 'colossalai/inference/core/llm_engine.py' 2024-07-17T10:57:02,188 adding 'colossalai/inference/core/plugin.py' 2024-07-17T10:57:02,191 adding 'colossalai/inference/core/request_handler.py' 2024-07-17T10:57:02,193 adding 'colossalai/inference/core/rpc_engine.py' 2024-07-17T10:57:02,195 adding 'colossalai/inference/executor/__init__.py' 2024-07-17T10:57:02,197 adding 'colossalai/inference/executor/rpc_worker.py' 2024-07-17T10:57:02,199 adding 'colossalai/inference/kv_cache/__init__.py' 2024-07-17T10:57:02,200 adding 'colossalai/inference/kv_cache/block_cache.py' 2024-07-17T10:57:02,204 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2024-07-17T10:57:02,205 adding 'colossalai/inference/modeling/__init__.py' 2024-07-17T10:57:02,207 adding 'colossalai/inference/modeling/backends/__init__.py' 2024-07-17T10:57:02,208 adding 'colossalai/inference/modeling/backends/attention_backend.py' 2024-07-17T10:57:02,210 adding 'colossalai/inference/modeling/backends/pre_attention_backend.py' 2024-07-17T10:57:02,211 adding 'colossalai/inference/modeling/layers/__init__.py' 2024-07-17T10:57:02,213 adding 'colossalai/inference/modeling/layers/attention.py' 2024-07-17T10:57:02,215 adding 'colossalai/inference/modeling/layers/baichuan_tp_linear.py' 2024-07-17T10:57:02,216 adding 'colossalai/inference/modeling/models/__init__.py' 2024-07-17T10:57:02,218 adding 'colossalai/inference/modeling/models/diffusion.py' 2024-07-17T10:57:02,220 adding 'colossalai/inference/modeling/models/glide_llama.py' 2024-07-17T10:57:02,222 adding 'colossalai/inference/modeling/models/nopadding_baichuan.py' 2024-07-17T10:57:02,225 adding 'colossalai/inference/modeling/models/nopadding_llama.py' 2024-07-17T10:57:02,227 adding 'colossalai/inference/modeling/models/pixart_alpha.py' 2024-07-17T10:57:02,229 adding 'colossalai/inference/modeling/models/stablediffusion3.py' 2024-07-17T10:57:02,231 adding 'colossalai/inference/modeling/policy/__init__.py' 2024-07-17T10:57:02,232 adding 'colossalai/inference/modeling/policy/glide_llama.py' 2024-07-17T10:57:02,234 adding 'colossalai/inference/modeling/policy/nopadding_baichuan.py' 2024-07-17T10:57:02,235 adding 'colossalai/inference/modeling/policy/nopadding_llama.py' 2024-07-17T10:57:02,237 adding 'colossalai/inference/modeling/policy/pixart_alpha.py' 2024-07-17T10:57:02,238 adding 'colossalai/inference/modeling/policy/stablediffusion3.py' 2024-07-17T10:57:02,240 adding 'colossalai/inference/server/__init__.py' 2024-07-17T10:57:02,242 adding 'colossalai/inference/server/api_server.py' 2024-07-17T10:57:02,243 adding 'colossalai/inference/server/chat_service.py' 2024-07-17T10:57:02,245 adding 'colossalai/inference/server/completion_service.py' 2024-07-17T10:57:02,246 adding 'colossalai/inference/server/utils.py' 2024-07-17T10:57:02,247 adding 'colossalai/inference/spec/__init__.py' 2024-07-17T10:57:02,249 adding 'colossalai/inference/spec/drafter.py' 2024-07-17T10:57:02,250 adding 'colossalai/inference/spec/struct.py' 2024-07-17T10:57:02,252 adding 'colossalai/interface/__init__.py' 2024-07-17T10:57:02,253 adding 'colossalai/interface/model.py' 2024-07-17T10:57:02,254 adding 'colossalai/interface/optimizer.py' 2024-07-17T10:57:02,256 adding 'colossalai/interface/pretrained.py' 2024-07-17T10:57:02,257 adding 'colossalai/kernel/__init__.py' 2024-07-17T10:57:02,259 adding 'colossalai/kernel/kernel_loader.py' 2024-07-17T10:57:02,260 adding 'colossalai/kernel/extensions/__init__.py' 2024-07-17T10:57:02,262 adding 'colossalai/kernel/extensions/base_extension.py' 2024-07-17T10:57:02,263 adding 'colossalai/kernel/extensions/cpp_extension.py' 2024-07-17T10:57:02,265 adding 'colossalai/kernel/extensions/cuda_extension.py' 2024-07-17T10:57:02,266 adding 'colossalai/kernel/extensions/triton_extension.py' 2024-07-17T10:57:02,268 adding 'colossalai/kernel/extensions/utils.py' 2024-07-17T10:57:02,269 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2024-07-17T10:57:02,271 adding 'colossalai/kernel/extensions/csrc/common/data_type.h' 2024-07-17T10:57:02,273 adding 'colossalai/kernel/extensions/csrc/common/micros.h' 2024-07-17T10:57:02,274 adding 'colossalai/kernel/extensions/csrc/common/mp_type_traits.h' 2024-07-17T10:57:02,275 adding 'colossalai/kernel/extensions/csrc/common/target.h' 2024-07-17T10:57:02,277 adding 'colossalai/kernel/extensions/csrc/common/vec_type_traits.h' 2024-07-17T10:57:02,279 adding 'colossalai/kernel/extensions/csrc/funcs/binary_functor.h' 2024-07-17T10:57:02,281 adding 'colossalai/kernel/extensions/csrc/funcs/cast_functor.h' 2024-07-17T10:57:02,282 adding 'colossalai/kernel/extensions/csrc/funcs/reduce_function.h' 2024-07-17T10:57:02,284 adding 'colossalai/kernel/extensions/csrc/funcs/ternary_functor.h' 2024-07-17T10:57:02,285 adding 'colossalai/kernel/extensions/csrc/funcs/unary_functor.h' 2024-07-17T10:57:02,288 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp' 2024-07-17T10:57:02,290 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h' 2024-07-17T10:57:02,292 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu' 2024-07-17T10:57:02,294 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu' 2024-07-17T10:57:02,295 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu' 2024-07-17T10:57:02,297 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu' 2024-07-17T10:57:02,301 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu' 2024-07-17T10:57:02,303 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu' 2024-07-17T10:57:02,305 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu' 2024-07-17T10:57:02,308 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu' 2024-07-17T10:57:02,311 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu' 2024-07-17T10:57:02,312 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu' 2024-07-17T10:57:02,314 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh' 2024-07-17T10:57:02,316 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu' 2024-07-17T10:57:02,318 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu' 2024-07-17T10:57:02,319 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu' 2024-07-17T10:57:02,321 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu' 2024-07-17T10:57:02,323 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu' 2024-07-17T10:57:02,325 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu' 2024-07-17T10:57:02,328 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu' 2024-07-17T10:57:02,330 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h' 2024-07-17T10:57:02,332 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h' 2024-07-17T10:57:02,333 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h' 2024-07-17T10:57:02,335 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h' 2024-07-17T10:57:02,336 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h' 2024-07-17T10:57:02,338 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp' 2024-07-17T10:57:02,340 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h' 2024-07-17T10:57:02,342 adding 'colossalai/kernel/extensions/pybind/__init__.py' 2024-07-17T10:57:02,343 adding 'colossalai/kernel/extensions/pybind/cpu_adam/__init__.py' 2024-07-17T10:57:02,345 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-07-17T10:57:02,346 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-07-17T10:57:02,348 adding 'colossalai/kernel/extensions/pybind/flash_attention/__init__.py' 2024-07-17T10:57:02,349 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-07-17T10:57:02,350 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py' 2024-07-17T10:57:02,352 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-07-17T10:57:02,353 adding 'colossalai/kernel/extensions/pybind/inference/__init__.py' 2024-07-17T10:57:02,355 adding 'colossalai/kernel/extensions/pybind/inference/inference.cpp' 2024-07-17T10:57:02,356 adding 'colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py' 2024-07-17T10:57:02,358 adding 'colossalai/kernel/extensions/pybind/layernorm/__init__.py' 2024-07-17T10:57:02,359 adding 'colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp' 2024-07-17T10:57:02,360 adding 'colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py' 2024-07-17T10:57:02,362 adding 'colossalai/kernel/extensions/pybind/moe/__init__.py' 2024-07-17T10:57:02,363 adding 'colossalai/kernel/extensions/pybind/moe/moe.cpp' 2024-07-17T10:57:02,365 adding 'colossalai/kernel/extensions/pybind/moe/moe_cuda.py' 2024-07-17T10:57:02,366 adding 'colossalai/kernel/extensions/pybind/optimizer/__init__.py' 2024-07-17T10:57:02,367 adding 'colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-07-17T10:57:02,369 adding 'colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp' 2024-07-17T10:57:02,370 adding 'colossalai/kernel/extensions/pybind/softmax/__init__.py' 2024-07-17T10:57:02,372 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp' 2024-07-17T10:57:02,373 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-07-17T10:57:02,374 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp' 2024-07-17T10:57:02,375 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-07-17T10:57:02,377 adding 'colossalai/kernel/jit/__init__.py' 2024-07-17T10:57:02,378 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2024-07-17T10:57:02,379 adding 'colossalai/kernel/jit/bias_gelu.py' 2024-07-17T10:57:02,381 adding 'colossalai/kernel/jit/option.py' 2024-07-17T10:57:02,382 adding 'colossalai/kernel/triton/__init__.py' 2024-07-17T10:57:02,385 adding 'colossalai/kernel/triton/context_attn_unpad.py' 2024-07-17T10:57:02,388 adding 'colossalai/kernel/triton/flash_decoding.py' 2024-07-17T10:57:02,389 adding 'colossalai/kernel/triton/fused_rotary_embedding.py' 2024-07-17T10:57:02,391 adding 'colossalai/kernel/triton/kvcache_copy.py' 2024-07-17T10:57:02,393 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2024-07-17T10:57:02,395 adding 'colossalai/kernel/triton/no_pad_rotary_embedding.py' 2024-07-17T10:57:02,397 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2024-07-17T10:57:02,398 adding 'colossalai/kernel/triton/rms_layernorm.py' 2024-07-17T10:57:02,400 adding 'colossalai/kernel/triton/rotary_cache_copy.py' 2024-07-17T10:57:02,401 adding 'colossalai/kernel/triton/softmax.py' 2024-07-17T10:57:02,403 adding 'colossalai/lazy/__init__.py' 2024-07-17T10:57:02,404 adding 'colossalai/lazy/construction.py' 2024-07-17T10:57:02,407 adding 'colossalai/lazy/lazy_init.py' 2024-07-17T10:57:02,410 adding 'colossalai/lazy/pretrained.py' 2024-07-17T10:57:02,412 adding 'colossalai/legacy/__init__.py' 2024-07-17T10:57:02,413 adding 'colossalai/legacy/constants.py' 2024-07-17T10:57:02,414 adding 'colossalai/legacy/core.py' 2024-07-17T10:57:02,415 adding 'colossalai/legacy/global_variables.py' 2024-07-17T10:57:02,418 adding 'colossalai/legacy/initialize.py' 2024-07-17T10:57:02,420 adding 'colossalai/legacy/amp/__init__.py' 2024-07-17T10:57:02,421 adding 'colossalai/legacy/amp/amp_type.py' 2024-07-17T10:57:02,423 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2024-07-17T10:57:02,424 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2024-07-17T10:57:02,426 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2024-07-17T10:57:02,428 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2024-07-17T10:57:02,429 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2024-07-17T10:57:02,431 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2024-07-17T10:57:02,433 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2024-07-17T10:57:02,436 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2024-07-17T10:57:02,438 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2024-07-17T10:57:02,439 adding 'colossalai/legacy/builder/__init__.py' 2024-07-17T10:57:02,441 adding 'colossalai/legacy/builder/builder.py' 2024-07-17T10:57:02,442 adding 'colossalai/legacy/communication/__init__.py' 2024-07-17T10:57:02,444 adding 'colossalai/legacy/communication/collective.py' 2024-07-17T10:57:02,446 adding 'colossalai/legacy/communication/p2p.py' 2024-07-17T10:57:02,448 adding 'colossalai/legacy/communication/p2p_v2.py' 2024-07-17T10:57:02,449 adding 'colossalai/legacy/communication/ring.py' 2024-07-17T10:57:02,451 adding 'colossalai/legacy/communication/utils.py' 2024-07-17T10:57:02,452 adding 'colossalai/legacy/context/__init__.py' 2024-07-17T10:57:02,455 adding 'colossalai/legacy/context/parallel_context.py' 2024-07-17T10:57:02,457 adding 'colossalai/legacy/context/parallel_mode.py' 2024-07-17T10:57:02,458 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2024-07-17T10:57:02,460 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2024-07-17T10:57:02,461 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2024-07-17T10:57:02,463 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2024-07-17T10:57:02,465 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2024-07-17T10:57:02,466 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2024-07-17T10:57:02,467 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2024-07-17T10:57:02,469 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2024-07-17T10:57:02,470 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2024-07-17T10:57:02,471 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2024-07-17T10:57:02,472 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2024-07-17T10:57:02,474 adding 'colossalai/legacy/context/random/__init__.py' 2024-07-17T10:57:02,476 adding 'colossalai/legacy/context/random/_helper.py' 2024-07-17T10:57:02,477 adding 'colossalai/legacy/context/random/seed_manager.py' 2024-07-17T10:57:02,479 adding 'colossalai/legacy/engine/__init__.py' 2024-07-17T10:57:02,480 adding 'colossalai/legacy/engine/_base_engine.py' 2024-07-17T10:57:02,482 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2024-07-17T10:57:02,484 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2024-07-17T10:57:02,486 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2024-07-17T10:57:02,487 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2024-07-17T10:57:02,488 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2024-07-17T10:57:02,489 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2024-07-17T10:57:02,491 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2024-07-17T10:57:02,492 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2024-07-17T10:57:02,493 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2024-07-17T10:57:02,495 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2024-07-17T10:57:02,496 adding 'colossalai/legacy/engine/schedule/__init__.py' 2024-07-17T10:57:02,498 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2024-07-17T10:57:02,499 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2024-07-17T10:57:02,503 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2024-07-17T10:57:02,505 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2024-07-17T10:57:02,507 adding 'colossalai/legacy/inference/__init__.py' 2024-07-17T10:57:02,508 adding 'colossalai/legacy/inference/async_engine.py' 2024-07-17T10:57:02,510 adding 'colossalai/legacy/inference/async_manager.py' 2024-07-17T10:57:02,512 adding 'colossalai/legacy/inference/manager.py' 2024-07-17T10:57:02,514 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2024-07-17T10:57:02,515 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2024-07-17T10:57:02,517 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2024-07-17T10:57:02,518 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2024-07-17T10:57:02,520 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2024-07-17T10:57:02,521 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2024-07-17T10:57:02,523 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2024-07-17T10:57:02,524 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2024-07-17T10:57:02,525 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2024-07-17T10:57:02,527 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2024-07-17T10:57:02,528 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2024-07-17T10:57:02,530 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2024-07-17T10:57:02,531 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2024-07-17T10:57:02,534 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2024-07-17T10:57:02,536 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2024-07-17T10:57:02,537 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2024-07-17T10:57:02,539 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2024-07-17T10:57:02,541 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2024-07-17T10:57:02,542 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2024-07-17T10:57:02,544 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2024-07-17T10:57:02,547 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2024-07-17T10:57:02,548 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2024-07-17T10:57:02,550 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2024-07-17T10:57:02,551 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2024-07-17T10:57:02,554 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2024-07-17T10:57:02,557 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2024-07-17T10:57:02,559 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2024-07-17T10:57:02,561 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2024-07-17T10:57:02,562 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2024-07-17T10:57:02,564 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2024-07-17T10:57:02,565 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2024-07-17T10:57:02,567 adding 'colossalai/legacy/nn/__init__.py' 2024-07-17T10:57:02,568 adding 'colossalai/legacy/nn/_ops/__init__.py' 2024-07-17T10:57:02,570 adding 'colossalai/legacy/nn/_ops/_utils.py' 2024-07-17T10:57:02,572 adding 'colossalai/legacy/nn/layer/__init__.py' 2024-07-17T10:57:02,573 adding 'colossalai/legacy/nn/layer/base_layer.py' 2024-07-17T10:57:02,575 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2024-07-17T10:57:02,576 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2024-07-17T10:57:02,577 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2024-07-17T10:57:02,579 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2024-07-17T10:57:02,580 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2024-07-17T10:57:02,582 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2024-07-17T10:57:02,583 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2024-07-17T10:57:02,585 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2024-07-17T10:57:02,586 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2024-07-17T10:57:02,590 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2024-07-17T10:57:02,592 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2024-07-17T10:57:02,595 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2024-07-17T10:57:02,596 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2024-07-17T10:57:02,600 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2024-07-17T10:57:02,602 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2024-07-17T10:57:02,605 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2024-07-17T10:57:02,606 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2024-07-17T10:57:02,610 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2024-07-17T10:57:02,612 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2024-07-17T10:57:02,614 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2024-07-17T10:57:02,616 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2024-07-17T10:57:02,619 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2024-07-17T10:57:02,621 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2024-07-17T10:57:02,623 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2024-07-17T10:57:02,624 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2024-07-17T10:57:02,626 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2024-07-17T10:57:02,628 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2024-07-17T10:57:02,629 adding 'colossalai/legacy/nn/layer/utils/common.py' 2024-07-17T10:57:02,631 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2024-07-17T10:57:02,633 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2024-07-17T10:57:02,634 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2024-07-17T10:57:02,636 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2024-07-17T10:57:02,638 adding 'colossalai/legacy/nn/loss/__init__.py' 2024-07-17T10:57:02,639 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2024-07-17T10:57:02,641 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2024-07-17T10:57:02,642 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2024-07-17T10:57:02,644 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2024-07-17T10:57:02,646 adding 'colossalai/legacy/nn/metric/__init__.py' 2024-07-17T10:57:02,647 adding 'colossalai/legacy/nn/metric/_utils.py' 2024-07-17T10:57:02,648 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2024-07-17T10:57:02,649 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2024-07-17T10:57:02,650 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2024-07-17T10:57:02,652 adding 'colossalai/legacy/nn/parallel/__init__.py' 2024-07-17T10:57:02,653 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2024-07-17T10:57:02,655 adding 'colossalai/legacy/nn/parallel/reducer.py' 2024-07-17T10:57:02,657 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2024-07-17T10:57:02,658 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2024-07-17T10:57:02,660 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2024-07-17T10:57:02,661 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2024-07-17T10:57:02,662 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2024-07-17T10:57:02,664 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2024-07-17T10:57:02,665 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2024-07-17T10:57:02,668 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2024-07-17T10:57:02,670 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2024-07-17T10:57:02,672 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2024-07-17T10:57:02,673 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2024-07-17T10:57:02,674 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2024-07-17T10:57:02,676 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2024-07-17T10:57:02,678 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2024-07-17T10:57:02,680 adding 'colossalai/legacy/pipeline/__init__.py' 2024-07-17T10:57:02,681 adding 'colossalai/legacy/pipeline/layer_spec.py' 2024-07-17T10:57:02,683 adding 'colossalai/legacy/pipeline/pipelinable.py' 2024-07-17T10:57:02,685 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2024-07-17T10:57:02,686 adding 'colossalai/legacy/pipeline/utils.py' 2024-07-17T10:57:02,688 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2024-07-17T10:57:02,690 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2024-07-17T10:57:02,691 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2024-07-17T10:57:02,693 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2024-07-17T10:57:02,694 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2024-07-17T10:57:02,700 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2024-07-17T10:57:02,703 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2024-07-17T10:57:02,704 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2024-07-17T10:57:02,706 adding 'colossalai/legacy/registry/__init__.py' 2024-07-17T10:57:02,707 adding 'colossalai/legacy/registry/registry.py' 2024-07-17T10:57:02,709 adding 'colossalai/legacy/tensor/__init__.py' 2024-07-17T10:57:02,711 adding 'colossalai/legacy/tensor/compute_spec.py' 2024-07-17T10:57:02,712 adding 'colossalai/legacy/tensor/const.py' 2024-07-17T10:57:02,714 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2024-07-17T10:57:02,715 adding 'colossalai/legacy/tensor/distspec.py' 2024-07-17T10:57:02,716 adding 'colossalai/legacy/tensor/op_wrapper.py' 2024-07-17T10:57:02,718 adding 'colossalai/legacy/tensor/process_group.py' 2024-07-17T10:57:02,719 adding 'colossalai/legacy/tensor/tensor_spec.py' 2024-07-17T10:57:02,721 adding 'colossalai/legacy/trainer/__init__.py' 2024-07-17T10:57:02,723 adding 'colossalai/legacy/trainer/_trainer.py' 2024-07-17T10:57:02,725 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2024-07-17T10:57:02,727 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2024-07-17T10:57:02,728 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2024-07-17T10:57:02,729 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2024-07-17T10:57:02,731 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2024-07-17T10:57:02,733 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2024-07-17T10:57:02,735 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2024-07-17T10:57:02,737 adding 'colossalai/legacy/utils/__init__.py' 2024-07-17T10:57:02,738 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2024-07-17T10:57:02,740 adding 'colossalai/legacy/utils/checkpointing.py' 2024-07-17T10:57:02,743 adding 'colossalai/legacy/utils/common.py' 2024-07-17T10:57:02,744 adding 'colossalai/legacy/utils/memory.py' 2024-07-17T10:57:02,746 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2024-07-17T10:57:02,748 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2024-07-17T10:57:02,749 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2024-07-17T10:57:02,751 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2024-07-17T10:57:02,752 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2024-07-17T10:57:02,753 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2024-07-17T10:57:02,755 adding 'colossalai/legacy/utils/profiler/__init__.py' 2024-07-17T10:57:02,756 adding 'colossalai/legacy/utils/profiler/extention.py' 2024-07-17T10:57:02,758 adding 'colossalai/legacy/utils/profiler/profiler.py' 2024-07-17T10:57:02,759 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2024-07-17T10:57:02,761 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2024-07-17T10:57:02,763 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2024-07-17T10:57:02,765 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2024-07-17T10:57:02,766 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2024-07-17T10:57:02,768 adding 'colossalai/legacy/zero/__init__.py' 2024-07-17T10:57:02,770 adding 'colossalai/legacy/zero/gemini/__init__.py' 2024-07-17T10:57:02,771 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2024-07-17T10:57:02,773 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2024-07-17T10:57:02,774 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2024-07-17T10:57:02,776 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2024-07-17T10:57:02,777 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2024-07-17T10:57:02,779 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2024-07-17T10:57:02,780 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2024-07-17T10:57:02,782 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2024-07-17T10:57:02,783 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2024-07-17T10:57:02,784 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2024-07-17T10:57:02,786 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2024-07-17T10:57:02,787 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2024-07-17T10:57:02,789 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2024-07-17T10:57:02,790 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2024-07-17T10:57:02,792 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2024-07-17T10:57:02,794 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2024-07-17T10:57:02,795 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2024-07-17T10:57:02,796 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2024-07-17T10:57:02,798 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2024-07-17T10:57:02,799 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2024-07-17T10:57:02,801 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2024-07-17T10:57:02,802 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2024-07-17T10:57:02,804 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2024-07-17T10:57:02,807 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2024-07-17T10:57:02,809 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2024-07-17T10:57:02,810 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2024-07-17T10:57:02,812 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2024-07-17T10:57:02,814 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2024-07-17T10:57:02,816 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2024-07-17T10:57:02,818 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2024-07-17T10:57:02,819 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2024-07-17T10:57:02,821 adding 'colossalai/logging/__init__.py' 2024-07-17T10:57:02,822 adding 'colossalai/logging/logger.py' 2024-07-17T10:57:02,824 adding 'colossalai/moe/__init__.py' 2024-07-17T10:57:02,826 adding 'colossalai/moe/_operation.py' 2024-07-17T10:57:02,828 adding 'colossalai/moe/load_balance.py' 2024-07-17T10:57:02,830 adding 'colossalai/moe/manager.py' 2024-07-17T10:57:02,832 adding 'colossalai/moe/utils.py' 2024-07-17T10:57:02,833 adding 'colossalai/nn/__init__.py' 2024-07-17T10:57:02,835 adding 'colossalai/nn/init.py' 2024-07-17T10:57:02,837 adding 'colossalai/nn/layer/__init__.py' 2024-07-17T10:57:02,838 adding 'colossalai/nn/layer/layernorm.py' 2024-07-17T10:57:02,840 adding 'colossalai/nn/layer/scaled_softmax.py' 2024-07-17T10:57:02,841 adding 'colossalai/nn/layer/utils.py' 2024-07-17T10:57:02,843 adding 'colossalai/nn/loss/__init__.py' 2024-07-17T10:57:02,844 adding 'colossalai/nn/lr_scheduler/__init__.py' 2024-07-17T10:57:02,846 adding 'colossalai/nn/lr_scheduler/cosine.py' 2024-07-17T10:57:02,847 adding 'colossalai/nn/lr_scheduler/delayed.py' 2024-07-17T10:57:02,849 adding 'colossalai/nn/lr_scheduler/linear.py' 2024-07-17T10:57:02,850 adding 'colossalai/nn/lr_scheduler/multistep.py' 2024-07-17T10:57:02,851 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2024-07-17T10:57:02,853 adding 'colossalai/nn/lr_scheduler/poly.py' 2024-07-17T10:57:02,854 adding 'colossalai/nn/lr_scheduler/torch.py' 2024-07-17T10:57:02,856 adding 'colossalai/nn/optimizer/__init__.py' 2024-07-17T10:57:02,858 adding 'colossalai/nn/optimizer/adafactor.py' 2024-07-17T10:57:02,859 adding 'colossalai/nn/optimizer/came.py' 2024-07-17T10:57:02,861 adding 'colossalai/nn/optimizer/cpu_adam.py' 2024-07-17T10:57:02,863 adding 'colossalai/nn/optimizer/distributed_adafactor.py' 2024-07-17T10:57:02,866 adding 'colossalai/nn/optimizer/distributed_came.py' 2024-07-17T10:57:02,868 adding 'colossalai/nn/optimizer/distributed_galore.py' 2024-07-17T10:57:02,870 adding 'colossalai/nn/optimizer/distributed_lamb.py' 2024-07-17T10:57:02,872 adding 'colossalai/nn/optimizer/fused_adam.py' 2024-07-17T10:57:02,874 adding 'colossalai/nn/optimizer/fused_lamb.py' 2024-07-17T10:57:02,875 adding 'colossalai/nn/optimizer/fused_sgd.py' 2024-07-17T10:57:02,877 adding 'colossalai/nn/optimizer/galore.py' 2024-07-17T10:57:02,879 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2024-07-17T10:57:02,881 adding 'colossalai/nn/optimizer/lamb.py' 2024-07-17T10:57:02,882 adding 'colossalai/nn/optimizer/lars.py' 2024-07-17T10:57:02,884 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2024-07-17T10:57:02,885 adding 'colossalai/pipeline/__init__.py' 2024-07-17T10:57:02,889 adding 'colossalai/pipeline/p2p.py' 2024-07-17T10:57:02,890 adding 'colossalai/pipeline/stage_manager.py' 2024-07-17T10:57:02,892 adding 'colossalai/pipeline/schedule/__init__.py' 2024-07-17T10:57:02,894 adding 'colossalai/pipeline/schedule/_utils.py' 2024-07-17T10:57:02,895 adding 'colossalai/pipeline/schedule/base.py' 2024-07-17T10:57:02,897 adding 'colossalai/pipeline/schedule/generate.py' 2024-07-17T10:57:02,900 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2024-07-17T10:57:02,903 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2024-07-17T10:57:02,904 adding 'colossalai/quantization/__init__.py' 2024-07-17T10:57:02,907 adding 'colossalai/quantization/bnb.py' 2024-07-17T10:57:02,908 adding 'colossalai/quantization/bnb_config.py' 2024-07-17T10:57:02,910 adding 'colossalai/shardformer/__init__.py' 2024-07-17T10:57:02,911 adding 'colossalai/shardformer/_utils.py' 2024-07-17T10:57:02,913 adding 'colossalai/shardformer/layer/__init__.py' 2024-07-17T10:57:02,917 adding 'colossalai/shardformer/layer/_operation.py' 2024-07-17T10:57:02,919 adding 'colossalai/shardformer/layer/attn.py' 2024-07-17T10:57:02,920 adding 'colossalai/shardformer/layer/dropout.py' 2024-07-17T10:57:02,922 adding 'colossalai/shardformer/layer/embedding.py' 2024-07-17T10:57:02,925 adding 'colossalai/shardformer/layer/linear.py' 2024-07-17T10:57:02,927 adding 'colossalai/shardformer/layer/loss.py' 2024-07-17T10:57:02,929 adding 'colossalai/shardformer/layer/normalization.py' 2024-07-17T10:57:02,932 adding 'colossalai/shardformer/layer/parallel_module.py' 2024-07-17T10:57:02,936 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2024-07-17T10:57:02,939 adding 'colossalai/shardformer/layer/utils.py' 2024-07-17T10:57:02,940 adding 'colossalai/shardformer/layer/moe/__init__.py' 2024-07-17T10:57:02,942 adding 'colossalai/shardformer/layer/moe/experts.py' 2024-07-17T10:57:02,944 adding 'colossalai/shardformer/layer/moe/layers.py' 2024-07-17T10:57:02,946 adding 'colossalai/shardformer/layer/moe/routers.py' 2024-07-17T10:57:02,947 adding 'colossalai/shardformer/modeling/__init__.py' 2024-07-17T10:57:02,952 adding 'colossalai/shardformer/modeling/bert.py' 2024-07-17T10:57:02,953 adding 'colossalai/shardformer/modeling/blip2.py' 2024-07-17T10:57:02,958 adding 'colossalai/shardformer/modeling/bloom.py' 2024-07-17T10:57:02,961 adding 'colossalai/shardformer/modeling/chatglm2.py' 2024-07-17T10:57:02,964 adding 'colossalai/shardformer/modeling/command.py' 2024-07-17T10:57:02,966 adding 'colossalai/shardformer/modeling/deepseek.py' 2024-07-17T10:57:02,970 adding 'colossalai/shardformer/modeling/falcon.py' 2024-07-17T10:57:02,975 adding 'colossalai/shardformer/modeling/gpt2.py' 2024-07-17T10:57:02,979 adding 'colossalai/shardformer/modeling/gptj.py' 2024-07-17T10:57:02,980 adding 'colossalai/shardformer/modeling/jit.py' 2024-07-17T10:57:02,983 adding 'colossalai/shardformer/modeling/llama.py' 2024-07-17T10:57:02,986 adding 'colossalai/shardformer/modeling/mistral.py' 2024-07-17T10:57:02,989 adding 'colossalai/shardformer/modeling/mixtral.py' 2024-07-17T10:57:02,993 adding 'colossalai/shardformer/modeling/opt.py' 2024-07-17T10:57:02,997 adding 'colossalai/shardformer/modeling/qwen2.py' 2024-07-17T10:57:02,999 adding 'colossalai/shardformer/modeling/sam.py' 2024-07-17T10:57:03,002 adding 'colossalai/shardformer/modeling/t5.py' 2024-07-17T10:57:03,004 adding 'colossalai/shardformer/modeling/vit.py' 2024-07-17T10:57:03,009 adding 'colossalai/shardformer/modeling/whisper.py' 2024-07-17T10:57:03,011 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2024-07-17T10:57:03,013 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2024-07-17T10:57:03,019 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2024-07-17T10:57:03,021 adding 'colossalai/shardformer/policies/__init__.py' 2024-07-17T10:57:03,023 adding 'colossalai/shardformer/policies/auto_policy.py' 2024-07-17T10:57:03,025 adding 'colossalai/shardformer/policies/base_policy.py' 2024-07-17T10:57:03,027 adding 'colossalai/shardformer/policies/bert.py' 2024-07-17T10:57:03,029 adding 'colossalai/shardformer/policies/blip2.py' 2024-07-17T10:57:03,031 adding 'colossalai/shardformer/policies/bloom.py' 2024-07-17T10:57:03,033 adding 'colossalai/shardformer/policies/chatglm2.py' 2024-07-17T10:57:03,035 adding 'colossalai/shardformer/policies/command.py' 2024-07-17T10:57:03,037 adding 'colossalai/shardformer/policies/deepseek.py' 2024-07-17T10:57:03,039 adding 'colossalai/shardformer/policies/falcon.py' 2024-07-17T10:57:03,041 adding 'colossalai/shardformer/policies/gpt2.py' 2024-07-17T10:57:03,043 adding 'colossalai/shardformer/policies/gptj.py' 2024-07-17T10:57:03,045 adding 'colossalai/shardformer/policies/llama.py' 2024-07-17T10:57:03,047 adding 'colossalai/shardformer/policies/mistral.py' 2024-07-17T10:57:03,049 adding 'colossalai/shardformer/policies/mixtral.py' 2024-07-17T10:57:03,050 adding 'colossalai/shardformer/policies/opt.py' 2024-07-17T10:57:03,053 adding 'colossalai/shardformer/policies/qwen2.py' 2024-07-17T10:57:03,054 adding 'colossalai/shardformer/policies/sam.py' 2024-07-17T10:57:03,056 adding 'colossalai/shardformer/policies/t5.py' 2024-07-17T10:57:03,058 adding 'colossalai/shardformer/policies/vit.py' 2024-07-17T10:57:03,061 adding 'colossalai/shardformer/policies/whisper.py' 2024-07-17T10:57:03,063 adding 'colossalai/shardformer/shard/__init__.py' 2024-07-17T10:57:03,064 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2024-07-17T10:57:03,066 adding 'colossalai/shardformer/shard/shard_config.py' 2024-07-17T10:57:03,067 adding 'colossalai/shardformer/shard/sharder.py' 2024-07-17T10:57:03,069 adding 'colossalai/shardformer/shard/shardformer.py' 2024-07-17T10:57:03,070 adding 'colossalai/shardformer/shard/utils.py' 2024-07-17T10:57:03,072 adding 'colossalai/tensor/__init__.py' 2024-07-17T10:57:03,073 adding 'colossalai/tensor/colo_parameter.py' 2024-07-17T10:57:03,075 adding 'colossalai/tensor/colo_tensor.py' 2024-07-17T10:57:03,077 adding 'colossalai/tensor/comm_spec.py' 2024-07-17T10:57:03,079 adding 'colossalai/tensor/param_op_hook.py' 2024-07-17T10:57:03,082 adding 'colossalai/tensor/shape_consistency.py' 2024-07-17T10:57:03,085 adding 'colossalai/tensor/sharding_spec.py' 2024-07-17T10:57:03,086 adding 'colossalai/tensor/utils.py' 2024-07-17T10:57:03,088 adding 'colossalai/tensor/d_tensor/__init__.py' 2024-07-17T10:57:03,090 adding 'colossalai/tensor/d_tensor/api.py' 2024-07-17T10:57:03,092 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2024-07-17T10:57:03,094 adding 'colossalai/tensor/d_tensor/layout.py' 2024-07-17T10:57:03,097 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2024-07-17T10:57:03,098 adding 'colossalai/tensor/d_tensor/misc.py' 2024-07-17T10:57:03,100 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2024-07-17T10:57:03,101 adding 'colossalai/tensor/d_tensor/utils.py' 2024-07-17T10:57:03,103 adding 'colossalai/tensor/moe_tensor/__init__.py' 2024-07-17T10:57:03,104 adding 'colossalai/tensor/moe_tensor/api.py' 2024-07-17T10:57:03,106 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2024-07-17T10:57:03,107 adding 'colossalai/tensor/padded_tensor/__init__.py' 2024-07-17T10:57:03,109 adding 'colossalai/tensor/padded_tensor/api.py' 2024-07-17T10:57:03,110 adding 'colossalai/testing/__init__.py' 2024-07-17T10:57:03,112 adding 'colossalai/testing/comparison.py' 2024-07-17T10:57:03,113 adding 'colossalai/testing/pytest_wrapper.py' 2024-07-17T10:57:03,114 adding 'colossalai/testing/random.py' 2024-07-17T10:57:03,116 adding 'colossalai/testing/utils.py' 2024-07-17T10:57:03,118 adding 'colossalai/utils/__init__.py' 2024-07-17T10:57:03,119 adding 'colossalai/utils/common.py' 2024-07-17T10:57:03,121 adding 'colossalai/utils/memory.py' 2024-07-17T10:57:03,122 adding 'colossalai/utils/timer.py' 2024-07-17T10:57:03,124 adding 'colossalai/utils/model/__init__.py' 2024-07-17T10:57:03,126 adding 'colossalai/utils/model/utils.py' 2024-07-17T10:57:03,127 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2024-07-17T10:57:03,128 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2024-07-17T10:57:03,130 adding 'colossalai/utils/rank_recorder/__init__.py' 2024-07-17T10:57:03,131 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2024-07-17T10:57:03,133 adding 'colossalai/utils/tensor_detector/__init__.py' 2024-07-17T10:57:03,135 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2024-07-17T10:57:03,137 adding 'colossalai/zero/__init__.py' 2024-07-17T10:57:03,138 adding 'colossalai/zero/wrapper.py' 2024-07-17T10:57:03,140 adding 'colossalai/zero/gemini/__init__.py' 2024-07-17T10:57:03,145 adding 'colossalai/zero/gemini/gemini_ddp.py' 2024-07-17T10:57:03,147 adding 'colossalai/zero/gemini/gemini_hook.py' 2024-07-17T10:57:03,149 adding 'colossalai/zero/gemini/gemini_mgr.py' 2024-07-17T10:57:03,154 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2024-07-17T10:57:03,156 adding 'colossalai/zero/gemini/placement_policy.py' 2024-07-17T10:57:03,158 adding 'colossalai/zero/gemini/utils.py' 2024-07-17T10:57:03,159 adding 'colossalai/zero/gemini/chunk/__init__.py' 2024-07-17T10:57:03,163 adding 'colossalai/zero/gemini/chunk/chunk.py' 2024-07-17T10:57:03,165 adding 'colossalai/zero/gemini/chunk/manager.py' 2024-07-17T10:57:03,166 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2024-07-17T10:57:03,168 adding 'colossalai/zero/gemini/chunk/utils.py' 2024-07-17T10:57:03,170 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2024-07-17T10:57:03,171 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2024-07-17T10:57:03,172 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2024-07-17T10:57:03,174 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2024-07-17T10:57:03,175 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2024-07-17T10:57:03,177 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2024-07-17T10:57:03,178 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2024-07-17T10:57:03,179 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2024-07-17T10:57:03,181 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2024-07-17T10:57:03,182 adding 'colossalai/zero/low_level/__init__.py' 2024-07-17T10:57:03,184 adding 'colossalai/zero/low_level/_utils.py' 2024-07-17T10:57:03,189 adding 'colossalai/zero/low_level/low_level_optim.py' 2024-07-17T10:57:03,191 adding 'colossalai/zero/low_level/zero_hook.py' 2024-07-17T10:57:03,192 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2024-07-17T10:57:03,194 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2024-07-17T10:57:03,196 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2024-07-17T10:57:03,197 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2024-07-17T10:57:03,199 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2024-07-17T10:57:03,202 adding 'extensions/csrc/__init__.py' 2024-07-17T10:57:03,203 adding 'extensions/pybind/__init__.py' 2024-07-17T10:57:03,205 adding 'extensions/pybind/cpu_adam/__init__.py' 2024-07-17T10:57:03,206 adding 'extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-07-17T10:57:03,207 adding 'extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-07-17T10:57:03,209 adding 'extensions/pybind/flash_attention/__init__.py' 2024-07-17T10:57:03,210 adding 'extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-07-17T10:57:03,212 adding 'extensions/pybind/flash_attention/flash_attention_npu.py' 2024-07-17T10:57:03,213 adding 'extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-07-17T10:57:03,215 adding 'extensions/pybind/inference/__init__.py' 2024-07-17T10:57:03,216 adding 'extensions/pybind/inference/inference_ops_cuda.py' 2024-07-17T10:57:03,218 adding 'extensions/pybind/layernorm/__init__.py' 2024-07-17T10:57:03,219 adding 'extensions/pybind/layernorm/layernorm_cuda.py' 2024-07-17T10:57:03,220 adding 'extensions/pybind/moe/__init__.py' 2024-07-17T10:57:03,222 adding 'extensions/pybind/moe/moe_cuda.py' 2024-07-17T10:57:03,223 adding 'extensions/pybind/optimizer/__init__.py' 2024-07-17T10:57:03,224 adding 'extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-07-17T10:57:03,226 adding 'extensions/pybind/softmax/__init__.py' 2024-07-17T10:57:03,227 adding 'extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-07-17T10:57:03,229 adding 'extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-07-17T10:57:03,232 adding 'colossalai-0.4.1.dist-info/LICENSE' 2024-07-17T10:57:03,236 adding 'colossalai-0.4.1.dist-info/METADATA' 2024-07-17T10:57:03,238 adding 'colossalai-0.4.1.dist-info/WHEEL' 2024-07-17T10:57:03,239 adding 'colossalai-0.4.1.dist-info/entry_points.txt' 2024-07-17T10:57:03,240 adding 'colossalai-0.4.1.dist-info/top_level.txt' 2024-07-17T10:57:03,256 adding 'colossalai-0.4.1.dist-info/RECORD' 2024-07-17T10:57:03,290 removing build/bdist.linux-armv7l/wheel 2024-07-17T10:57:03,623 Building wheel for colossalai (setup.py): finished with status 'done' 2024-07-17T10:57:03,641 Created wheel for colossalai: filename=colossalai-0.4.1-py3-none-any.whl size=1558045 sha256=5355444b4f627d0b5516a1053a0b99c3eb130a9bdde95abefa4dcd7a881b0119 2024-07-17T10:57:03,642 Stored in directory: /tmp/pip-ephem-wheel-cache-z5s8yy39/wheels/e1/80/e3/1f151f59ae72a301e6191e2ba54a77d755f0d6603c13994c05 2024-07-17T10:57:03,684 Successfully built colossalai 2024-07-17T10:57:03,724 Removed build tracker: '/tmp/pip-build-tracker-4cr0k6ih'