2024-07-31T02:39:25,796 Created temporary directory: /tmp/pip-build-tracker-fm_z1lbu 2024-07-31T02:39:25,797 Initialized build tracking at /tmp/pip-build-tracker-fm_z1lbu 2024-07-31T02:39:25,798 Created build tracker: /tmp/pip-build-tracker-fm_z1lbu 2024-07-31T02:39:25,798 Entered build tracker: /tmp/pip-build-tracker-fm_z1lbu 2024-07-31T02:39:25,799 Created temporary directory: /tmp/pip-wheel-scy_ne74 2024-07-31T02:39:25,803 Created temporary directory: /tmp/pip-ephem-wheel-cache-wmwes89e 2024-07-31T02:39:25,831 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-07-31T02:39:25,834 2 location(s) to search for versions of colossalai: 2024-07-31T02:39:25,834 * https://pypi.org/simple/colossalai/ 2024-07-31T02:39:25,834 * https://www.piwheels.org/simple/colossalai/ 2024-07-31T02:39:25,835 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2024-07-31T02:39:25,835 Getting page https://pypi.org/simple/colossalai/ 2024-07-31T02:39:25,837 Found index url https://pypi.org/simple/ 2024-07-31T02:39:25,935 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2024-07-31T02:39:25,940 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2024-07-31T02:39:25,941 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2024-07-31T02:39:25,942 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2024-07-31T02:39:25,943 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2024-07-31T02:39:25,944 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2024-07-31T02:39:25,945 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2024-07-31T02:39:25,946 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2024-07-31T02:39:25,947 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2024-07-31T02:39:25,948 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2024-07-31T02:39:25,949 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2024-07-31T02:39:25,950 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2024-07-31T02:39:25,951 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2024-07-31T02:39:25,952 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2024-07-31T02:39:25,953 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2024-07-31T02:39:25,954 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2024-07-31T02:39:25,955 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2024-07-31T02:39:25,955 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2024-07-31T02:39:25,956 Found link https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.8 2024-07-31T02:39:25,957 Found link https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.9 2024-07-31T02:39:25,958 Found link https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.0 2024-07-31T02:39:25,959 Found link https://files.pythonhosted.org/packages/3c/cd/206593b5c417a436382ca5e93c0188c031830341ee352c35e020ce83f57c/colossalai-0.4.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.1 2024-07-31T02:39:25,960 Found link https://files.pythonhosted.org/packages/0d/98/7adbf8fd663234fee2ea43382b065979c22612f319c322aa0eb675457327/colossalai-0.4.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.2 2024-07-31T02:39:25,961 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2024-07-31T02:39:25,961 Getting page https://www.piwheels.org/simple/colossalai/ 2024-07-31T02:39:25,963 Found index url https://www.piwheels.org/simple/ 2024-07-31T02:39:26,001 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2024-07-31T02:39:26,007 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.1-py3-none-any.whl#sha256=5355444b4f627d0b5516a1053a0b99c3eb130a9bdde95abefa4dcd7a881b0119 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,008 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.0-py3-none-any.whl#sha256=bca14360afc924008f910785cbb07e07f1f743e3a7182103caa09a4d6c49d3a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,009 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.9-py3-none-any.whl#sha256=670e4e0d607a0803e8f0a7349996228f4cfa411d817bd631c07b1b2064e7af48 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,009 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.8-py3-none-any.whl#sha256=73a2dba29be661597422944d917c709df77c91843d30ab323f6c740173686dab (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,010 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.7-py3-none-any.whl#sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,011 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,011 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,012 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,012 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,013 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,013 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,014 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,014 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,015 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,016 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,016 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,017 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,017 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,018 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,019 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,019 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-07-31T02:39:26,020 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2024-07-31T02:39:26,020 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2024-07-31T02:39:26,042 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2024-07-31T02:39:26,060 Collecting colossalai==0.4.2 2024-07-31T02:39:26,063 Created temporary directory: /tmp/pip-unpack-dhua95w2 2024-07-31T02:39:26,396 Downloading colossalai-0.4.2.tar.gz (1.3 MB) 2024-07-31T02:39:28,743 Added colossalai==0.4.2 from https://files.pythonhosted.org/packages/0d/98/7adbf8fd663234fee2ea43382b065979c22612f319c322aa0eb675457327/colossalai-0.4.2.tar.gz to build tracker '/tmp/pip-build-tracker-fm_z1lbu' 2024-07-31T02:39:28,746 Running setup.py (path:/tmp/pip-wheel-scy_ne74/colossalai_561b925ae0b8424dabe6bae910d73996/setup.py) egg_info for package colossalai 2024-07-31T02:39:28,747 Created temporary directory: /tmp/pip-pip-egg-info-nc4q5ca1 2024-07-31T02:39:28,748 Preparing metadata (setup.py): started 2024-07-31T02:39:28,749 Running command python setup.py egg_info 2024-07-31T02:39:30,001 running egg_info 2024-07-31T02:39:30,002 creating /tmp/pip-pip-egg-info-nc4q5ca1/colossalai.egg-info 2024-07-31T02:39:30,030 writing /tmp/pip-pip-egg-info-nc4q5ca1/colossalai.egg-info/PKG-INFO 2024-07-31T02:39:30,035 writing dependency_links to /tmp/pip-pip-egg-info-nc4q5ca1/colossalai.egg-info/dependency_links.txt 2024-07-31T02:39:30,036 writing entry points to /tmp/pip-pip-egg-info-nc4q5ca1/colossalai.egg-info/entry_points.txt 2024-07-31T02:39:30,038 writing requirements to /tmp/pip-pip-egg-info-nc4q5ca1/colossalai.egg-info/requires.txt 2024-07-31T02:39:30,039 writing top-level names to /tmp/pip-pip-egg-info-nc4q5ca1/colossalai.egg-info/top_level.txt 2024-07-31T02:39:30,040 writing manifest file '/tmp/pip-pip-egg-info-nc4q5ca1/colossalai.egg-info/SOURCES.txt' 2024-07-31T02:39:30,322 reading manifest file '/tmp/pip-pip-egg-info-nc4q5ca1/colossalai.egg-info/SOURCES.txt' 2024-07-31T02:39:30,323 reading manifest template 'MANIFEST.in' 2024-07-31T02:39:31,579 warning: no files found matching '*.tr' under directory 'colossalai' 2024-07-31T02:39:32,203 warning: no files found matching '*.cc' under directory 'colossalai' 2024-07-31T02:39:32,511 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-07-31T02:39:32,657 warning: no files found matching '*.tr' under directory 'extensions' 2024-07-31T02:39:32,711 warning: no files found matching '*.cc' under directory 'extensions' 2024-07-31T02:39:32,739 warning: no files found matching '*.pyi' under directory 'extensions' 2024-07-31T02:39:32,740 adding license file 'LICENSE' 2024-07-31T02:39:32,772 writing manifest file '/tmp/pip-pip-egg-info-nc4q5ca1/colossalai.egg-info/SOURCES.txt' 2024-07-31T02:39:32,889 Preparing metadata (setup.py): finished with status 'done' 2024-07-31T02:39:32,895 Source in /tmp/pip-wheel-scy_ne74/colossalai_561b925ae0b8424dabe6bae910d73996 has version 0.4.2, which satisfies requirement colossalai==0.4.2 from https://files.pythonhosted.org/packages/0d/98/7adbf8fd663234fee2ea43382b065979c22612f319c322aa0eb675457327/colossalai-0.4.2.tar.gz 2024-07-31T02:39:32,896 Removed colossalai==0.4.2 from https://files.pythonhosted.org/packages/0d/98/7adbf8fd663234fee2ea43382b065979c22612f319c322aa0eb675457327/colossalai-0.4.2.tar.gz from build tracker '/tmp/pip-build-tracker-fm_z1lbu' 2024-07-31T02:39:32,908 Created temporary directory: /tmp/pip-unpack-0awkp0vw 2024-07-31T02:39:32,909 Created temporary directory: /tmp/pip-unpack-k9t35m8z 2024-07-31T02:39:32,910 Building wheels for collected packages: colossalai 2024-07-31T02:39:32,913 Created temporary directory: /tmp/pip-wheel-grqfscqy 2024-07-31T02:39:32,914 Building wheel for colossalai (setup.py): started 2024-07-31T02:39:32,915 Destination directory: /tmp/pip-wheel-grqfscqy 2024-07-31T02:39:32,916 Running command python setup.py bdist_wheel 2024-07-31T02:39:34,038 running bdist_wheel 2024-07-31T02:39:34,181 running build 2024-07-31T02:39:34,182 running build_py 2024-07-31T02:39:34,212 creating build 2024-07-31T02:39:34,213 creating build/lib 2024-07-31T02:39:34,213 creating build/lib/colossalai 2024-07-31T02:39:34,215 copying colossalai/version.py -> build/lib/colossalai 2024-07-31T02:39:34,216 copying colossalai/initialize.py -> build/lib/colossalai 2024-07-31T02:39:34,219 copying colossalai/__init__.py -> build/lib/colossalai 2024-07-31T02:39:34,221 creating build/lib/extensions 2024-07-31T02:39:34,221 creating build/lib/extensions/pybind 2024-07-31T02:39:34,222 copying extensions/pybind/__init__.py -> build/lib/extensions/pybind 2024-07-31T02:39:34,224 creating build/lib/extensions/csrc 2024-07-31T02:39:34,225 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2024-07-31T02:39:34,227 creating build/lib/extensions/pybind/moe 2024-07-31T02:39:34,228 copying extensions/pybind/moe/moe_cuda.py -> build/lib/extensions/pybind/moe 2024-07-31T02:39:34,230 copying extensions/pybind/moe/__init__.py -> build/lib/extensions/pybind/moe 2024-07-31T02:39:34,232 creating build/lib/extensions/pybind/layernorm 2024-07-31T02:39:34,233 copying extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/extensions/pybind/layernorm 2024-07-31T02:39:34,234 copying extensions/pybind/layernorm/__init__.py -> build/lib/extensions/pybind/layernorm 2024-07-31T02:39:34,237 creating build/lib/extensions/pybind/softmax 2024-07-31T02:39:34,238 copying extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-07-31T02:39:34,239 copying extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-07-31T02:39:34,241 copying extensions/pybind/softmax/__init__.py -> build/lib/extensions/pybind/softmax 2024-07-31T02:39:34,243 creating build/lib/extensions/pybind/cpu_adam 2024-07-31T02:39:34,244 copying extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/pybind/cpu_adam 2024-07-31T02:39:34,246 copying extensions/pybind/cpu_adam/__init__.py -> build/lib/extensions/pybind/cpu_adam 2024-07-31T02:39:34,248 copying extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/pybind/cpu_adam 2024-07-31T02:39:34,250 creating build/lib/extensions/pybind/optimizer 2024-07-31T02:39:34,251 copying extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/pybind/optimizer 2024-07-31T02:39:34,253 copying extensions/pybind/optimizer/__init__.py -> build/lib/extensions/pybind/optimizer 2024-07-31T02:39:34,255 creating build/lib/extensions/pybind/flash_attention 2024-07-31T02:39:34,256 copying extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-07-31T02:39:34,257 copying extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-07-31T02:39:34,259 copying extensions/pybind/flash_attention/__init__.py -> build/lib/extensions/pybind/flash_attention 2024-07-31T02:39:34,261 copying extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/extensions/pybind/flash_attention 2024-07-31T02:39:34,263 creating build/lib/extensions/pybind/inference 2024-07-31T02:39:34,264 copying extensions/pybind/inference/inference_ops_cuda.py -> build/lib/extensions/pybind/inference 2024-07-31T02:39:34,265 copying extensions/pybind/inference/__init__.py -> build/lib/extensions/pybind/inference 2024-07-31T02:39:34,267 creating build/lib/colossalai/_analyzer 2024-07-31T02:39:34,268 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2024-07-31T02:39:34,270 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2024-07-31T02:39:34,272 creating build/lib/colossalai/cluster 2024-07-31T02:39:34,272 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2024-07-31T02:39:34,274 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2024-07-31T02:39:34,276 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2024-07-31T02:39:34,278 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2024-07-31T02:39:34,280 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2024-07-31T02:39:34,282 creating build/lib/colossalai/device 2024-07-31T02:39:34,283 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2024-07-31T02:39:34,285 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2024-07-31T02:39:34,288 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2024-07-31T02:39:34,290 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2024-07-31T02:39:34,292 creating build/lib/colossalai/fx 2024-07-31T02:39:34,293 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2024-07-31T02:39:34,295 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2024-07-31T02:39:34,297 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2024-07-31T02:39:34,299 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2024-07-31T02:39:34,300 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2024-07-31T02:39:34,302 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2024-07-31T02:39:34,305 creating build/lib/colossalai/tensor 2024-07-31T02:39:34,306 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2024-07-31T02:39:34,309 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2024-07-31T02:39:34,311 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2024-07-31T02:39:34,313 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2024-07-31T02:39:34,315 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2024-07-31T02:39:34,317 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2024-07-31T02:39:34,319 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2024-07-31T02:39:34,322 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2024-07-31T02:39:34,324 creating build/lib/colossalai/moe 2024-07-31T02:39:34,325 copying colossalai/moe/utils.py -> build/lib/colossalai/moe 2024-07-31T02:39:34,327 copying colossalai/moe/manager.py -> build/lib/colossalai/moe 2024-07-31T02:39:34,329 copying colossalai/moe/load_balance.py -> build/lib/colossalai/moe 2024-07-31T02:39:34,332 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2024-07-31T02:39:34,333 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2024-07-31T02:39:34,336 creating build/lib/colossalai/testing 2024-07-31T02:39:34,337 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2024-07-31T02:39:34,340 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2024-07-31T02:39:34,342 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2024-07-31T02:39:34,343 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2024-07-31T02:39:34,345 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2024-07-31T02:39:34,348 creating build/lib/colossalai/booster 2024-07-31T02:39:34,349 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2024-07-31T02:39:34,351 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2024-07-31T02:39:34,353 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2024-07-31T02:39:34,355 creating build/lib/colossalai/nn 2024-07-31T02:39:34,356 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2024-07-31T02:39:34,358 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2024-07-31T02:39:34,360 creating build/lib/colossalai/amp 2024-07-31T02:39:34,361 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2024-07-31T02:39:34,363 creating build/lib/colossalai/kernel 2024-07-31T02:39:34,364 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2024-07-31T02:39:34,365 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2024-07-31T02:39:34,367 creating build/lib/colossalai/lazy 2024-07-31T02:39:34,368 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2024-07-31T02:39:34,371 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2024-07-31T02:39:34,373 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2024-07-31T02:39:34,375 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2024-07-31T02:39:34,377 creating build/lib/colossalai/context 2024-07-31T02:39:34,378 copying colossalai/context/config.py -> build/lib/colossalai/context 2024-07-31T02:39:34,380 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2024-07-31T02:39:34,382 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2024-07-31T02:39:34,384 creating build/lib/colossalai/quantization 2024-07-31T02:39:34,385 copying colossalai/quantization/bnb.py -> build/lib/colossalai/quantization 2024-07-31T02:39:34,388 copying colossalai/quantization/__init__.py -> build/lib/colossalai/quantization 2024-07-31T02:39:34,389 copying colossalai/quantization/bnb_config.py -> build/lib/colossalai/quantization 2024-07-31T02:39:34,392 creating build/lib/colossalai/checkpoint_io 2024-07-31T02:39:34,393 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-07-31T02:39:34,395 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2024-07-31T02:39:34,398 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-07-31T02:39:34,401 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2024-07-31T02:39:34,404 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2024-07-31T02:39:34,405 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2024-07-31T02:39:34,408 copying colossalai/checkpoint_io/moe_checkpoint.py -> build/lib/colossalai/checkpoint_io 2024-07-31T02:39:34,411 creating build/lib/colossalai/legacy 2024-07-31T02:39:34,412 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2024-07-31T02:39:34,414 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2024-07-31T02:39:34,416 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2024-07-31T02:39:34,418 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2024-07-31T02:39:34,420 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2024-07-31T02:39:34,422 creating build/lib/colossalai/utils 2024-07-31T02:39:34,423 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2024-07-31T02:39:34,425 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2024-07-31T02:39:34,427 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2024-07-31T02:39:34,429 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2024-07-31T02:39:34,431 creating build/lib/colossalai/cli 2024-07-31T02:39:34,432 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2024-07-31T02:39:34,433 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2024-07-31T02:39:34,435 creating build/lib/colossalai/shardformer 2024-07-31T02:39:34,436 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2024-07-31T02:39:34,438 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2024-07-31T02:39:34,440 creating build/lib/colossalai/pipeline 2024-07-31T02:39:34,440 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2024-07-31T02:39:34,442 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2024-07-31T02:39:34,444 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2024-07-31T02:39:34,447 creating build/lib/colossalai/logging 2024-07-31T02:39:34,448 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2024-07-31T02:39:34,450 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2024-07-31T02:39:34,452 creating build/lib/colossalai/auto_parallel 2024-07-31T02:39:34,453 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2024-07-31T02:39:34,455 creating build/lib/colossalai/_C 2024-07-31T02:39:34,456 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2024-07-31T02:39:34,458 creating build/lib/colossalai/inference 2024-07-31T02:39:34,459 copying colossalai/inference/sampler.py -> build/lib/colossalai/inference 2024-07-31T02:39:34,461 copying colossalai/inference/utils.py -> build/lib/colossalai/inference 2024-07-31T02:39:34,463 copying colossalai/inference/flash_decoding_utils.py -> build/lib/colossalai/inference 2024-07-31T02:39:34,465 copying colossalai/inference/logit_processors.py -> build/lib/colossalai/inference 2024-07-31T02:39:34,467 copying colossalai/inference/struct.py -> build/lib/colossalai/inference 2024-07-31T02:39:34,469 copying colossalai/inference/config.py -> build/lib/colossalai/inference 2024-07-31T02:39:34,471 copying colossalai/inference/batch_bucket.py -> build/lib/colossalai/inference 2024-07-31T02:39:34,474 copying colossalai/inference/graph_runner.py -> build/lib/colossalai/inference 2024-07-31T02:39:34,476 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2024-07-31T02:39:34,478 creating build/lib/colossalai/zero 2024-07-31T02:39:34,479 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2024-07-31T02:39:34,481 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2024-07-31T02:39:34,484 creating build/lib/colossalai/interface 2024-07-31T02:39:34,485 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2024-07-31T02:39:34,487 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2024-07-31T02:39:34,489 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2024-07-31T02:39:34,491 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2024-07-31T02:39:34,494 creating build/lib/colossalai/accelerator 2024-07-31T02:39:34,495 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2024-07-31T02:39:34,498 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2024-07-31T02:39:34,500 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2024-07-31T02:39:34,502 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2024-07-31T02:39:34,505 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2024-07-31T02:39:34,508 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2024-07-31T02:39:34,510 creating build/lib/colossalai/_analyzer/fx 2024-07-31T02:39:34,511 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2024-07-31T02:39:34,514 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2024-07-31T02:39:34,516 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2024-07-31T02:39:34,518 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2024-07-31T02:39:34,521 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2024-07-31T02:39:34,523 creating build/lib/colossalai/_analyzer/_subclasses 2024-07-31T02:39:34,524 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-07-31T02:39:34,527 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2024-07-31T02:39:34,529 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2024-07-31T02:39:34,532 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2024-07-31T02:39:34,533 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-07-31T02:39:34,537 creating build/lib/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:34,538 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:34,540 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:34,542 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:34,545 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:34,547 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:34,549 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:34,552 creating build/lib/colossalai/_analyzer/fx/passes 2024-07-31T02:39:34,553 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2024-07-31T02:39:34,556 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2024-07-31T02:39:34,558 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2024-07-31T02:39:34,561 creating build/lib/colossalai/fx/profiler 2024-07-31T02:39:34,562 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2024-07-31T02:39:34,564 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2024-07-31T02:39:34,566 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2024-07-31T02:39:34,569 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2024-07-31T02:39:34,571 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2024-07-31T02:39:34,574 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2024-07-31T02:39:34,576 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2024-07-31T02:39:34,578 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2024-07-31T02:39:34,581 creating build/lib/colossalai/fx/tracer 2024-07-31T02:39:34,582 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2024-07-31T02:39:34,584 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2024-07-31T02:39:34,587 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2024-07-31T02:39:34,590 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2024-07-31T02:39:34,592 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2024-07-31T02:39:34,594 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2024-07-31T02:39:34,596 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2024-07-31T02:39:34,599 creating build/lib/colossalai/fx/codegen 2024-07-31T02:39:34,600 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2024-07-31T02:39:34,603 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2024-07-31T02:39:34,605 creating build/lib/colossalai/fx/passes 2024-07-31T02:39:34,606 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2024-07-31T02:39:34,609 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2024-07-31T02:39:34,611 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2024-07-31T02:39:34,613 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2024-07-31T02:39:34,616 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2024-07-31T02:39:34,618 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2024-07-31T02:39:34,620 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2024-07-31T02:39:34,623 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2024-07-31T02:39:34,625 creating build/lib/colossalai/fx/profiler/experimental 2024-07-31T02:39:34,626 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2024-07-31T02:39:34,628 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2024-07-31T02:39:34,630 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2024-07-31T02:39:34,632 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2024-07-31T02:39:34,634 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2024-07-31T02:39:34,637 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:34,638 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:34,640 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:34,642 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:34,644 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:34,646 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:34,648 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:34,650 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:34,652 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:34,654 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:34,656 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:34,658 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:34,660 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:34,662 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:34,664 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:34,666 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:34,668 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:34,670 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:34,672 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:34,674 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:34,675 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:34,677 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:34,680 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2024-07-31T02:39:34,681 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2024-07-31T02:39:34,683 creating build/lib/colossalai/fx/tracer/meta_patch 2024-07-31T02:39:34,684 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2024-07-31T02:39:34,686 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-31T02:39:34,688 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-31T02:39:34,690 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-31T02:39:34,692 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-31T02:39:34,694 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-31T02:39:34,696 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-31T02:39:34,697 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-31T02:39:34,700 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-31T02:39:34,702 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-31T02:39:34,703 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-31T02:39:34,705 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-31T02:39:34,708 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:34,709 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:34,711 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:34,714 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:34,716 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:34,718 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:34,721 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:34,723 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:34,725 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:34,727 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:34,728 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:34,731 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:34,733 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:34,735 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:34,737 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:34,738 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:34,740 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:34,742 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:34,745 creating build/lib/colossalai/tensor/moe_tensor 2024-07-31T02:39:34,746 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2024-07-31T02:39:34,748 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2024-07-31T02:39:34,750 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2024-07-31T02:39:34,752 creating build/lib/colossalai/tensor/padded_tensor 2024-07-31T02:39:34,753 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2024-07-31T02:39:34,755 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2024-07-31T02:39:34,758 creating build/lib/colossalai/tensor/d_tensor 2024-07-31T02:39:34,759 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-07-31T02:39:34,761 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2024-07-31T02:39:34,763 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2024-07-31T02:39:34,765 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2024-07-31T02:39:34,768 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-07-31T02:39:34,770 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2024-07-31T02:39:34,772 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2024-07-31T02:39:34,775 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2024-07-31T02:39:34,777 creating build/lib/colossalai/booster/mixed_precision 2024-07-31T02:39:34,779 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2024-07-31T02:39:34,780 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2024-07-31T02:39:34,783 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2024-07-31T02:39:34,785 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2024-07-31T02:39:34,787 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2024-07-31T02:39:34,788 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2024-07-31T02:39:34,790 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2024-07-31T02:39:34,793 creating build/lib/colossalai/booster/plugin 2024-07-31T02:39:34,794 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2024-07-31T02:39:34,796 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-07-31T02:39:34,798 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2024-07-31T02:39:34,800 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-07-31T02:39:34,803 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2024-07-31T02:39:34,806 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2024-07-31T02:39:34,809 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-07-31T02:39:34,812 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2024-07-31T02:39:34,814 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2024-07-31T02:39:34,817 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-07-31T02:39:34,819 creating build/lib/colossalai/nn/lr_scheduler 2024-07-31T02:39:34,820 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-31T02:39:34,823 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-31T02:39:34,825 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-31T02:39:34,827 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-31T02:39:34,829 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-31T02:39:34,832 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-31T02:39:34,835 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-31T02:39:34,837 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2024-07-31T02:39:34,840 creating build/lib/colossalai/nn/layer 2024-07-31T02:39:34,841 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2024-07-31T02:39:34,843 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2024-07-31T02:39:34,845 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2024-07-31T02:39:34,847 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2024-07-31T02:39:34,850 creating build/lib/colossalai/nn/loss 2024-07-31T02:39:34,851 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2024-07-31T02:39:34,854 creating build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,855 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,858 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,860 copying colossalai/nn/optimizer/distributed_came.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,863 copying colossalai/nn/optimizer/distributed_adafactor.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,865 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,868 copying colossalai/nn/optimizer/galore.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,870 copying colossalai/nn/optimizer/distributed_lamb.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,873 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,875 copying colossalai/nn/optimizer/came.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,877 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,879 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,882 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,884 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,886 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,888 copying colossalai/nn/optimizer/distributed_galore.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,891 copying colossalai/nn/optimizer/adafactor.py -> build/lib/colossalai/nn/optimizer 2024-07-31T02:39:34,894 creating build/lib/colossalai/amp/naive_amp 2024-07-31T02:39:34,895 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2024-07-31T02:39:34,897 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2024-07-31T02:39:34,899 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-31T02:39:34,901 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-31T02:39:34,903 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-31T02:39:34,905 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-31T02:39:34,907 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-31T02:39:34,909 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2024-07-31T02:39:34,910 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-07-31T02:39:34,912 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-07-31T02:39:34,914 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-07-31T02:39:34,916 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-07-31T02:39:34,918 creating build/lib/colossalai/kernel/extensions 2024-07-31T02:39:34,919 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2024-07-31T02:39:34,921 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2024-07-31T02:39:34,923 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2024-07-31T02:39:34,925 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2024-07-31T02:39:34,927 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2024-07-31T02:39:34,929 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2024-07-31T02:39:34,931 creating build/lib/colossalai/kernel/jit 2024-07-31T02:39:34,932 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2024-07-31T02:39:34,933 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2024-07-31T02:39:34,935 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2024-07-31T02:39:34,937 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2024-07-31T02:39:34,939 creating build/lib/colossalai/kernel/triton 2024-07-31T02:39:34,940 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2024-07-31T02:39:34,942 copying colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-07-31T02:39:34,946 copying colossalai/kernel/triton/rms_layernorm.py -> build/lib/colossalai/kernel/triton 2024-07-31T02:39:34,949 copying colossalai/kernel/triton/context_attn_unpad.py -> build/lib/colossalai/kernel/triton 2024-07-31T02:39:34,951 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2024-07-31T02:39:34,954 copying colossalai/kernel/triton/fused_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-07-31T02:39:34,956 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2024-07-31T02:39:34,958 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2024-07-31T02:39:34,960 copying colossalai/kernel/triton/rotary_cache_copy.py -> build/lib/colossalai/kernel/triton 2024-07-31T02:39:34,962 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2024-07-31T02:39:34,963 copying colossalai/kernel/triton/kvcache_copy.py -> build/lib/colossalai/kernel/triton 2024-07-31T02:39:34,966 creating build/lib/colossalai/kernel/extensions/pybind 2024-07-31T02:39:34,967 copying colossalai/kernel/extensions/pybind/__init__.py -> build/lib/colossalai/kernel/extensions/pybind 2024-07-31T02:39:34,969 creating build/lib/colossalai/kernel/extensions/csrc 2024-07-31T02:39:34,970 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2024-07-31T02:39:34,972 creating build/lib/colossalai/kernel/extensions/pybind/moe 2024-07-31T02:39:34,973 copying colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-07-31T02:39:34,975 copying colossalai/kernel/extensions/pybind/moe/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-07-31T02:39:34,977 creating build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-07-31T02:39:34,978 copying colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-07-31T02:39:34,980 copying colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-07-31T02:39:34,982 creating build/lib/colossalai/kernel/extensions/pybind/softmax 2024-07-31T02:39:34,983 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-07-31T02:39:34,985 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-07-31T02:39:34,986 copying colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-07-31T02:39:34,988 creating build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-31T02:39:34,989 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-31T02:39:34,991 copying colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-31T02:39:34,993 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-31T02:39:34,995 creating build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-07-31T02:39:34,996 copying colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-07-31T02:39:34,998 copying colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-07-31T02:39:35,000 creating build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-07-31T02:39:35,001 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-07-31T02:39:35,003 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-07-31T02:39:35,005 copying colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-07-31T02:39:35,006 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-07-31T02:39:35,009 creating build/lib/colossalai/kernel/extensions/pybind/inference 2024-07-31T02:39:35,010 copying colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-07-31T02:39:35,012 copying colossalai/kernel/extensions/pybind/inference/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-07-31T02:39:35,014 creating build/lib/colossalai/legacy/communication 2024-07-31T02:39:35,015 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2024-07-31T02:39:35,018 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2024-07-31T02:39:35,020 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2024-07-31T02:39:35,023 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2024-07-31T02:39:35,025 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2024-07-31T02:39:35,028 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2024-07-31T02:39:35,032 creating build/lib/colossalai/legacy/tensor 2024-07-31T02:39:35,033 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2024-07-31T02:39:35,036 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2024-07-31T02:39:35,038 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2024-07-31T02:39:35,040 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2024-07-31T02:39:35,042 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2024-07-31T02:39:35,044 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2024-07-31T02:39:35,046 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2024-07-31T02:39:35,049 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2024-07-31T02:39:35,051 creating build/lib/colossalai/legacy/nn 2024-07-31T02:39:35,052 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2024-07-31T02:39:35,055 creating build/lib/colossalai/legacy/amp 2024-07-31T02:39:35,056 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2024-07-31T02:39:35,058 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2024-07-31T02:39:35,061 creating build/lib/colossalai/legacy/context 2024-07-31T02:39:35,062 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2024-07-31T02:39:35,064 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2024-07-31T02:39:35,066 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2024-07-31T02:39:35,068 creating build/lib/colossalai/legacy/utils 2024-07-31T02:39:35,069 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2024-07-31T02:39:35,071 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2024-07-31T02:39:35,074 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2024-07-31T02:39:35,076 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2024-07-31T02:39:35,077 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2024-07-31T02:39:35,080 creating build/lib/colossalai/legacy/registry 2024-07-31T02:39:35,081 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2024-07-31T02:39:35,083 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2024-07-31T02:39:35,085 creating build/lib/colossalai/legacy/builder 2024-07-31T02:39:35,086 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2024-07-31T02:39:35,087 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2024-07-31T02:39:35,090 creating build/lib/colossalai/legacy/pipeline 2024-07-31T02:39:35,091 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2024-07-31T02:39:35,093 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2024-07-31T02:39:35,095 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2024-07-31T02:39:35,097 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2024-07-31T02:39:35,099 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2024-07-31T02:39:35,101 creating build/lib/colossalai/legacy/trainer 2024-07-31T02:39:35,102 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2024-07-31T02:39:35,105 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2024-07-31T02:39:35,107 creating build/lib/colossalai/legacy/engine 2024-07-31T02:39:35,108 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2024-07-31T02:39:35,110 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2024-07-31T02:39:35,112 creating build/lib/colossalai/legacy/inference 2024-07-31T02:39:35,113 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2024-07-31T02:39:35,116 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2024-07-31T02:39:35,118 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2024-07-31T02:39:35,121 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2024-07-31T02:39:35,123 creating build/lib/colossalai/legacy/zero 2024-07-31T02:39:35,124 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2024-07-31T02:39:35,128 creating build/lib/colossalai/legacy/nn/layer 2024-07-31T02:39:35,129 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2024-07-31T02:39:35,131 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2024-07-31T02:39:35,134 creating build/lib/colossalai/legacy/nn/loss 2024-07-31T02:39:35,135 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2024-07-31T02:39:35,138 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2024-07-31T02:39:35,141 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2024-07-31T02:39:35,143 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2024-07-31T02:39:35,145 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2024-07-31T02:39:35,148 creating build/lib/colossalai/legacy/nn/_ops 2024-07-31T02:39:35,149 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2024-07-31T02:39:35,152 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2024-07-31T02:39:35,155 creating build/lib/colossalai/legacy/nn/metric 2024-07-31T02:39:35,156 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2024-07-31T02:39:35,158 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2024-07-31T02:39:35,160 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2024-07-31T02:39:35,162 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2024-07-31T02:39:35,165 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2024-07-31T02:39:35,168 creating build/lib/colossalai/legacy/nn/parallel 2024-07-31T02:39:35,170 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2024-07-31T02:39:35,173 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2024-07-31T02:39:35,175 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2024-07-31T02:39:35,178 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-07-31T02:39:35,179 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-07-31T02:39:35,184 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-07-31T02:39:35,186 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-07-31T02:39:35,188 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-07-31T02:39:35,192 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:35,193 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:35,196 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:35,199 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:35,201 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:35,203 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:35,205 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:35,208 creating build/lib/colossalai/legacy/nn/layer/utils 2024-07-31T02:39:35,210 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-07-31T02:39:35,212 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-07-31T02:39:35,216 creating build/lib/colossalai/legacy/nn/layer/vanilla 2024-07-31T02:39:35,217 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-07-31T02:39:35,220 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-07-31T02:39:35,222 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-31T02:39:35,223 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-31T02:39:35,227 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-31T02:39:35,229 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-31T02:39:35,230 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-31T02:39:35,234 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-07-31T02:39:35,234 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-07-31T02:39:35,237 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-07-31T02:39:35,239 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-07-31T02:39:35,241 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-07-31T02:39:35,243 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-07-31T02:39:35,244 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-07-31T02:39:35,246 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-07-31T02:39:35,248 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-07-31T02:39:35,250 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-07-31T02:39:35,252 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-07-31T02:39:35,253 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-07-31T02:39:35,256 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-07-31T02:39:35,258 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-07-31T02:39:35,260 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-07-31T02:39:35,263 creating build/lib/colossalai/legacy/nn/layer/wrapper 2024-07-31T02:39:35,264 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-07-31T02:39:35,266 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-07-31T02:39:35,268 creating build/lib/colossalai/legacy/nn/parallel/layers 2024-07-31T02:39:35,269 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-07-31T02:39:35,272 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-07-31T02:39:35,273 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-07-31T02:39:35,275 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-07-31T02:39:35,277 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-07-31T02:39:35,280 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:35,281 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:35,283 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:35,285 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:35,288 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:35,290 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:35,292 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:35,294 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:35,296 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:35,298 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:35,300 creating build/lib/colossalai/legacy/amp/naive_amp 2024-07-31T02:39:35,301 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-07-31T02:39:35,303 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-07-31T02:39:35,305 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-07-31T02:39:35,307 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-07-31T02:39:35,309 creating build/lib/colossalai/legacy/amp/apex_amp 2024-07-31T02:39:35,310 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-07-31T02:39:35,312 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-07-31T02:39:35,314 creating build/lib/colossalai/legacy/amp/torch_amp 2024-07-31T02:39:35,315 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-07-31T02:39:35,317 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-07-31T02:39:35,319 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-07-31T02:39:35,322 creating build/lib/colossalai/legacy/context/random 2024-07-31T02:39:35,322 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2024-07-31T02:39:35,325 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2024-07-31T02:39:35,326 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2024-07-31T02:39:35,329 creating build/lib/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:35,330 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:35,332 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:35,334 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:35,336 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:35,338 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:35,340 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:35,342 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:35,344 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:35,345 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:35,347 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:35,349 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:35,351 creating build/lib/colossalai/legacy/utils/profiler 2024-07-31T02:39:35,352 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-07-31T02:39:35,354 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-07-31T02:39:35,356 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2024-07-31T02:39:35,358 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2024-07-31T02:39:35,360 creating build/lib/colossalai/legacy/utils/checkpoint 2024-07-31T02:39:35,361 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-07-31T02:39:35,364 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-07-31T02:39:35,365 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-07-31T02:39:35,367 creating build/lib/colossalai/legacy/utils/data_sampler 2024-07-31T02:39:35,369 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-07-31T02:39:35,371 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-07-31T02:39:35,373 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-07-31T02:39:35,375 creating build/lib/colossalai/legacy/utils/profiler/legacy 2024-07-31T02:39:35,376 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-07-31T02:39:35,378 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-07-31T02:39:35,380 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-07-31T02:39:35,382 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-07-31T02:39:35,385 creating build/lib/colossalai/legacy/pipeline/rpc 2024-07-31T02:39:35,386 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-07-31T02:39:35,388 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-07-31T02:39:35,391 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-07-31T02:39:35,394 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-07-31T02:39:35,396 creating build/lib/colossalai/legacy/pipeline/middleware 2024-07-31T02:39:35,397 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-07-31T02:39:35,400 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-07-31T02:39:35,402 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-07-31T02:39:35,403 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-07-31T02:39:35,406 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-07-31T02:39:35,408 creating build/lib/colossalai/legacy/trainer/hooks 2024-07-31T02:39:35,409 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-31T02:39:35,412 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-31T02:39:35,413 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-31T02:39:35,415 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-31T02:39:35,417 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-31T02:39:35,420 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-31T02:39:35,421 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2024-07-31T02:39:35,423 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2024-07-31T02:39:35,425 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-07-31T02:39:35,427 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-07-31T02:39:35,429 creating build/lib/colossalai/legacy/engine/schedule 2024-07-31T02:39:35,430 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-07-31T02:39:35,433 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-07-31T02:39:35,436 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2024-07-31T02:39:35,438 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2024-07-31T02:39:35,440 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-07-31T02:39:35,443 creating build/lib/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:35,444 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:35,446 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:35,449 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:35,450 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:35,453 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:35,455 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:35,456 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:35,459 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:35,462 creating build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:35,463 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:35,465 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:35,467 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:35,469 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:35,471 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:35,473 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:35,476 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:35,478 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:35,480 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:35,482 creating build/lib/colossalai/legacy/inference/pipeline 2024-07-31T02:39:35,483 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2024-07-31T02:39:35,485 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2024-07-31T02:39:35,488 creating build/lib/colossalai/legacy/inference/tensor_parallel 2024-07-31T02:39:35,489 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-07-31T02:39:35,493 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-07-31T02:39:35,495 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-07-31T02:39:35,498 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-07-31T02:39:35,500 creating build/lib/colossalai/legacy/inference/hybridengine 2024-07-31T02:39:35,501 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-07-31T02:39:35,504 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-07-31T02:39:35,506 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-07-31T02:39:35,508 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-07-31T02:39:35,510 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-07-31T02:39:35,513 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-07-31T02:39:35,515 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-07-31T02:39:35,518 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-31T02:39:35,520 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-31T02:39:35,523 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-31T02:39:35,526 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-31T02:39:35,529 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-31T02:39:35,531 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-31T02:39:35,533 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2024-07-31T02:39:35,535 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-07-31T02:39:35,537 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-07-31T02:39:35,540 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-07-31T02:39:35,541 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-07-31T02:39:35,544 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-07-31T02:39:35,546 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-07-31T02:39:35,549 creating build/lib/colossalai/legacy/zero/sharded_param 2024-07-31T02:39:35,551 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-07-31T02:39:35,553 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-07-31T02:39:35,555 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-07-31T02:39:35,558 creating build/lib/colossalai/legacy/zero/shard_utils 2024-07-31T02:39:35,559 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-07-31T02:39:35,561 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-07-31T02:39:35,564 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-07-31T02:39:35,566 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-07-31T02:39:35,568 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-07-31T02:39:35,571 creating build/lib/colossalai/legacy/zero/init_ctx 2024-07-31T02:39:35,572 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-07-31T02:39:35,575 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-07-31T02:39:35,578 creating build/lib/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:35,579 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:35,581 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:35,584 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:35,586 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:35,590 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:35,592 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:35,594 creating build/lib/colossalai/legacy/zero/sharded_optim 2024-07-31T02:39:35,596 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-07-31T02:39:35,599 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-07-31T02:39:35,602 creating build/lib/colossalai/legacy/zero/gemini 2024-07-31T02:39:35,603 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-31T02:39:35,605 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-31T02:39:35,608 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-31T02:39:35,610 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-31T02:39:35,612 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-31T02:39:35,614 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-31T02:39:35,615 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2024-07-31T02:39:35,618 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2024-07-31T02:39:35,619 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-07-31T02:39:35,622 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-07-31T02:39:35,624 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-07-31T02:39:35,626 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-07-31T02:39:35,628 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-07-31T02:39:35,630 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-07-31T02:39:35,631 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-07-31T02:39:35,633 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-07-31T02:39:35,636 creating build/lib/colossalai/utils/tensor_detector 2024-07-31T02:39:35,637 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2024-07-31T02:39:35,639 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2024-07-31T02:39:35,641 creating build/lib/colossalai/utils/multi_tensor_apply 2024-07-31T02:39:35,642 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-07-31T02:39:35,644 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-07-31T02:39:35,647 creating build/lib/colossalai/utils/rank_recorder 2024-07-31T02:39:35,648 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2024-07-31T02:39:35,650 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2024-07-31T02:39:35,653 creating build/lib/colossalai/utils/model 2024-07-31T02:39:35,654 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2024-07-31T02:39:35,656 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2024-07-31T02:39:35,658 creating build/lib/colossalai/cli/launcher 2024-07-31T02:39:35,659 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2024-07-31T02:39:35,662 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2024-07-31T02:39:35,664 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2024-07-31T02:39:35,666 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2024-07-31T02:39:35,669 creating build/lib/colossalai/cli/check 2024-07-31T02:39:35,670 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2024-07-31T02:39:35,672 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2024-07-31T02:39:35,675 creating build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,676 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,679 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,681 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,684 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,687 copying colossalai/shardformer/policies/command.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,689 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,692 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,694 copying colossalai/shardformer/policies/deepseek.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,696 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,699 copying colossalai/shardformer/policies/qwen2.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,701 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,704 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,706 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,709 copying colossalai/shardformer/policies/mixtral.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,711 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,714 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,716 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,719 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,721 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,724 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,726 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2024-07-31T02:39:35,729 creating build/lib/colossalai/shardformer/shard 2024-07-31T02:39:35,730 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2024-07-31T02:39:35,732 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2024-07-31T02:39:35,735 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2024-07-31T02:39:35,737 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2024-07-31T02:39:35,740 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2024-07-31T02:39:35,742 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2024-07-31T02:39:35,744 creating build/lib/colossalai/shardformer/layer 2024-07-31T02:39:35,746 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2024-07-31T02:39:35,749 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2024-07-31T02:39:35,752 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2024-07-31T02:39:35,754 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2024-07-31T02:39:35,757 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2024-07-31T02:39:35,760 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2024-07-31T02:39:35,763 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2024-07-31T02:39:35,765 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2024-07-31T02:39:35,767 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2024-07-31T02:39:35,770 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2024-07-31T02:39:35,777 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2024-07-31T02:39:35,781 creating build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,783 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,786 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,788 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,792 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,795 copying colossalai/shardformer/modeling/command.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,798 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,801 copying colossalai/shardformer/modeling/deepseek.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,804 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,806 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,810 copying colossalai/shardformer/modeling/qwen2.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,813 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,816 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,819 copying colossalai/shardformer/modeling/mixtral.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,822 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,825 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,827 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,831 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,834 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,837 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,839 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2024-07-31T02:39:35,843 creating build/lib/colossalai/shardformer/layer/moe 2024-07-31T02:39:35,844 copying colossalai/shardformer/layer/moe/layers.py -> build/lib/colossalai/shardformer/layer/moe 2024-07-31T02:39:35,847 copying colossalai/shardformer/layer/moe/routers.py -> build/lib/colossalai/shardformer/layer/moe 2024-07-31T02:39:35,850 copying colossalai/shardformer/layer/moe/experts.py -> build/lib/colossalai/shardformer/layer/moe 2024-07-31T02:39:35,852 copying colossalai/shardformer/layer/moe/__init__.py -> build/lib/colossalai/shardformer/layer/moe 2024-07-31T02:39:35,855 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-07-31T02:39:35,856 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-07-31T02:39:35,860 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-07-31T02:39:35,863 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-07-31T02:39:35,865 creating build/lib/colossalai/pipeline/schedule 2024-07-31T02:39:35,866 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2024-07-31T02:39:35,869 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2024-07-31T02:39:35,872 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2024-07-31T02:39:35,876 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2024-07-31T02:39:35,878 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2024-07-31T02:39:35,880 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2024-07-31T02:39:35,883 creating build/lib/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:35,884 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:35,887 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:35,890 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:35,892 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:35,895 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:35,896 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:35,899 creating build/lib/colossalai/auto_parallel/passes 2024-07-31T02:39:35,900 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-07-31T02:39:35,903 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-07-31T02:39:35,906 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2024-07-31T02:39:35,908 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2024-07-31T02:39:35,910 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-07-31T02:39:35,912 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2024-07-31T02:39:35,915 creating build/lib/colossalai/auto_parallel/tensor_shard 2024-07-31T02:39:35,916 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-07-31T02:39:35,918 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-07-31T02:39:35,921 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-07-31T02:39:35,923 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-07-31T02:39:35,924 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-07-31T02:39:35,927 creating build/lib/colossalai/auto_parallel/pipeline_shard 2024-07-31T02:39:35,929 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2024-07-31T02:39:35,932 creating build/lib/colossalai/auto_parallel/meta_profiler 2024-07-31T02:39:35,933 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-07-31T02:39:35,936 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-07-31T02:39:35,939 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-07-31T02:39:35,942 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-07-31T02:39:35,946 creating build/lib/colossalai/auto_parallel/offload 2024-07-31T02:39:35,947 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2024-07-31T02:39:35,950 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2024-07-31T02:39:35,952 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2024-07-31T02:39:35,956 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2024-07-31T02:39:35,960 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2024-07-31T02:39:35,963 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2024-07-31T02:39:35,966 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2024-07-31T02:39:35,968 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2024-07-31T02:39:35,972 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2024-07-31T02:39:35,974 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2024-07-31T02:39:35,977 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:35,979 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:35,982 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:35,985 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:35,988 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:35,992 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:35,994 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:35,998 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-07-31T02:39:35,999 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-07-31T02:39:36,002 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-07-31T02:39:36,005 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-07-31T02:39:36,009 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-07-31T02:39:36,012 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-07-31T02:39:36,016 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,018 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,020 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,024 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,026 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,029 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,030 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,033 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,035 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,037 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,039 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,041 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,043 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,045 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,047 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,049 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,051 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,053 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,055 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,057 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,059 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,061 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,063 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,065 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,067 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,069 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,071 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,072 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:36,075 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,076 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,079 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,081 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,084 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,085 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,088 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,089 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,092 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,094 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,096 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,098 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,101 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,103 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,105 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,108 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,110 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,112 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,115 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,117 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:36,120 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:36,122 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:36,124 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:36,126 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:36,128 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:36,130 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:36,132 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:36,134 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:36,136 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:36,138 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:36,141 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:36,143 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:36,145 creating build/lib/colossalai/inference/spec 2024-07-31T02:39:36,146 copying colossalai/inference/spec/drafter.py -> build/lib/colossalai/inference/spec 2024-07-31T02:39:36,149 copying colossalai/inference/spec/struct.py -> build/lib/colossalai/inference/spec 2024-07-31T02:39:36,150 copying colossalai/inference/spec/__init__.py -> build/lib/colossalai/inference/spec 2024-07-31T02:39:36,152 creating build/lib/colossalai/inference/kv_cache 2024-07-31T02:39:36,153 copying colossalai/inference/kv_cache/block_cache.py -> build/lib/colossalai/inference/kv_cache 2024-07-31T02:39:36,156 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2024-07-31T02:39:36,158 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2024-07-31T02:39:36,161 creating build/lib/colossalai/inference/executor 2024-07-31T02:39:36,162 copying colossalai/inference/executor/rpc_worker.py -> build/lib/colossalai/inference/executor 2024-07-31T02:39:36,164 copying colossalai/inference/executor/__init__.py -> build/lib/colossalai/inference/executor 2024-07-31T02:39:36,166 creating build/lib/colossalai/inference/core 2024-07-31T02:39:36,167 copying colossalai/inference/core/llm_engine.py -> build/lib/colossalai/inference/core 2024-07-31T02:39:36,171 copying colossalai/inference/core/engine.py -> build/lib/colossalai/inference/core 2024-07-31T02:39:36,173 copying colossalai/inference/core/plugin.py -> build/lib/colossalai/inference/core 2024-07-31T02:39:36,176 copying colossalai/inference/core/base_engine.py -> build/lib/colossalai/inference/core 2024-07-31T02:39:36,177 copying colossalai/inference/core/rpc_engine.py -> build/lib/colossalai/inference/core 2024-07-31T02:39:36,180 copying colossalai/inference/core/async_engine.py -> build/lib/colossalai/inference/core 2024-07-31T02:39:36,182 copying colossalai/inference/core/__init__.py -> build/lib/colossalai/inference/core 2024-07-31T02:39:36,184 copying colossalai/inference/core/diffusion_engine.py -> build/lib/colossalai/inference/core 2024-07-31T02:39:36,186 copying colossalai/inference/core/request_handler.py -> build/lib/colossalai/inference/core 2024-07-31T02:39:36,190 creating build/lib/colossalai/inference/server 2024-07-31T02:39:36,191 copying colossalai/inference/server/utils.py -> build/lib/colossalai/inference/server 2024-07-31T02:39:36,193 copying colossalai/inference/server/api_server.py -> build/lib/colossalai/inference/server 2024-07-31T02:39:36,195 copying colossalai/inference/server/completion_service.py -> build/lib/colossalai/inference/server 2024-07-31T02:39:36,197 copying colossalai/inference/server/chat_service.py -> build/lib/colossalai/inference/server 2024-07-31T02:39:36,199 copying colossalai/inference/server/__init__.py -> build/lib/colossalai/inference/server 2024-07-31T02:39:36,201 creating build/lib/colossalai/inference/modeling 2024-07-31T02:39:36,202 copying colossalai/inference/modeling/__init__.py -> build/lib/colossalai/inference/modeling 2024-07-31T02:39:36,204 creating build/lib/colossalai/inference/modeling/backends 2024-07-31T02:39:36,205 copying colossalai/inference/modeling/backends/pre_attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-07-31T02:39:36,208 copying colossalai/inference/modeling/backends/attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-07-31T02:39:36,210 copying colossalai/inference/modeling/backends/__init__.py -> build/lib/colossalai/inference/modeling/backends 2024-07-31T02:39:36,212 creating build/lib/colossalai/inference/modeling/policy 2024-07-31T02:39:36,213 copying colossalai/inference/modeling/policy/glide_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-07-31T02:39:36,215 copying colossalai/inference/modeling/policy/stablediffusion3.py -> build/lib/colossalai/inference/modeling/policy 2024-07-31T02:39:36,217 copying colossalai/inference/modeling/policy/nopadding_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-07-31T02:39:36,219 copying colossalai/inference/modeling/policy/pixart_alpha.py -> build/lib/colossalai/inference/modeling/policy 2024-07-31T02:39:36,221 copying colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/policy 2024-07-31T02:39:36,223 copying colossalai/inference/modeling/policy/__init__.py -> build/lib/colossalai/inference/modeling/policy 2024-07-31T02:39:36,225 creating build/lib/colossalai/inference/modeling/models 2024-07-31T02:39:36,226 copying colossalai/inference/modeling/models/glide_llama.py -> build/lib/colossalai/inference/modeling/models 2024-07-31T02:39:36,229 copying colossalai/inference/modeling/models/stablediffusion3.py -> build/lib/colossalai/inference/modeling/models 2024-07-31T02:39:36,232 copying colossalai/inference/modeling/models/nopadding_llama.py -> build/lib/colossalai/inference/modeling/models 2024-07-31T02:39:36,235 copying colossalai/inference/modeling/models/pixart_alpha.py -> build/lib/colossalai/inference/modeling/models 2024-07-31T02:39:36,238 copying colossalai/inference/modeling/models/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/models 2024-07-31T02:39:36,240 copying colossalai/inference/modeling/models/__init__.py -> build/lib/colossalai/inference/modeling/models 2024-07-31T02:39:36,242 creating build/lib/colossalai/inference/modeling/layers 2024-07-31T02:39:36,244 copying colossalai/inference/modeling/layers/distrifusion.py -> build/lib/colossalai/inference/modeling/layers 2024-07-31T02:39:36,247 copying colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/lib/colossalai/inference/modeling/layers 2024-07-31T02:39:36,249 copying colossalai/inference/modeling/layers/attention.py -> build/lib/colossalai/inference/modeling/layers 2024-07-31T02:39:36,252 copying colossalai/inference/modeling/layers/__init__.py -> build/lib/colossalai/inference/modeling/layers 2024-07-31T02:39:36,253 copying colossalai/inference/modeling/layers/diffusion.py -> build/lib/colossalai/inference/modeling/layers 2024-07-31T02:39:36,256 creating build/lib/colossalai/zero/low_level 2024-07-31T02:39:36,257 copying colossalai/zero/low_level/zero_hook.py -> build/lib/colossalai/zero/low_level 2024-07-31T02:39:36,259 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2024-07-31T02:39:36,262 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2024-07-31T02:39:36,264 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2024-07-31T02:39:36,267 creating build/lib/colossalai/zero/gemini 2024-07-31T02:39:36,268 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2024-07-31T02:39:36,271 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2024-07-31T02:39:36,273 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2024-07-31T02:39:36,276 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2024-07-31T02:39:36,279 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2024-07-31T02:39:36,281 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2024-07-31T02:39:36,283 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2024-07-31T02:39:36,286 creating build/lib/colossalai/zero/low_level/bookkeeping 2024-07-31T02:39:36,287 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-07-31T02:39:36,290 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-07-31T02:39:36,292 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-07-31T02:39:36,293 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-07-31T02:39:36,295 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-07-31T02:39:36,297 creating build/lib/colossalai/zero/gemini/chunk 2024-07-31T02:39:36,298 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-07-31T02:39:36,300 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2024-07-31T02:39:36,302 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-07-31T02:39:36,305 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2024-07-31T02:39:36,307 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2024-07-31T02:39:36,310 creating build/lib/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:36,311 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:36,313 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:36,315 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:36,317 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:36,319 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:36,321 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:36,323 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:36,325 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:36,327 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:36,410 creating build/lib/colossalai/kernel/extensions/csrc/kernel 2024-07-31T02:39:36,411 creating build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-07-31T02:39:36,412 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-07-31T02:39:36,415 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-07-31T02:39:36,417 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,418 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,421 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,424 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,426 copying colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,429 copying colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,432 copying colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,435 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,438 copying colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,440 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,442 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,445 copying colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,447 copying colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,450 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,453 copying colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,456 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,459 copying colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,461 copying colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,464 copying colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:36,466 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-31T02:39:36,468 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-31T02:39:36,470 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-31T02:39:36,472 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-31T02:39:36,474 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-31T02:39:36,476 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-07-31T02:39:36,477 copying colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-07-31T02:39:36,480 creating build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-07-31T02:39:36,481 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-07-31T02:39:36,484 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-07-31T02:39:36,486 creating build/lib/colossalai/kernel/extensions/csrc/common 2024-07-31T02:39:36,487 copying colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-07-31T02:39:36,489 copying colossalai/kernel/extensions/csrc/common/data_type.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-07-31T02:39:36,491 copying colossalai/kernel/extensions/csrc/common/target.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-07-31T02:39:36,493 copying colossalai/kernel/extensions/csrc/common/micros.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-07-31T02:39:36,496 copying colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-07-31T02:39:36,498 creating build/lib/colossalai/kernel/extensions/csrc/funcs 2024-07-31T02:39:36,499 copying colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-07-31T02:39:36,501 copying colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-07-31T02:39:36,504 copying colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-07-31T02:39:36,506 copying colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-07-31T02:39:36,510 copying colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-07-31T02:39:36,513 copying colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-07-31T02:39:36,517 copying colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-07-31T02:39:36,520 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-07-31T02:39:36,522 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-07-31T02:39:36,526 copying colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-07-31T02:39:36,530 copying colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-07-31T02:39:36,639 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-07-31T02:39:36,640 !! 2024-07-31T02:39:36,641 ******************************************************************************** 2024-07-31T02:39:36,641 Please avoid running ``setup.py`` directly. 2024-07-31T02:39:36,642 Instead, use pypa/build, pypa/installer or other 2024-07-31T02:39:36,643 standards-based tools. 2024-07-31T02:39:36,644 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-07-31T02:39:36,644 ******************************************************************************** 2024-07-31T02:39:36,645 !! 2024-07-31T02:39:36,646 self.initialize_options() 2024-07-31T02:39:36,670 installing to build/bdist.linux-armv7l/wheel 2024-07-31T02:39:36,670 running install 2024-07-31T02:39:36,696 running install_lib 2024-07-31T02:39:36,724 creating build/bdist.linux-armv7l 2024-07-31T02:39:36,724 creating build/bdist.linux-armv7l/wheel 2024-07-31T02:39:36,726 creating build/bdist.linux-armv7l/wheel/extensions 2024-07-31T02:39:36,727 creating build/bdist.linux-armv7l/wheel/extensions/pybind 2024-07-31T02:39:36,729 creating build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-07-31T02:39:36,730 copying build/lib/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-07-31T02:39:36,732 copying build/lib/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-07-31T02:39:36,734 creating build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-07-31T02:39:36,735 copying build/lib/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-07-31T02:39:36,737 copying build/lib/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-07-31T02:39:36,739 creating build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-07-31T02:39:36,740 copying build/lib/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-07-31T02:39:36,742 copying build/lib/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-07-31T02:39:36,744 copying build/lib/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-07-31T02:39:36,746 creating build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-07-31T02:39:36,747 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-07-31T02:39:36,748 copying build/lib/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-07-31T02:39:36,750 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-07-31T02:39:36,752 creating build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-07-31T02:39:36,753 copying build/lib/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-07-31T02:39:36,755 copying build/lib/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-07-31T02:39:36,757 creating build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-07-31T02:39:36,758 copying build/lib/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-07-31T02:39:36,760 copying build/lib/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-07-31T02:39:36,762 copying build/lib/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-07-31T02:39:36,764 copying build/lib/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-07-31T02:39:36,766 creating build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-07-31T02:39:36,767 copying build/lib/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-07-31T02:39:36,769 copying build/lib/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-07-31T02:39:36,771 copying build/lib/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind 2024-07-31T02:39:36,773 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2024-07-31T02:39:36,774 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/csrc 2024-07-31T02:39:36,776 creating build/bdist.linux-armv7l/wheel/colossalai 2024-07-31T02:39:36,777 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-07-31T02:39:36,779 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-07-31T02:39:36,781 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:36,782 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:36,784 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:36,786 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:36,788 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:36,790 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:36,792 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-07-31T02:39:36,794 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-07-31T02:39:36,796 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-07-31T02:39:36,798 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-07-31T02:39:36,799 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-07-31T02:39:36,801 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-07-31T02:39:36,804 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-07-31T02:39:36,806 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-07-31T02:39:36,807 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-07-31T02:39:36,810 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-07-31T02:39:36,812 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-07-31T02:39:36,814 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-07-31T02:39:36,815 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-07-31T02:39:36,816 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-07-31T02:39:36,819 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-07-31T02:39:36,820 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-07-31T02:39:36,823 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-07-31T02:39:36,825 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-07-31T02:39:36,827 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-07-31T02:39:36,828 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-07-31T02:39:36,831 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-07-31T02:39:36,833 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-07-31T02:39:36,836 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-07-31T02:39:36,838 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-07-31T02:39:36,840 creating build/bdist.linux-armv7l/wheel/colossalai/device 2024-07-31T02:39:36,841 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-07-31T02:39:36,844 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-07-31T02:39:36,846 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-07-31T02:39:36,849 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-07-31T02:39:36,851 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-31T02:39:36,852 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-31T02:39:36,853 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-31T02:39:36,856 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-07-31T02:39:36,857 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-07-31T02:39:36,859 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-07-31T02:39:36,862 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:36,863 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:36,865 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:36,867 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:36,869 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:36,871 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:36,873 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:36,875 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:36,877 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:36,879 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:36,881 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:36,883 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-07-31T02:39:36,886 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:36,887 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:36,889 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:36,891 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:36,893 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:36,894 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:36,896 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:36,898 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:36,900 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:36,901 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-07-31T02:39:36,903 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-07-31T02:39:36,905 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-07-31T02:39:36,907 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-07-31T02:39:36,909 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-31T02:39:36,911 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-31T02:39:36,913 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-31T02:39:36,916 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-31T02:39:36,918 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-31T02:39:36,920 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-31T02:39:36,922 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-07-31T02:39:36,925 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-31T02:39:36,926 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-31T02:39:36,928 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-31T02:39:36,931 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-31T02:39:36,934 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-31T02:39:36,936 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-07-31T02:39:36,938 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-31T02:39:36,939 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-31T02:39:36,941 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-31T02:39:36,943 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-31T02:39:36,945 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-07-31T02:39:36,947 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-31T02:39:36,948 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-31T02:39:36,950 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-31T02:39:36,952 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-31T02:39:36,954 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-31T02:39:36,955 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-07-31T02:39:36,957 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-07-31T02:39:36,959 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-31T02:39:36,961 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-07-31T02:39:36,963 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:36,964 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:36,966 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:36,968 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:36,970 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:36,972 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:36,974 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:36,976 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:36,977 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-07-31T02:39:36,979 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-07-31T02:39:36,981 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:36,982 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:36,984 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:36,987 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:36,988 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:36,990 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:36,992 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:36,993 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:36,995 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-07-31T02:39:36,997 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-31T02:39:36,999 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-07-31T02:39:37,000 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-31T02:39:37,003 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-07-31T02:39:37,004 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-07-31T02:39:37,007 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-07-31T02:39:37,008 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-31T02:39:37,011 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-31T02:39:37,012 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-31T02:39:37,014 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-31T02:39:37,016 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-31T02:39:37,019 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-31T02:39:37,021 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-31T02:39:37,023 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-31T02:39:37,025 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-31T02:39:37,028 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-07-31T02:39:37,030 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-31T02:39:37,031 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-31T02:39:37,033 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-31T02:39:37,035 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-07-31T02:39:37,038 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-31T02:39:37,040 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-07-31T02:39:37,040 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-07-31T02:39:37,042 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-07-31T02:39:37,044 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-07-31T02:39:37,046 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-31T02:39:37,048 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-31T02:39:37,051 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-31T02:39:37,053 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-31T02:39:37,055 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-31T02:39:37,057 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-07-31T02:39:37,058 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-07-31T02:39:37,060 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-07-31T02:39:37,062 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-31T02:39:37,064 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-31T02:39:37,067 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-31T02:39:37,068 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-31T02:39:37,070 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-31T02:39:37,072 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-31T02:39:37,074 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-31T02:39:37,076 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-31T02:39:37,079 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-31T02:39:37,080 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-31T02:39:37,083 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-07-31T02:39:37,085 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-07-31T02:39:37,087 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2024-07-31T02:39:37,088 copying build/lib/colossalai/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-07-31T02:39:37,090 copying build/lib/colossalai/moe/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-07-31T02:39:37,092 copying build/lib/colossalai/moe/load_balance.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-07-31T02:39:37,095 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-07-31T02:39:37,097 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-07-31T02:39:37,100 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2024-07-31T02:39:37,101 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-07-31T02:39:37,103 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-07-31T02:39:37,105 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-07-31T02:39:37,106 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-07-31T02:39:37,108 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-07-31T02:39:37,111 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2024-07-31T02:39:37,112 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-07-31T02:39:37,114 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-07-31T02:39:37,116 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-31T02:39:37,117 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-31T02:39:37,119 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-31T02:39:37,121 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-31T02:39:37,123 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-31T02:39:37,125 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-31T02:39:37,126 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-31T02:39:37,128 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-07-31T02:39:37,130 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-31T02:39:37,132 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-31T02:39:37,133 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-31T02:39:37,135 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-31T02:39:37,138 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-31T02:39:37,140 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-31T02:39:37,143 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-31T02:39:37,146 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-31T02:39:37,149 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-31T02:39:37,151 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-31T02:39:37,153 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-07-31T02:39:37,155 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-07-31T02:39:37,157 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2024-07-31T02:39:37,158 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-31T02:39:37,160 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-31T02:39:37,162 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-31T02:39:37,164 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-31T02:39:37,165 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-31T02:39:37,167 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-31T02:39:37,169 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-31T02:39:37,171 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-31T02:39:37,172 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-07-31T02:39:37,175 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-07-31T02:39:37,176 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-07-31T02:39:37,178 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-07-31T02:39:37,180 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-07-31T02:39:37,181 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-07-31T02:39:37,184 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-07-31T02:39:37,185 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-07-31T02:39:37,187 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-07-31T02:39:37,190 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,191 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,194 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,196 copying build/lib/colossalai/nn/optimizer/distributed_came.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,199 copying build/lib/colossalai/nn/optimizer/distributed_adafactor.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,202 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,204 copying build/lib/colossalai/nn/optimizer/galore.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,207 copying build/lib/colossalai/nn/optimizer/distributed_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,209 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,211 copying build/lib/colossalai/nn/optimizer/came.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,213 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,215 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,217 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,220 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,222 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,224 copying build/lib/colossalai/nn/optimizer/distributed_galore.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,226 copying build/lib/colossalai/nn/optimizer/adafactor.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-07-31T02:39:37,228 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-07-31T02:39:37,230 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2024-07-31T02:39:37,231 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-07-31T02:39:37,233 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-31T02:39:37,234 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-31T02:39:37,236 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-31T02:39:37,237 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-31T02:39:37,239 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-07-31T02:39:37,241 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-07-31T02:39:37,242 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-07-31T02:39:37,244 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-07-31T02:39:37,246 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-07-31T02:39:37,248 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-07-31T02:39:37,250 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-07-31T02:39:37,251 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-07-31T02:39:37,253 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2024-07-31T02:39:37,255 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-07-31T02:39:37,256 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-31T02:39:37,257 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-31T02:39:37,260 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-31T02:39:37,262 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-07-31T02:39:37,264 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-07-31T02:39:37,265 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-07-31T02:39:37,267 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-07-31T02:39:37,269 copying build/lib/colossalai/kernel/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-07-31T02:39:37,271 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-07-31T02:39:37,272 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-07-31T02:39:37,274 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-07-31T02:39:37,276 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-07-31T02:39:37,278 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-07-31T02:39:37,279 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-07-31T02:39:37,281 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-07-31T02:39:37,282 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-07-31T02:39:37,284 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-07-31T02:39:37,286 copying build/lib/colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-07-31T02:39:37,288 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-31T02:39:37,289 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-31T02:39:37,291 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-31T02:39:37,293 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-07-31T02:39:37,295 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-07-31T02:39:37,296 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-07-31T02:39:37,298 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-07-31T02:39:37,300 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-07-31T02:39:37,302 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-07-31T02:39:37,303 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-07-31T02:39:37,305 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-07-31T02:39:37,307 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-07-31T02:39:37,309 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-07-31T02:39:37,311 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-07-31T02:39:37,312 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-07-31T02:39:37,314 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-07-31T02:39:37,316 copying build/lib/colossalai/kernel/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-07-31T02:39:37,318 copying build/lib/colossalai/kernel/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-07-31T02:39:37,320 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-07-31T02:39:37,321 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel 2024-07-31T02:39:37,323 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-07-31T02:39:37,324 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-07-31T02:39:37,326 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-07-31T02:39:37,329 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,329 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,332 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,334 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,336 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,339 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,342 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,345 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,347 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,349 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,351 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-31T02:39:37,352 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-31T02:39:37,354 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-31T02:39:37,356 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-31T02:39:37,358 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-07-31T02:39:37,360 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,363 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,364 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,367 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,369 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,372 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,374 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-07-31T02:39:37,375 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-07-31T02:39:37,377 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,379 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,382 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-07-31T02:39:37,384 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-07-31T02:39:37,385 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-07-31T02:39:37,387 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-07-31T02:39:37,390 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-07-31T02:39:37,392 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-07-31T02:39:37,393 copying build/lib/colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-07-31T02:39:37,394 copying build/lib/colossalai/kernel/extensions/csrc/common/data_type.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-07-31T02:39:37,396 copying build/lib/colossalai/kernel/extensions/csrc/common/target.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-07-31T02:39:37,398 copying build/lib/colossalai/kernel/extensions/csrc/common/micros.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-07-31T02:39:37,400 copying build/lib/colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-07-31T02:39:37,403 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-07-31T02:39:37,404 copying build/lib/colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-07-31T02:39:37,405 copying build/lib/colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-07-31T02:39:37,408 copying build/lib/colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-07-31T02:39:37,409 copying build/lib/colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-07-31T02:39:37,412 copying build/lib/colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-07-31T02:39:37,414 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-31T02:39:37,416 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-31T02:39:37,417 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-31T02:39:37,419 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-07-31T02:39:37,421 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-07-31T02:39:37,422 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-07-31T02:39:37,424 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-07-31T02:39:37,425 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-07-31T02:39:37,427 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-07-31T02:39:37,429 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-31T02:39:37,430 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-31T02:39:37,432 copying build/lib/colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-31T02:39:37,434 copying build/lib/colossalai/kernel/triton/rms_layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-31T02:39:37,437 copying build/lib/colossalai/kernel/triton/context_attn_unpad.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-31T02:39:37,440 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-31T02:39:37,443 copying build/lib/colossalai/kernel/triton/fused_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-31T02:39:37,445 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-31T02:39:37,448 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-31T02:39:37,451 copying build/lib/colossalai/kernel/triton/rotary_cache_copy.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-31T02:39:37,453 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-31T02:39:37,455 copying build/lib/colossalai/kernel/triton/kvcache_copy.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-07-31T02:39:37,458 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-07-31T02:39:37,461 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-07-31T02:39:37,463 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-07-31T02:39:37,464 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-07-31T02:39:37,468 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-07-31T02:39:37,470 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-07-31T02:39:37,473 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-07-31T02:39:37,475 creating build/bdist.linux-armv7l/wheel/colossalai/context 2024-07-31T02:39:37,476 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-07-31T02:39:37,478 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-07-31T02:39:37,480 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-07-31T02:39:37,483 creating build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-07-31T02:39:37,484 copying build/lib/colossalai/quantization/bnb.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-07-31T02:39:37,487 copying build/lib/colossalai/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-07-31T02:39:37,489 copying build/lib/colossalai/quantization/bnb_config.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-07-31T02:39:37,491 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-07-31T02:39:37,493 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-07-31T02:39:37,496 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-31T02:39:37,497 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-31T02:39:37,500 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-31T02:39:37,503 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-31T02:39:37,507 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-31T02:39:37,510 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-31T02:39:37,512 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-31T02:39:37,514 copying build/lib/colossalai/checkpoint_io/moe_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-07-31T02:39:37,519 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-07-31T02:39:37,521 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-31T02:39:37,522 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-31T02:39:37,525 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-31T02:39:37,527 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-31T02:39:37,530 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-31T02:39:37,533 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-31T02:39:37,535 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-07-31T02:39:37,538 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-31T02:39:37,539 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-31T02:39:37,541 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-31T02:39:37,543 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-31T02:39:37,545 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-31T02:39:37,546 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-31T02:39:37,548 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-31T02:39:37,550 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-31T02:39:37,552 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-07-31T02:39:37,555 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-07-31T02:39:37,556 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-07-31T02:39:37,558 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-07-31T02:39:37,559 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-07-31T02:39:37,562 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-07-31T02:39:37,564 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-07-31T02:39:37,565 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-07-31T02:39:37,568 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:37,569 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:37,572 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:37,574 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:37,576 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:37,578 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:37,580 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-07-31T02:39:37,582 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-07-31T02:39:37,583 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-07-31T02:39:37,585 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-07-31T02:39:37,587 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-07-31T02:39:37,588 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-07-31T02:39:37,590 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-07-31T02:39:37,593 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-31T02:39:37,594 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-31T02:39:37,597 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-31T02:39:37,599 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-31T02:39:37,601 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-07-31T02:39:37,604 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-07-31T02:39:37,605 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-07-31T02:39:37,608 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-07-31T02:39:37,610 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-07-31T02:39:37,612 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-07-31T02:39:37,614 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-07-31T02:39:37,615 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-07-31T02:39:37,617 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-07-31T02:39:37,619 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-07-31T02:39:37,620 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-07-31T02:39:37,623 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-07-31T02:39:37,624 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-07-31T02:39:37,627 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-07-31T02:39:37,629 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-07-31T02:39:37,631 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-07-31T02:39:37,634 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-07-31T02:39:37,635 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-07-31T02:39:37,637 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-07-31T02:39:37,639 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-07-31T02:39:37,640 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-07-31T02:39:37,643 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-07-31T02:39:37,643 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-07-31T02:39:37,646 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-07-31T02:39:37,648 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-07-31T02:39:37,650 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-07-31T02:39:37,652 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-07-31T02:39:37,654 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-07-31T02:39:37,655 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-07-31T02:39:37,657 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-07-31T02:39:37,659 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-07-31T02:39:37,660 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-07-31T02:39:37,662 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-07-31T02:39:37,663 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-07-31T02:39:37,665 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-07-31T02:39:37,667 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-07-31T02:39:37,668 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-07-31T02:39:37,670 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-07-31T02:39:37,671 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-07-31T02:39:37,674 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-07-31T02:39:37,676 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-07-31T02:39:37,677 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-07-31T02:39:37,679 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-07-31T02:39:37,681 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:37,682 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:37,685 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:37,686 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:37,689 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:37,691 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:37,693 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:37,695 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:37,697 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:37,699 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-07-31T02:39:37,701 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-07-31T02:39:37,702 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-07-31T02:39:37,704 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-07-31T02:39:37,706 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-07-31T02:39:37,708 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-07-31T02:39:37,709 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-07-31T02:39:37,710 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-07-31T02:39:37,713 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-07-31T02:39:37,715 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-07-31T02:39:37,717 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-07-31T02:39:37,719 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-07-31T02:39:37,720 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-07-31T02:39:37,722 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-07-31T02:39:37,724 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-07-31T02:39:37,725 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-07-31T02:39:37,728 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-07-31T02:39:37,729 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-07-31T02:39:37,731 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-07-31T02:39:37,733 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-07-31T02:39:37,736 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-07-31T02:39:37,737 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-07-31T02:39:37,738 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-07-31T02:39:37,740 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-07-31T02:39:37,742 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-07-31T02:39:37,744 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-07-31T02:39:37,747 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:37,748 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:37,750 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:37,753 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:37,755 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:37,757 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:37,759 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:37,761 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:37,763 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:37,764 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:37,766 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:37,768 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-07-31T02:39:37,770 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-07-31T02:39:37,772 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-07-31T02:39:37,773 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-07-31T02:39:37,776 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-07-31T02:39:37,777 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-07-31T02:39:37,778 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-07-31T02:39:37,780 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-07-31T02:39:37,783 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-07-31T02:39:37,783 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-07-31T02:39:37,786 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-07-31T02:39:37,788 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-07-31T02:39:37,793 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-07-31T02:39:37,795 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-07-31T02:39:37,797 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-07-31T02:39:37,799 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-07-31T02:39:37,800 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-07-31T02:39:37,802 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-07-31T02:39:37,804 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-07-31T02:39:37,806 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-07-31T02:39:37,808 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-07-31T02:39:37,809 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-07-31T02:39:37,811 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-07-31T02:39:37,813 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-07-31T02:39:37,814 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-07-31T02:39:37,817 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-07-31T02:39:37,819 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-07-31T02:39:37,821 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-07-31T02:39:37,823 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-07-31T02:39:37,825 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-07-31T02:39:37,826 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-07-31T02:39:37,828 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-07-31T02:39:37,830 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-07-31T02:39:37,831 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-07-31T02:39:37,833 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-07-31T02:39:37,835 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-07-31T02:39:37,837 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-07-31T02:39:37,838 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-07-31T02:39:37,841 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-07-31T02:39:37,842 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-07-31T02:39:37,844 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-07-31T02:39:37,847 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-07-31T02:39:37,849 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-07-31T02:39:37,851 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-07-31T02:39:37,853 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-07-31T02:39:37,855 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-07-31T02:39:37,856 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-07-31T02:39:37,858 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-07-31T02:39:37,860 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-07-31T02:39:37,862 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-07-31T02:39:37,864 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-07-31T02:39:37,866 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-07-31T02:39:37,869 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-07-31T02:39:37,871 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-07-31T02:39:37,872 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-31T02:39:37,873 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-31T02:39:37,876 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-31T02:39:37,878 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-31T02:39:37,880 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-31T02:39:37,881 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-31T02:39:37,884 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-31T02:39:37,886 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-07-31T02:39:37,887 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-07-31T02:39:37,890 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-07-31T02:39:37,892 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-07-31T02:39:37,893 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-07-31T02:39:37,896 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-07-31T02:39:37,897 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-07-31T02:39:37,900 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-07-31T02:39:37,902 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-07-31T02:39:37,903 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-07-31T02:39:37,905 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-07-31T02:39:37,908 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-07-31T02:39:37,910 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-07-31T02:39:37,912 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-07-31T02:39:37,914 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:37,915 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:37,917 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:37,919 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:37,920 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:37,922 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:37,924 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:37,925 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:37,927 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-07-31T02:39:37,929 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-07-31T02:39:37,931 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-07-31T02:39:37,932 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-07-31T02:39:37,934 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:37,935 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:37,937 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:37,939 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:37,941 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:37,943 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:37,945 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:37,947 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:37,949 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:37,951 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-07-31T02:39:37,952 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-07-31T02:39:37,955 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-07-31T02:39:37,956 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-07-31T02:39:37,958 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-07-31T02:39:37,960 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-07-31T02:39:37,961 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-07-31T02:39:37,962 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-07-31T02:39:37,965 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-07-31T02:39:37,967 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-07-31T02:39:37,968 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-07-31T02:39:37,970 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-07-31T02:39:37,973 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-07-31T02:39:37,975 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-07-31T02:39:37,977 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-07-31T02:39:37,979 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-31T02:39:37,980 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-31T02:39:37,983 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-31T02:39:37,985 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-31T02:39:37,988 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-31T02:39:37,990 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-07-31T02:39:37,991 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-07-31T02:39:37,994 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-07-31T02:39:37,995 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-07-31T02:39:37,997 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-07-31T02:39:37,998 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-07-31T02:39:38,001 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-07-31T02:39:38,002 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-07-31T02:39:38,004 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-07-31T02:39:38,005 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-07-31T02:39:38,008 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-07-31T02:39:38,010 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-07-31T02:39:38,011 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-07-31T02:39:38,013 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-07-31T02:39:38,015 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-07-31T02:39:38,016 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-07-31T02:39:38,017 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-07-31T02:39:38,019 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-07-31T02:39:38,021 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-07-31T02:39:38,023 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-07-31T02:39:38,024 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-07-31T02:39:38,026 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-07-31T02:39:38,028 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-07-31T02:39:38,030 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-07-31T02:39:38,031 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-07-31T02:39:38,033 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-07-31T02:39:38,034 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-07-31T02:39:38,037 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-07-31T02:39:38,039 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:38,040 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:38,042 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:38,044 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:38,047 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:38,049 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:38,051 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-07-31T02:39:38,053 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-07-31T02:39:38,054 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-07-31T02:39:38,057 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-07-31T02:39:38,059 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-31T02:39:38,060 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-31T02:39:38,062 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-07-31T02:39:38,063 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-07-31T02:39:38,065 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-07-31T02:39:38,066 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-07-31T02:39:38,069 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-07-31T02:39:38,070 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-07-31T02:39:38,072 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-31T02:39:38,074 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-31T02:39:38,076 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-31T02:39:38,078 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-31T02:39:38,080 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-31T02:39:38,082 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-07-31T02:39:38,084 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-07-31T02:39:38,085 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-07-31T02:39:38,087 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-07-31T02:39:38,089 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-07-31T02:39:38,091 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-07-31T02:39:38,093 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2024-07-31T02:39:38,094 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-07-31T02:39:38,097 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-07-31T02:39:38,098 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-07-31T02:39:38,100 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-07-31T02:39:38,102 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-07-31T02:39:38,103 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-07-31T02:39:38,105 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-07-31T02:39:38,107 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-07-31T02:39:38,108 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-07-31T02:39:38,110 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-07-31T02:39:38,112 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-07-31T02:39:38,113 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-07-31T02:39:38,115 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-07-31T02:39:38,116 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-07-31T02:39:38,118 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-07-31T02:39:38,120 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-07-31T02:39:38,122 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2024-07-31T02:39:38,123 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-07-31T02:39:38,125 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-07-31T02:39:38,126 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-07-31T02:39:38,128 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-07-31T02:39:38,130 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-07-31T02:39:38,132 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-07-31T02:39:38,134 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-07-31T02:39:38,136 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-07-31T02:39:38,137 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-07-31T02:39:38,139 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-07-31T02:39:38,142 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-07-31T02:39:38,143 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,144 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,147 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,149 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,152 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,154 copying build/lib/colossalai/shardformer/policies/command.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,157 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,159 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,162 copying build/lib/colossalai/shardformer/policies/deepseek.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,164 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,166 copying build/lib/colossalai/shardformer/policies/qwen2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,169 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,171 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,173 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,176 copying build/lib/colossalai/shardformer/policies/mixtral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,178 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,180 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,183 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,185 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,188 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,191 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,192 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-07-31T02:39:38,195 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-31T02:39:38,196 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-31T02:39:38,198 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-31T02:39:38,200 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-31T02:39:38,202 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-31T02:39:38,204 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-31T02:39:38,206 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-07-31T02:39:38,208 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-31T02:39:38,210 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer/moe 2024-07-31T02:39:38,211 copying build/lib/colossalai/shardformer/layer/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer/moe 2024-07-31T02:39:38,213 copying build/lib/colossalai/shardformer/layer/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer/moe 2024-07-31T02:39:38,216 copying build/lib/colossalai/shardformer/layer/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer/moe 2024-07-31T02:39:38,218 copying build/lib/colossalai/shardformer/layer/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer/moe 2024-07-31T02:39:38,219 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-31T02:39:38,221 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-31T02:39:38,224 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-31T02:39:38,226 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-31T02:39:38,228 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-31T02:39:38,230 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-31T02:39:38,233 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-31T02:39:38,235 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-31T02:39:38,236 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-31T02:39:38,238 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-31T02:39:38,241 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-07-31T02:39:38,244 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-07-31T02:39:38,246 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,247 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,250 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,252 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,255 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,258 copying build/lib/colossalai/shardformer/modeling/command.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,261 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,264 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-07-31T02:39:38,265 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-07-31T02:39:38,268 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-07-31T02:39:38,270 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-07-31T02:39:38,272 copying build/lib/colossalai/shardformer/modeling/deepseek.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,274 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,276 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,279 copying build/lib/colossalai/shardformer/modeling/qwen2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,282 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,284 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,287 copying build/lib/colossalai/shardformer/modeling/mixtral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,289 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,292 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,294 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,297 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,299 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,302 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,303 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-07-31T02:39:38,306 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-07-31T02:39:38,308 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-07-31T02:39:38,309 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-31T02:39:38,310 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-31T02:39:38,313 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-31T02:39:38,315 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-31T02:39:38,318 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-31T02:39:38,319 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-31T02:39:38,321 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-07-31T02:39:38,323 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-07-31T02:39:38,325 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-07-31T02:39:38,327 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-07-31T02:39:38,330 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2024-07-31T02:39:38,331 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-07-31T02:39:38,333 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-07-31T02:39:38,335 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-07-31T02:39:38,337 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:38,338 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:38,340 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:38,343 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:38,345 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:38,346 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:38,348 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-07-31T02:39:38,350 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-31T02:39:38,351 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-31T02:39:38,353 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-31T02:39:38,355 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-31T02:39:38,358 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-31T02:39:38,359 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-31T02:39:38,361 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-07-31T02:39:38,363 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-07-31T02:39:38,364 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-07-31T02:39:38,366 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-07-31T02:39:38,369 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:38,370 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:38,372 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:38,374 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:38,376 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:38,378 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:38,380 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-07-31T02:39:38,382 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-07-31T02:39:38,384 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-07-31T02:39:38,385 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-07-31T02:39:38,387 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-07-31T02:39:38,389 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-07-31T02:39:38,392 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-07-31T02:39:38,394 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-07-31T02:39:38,398 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,398 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,400 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,402 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,405 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,406 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,408 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,410 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,412 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,414 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,417 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,418 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,420 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,422 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,424 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,426 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,428 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,430 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,432 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,434 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,436 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,437 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,439 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,441 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,443 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,445 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,447 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,448 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,450 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,453 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,455 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,457 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,459 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,461 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,463 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,465 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,467 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,469 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,471 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,473 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,475 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,478 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,480 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,482 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,484 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,487 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-07-31T02:39:38,489 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,492 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-07-31T02:39:38,494 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-07-31T02:39:38,495 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-07-31T02:39:38,497 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-07-31T02:39:38,498 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-07-31T02:39:38,501 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-07-31T02:39:38,502 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-07-31T02:39:38,504 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-07-31T02:39:38,506 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:38,507 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:38,509 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:38,511 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:38,513 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:38,515 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:38,517 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:38,519 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:38,520 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:38,522 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:38,525 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:38,527 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-07-31T02:39:38,529 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-07-31T02:39:38,530 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-07-31T02:39:38,533 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-31T02:39:38,534 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-31T02:39:38,536 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-31T02:39:38,538 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-31T02:39:38,540 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-31T02:39:38,543 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-31T02:39:38,545 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-31T02:39:38,547 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-31T02:39:38,549 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-31T02:39:38,551 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-31T02:39:38,553 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-07-31T02:39:38,554 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-07-31T02:39:38,556 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2024-07-31T02:39:38,557 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C 2024-07-31T02:39:38,559 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-31T02:39:38,560 copying build/lib/colossalai/inference/sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-31T02:39:38,562 copying build/lib/colossalai/inference/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-31T02:39:38,565 creating build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-07-31T02:39:38,566 copying build/lib/colossalai/inference/spec/drafter.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-07-31T02:39:38,568 copying build/lib/colossalai/inference/spec/struct.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-07-31T02:39:38,569 copying build/lib/colossalai/inference/spec/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-07-31T02:39:38,571 copying build/lib/colossalai/inference/flash_decoding_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-31T02:39:38,573 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-07-31T02:39:38,574 copying build/lib/colossalai/inference/kv_cache/block_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-07-31T02:39:38,576 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-07-31T02:39:38,578 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-07-31T02:39:38,580 copying build/lib/colossalai/inference/logit_processors.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-31T02:39:38,582 copying build/lib/colossalai/inference/struct.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-31T02:39:38,584 copying build/lib/colossalai/inference/config.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-31T02:39:38,587 creating build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-07-31T02:39:38,588 copying build/lib/colossalai/inference/executor/rpc_worker.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-07-31T02:39:38,590 copying build/lib/colossalai/inference/executor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-07-31T02:39:38,592 copying build/lib/colossalai/inference/batch_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-31T02:39:38,594 copying build/lib/colossalai/inference/graph_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-31T02:39:38,597 creating build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-31T02:39:38,597 copying build/lib/colossalai/inference/core/llm_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-31T02:39:38,600 copying build/lib/colossalai/inference/core/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-31T02:39:38,603 copying build/lib/colossalai/inference/core/plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-31T02:39:38,605 copying build/lib/colossalai/inference/core/base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-31T02:39:38,607 copying build/lib/colossalai/inference/core/rpc_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-31T02:39:38,609 copying build/lib/colossalai/inference/core/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-31T02:39:38,611 copying build/lib/colossalai/inference/core/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-31T02:39:38,613 copying build/lib/colossalai/inference/core/diffusion_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-31T02:39:38,615 copying build/lib/colossalai/inference/core/request_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-07-31T02:39:38,618 creating build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-07-31T02:39:38,619 copying build/lib/colossalai/inference/server/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-07-31T02:39:38,621 copying build/lib/colossalai/inference/server/api_server.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-07-31T02:39:38,623 copying build/lib/colossalai/inference/server/completion_service.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-07-31T02:39:38,625 copying build/lib/colossalai/inference/server/chat_service.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-07-31T02:39:38,627 copying build/lib/colossalai/inference/server/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-07-31T02:39:38,628 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-07-31T02:39:38,630 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-07-31T02:39:38,631 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-07-31T02:39:38,632 copying build/lib/colossalai/inference/modeling/backends/pre_attention_backend.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-07-31T02:39:38,634 copying build/lib/colossalai/inference/modeling/backends/attention_backend.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-07-31T02:39:38,636 copying build/lib/colossalai/inference/modeling/backends/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-07-31T02:39:38,638 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-31T02:39:38,639 copying build/lib/colossalai/inference/modeling/policy/glide_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-31T02:39:38,641 copying build/lib/colossalai/inference/modeling/policy/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-31T02:39:38,643 copying build/lib/colossalai/inference/modeling/policy/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-31T02:39:38,645 copying build/lib/colossalai/inference/modeling/policy/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-31T02:39:38,647 copying build/lib/colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-31T02:39:38,649 copying build/lib/colossalai/inference/modeling/policy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-07-31T02:39:38,651 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-31T02:39:38,652 copying build/lib/colossalai/inference/modeling/models/glide_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-31T02:39:38,654 copying build/lib/colossalai/inference/modeling/models/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-31T02:39:38,657 copying build/lib/colossalai/inference/modeling/models/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-31T02:39:38,659 copying build/lib/colossalai/inference/modeling/models/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-31T02:39:38,662 copying build/lib/colossalai/inference/modeling/models/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-31T02:39:38,664 copying build/lib/colossalai/inference/modeling/models/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-07-31T02:39:38,666 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-07-31T02:39:38,667 copying build/lib/colossalai/inference/modeling/layers/distrifusion.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-07-31T02:39:38,670 copying build/lib/colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-07-31T02:39:38,672 copying build/lib/colossalai/inference/modeling/layers/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-07-31T02:39:38,674 copying build/lib/colossalai/inference/modeling/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-07-31T02:39:38,676 copying build/lib/colossalai/inference/modeling/layers/diffusion.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-07-31T02:39:38,677 copying build/lib/colossalai/inference/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-07-31T02:39:38,679 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-07-31T02:39:38,681 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2024-07-31T02:39:38,682 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-07-31T02:39:38,683 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-07-31T02:39:38,684 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-07-31T02:39:38,686 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-07-31T02:39:38,689 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-07-31T02:39:38,690 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-07-31T02:39:38,692 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-07-31T02:39:38,694 copying build/lib/colossalai/zero/low_level/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-07-31T02:39:38,695 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-07-31T02:39:38,698 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-07-31T02:39:38,700 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-07-31T02:39:38,703 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-31T02:39:38,704 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-31T02:39:38,706 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-31T02:39:38,708 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-31T02:39:38,711 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-31T02:39:38,714 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-31T02:39:38,716 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-07-31T02:39:38,717 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-07-31T02:39:38,719 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-07-31T02:39:38,722 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-07-31T02:39:38,724 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-07-31T02:39:38,726 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-07-31T02:39:38,729 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:38,730 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:38,732 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:38,734 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:38,735 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:38,737 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:38,739 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:38,741 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:38,743 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:38,745 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-07-31T02:39:38,747 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-31T02:39:38,749 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-07-31T02:39:38,751 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-07-31T02:39:38,753 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-07-31T02:39:38,756 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2024-07-31T02:39:38,757 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-07-31T02:39:38,759 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-07-31T02:39:38,761 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-07-31T02:39:38,762 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-07-31T02:39:38,764 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-31T02:39:38,765 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-31T02:39:38,768 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-31T02:39:38,770 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-31T02:39:38,772 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-31T02:39:38,774 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-31T02:39:38,776 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-07-31T02:39:38,778 running install_egg_info 2024-07-31T02:39:38,810 running egg_info 2024-07-31T02:39:38,840 writing colossalai.egg-info/PKG-INFO 2024-07-31T02:39:38,844 writing dependency_links to colossalai.egg-info/dependency_links.txt 2024-07-31T02:39:38,846 writing entry points to colossalai.egg-info/entry_points.txt 2024-07-31T02:39:38,847 writing requirements to colossalai.egg-info/requires.txt 2024-07-31T02:39:38,848 writing top-level names to colossalai.egg-info/top_level.txt 2024-07-31T02:39:39,110 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2024-07-31T02:39:39,158 reading manifest template 'MANIFEST.in' 2024-07-31T02:39:40,426 warning: no files found matching '*.tr' under directory 'colossalai' 2024-07-31T02:39:41,063 warning: no files found matching '*.cc' under directory 'colossalai' 2024-07-31T02:39:41,398 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-07-31T02:39:41,532 warning: no files found matching '*.tr' under directory 'extensions' 2024-07-31T02:39:41,585 warning: no files found matching '*.cc' under directory 'extensions' 2024-07-31T02:39:41,610 warning: no files found matching '*.pyi' under directory 'extensions' 2024-07-31T02:39:41,611 adding license file 'LICENSE' 2024-07-31T02:39:41,658 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2024-07-31T02:39:41,661 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.4.2-py3.11.egg-info 2024-07-31T02:39:41,674 running install_scripts 2024-07-31T02:39:41,699 creating build/bdist.linux-armv7l/wheel/colossalai-0.4.2.dist-info/WHEEL 2024-07-31T02:39:41,701 creating '/tmp/pip-wheel-grqfscqy/colossalai-0.4.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-07-31T02:39:41,704 adding 'colossalai/__init__.py' 2024-07-31T02:39:41,706 adding 'colossalai/initialize.py' 2024-07-31T02:39:41,707 adding 'colossalai/version.py' 2024-07-31T02:39:41,708 adding 'colossalai/_C/__init__.py' 2024-07-31T02:39:41,710 adding 'colossalai/_analyzer/__init__.py' 2024-07-31T02:39:41,711 adding 'colossalai/_analyzer/envs.py' 2024-07-31T02:39:41,713 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2024-07-31T02:39:41,715 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2024-07-31T02:39:41,717 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2024-07-31T02:39:41,719 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2024-07-31T02:39:41,721 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2024-07-31T02:39:41,723 adding 'colossalai/_analyzer/fx/__init__.py' 2024-07-31T02:39:41,725 adding 'colossalai/_analyzer/fx/codegen.py' 2024-07-31T02:39:41,727 adding 'colossalai/_analyzer/fx/graph_module.py' 2024-07-31T02:39:41,729 adding 'colossalai/_analyzer/fx/node_util.py' 2024-07-31T02:39:41,730 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2024-07-31T02:39:41,732 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2024-07-31T02:39:41,734 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2024-07-31T02:39:41,736 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2024-07-31T02:39:41,737 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2024-07-31T02:39:41,739 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2024-07-31T02:39:41,740 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2024-07-31T02:39:41,741 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2024-07-31T02:39:41,743 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2024-07-31T02:39:41,745 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2024-07-31T02:39:41,747 adding 'colossalai/accelerator/__init__.py' 2024-07-31T02:39:41,748 adding 'colossalai/accelerator/api.py' 2024-07-31T02:39:41,750 adding 'colossalai/accelerator/base_accelerator.py' 2024-07-31T02:39:41,751 adding 'colossalai/accelerator/cpu_accelerator.py' 2024-07-31T02:39:41,753 adding 'colossalai/accelerator/cuda_accelerator.py' 2024-07-31T02:39:41,755 adding 'colossalai/accelerator/npu_accelerator.py' 2024-07-31T02:39:41,757 adding 'colossalai/amp/__init__.py' 2024-07-31T02:39:41,759 adding 'colossalai/amp/naive_amp/__init__.py' 2024-07-31T02:39:41,760 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2024-07-31T02:39:41,762 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2024-07-31T02:39:41,763 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2024-07-31T02:39:41,765 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2024-07-31T02:39:41,766 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2024-07-31T02:39:41,768 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2024-07-31T02:39:41,769 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2024-07-31T02:39:41,770 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2024-07-31T02:39:41,771 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2024-07-31T02:39:41,773 adding 'colossalai/auto_parallel/__init__.py' 2024-07-31T02:39:41,774 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2024-07-31T02:39:41,775 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2024-07-31T02:39:41,777 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2024-07-31T02:39:41,778 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2024-07-31T02:39:41,780 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2024-07-31T02:39:41,782 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2024-07-31T02:39:41,784 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2024-07-31T02:39:41,785 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2024-07-31T02:39:41,786 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2024-07-31T02:39:41,788 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2024-07-31T02:39:41,789 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2024-07-31T02:39:41,791 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2024-07-31T02:39:41,792 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2024-07-31T02:39:41,794 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2024-07-31T02:39:41,795 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2024-07-31T02:39:41,797 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2024-07-31T02:39:41,799 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2024-07-31T02:39:41,800 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2024-07-31T02:39:41,802 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2024-07-31T02:39:41,803 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2024-07-31T02:39:41,805 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2024-07-31T02:39:41,806 adding 'colossalai/auto_parallel/offload/__init__.py' 2024-07-31T02:39:41,808 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2024-07-31T02:39:41,810 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2024-07-31T02:39:41,811 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2024-07-31T02:39:41,812 adding 'colossalai/auto_parallel/offload/region.py' 2024-07-31T02:39:41,815 adding 'colossalai/auto_parallel/offload/region_manager.py' 2024-07-31T02:39:41,817 adding 'colossalai/auto_parallel/offload/runtime.py' 2024-07-31T02:39:41,819 adding 'colossalai/auto_parallel/offload/solver.py' 2024-07-31T02:39:41,821 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2024-07-31T02:39:41,823 adding 'colossalai/auto_parallel/offload/util.py' 2024-07-31T02:39:41,824 adding 'colossalai/auto_parallel/passes/__init__.py' 2024-07-31T02:39:41,826 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2024-07-31T02:39:41,827 adding 'colossalai/auto_parallel/passes/constants.py' 2024-07-31T02:39:41,829 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2024-07-31T02:39:41,830 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2024-07-31T02:39:41,833 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2024-07-31T02:39:41,835 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2024-07-31T02:39:41,836 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2024-07-31T02:39:41,838 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2024-07-31T02:39:41,840 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2024-07-31T02:39:41,842 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2024-07-31T02:39:41,843 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2024-07-31T02:39:41,845 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2024-07-31T02:39:41,847 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2024-07-31T02:39:41,848 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2024-07-31T02:39:41,849 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2024-07-31T02:39:41,850 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2024-07-31T02:39:41,852 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2024-07-31T02:39:41,853 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2024-07-31T02:39:41,855 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2024-07-31T02:39:41,856 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2024-07-31T02:39:41,857 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2024-07-31T02:39:41,859 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2024-07-31T02:39:41,861 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2024-07-31T02:39:41,863 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2024-07-31T02:39:41,865 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2024-07-31T02:39:41,866 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2024-07-31T02:39:41,868 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2024-07-31T02:39:41,869 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2024-07-31T02:39:41,870 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2024-07-31T02:39:41,872 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2024-07-31T02:39:41,873 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2024-07-31T02:39:41,874 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2024-07-31T02:39:41,876 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2024-07-31T02:39:41,877 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2024-07-31T02:39:41,878 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2024-07-31T02:39:41,879 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2024-07-31T02:39:41,881 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2024-07-31T02:39:41,882 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2024-07-31T02:39:41,884 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2024-07-31T02:39:41,886 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2024-07-31T02:39:41,888 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2024-07-31T02:39:41,890 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2024-07-31T02:39:41,892 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2024-07-31T02:39:41,893 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2024-07-31T02:39:41,895 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2024-07-31T02:39:41,897 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2024-07-31T02:39:41,900 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2024-07-31T02:39:41,902 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2024-07-31T02:39:41,903 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2024-07-31T02:39:41,904 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2024-07-31T02:39:41,906 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2024-07-31T02:39:41,908 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2024-07-31T02:39:41,910 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2024-07-31T02:39:41,911 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2024-07-31T02:39:41,912 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2024-07-31T02:39:41,914 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2024-07-31T02:39:41,915 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2024-07-31T02:39:41,917 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2024-07-31T02:39:41,919 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2024-07-31T02:39:41,920 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2024-07-31T02:39:41,923 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2024-07-31T02:39:41,924 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2024-07-31T02:39:41,926 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2024-07-31T02:39:41,928 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2024-07-31T02:39:41,929 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2024-07-31T02:39:41,931 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2024-07-31T02:39:41,932 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2024-07-31T02:39:41,934 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2024-07-31T02:39:41,936 adding 'colossalai/booster/__init__.py' 2024-07-31T02:39:41,937 adding 'colossalai/booster/accelerator.py' 2024-07-31T02:39:41,939 adding 'colossalai/booster/booster.py' 2024-07-31T02:39:41,941 adding 'colossalai/booster/mixed_precision/__init__.py' 2024-07-31T02:39:41,942 adding 'colossalai/booster/mixed_precision/bf16.py' 2024-07-31T02:39:41,944 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2024-07-31T02:39:41,945 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2024-07-31T02:39:41,946 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2024-07-31T02:39:41,947 adding 'colossalai/booster/mixed_precision/fp8.py' 2024-07-31T02:39:41,949 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2024-07-31T02:39:41,950 adding 'colossalai/booster/plugin/__init__.py' 2024-07-31T02:39:41,952 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2024-07-31T02:39:41,955 adding 'colossalai/booster/plugin/gemini_plugin.py' 2024-07-31T02:39:41,962 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2024-07-31T02:39:41,965 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2024-07-31T02:39:41,968 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2024-07-31T02:39:41,969 adding 'colossalai/booster/plugin/plugin_base.py' 2024-07-31T02:39:41,970 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2024-07-31T02:39:41,972 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2024-07-31T02:39:41,974 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2024-07-31T02:39:41,976 adding 'colossalai/checkpoint_io/__init__.py' 2024-07-31T02:39:41,978 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2024-07-31T02:39:41,980 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2024-07-31T02:39:41,984 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2024-07-31T02:39:41,985 adding 'colossalai/checkpoint_io/index_file.py' 2024-07-31T02:39:41,989 adding 'colossalai/checkpoint_io/moe_checkpoint.py' 2024-07-31T02:39:41,993 adding 'colossalai/checkpoint_io/utils.py' 2024-07-31T02:39:41,995 adding 'colossalai/cli/__init__.py' 2024-07-31T02:39:41,996 adding 'colossalai/cli/cli.py' 2024-07-31T02:39:41,998 adding 'colossalai/cli/check/__init__.py' 2024-07-31T02:39:41,999 adding 'colossalai/cli/check/check_installation.py' 2024-07-31T02:39:42,001 adding 'colossalai/cli/launcher/__init__.py' 2024-07-31T02:39:42,002 adding 'colossalai/cli/launcher/hostinfo.py' 2024-07-31T02:39:42,004 adding 'colossalai/cli/launcher/multinode_runner.py' 2024-07-31T02:39:42,006 adding 'colossalai/cli/launcher/run.py' 2024-07-31T02:39:42,007 adding 'colossalai/cluster/__init__.py' 2024-07-31T02:39:42,009 adding 'colossalai/cluster/device_mesh_manager.py' 2024-07-31T02:39:42,010 adding 'colossalai/cluster/dist_coordinator.py' 2024-07-31T02:39:42,012 adding 'colossalai/cluster/process_group_manager.py' 2024-07-31T02:39:42,013 adding 'colossalai/cluster/process_group_mesh.py' 2024-07-31T02:39:42,015 adding 'colossalai/context/__init__.py' 2024-07-31T02:39:42,017 adding 'colossalai/context/config.py' 2024-07-31T02:39:42,018 adding 'colossalai/context/singleton_meta.py' 2024-07-31T02:39:42,020 adding 'colossalai/device/__init__.py' 2024-07-31T02:39:42,022 adding 'colossalai/device/alpha_beta_profiler.py' 2024-07-31T02:39:42,024 adding 'colossalai/device/calc_pipeline_strategy.py' 2024-07-31T02:39:42,026 adding 'colossalai/device/device_mesh.py' 2024-07-31T02:39:42,028 adding 'colossalai/fx/__init__.py' 2024-07-31T02:39:42,030 adding 'colossalai/fx/_compatibility.py' 2024-07-31T02:39:42,032 adding 'colossalai/fx/_meta_regist_12.py' 2024-07-31T02:39:42,034 adding 'colossalai/fx/_meta_regist_13.py' 2024-07-31T02:39:42,035 adding 'colossalai/fx/graph_module.py' 2024-07-31T02:39:42,037 adding 'colossalai/fx/proxy.py' 2024-07-31T02:39:42,038 adding 'colossalai/fx/codegen/__init__.py' 2024-07-31T02:39:42,043 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2024-07-31T02:39:42,045 adding 'colossalai/fx/passes/__init__.py' 2024-07-31T02:39:42,047 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2024-07-31T02:39:42,049 adding 'colossalai/fx/passes/concrete_info_prop.py' 2024-07-31T02:39:42,051 adding 'colossalai/fx/passes/meta_info_prop.py' 2024-07-31T02:39:42,053 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2024-07-31T02:39:42,055 adding 'colossalai/fx/passes/shard_1d_pass.py' 2024-07-31T02:39:42,057 adding 'colossalai/fx/passes/split_module.py' 2024-07-31T02:39:42,059 adding 'colossalai/fx/passes/utils.py' 2024-07-31T02:39:42,061 adding 'colossalai/fx/profiler/__init__.py' 2024-07-31T02:39:42,062 adding 'colossalai/fx/profiler/constants.py' 2024-07-31T02:39:42,064 adding 'colossalai/fx/profiler/dataflow.py' 2024-07-31T02:39:42,065 adding 'colossalai/fx/profiler/memory_utils.py' 2024-07-31T02:39:42,067 adding 'colossalai/fx/profiler/opcount.py' 2024-07-31T02:39:42,069 adding 'colossalai/fx/profiler/profiler.py' 2024-07-31T02:39:42,070 adding 'colossalai/fx/profiler/shard_utils.py' 2024-07-31T02:39:42,072 adding 'colossalai/fx/profiler/tensor.py' 2024-07-31T02:39:42,074 adding 'colossalai/fx/profiler/experimental/__init__.py' 2024-07-31T02:39:42,075 adding 'colossalai/fx/profiler/experimental/constants.py' 2024-07-31T02:39:42,077 adding 'colossalai/fx/profiler/experimental/profiler.py' 2024-07-31T02:39:42,078 adding 'colossalai/fx/profiler/experimental/registry.py' 2024-07-31T02:39:42,079 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2024-07-31T02:39:42,081 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2024-07-31T02:39:42,082 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2024-07-31T02:39:42,084 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2024-07-31T02:39:42,085 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2024-07-31T02:39:42,087 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2024-07-31T02:39:42,088 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2024-07-31T02:39:42,089 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2024-07-31T02:39:42,090 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2024-07-31T02:39:42,091 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2024-07-31T02:39:42,093 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2024-07-31T02:39:42,094 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2024-07-31T02:39:42,095 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2024-07-31T02:39:42,097 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2024-07-31T02:39:42,098 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2024-07-31T02:39:42,099 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2024-07-31T02:39:42,100 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2024-07-31T02:39:42,102 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2024-07-31T02:39:42,103 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2024-07-31T02:39:42,104 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2024-07-31T02:39:42,105 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2024-07-31T02:39:42,107 adding 'colossalai/fx/tracer/__init__.py' 2024-07-31T02:39:42,108 adding 'colossalai/fx/tracer/_meta_trace.py' 2024-07-31T02:39:42,110 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2024-07-31T02:39:42,111 adding 'colossalai/fx/tracer/_tracer_utils.py' 2024-07-31T02:39:42,114 adding 'colossalai/fx/tracer/experimental.py' 2024-07-31T02:39:42,115 adding 'colossalai/fx/tracer/registry.py' 2024-07-31T02:39:42,119 adding 'colossalai/fx/tracer/tracer.py' 2024-07-31T02:39:42,120 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2024-07-31T02:39:42,122 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2024-07-31T02:39:42,123 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2024-07-31T02:39:42,125 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2024-07-31T02:39:42,126 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2024-07-31T02:39:42,127 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2024-07-31T02:39:42,129 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2024-07-31T02:39:42,130 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2024-07-31T02:39:42,132 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2024-07-31T02:39:42,133 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2024-07-31T02:39:42,135 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2024-07-31T02:39:42,137 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2024-07-31T02:39:42,138 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2024-07-31T02:39:42,139 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2024-07-31T02:39:42,141 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2024-07-31T02:39:42,142 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2024-07-31T02:39:42,143 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2024-07-31T02:39:42,145 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2024-07-31T02:39:42,146 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2024-07-31T02:39:42,148 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2024-07-31T02:39:42,149 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2024-07-31T02:39:42,150 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2024-07-31T02:39:42,152 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2024-07-31T02:39:42,153 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2024-07-31T02:39:42,154 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2024-07-31T02:39:42,155 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2024-07-31T02:39:42,156 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2024-07-31T02:39:42,158 adding 'colossalai/inference/__init__.py' 2024-07-31T02:39:42,161 adding 'colossalai/inference/batch_bucket.py' 2024-07-31T02:39:42,164 adding 'colossalai/inference/config.py' 2024-07-31T02:39:42,166 adding 'colossalai/inference/flash_decoding_utils.py' 2024-07-31T02:39:42,167 adding 'colossalai/inference/graph_runner.py' 2024-07-31T02:39:42,169 adding 'colossalai/inference/logit_processors.py' 2024-07-31T02:39:42,170 adding 'colossalai/inference/sampler.py' 2024-07-31T02:39:42,172 adding 'colossalai/inference/struct.py' 2024-07-31T02:39:42,173 adding 'colossalai/inference/utils.py' 2024-07-31T02:39:42,175 adding 'colossalai/inference/core/__init__.py' 2024-07-31T02:39:42,177 adding 'colossalai/inference/core/async_engine.py' 2024-07-31T02:39:42,178 adding 'colossalai/inference/core/base_engine.py' 2024-07-31T02:39:42,180 adding 'colossalai/inference/core/diffusion_engine.py' 2024-07-31T02:39:42,182 adding 'colossalai/inference/core/engine.py' 2024-07-31T02:39:42,185 adding 'colossalai/inference/core/llm_engine.py' 2024-07-31T02:39:42,187 adding 'colossalai/inference/core/plugin.py' 2024-07-31T02:39:42,189 adding 'colossalai/inference/core/request_handler.py' 2024-07-31T02:39:42,192 adding 'colossalai/inference/core/rpc_engine.py' 2024-07-31T02:39:42,193 adding 'colossalai/inference/executor/__init__.py' 2024-07-31T02:39:42,195 adding 'colossalai/inference/executor/rpc_worker.py' 2024-07-31T02:39:42,197 adding 'colossalai/inference/kv_cache/__init__.py' 2024-07-31T02:39:42,198 adding 'colossalai/inference/kv_cache/block_cache.py' 2024-07-31T02:39:42,201 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2024-07-31T02:39:42,203 adding 'colossalai/inference/modeling/__init__.py' 2024-07-31T02:39:42,204 adding 'colossalai/inference/modeling/backends/__init__.py' 2024-07-31T02:39:42,206 adding 'colossalai/inference/modeling/backends/attention_backend.py' 2024-07-31T02:39:42,207 adding 'colossalai/inference/modeling/backends/pre_attention_backend.py' 2024-07-31T02:39:42,209 adding 'colossalai/inference/modeling/layers/__init__.py' 2024-07-31T02:39:42,211 adding 'colossalai/inference/modeling/layers/attention.py' 2024-07-31T02:39:42,212 adding 'colossalai/inference/modeling/layers/baichuan_tp_linear.py' 2024-07-31T02:39:42,213 adding 'colossalai/inference/modeling/layers/diffusion.py' 2024-07-31T02:39:42,216 adding 'colossalai/inference/modeling/layers/distrifusion.py' 2024-07-31T02:39:42,218 adding 'colossalai/inference/modeling/models/__init__.py' 2024-07-31T02:39:42,220 adding 'colossalai/inference/modeling/models/glide_llama.py' 2024-07-31T02:39:42,222 adding 'colossalai/inference/modeling/models/nopadding_baichuan.py' 2024-07-31T02:39:42,225 adding 'colossalai/inference/modeling/models/nopadding_llama.py' 2024-07-31T02:39:42,227 adding 'colossalai/inference/modeling/models/pixart_alpha.py' 2024-07-31T02:39:42,229 adding 'colossalai/inference/modeling/models/stablediffusion3.py' 2024-07-31T02:39:42,231 adding 'colossalai/inference/modeling/policy/__init__.py' 2024-07-31T02:39:42,232 adding 'colossalai/inference/modeling/policy/glide_llama.py' 2024-07-31T02:39:42,233 adding 'colossalai/inference/modeling/policy/nopadding_baichuan.py' 2024-07-31T02:39:42,235 adding 'colossalai/inference/modeling/policy/nopadding_llama.py' 2024-07-31T02:39:42,236 adding 'colossalai/inference/modeling/policy/pixart_alpha.py' 2024-07-31T02:39:42,237 adding 'colossalai/inference/modeling/policy/stablediffusion3.py' 2024-07-31T02:39:42,239 adding 'colossalai/inference/server/__init__.py' 2024-07-31T02:39:42,240 adding 'colossalai/inference/server/api_server.py' 2024-07-31T02:39:42,242 adding 'colossalai/inference/server/chat_service.py' 2024-07-31T02:39:42,243 adding 'colossalai/inference/server/completion_service.py' 2024-07-31T02:39:42,244 adding 'colossalai/inference/server/utils.py' 2024-07-31T02:39:42,246 adding 'colossalai/inference/spec/__init__.py' 2024-07-31T02:39:42,247 adding 'colossalai/inference/spec/drafter.py' 2024-07-31T02:39:42,248 adding 'colossalai/inference/spec/struct.py' 2024-07-31T02:39:42,250 adding 'colossalai/interface/__init__.py' 2024-07-31T02:39:42,251 adding 'colossalai/interface/model.py' 2024-07-31T02:39:42,252 adding 'colossalai/interface/optimizer.py' 2024-07-31T02:39:42,254 adding 'colossalai/interface/pretrained.py' 2024-07-31T02:39:42,255 adding 'colossalai/kernel/__init__.py' 2024-07-31T02:39:42,256 adding 'colossalai/kernel/kernel_loader.py' 2024-07-31T02:39:42,258 adding 'colossalai/kernel/extensions/__init__.py' 2024-07-31T02:39:42,259 adding 'colossalai/kernel/extensions/base_extension.py' 2024-07-31T02:39:42,261 adding 'colossalai/kernel/extensions/cpp_extension.py' 2024-07-31T02:39:42,262 adding 'colossalai/kernel/extensions/cuda_extension.py' 2024-07-31T02:39:42,263 adding 'colossalai/kernel/extensions/triton_extension.py' 2024-07-31T02:39:42,265 adding 'colossalai/kernel/extensions/utils.py' 2024-07-31T02:39:42,267 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2024-07-31T02:39:42,268 adding 'colossalai/kernel/extensions/csrc/common/data_type.h' 2024-07-31T02:39:42,270 adding 'colossalai/kernel/extensions/csrc/common/micros.h' 2024-07-31T02:39:42,271 adding 'colossalai/kernel/extensions/csrc/common/mp_type_traits.h' 2024-07-31T02:39:42,273 adding 'colossalai/kernel/extensions/csrc/common/target.h' 2024-07-31T02:39:42,274 adding 'colossalai/kernel/extensions/csrc/common/vec_type_traits.h' 2024-07-31T02:39:42,276 adding 'colossalai/kernel/extensions/csrc/funcs/binary_functor.h' 2024-07-31T02:39:42,278 adding 'colossalai/kernel/extensions/csrc/funcs/cast_functor.h' 2024-07-31T02:39:42,280 adding 'colossalai/kernel/extensions/csrc/funcs/reduce_function.h' 2024-07-31T02:39:42,281 adding 'colossalai/kernel/extensions/csrc/funcs/ternary_functor.h' 2024-07-31T02:39:42,283 adding 'colossalai/kernel/extensions/csrc/funcs/unary_functor.h' 2024-07-31T02:39:42,285 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp' 2024-07-31T02:39:42,287 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h' 2024-07-31T02:39:42,289 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu' 2024-07-31T02:39:42,291 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu' 2024-07-31T02:39:42,292 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu' 2024-07-31T02:39:42,294 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu' 2024-07-31T02:39:42,298 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu' 2024-07-31T02:39:42,300 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu' 2024-07-31T02:39:42,302 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu' 2024-07-31T02:39:42,305 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu' 2024-07-31T02:39:42,307 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu' 2024-07-31T02:39:42,309 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu' 2024-07-31T02:39:42,311 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh' 2024-07-31T02:39:42,313 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu' 2024-07-31T02:39:42,315 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu' 2024-07-31T02:39:42,317 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu' 2024-07-31T02:39:42,318 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu' 2024-07-31T02:39:42,320 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu' 2024-07-31T02:39:42,322 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu' 2024-07-31T02:39:42,324 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu' 2024-07-31T02:39:42,327 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h' 2024-07-31T02:39:42,329 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h' 2024-07-31T02:39:42,330 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h' 2024-07-31T02:39:42,331 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h' 2024-07-31T02:39:42,332 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h' 2024-07-31T02:39:42,335 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp' 2024-07-31T02:39:42,336 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h' 2024-07-31T02:39:42,338 adding 'colossalai/kernel/extensions/pybind/__init__.py' 2024-07-31T02:39:42,339 adding 'colossalai/kernel/extensions/pybind/cpu_adam/__init__.py' 2024-07-31T02:39:42,341 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-07-31T02:39:42,342 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-07-31T02:39:42,344 adding 'colossalai/kernel/extensions/pybind/flash_attention/__init__.py' 2024-07-31T02:39:42,345 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-07-31T02:39:42,346 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py' 2024-07-31T02:39:42,348 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-07-31T02:39:42,349 adding 'colossalai/kernel/extensions/pybind/inference/__init__.py' 2024-07-31T02:39:42,351 adding 'colossalai/kernel/extensions/pybind/inference/inference.cpp' 2024-07-31T02:39:42,352 adding 'colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py' 2024-07-31T02:39:42,354 adding 'colossalai/kernel/extensions/pybind/layernorm/__init__.py' 2024-07-31T02:39:42,356 adding 'colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp' 2024-07-31T02:39:42,358 adding 'colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py' 2024-07-31T02:39:42,360 adding 'colossalai/kernel/extensions/pybind/moe/__init__.py' 2024-07-31T02:39:42,361 adding 'colossalai/kernel/extensions/pybind/moe/moe.cpp' 2024-07-31T02:39:42,362 adding 'colossalai/kernel/extensions/pybind/moe/moe_cuda.py' 2024-07-31T02:39:42,364 adding 'colossalai/kernel/extensions/pybind/optimizer/__init__.py' 2024-07-31T02:39:42,366 adding 'colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-07-31T02:39:42,367 adding 'colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp' 2024-07-31T02:39:42,369 adding 'colossalai/kernel/extensions/pybind/softmax/__init__.py' 2024-07-31T02:39:42,370 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp' 2024-07-31T02:39:42,371 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-07-31T02:39:42,372 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp' 2024-07-31T02:39:42,374 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-07-31T02:39:42,375 adding 'colossalai/kernel/jit/__init__.py' 2024-07-31T02:39:42,377 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2024-07-31T02:39:42,378 adding 'colossalai/kernel/jit/bias_gelu.py' 2024-07-31T02:39:42,379 adding 'colossalai/kernel/jit/option.py' 2024-07-31T02:39:42,381 adding 'colossalai/kernel/triton/__init__.py' 2024-07-31T02:39:42,383 adding 'colossalai/kernel/triton/context_attn_unpad.py' 2024-07-31T02:39:42,386 adding 'colossalai/kernel/triton/flash_decoding.py' 2024-07-31T02:39:42,387 adding 'colossalai/kernel/triton/fused_rotary_embedding.py' 2024-07-31T02:39:42,389 adding 'colossalai/kernel/triton/kvcache_copy.py' 2024-07-31T02:39:42,390 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2024-07-31T02:39:42,393 adding 'colossalai/kernel/triton/no_pad_rotary_embedding.py' 2024-07-31T02:39:42,394 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2024-07-31T02:39:42,396 adding 'colossalai/kernel/triton/rms_layernorm.py' 2024-07-31T02:39:42,397 adding 'colossalai/kernel/triton/rotary_cache_copy.py' 2024-07-31T02:39:42,399 adding 'colossalai/kernel/triton/softmax.py' 2024-07-31T02:39:42,401 adding 'colossalai/lazy/__init__.py' 2024-07-31T02:39:42,402 adding 'colossalai/lazy/construction.py' 2024-07-31T02:39:42,405 adding 'colossalai/lazy/lazy_init.py' 2024-07-31T02:39:42,408 adding 'colossalai/lazy/pretrained.py' 2024-07-31T02:39:42,409 adding 'colossalai/legacy/__init__.py' 2024-07-31T02:39:42,410 adding 'colossalai/legacy/constants.py' 2024-07-31T02:39:42,411 adding 'colossalai/legacy/core.py' 2024-07-31T02:39:42,413 adding 'colossalai/legacy/global_variables.py' 2024-07-31T02:39:42,415 adding 'colossalai/legacy/initialize.py' 2024-07-31T02:39:42,417 adding 'colossalai/legacy/amp/__init__.py' 2024-07-31T02:39:42,418 adding 'colossalai/legacy/amp/amp_type.py' 2024-07-31T02:39:42,420 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2024-07-31T02:39:42,421 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2024-07-31T02:39:42,423 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2024-07-31T02:39:42,425 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2024-07-31T02:39:42,426 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2024-07-31T02:39:42,428 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2024-07-31T02:39:42,429 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2024-07-31T02:39:42,433 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2024-07-31T02:39:42,434 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2024-07-31T02:39:42,436 adding 'colossalai/legacy/builder/__init__.py' 2024-07-31T02:39:42,437 adding 'colossalai/legacy/builder/builder.py' 2024-07-31T02:39:42,439 adding 'colossalai/legacy/communication/__init__.py' 2024-07-31T02:39:42,441 adding 'colossalai/legacy/communication/collective.py' 2024-07-31T02:39:42,443 adding 'colossalai/legacy/communication/p2p.py' 2024-07-31T02:39:42,445 adding 'colossalai/legacy/communication/p2p_v2.py' 2024-07-31T02:39:42,446 adding 'colossalai/legacy/communication/ring.py' 2024-07-31T02:39:42,447 adding 'colossalai/legacy/communication/utils.py' 2024-07-31T02:39:42,449 adding 'colossalai/legacy/context/__init__.py' 2024-07-31T02:39:42,452 adding 'colossalai/legacy/context/parallel_context.py' 2024-07-31T02:39:42,453 adding 'colossalai/legacy/context/parallel_mode.py' 2024-07-31T02:39:42,455 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2024-07-31T02:39:42,456 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2024-07-31T02:39:42,458 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2024-07-31T02:39:42,459 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2024-07-31T02:39:42,461 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2024-07-31T02:39:42,463 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2024-07-31T02:39:42,464 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2024-07-31T02:39:42,465 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2024-07-31T02:39:42,467 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2024-07-31T02:39:42,468 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2024-07-31T02:39:42,469 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2024-07-31T02:39:42,471 adding 'colossalai/legacy/context/random/__init__.py' 2024-07-31T02:39:42,472 adding 'colossalai/legacy/context/random/_helper.py' 2024-07-31T02:39:42,473 adding 'colossalai/legacy/context/random/seed_manager.py' 2024-07-31T02:39:42,475 adding 'colossalai/legacy/engine/__init__.py' 2024-07-31T02:39:42,477 adding 'colossalai/legacy/engine/_base_engine.py' 2024-07-31T02:39:42,478 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2024-07-31T02:39:42,480 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2024-07-31T02:39:42,482 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2024-07-31T02:39:42,483 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2024-07-31T02:39:42,484 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2024-07-31T02:39:42,485 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2024-07-31T02:39:42,487 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2024-07-31T02:39:42,488 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2024-07-31T02:39:42,489 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2024-07-31T02:39:42,490 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2024-07-31T02:39:42,492 adding 'colossalai/legacy/engine/schedule/__init__.py' 2024-07-31T02:39:42,493 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2024-07-31T02:39:42,495 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2024-07-31T02:39:42,499 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2024-07-31T02:39:42,501 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2024-07-31T02:39:42,502 adding 'colossalai/legacy/inference/__init__.py' 2024-07-31T02:39:42,504 adding 'colossalai/legacy/inference/async_engine.py' 2024-07-31T02:39:42,505 adding 'colossalai/legacy/inference/async_manager.py' 2024-07-31T02:39:42,507 adding 'colossalai/legacy/inference/manager.py' 2024-07-31T02:39:42,509 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2024-07-31T02:39:42,510 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2024-07-31T02:39:42,512 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2024-07-31T02:39:42,514 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2024-07-31T02:39:42,515 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2024-07-31T02:39:42,517 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2024-07-31T02:39:42,518 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2024-07-31T02:39:42,519 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2024-07-31T02:39:42,520 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2024-07-31T02:39:42,522 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2024-07-31T02:39:42,524 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2024-07-31T02:39:42,525 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2024-07-31T02:39:42,527 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2024-07-31T02:39:42,529 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2024-07-31T02:39:42,531 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2024-07-31T02:39:42,532 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2024-07-31T02:39:42,534 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2024-07-31T02:39:42,536 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2024-07-31T02:39:42,537 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2024-07-31T02:39:42,539 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2024-07-31T02:39:42,541 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2024-07-31T02:39:42,543 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2024-07-31T02:39:42,544 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2024-07-31T02:39:42,546 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2024-07-31T02:39:42,549 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2024-07-31T02:39:42,551 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2024-07-31T02:39:42,553 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2024-07-31T02:39:42,555 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2024-07-31T02:39:42,557 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2024-07-31T02:39:42,558 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2024-07-31T02:39:42,559 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2024-07-31T02:39:42,561 adding 'colossalai/legacy/nn/__init__.py' 2024-07-31T02:39:42,562 adding 'colossalai/legacy/nn/_ops/__init__.py' 2024-07-31T02:39:42,564 adding 'colossalai/legacy/nn/_ops/_utils.py' 2024-07-31T02:39:42,566 adding 'colossalai/legacy/nn/layer/__init__.py' 2024-07-31T02:39:42,567 adding 'colossalai/legacy/nn/layer/base_layer.py' 2024-07-31T02:39:42,569 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2024-07-31T02:39:42,570 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2024-07-31T02:39:42,571 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2024-07-31T02:39:42,573 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2024-07-31T02:39:42,574 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2024-07-31T02:39:42,575 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2024-07-31T02:39:42,577 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2024-07-31T02:39:42,579 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2024-07-31T02:39:42,580 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2024-07-31T02:39:42,584 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2024-07-31T02:39:42,586 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2024-07-31T02:39:42,588 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2024-07-31T02:39:42,590 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2024-07-31T02:39:42,593 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2024-07-31T02:39:42,595 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2024-07-31T02:39:42,598 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2024-07-31T02:39:42,600 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2024-07-31T02:39:42,604 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2024-07-31T02:39:42,605 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2024-07-31T02:39:42,608 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2024-07-31T02:39:42,609 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2024-07-31T02:39:42,613 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2024-07-31T02:39:42,615 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2024-07-31T02:39:42,616 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2024-07-31T02:39:42,617 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2024-07-31T02:39:42,619 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2024-07-31T02:39:42,621 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2024-07-31T02:39:42,622 adding 'colossalai/legacy/nn/layer/utils/common.py' 2024-07-31T02:39:42,623 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2024-07-31T02:39:42,625 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2024-07-31T02:39:42,627 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2024-07-31T02:39:42,628 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2024-07-31T02:39:42,630 adding 'colossalai/legacy/nn/loss/__init__.py' 2024-07-31T02:39:42,631 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2024-07-31T02:39:42,633 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2024-07-31T02:39:42,634 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2024-07-31T02:39:42,635 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2024-07-31T02:39:42,637 adding 'colossalai/legacy/nn/metric/__init__.py' 2024-07-31T02:39:42,638 adding 'colossalai/legacy/nn/metric/_utils.py' 2024-07-31T02:39:42,640 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2024-07-31T02:39:42,641 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2024-07-31T02:39:42,642 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2024-07-31T02:39:42,643 adding 'colossalai/legacy/nn/parallel/__init__.py' 2024-07-31T02:39:42,645 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2024-07-31T02:39:42,646 adding 'colossalai/legacy/nn/parallel/reducer.py' 2024-07-31T02:39:42,648 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2024-07-31T02:39:42,649 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2024-07-31T02:39:42,651 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2024-07-31T02:39:42,652 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2024-07-31T02:39:42,653 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2024-07-31T02:39:42,655 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2024-07-31T02:39:42,656 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2024-07-31T02:39:42,660 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2024-07-31T02:39:42,661 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2024-07-31T02:39:42,663 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2024-07-31T02:39:42,664 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2024-07-31T02:39:42,665 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2024-07-31T02:39:42,667 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2024-07-31T02:39:42,669 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2024-07-31T02:39:42,671 adding 'colossalai/legacy/pipeline/__init__.py' 2024-07-31T02:39:42,672 adding 'colossalai/legacy/pipeline/layer_spec.py' 2024-07-31T02:39:42,674 adding 'colossalai/legacy/pipeline/pipelinable.py' 2024-07-31T02:39:42,675 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2024-07-31T02:39:42,677 adding 'colossalai/legacy/pipeline/utils.py' 2024-07-31T02:39:42,679 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2024-07-31T02:39:42,680 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2024-07-31T02:39:42,682 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2024-07-31T02:39:42,683 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2024-07-31T02:39:42,685 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2024-07-31T02:39:42,691 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2024-07-31T02:39:42,694 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2024-07-31T02:39:42,695 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2024-07-31T02:39:42,697 adding 'colossalai/legacy/registry/__init__.py' 2024-07-31T02:39:42,698 adding 'colossalai/legacy/registry/registry.py' 2024-07-31T02:39:42,700 adding 'colossalai/legacy/tensor/__init__.py' 2024-07-31T02:39:42,701 adding 'colossalai/legacy/tensor/compute_spec.py' 2024-07-31T02:39:42,702 adding 'colossalai/legacy/tensor/const.py' 2024-07-31T02:39:42,703 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2024-07-31T02:39:42,705 adding 'colossalai/legacy/tensor/distspec.py' 2024-07-31T02:39:42,706 adding 'colossalai/legacy/tensor/op_wrapper.py' 2024-07-31T02:39:42,707 adding 'colossalai/legacy/tensor/process_group.py' 2024-07-31T02:39:42,709 adding 'colossalai/legacy/tensor/tensor_spec.py' 2024-07-31T02:39:42,710 adding 'colossalai/legacy/trainer/__init__.py' 2024-07-31T02:39:42,712 adding 'colossalai/legacy/trainer/_trainer.py' 2024-07-31T02:39:42,714 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2024-07-31T02:39:42,715 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2024-07-31T02:39:42,716 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2024-07-31T02:39:42,718 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2024-07-31T02:39:42,719 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2024-07-31T02:39:42,721 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2024-07-31T02:39:42,723 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2024-07-31T02:39:42,724 adding 'colossalai/legacy/utils/__init__.py' 2024-07-31T02:39:42,726 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2024-07-31T02:39:42,728 adding 'colossalai/legacy/utils/checkpointing.py' 2024-07-31T02:39:42,730 adding 'colossalai/legacy/utils/common.py' 2024-07-31T02:39:42,732 adding 'colossalai/legacy/utils/memory.py' 2024-07-31T02:39:42,734 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2024-07-31T02:39:42,735 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2024-07-31T02:39:42,736 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2024-07-31T02:39:42,738 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2024-07-31T02:39:42,739 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2024-07-31T02:39:42,741 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2024-07-31T02:39:42,742 adding 'colossalai/legacy/utils/profiler/__init__.py' 2024-07-31T02:39:42,744 adding 'colossalai/legacy/utils/profiler/extention.py' 2024-07-31T02:39:42,745 adding 'colossalai/legacy/utils/profiler/profiler.py' 2024-07-31T02:39:42,747 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2024-07-31T02:39:42,749 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2024-07-31T02:39:42,750 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2024-07-31T02:39:42,752 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2024-07-31T02:39:42,753 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2024-07-31T02:39:42,755 adding 'colossalai/legacy/zero/__init__.py' 2024-07-31T02:39:42,757 adding 'colossalai/legacy/zero/gemini/__init__.py' 2024-07-31T02:39:42,759 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2024-07-31T02:39:42,760 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2024-07-31T02:39:42,762 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2024-07-31T02:39:42,763 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2024-07-31T02:39:42,765 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2024-07-31T02:39:42,766 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2024-07-31T02:39:42,768 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2024-07-31T02:39:42,770 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2024-07-31T02:39:42,771 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2024-07-31T02:39:42,773 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2024-07-31T02:39:42,774 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2024-07-31T02:39:42,776 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2024-07-31T02:39:42,777 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2024-07-31T02:39:42,778 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2024-07-31T02:39:42,780 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2024-07-31T02:39:42,782 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2024-07-31T02:39:42,783 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2024-07-31T02:39:42,784 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2024-07-31T02:39:42,785 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2024-07-31T02:39:42,787 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2024-07-31T02:39:42,788 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2024-07-31T02:39:42,790 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2024-07-31T02:39:42,791 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2024-07-31T02:39:42,795 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2024-07-31T02:39:42,796 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2024-07-31T02:39:42,797 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2024-07-31T02:39:42,799 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2024-07-31T02:39:42,801 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2024-07-31T02:39:42,803 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2024-07-31T02:39:42,804 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2024-07-31T02:39:42,806 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2024-07-31T02:39:42,807 adding 'colossalai/logging/__init__.py' 2024-07-31T02:39:42,809 adding 'colossalai/logging/logger.py' 2024-07-31T02:39:42,810 adding 'colossalai/moe/__init__.py' 2024-07-31T02:39:42,812 adding 'colossalai/moe/_operation.py' 2024-07-31T02:39:42,815 adding 'colossalai/moe/load_balance.py' 2024-07-31T02:39:42,817 adding 'colossalai/moe/manager.py' 2024-07-31T02:39:42,818 adding 'colossalai/moe/utils.py' 2024-07-31T02:39:42,820 adding 'colossalai/nn/__init__.py' 2024-07-31T02:39:42,822 adding 'colossalai/nn/init.py' 2024-07-31T02:39:42,824 adding 'colossalai/nn/layer/__init__.py' 2024-07-31T02:39:42,825 adding 'colossalai/nn/layer/layernorm.py' 2024-07-31T02:39:42,827 adding 'colossalai/nn/layer/scaled_softmax.py' 2024-07-31T02:39:42,828 adding 'colossalai/nn/layer/utils.py' 2024-07-31T02:39:42,830 adding 'colossalai/nn/loss/__init__.py' 2024-07-31T02:39:42,831 adding 'colossalai/nn/lr_scheduler/__init__.py' 2024-07-31T02:39:42,833 adding 'colossalai/nn/lr_scheduler/cosine.py' 2024-07-31T02:39:42,834 adding 'colossalai/nn/lr_scheduler/delayed.py' 2024-07-31T02:39:42,835 adding 'colossalai/nn/lr_scheduler/linear.py' 2024-07-31T02:39:42,837 adding 'colossalai/nn/lr_scheduler/multistep.py' 2024-07-31T02:39:42,838 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2024-07-31T02:39:42,839 adding 'colossalai/nn/lr_scheduler/poly.py' 2024-07-31T02:39:42,841 adding 'colossalai/nn/lr_scheduler/torch.py' 2024-07-31T02:39:42,843 adding 'colossalai/nn/optimizer/__init__.py' 2024-07-31T02:39:42,845 adding 'colossalai/nn/optimizer/adafactor.py' 2024-07-31T02:39:42,846 adding 'colossalai/nn/optimizer/came.py' 2024-07-31T02:39:42,848 adding 'colossalai/nn/optimizer/cpu_adam.py' 2024-07-31T02:39:42,850 adding 'colossalai/nn/optimizer/distributed_adafactor.py' 2024-07-31T02:39:42,853 adding 'colossalai/nn/optimizer/distributed_came.py' 2024-07-31T02:39:42,855 adding 'colossalai/nn/optimizer/distributed_galore.py' 2024-07-31T02:39:42,857 adding 'colossalai/nn/optimizer/distributed_lamb.py' 2024-07-31T02:39:42,859 adding 'colossalai/nn/optimizer/fused_adam.py' 2024-07-31T02:39:42,860 adding 'colossalai/nn/optimizer/fused_lamb.py' 2024-07-31T02:39:42,862 adding 'colossalai/nn/optimizer/fused_sgd.py' 2024-07-31T02:39:42,864 adding 'colossalai/nn/optimizer/galore.py' 2024-07-31T02:39:42,866 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2024-07-31T02:39:42,867 adding 'colossalai/nn/optimizer/lamb.py' 2024-07-31T02:39:42,868 adding 'colossalai/nn/optimizer/lars.py' 2024-07-31T02:39:42,870 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2024-07-31T02:39:42,871 adding 'colossalai/pipeline/__init__.py' 2024-07-31T02:39:42,874 adding 'colossalai/pipeline/p2p.py' 2024-07-31T02:39:42,876 adding 'colossalai/pipeline/stage_manager.py' 2024-07-31T02:39:42,878 adding 'colossalai/pipeline/schedule/__init__.py' 2024-07-31T02:39:42,879 adding 'colossalai/pipeline/schedule/_utils.py' 2024-07-31T02:39:42,880 adding 'colossalai/pipeline/schedule/base.py' 2024-07-31T02:39:42,882 adding 'colossalai/pipeline/schedule/generate.py' 2024-07-31T02:39:42,885 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2024-07-31T02:39:42,888 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2024-07-31T02:39:42,889 adding 'colossalai/quantization/__init__.py' 2024-07-31T02:39:42,891 adding 'colossalai/quantization/bnb.py' 2024-07-31T02:39:42,893 adding 'colossalai/quantization/bnb_config.py' 2024-07-31T02:39:42,894 adding 'colossalai/shardformer/__init__.py' 2024-07-31T02:39:42,895 adding 'colossalai/shardformer/_utils.py' 2024-07-31T02:39:42,897 adding 'colossalai/shardformer/layer/__init__.py' 2024-07-31T02:39:42,900 adding 'colossalai/shardformer/layer/_operation.py' 2024-07-31T02:39:42,903 adding 'colossalai/shardformer/layer/attn.py' 2024-07-31T02:39:42,904 adding 'colossalai/shardformer/layer/dropout.py' 2024-07-31T02:39:42,906 adding 'colossalai/shardformer/layer/embedding.py' 2024-07-31T02:39:42,909 adding 'colossalai/shardformer/layer/linear.py' 2024-07-31T02:39:42,910 adding 'colossalai/shardformer/layer/loss.py' 2024-07-31T02:39:42,912 adding 'colossalai/shardformer/layer/normalization.py' 2024-07-31T02:39:42,914 adding 'colossalai/shardformer/layer/parallel_module.py' 2024-07-31T02:39:42,917 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2024-07-31T02:39:42,919 adding 'colossalai/shardformer/layer/utils.py' 2024-07-31T02:39:42,921 adding 'colossalai/shardformer/layer/moe/__init__.py' 2024-07-31T02:39:42,922 adding 'colossalai/shardformer/layer/moe/experts.py' 2024-07-31T02:39:42,924 adding 'colossalai/shardformer/layer/moe/layers.py' 2024-07-31T02:39:42,926 adding 'colossalai/shardformer/layer/moe/routers.py' 2024-07-31T02:39:42,928 adding 'colossalai/shardformer/modeling/__init__.py' 2024-07-31T02:39:42,932 adding 'colossalai/shardformer/modeling/bert.py' 2024-07-31T02:39:42,934 adding 'colossalai/shardformer/modeling/blip2.py' 2024-07-31T02:39:42,938 adding 'colossalai/shardformer/modeling/bloom.py' 2024-07-31T02:39:42,941 adding 'colossalai/shardformer/modeling/chatglm2.py' 2024-07-31T02:39:42,943 adding 'colossalai/shardformer/modeling/command.py' 2024-07-31T02:39:42,946 adding 'colossalai/shardformer/modeling/deepseek.py' 2024-07-31T02:39:42,949 adding 'colossalai/shardformer/modeling/falcon.py' 2024-07-31T02:39:42,954 adding 'colossalai/shardformer/modeling/gpt2.py' 2024-07-31T02:39:42,958 adding 'colossalai/shardformer/modeling/gptj.py' 2024-07-31T02:39:42,959 adding 'colossalai/shardformer/modeling/jit.py' 2024-07-31T02:39:42,963 adding 'colossalai/shardformer/modeling/llama.py' 2024-07-31T02:39:42,966 adding 'colossalai/shardformer/modeling/mistral.py' 2024-07-31T02:39:42,968 adding 'colossalai/shardformer/modeling/mixtral.py' 2024-07-31T02:39:42,972 adding 'colossalai/shardformer/modeling/opt.py' 2024-07-31T02:39:42,976 adding 'colossalai/shardformer/modeling/qwen2.py' 2024-07-31T02:39:42,977 adding 'colossalai/shardformer/modeling/sam.py' 2024-07-31T02:39:42,981 adding 'colossalai/shardformer/modeling/t5.py' 2024-07-31T02:39:42,983 adding 'colossalai/shardformer/modeling/vit.py' 2024-07-31T02:39:42,988 adding 'colossalai/shardformer/modeling/whisper.py' 2024-07-31T02:39:42,990 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2024-07-31T02:39:42,991 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2024-07-31T02:39:42,997 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2024-07-31T02:39:42,999 adding 'colossalai/shardformer/policies/__init__.py' 2024-07-31T02:39:43,001 adding 'colossalai/shardformer/policies/auto_policy.py' 2024-07-31T02:39:43,002 adding 'colossalai/shardformer/policies/base_policy.py' 2024-07-31T02:39:43,005 adding 'colossalai/shardformer/policies/bert.py' 2024-07-31T02:39:43,006 adding 'colossalai/shardformer/policies/blip2.py' 2024-07-31T02:39:43,008 adding 'colossalai/shardformer/policies/bloom.py' 2024-07-31T02:39:43,010 adding 'colossalai/shardformer/policies/chatglm2.py' 2024-07-31T02:39:43,012 adding 'colossalai/shardformer/policies/command.py' 2024-07-31T02:39:43,013 adding 'colossalai/shardformer/policies/deepseek.py' 2024-07-31T02:39:43,015 adding 'colossalai/shardformer/policies/falcon.py' 2024-07-31T02:39:43,018 adding 'colossalai/shardformer/policies/gpt2.py' 2024-07-31T02:39:43,019 adding 'colossalai/shardformer/policies/gptj.py' 2024-07-31T02:39:43,021 adding 'colossalai/shardformer/policies/llama.py' 2024-07-31T02:39:43,023 adding 'colossalai/shardformer/policies/mistral.py' 2024-07-31T02:39:43,025 adding 'colossalai/shardformer/policies/mixtral.py' 2024-07-31T02:39:43,026 adding 'colossalai/shardformer/policies/opt.py' 2024-07-31T02:39:43,029 adding 'colossalai/shardformer/policies/qwen2.py' 2024-07-31T02:39:43,030 adding 'colossalai/shardformer/policies/sam.py' 2024-07-31T02:39:43,032 adding 'colossalai/shardformer/policies/t5.py' 2024-07-31T02:39:43,034 adding 'colossalai/shardformer/policies/vit.py' 2024-07-31T02:39:43,036 adding 'colossalai/shardformer/policies/whisper.py' 2024-07-31T02:39:43,038 adding 'colossalai/shardformer/shard/__init__.py' 2024-07-31T02:39:43,039 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2024-07-31T02:39:43,041 adding 'colossalai/shardformer/shard/shard_config.py' 2024-07-31T02:39:43,043 adding 'colossalai/shardformer/shard/sharder.py' 2024-07-31T02:39:43,044 adding 'colossalai/shardformer/shard/shardformer.py' 2024-07-31T02:39:43,045 adding 'colossalai/shardformer/shard/utils.py' 2024-07-31T02:39:43,047 adding 'colossalai/tensor/__init__.py' 2024-07-31T02:39:43,048 adding 'colossalai/tensor/colo_parameter.py' 2024-07-31T02:39:43,050 adding 'colossalai/tensor/colo_tensor.py' 2024-07-31T02:39:43,052 adding 'colossalai/tensor/comm_spec.py' 2024-07-31T02:39:43,054 adding 'colossalai/tensor/param_op_hook.py' 2024-07-31T02:39:43,058 adding 'colossalai/tensor/shape_consistency.py' 2024-07-31T02:39:43,060 adding 'colossalai/tensor/sharding_spec.py' 2024-07-31T02:39:43,062 adding 'colossalai/tensor/utils.py' 2024-07-31T02:39:43,064 adding 'colossalai/tensor/d_tensor/__init__.py' 2024-07-31T02:39:43,066 adding 'colossalai/tensor/d_tensor/api.py' 2024-07-31T02:39:43,068 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2024-07-31T02:39:43,070 adding 'colossalai/tensor/d_tensor/layout.py' 2024-07-31T02:39:43,073 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2024-07-31T02:39:43,074 adding 'colossalai/tensor/d_tensor/misc.py' 2024-07-31T02:39:43,076 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2024-07-31T02:39:43,078 adding 'colossalai/tensor/d_tensor/utils.py' 2024-07-31T02:39:43,080 adding 'colossalai/tensor/moe_tensor/__init__.py' 2024-07-31T02:39:43,081 adding 'colossalai/tensor/moe_tensor/api.py' 2024-07-31T02:39:43,082 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2024-07-31T02:39:43,084 adding 'colossalai/tensor/padded_tensor/__init__.py' 2024-07-31T02:39:43,085 adding 'colossalai/tensor/padded_tensor/api.py' 2024-07-31T02:39:43,087 adding 'colossalai/testing/__init__.py' 2024-07-31T02:39:43,089 adding 'colossalai/testing/comparison.py' 2024-07-31T02:39:43,090 adding 'colossalai/testing/pytest_wrapper.py' 2024-07-31T02:39:43,091 adding 'colossalai/testing/random.py' 2024-07-31T02:39:43,093 adding 'colossalai/testing/utils.py' 2024-07-31T02:39:43,095 adding 'colossalai/utils/__init__.py' 2024-07-31T02:39:43,096 adding 'colossalai/utils/common.py' 2024-07-31T02:39:43,097 adding 'colossalai/utils/memory.py' 2024-07-31T02:39:43,099 adding 'colossalai/utils/timer.py' 2024-07-31T02:39:43,100 adding 'colossalai/utils/model/__init__.py' 2024-07-31T02:39:43,101 adding 'colossalai/utils/model/utils.py' 2024-07-31T02:39:43,103 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2024-07-31T02:39:43,104 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2024-07-31T02:39:43,105 adding 'colossalai/utils/rank_recorder/__init__.py' 2024-07-31T02:39:43,107 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2024-07-31T02:39:43,108 adding 'colossalai/utils/tensor_detector/__init__.py' 2024-07-31T02:39:43,110 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2024-07-31T02:39:43,112 adding 'colossalai/zero/__init__.py' 2024-07-31T02:39:43,113 adding 'colossalai/zero/wrapper.py' 2024-07-31T02:39:43,115 adding 'colossalai/zero/gemini/__init__.py' 2024-07-31T02:39:43,120 adding 'colossalai/zero/gemini/gemini_ddp.py' 2024-07-31T02:39:43,121 adding 'colossalai/zero/gemini/gemini_hook.py' 2024-07-31T02:39:43,123 adding 'colossalai/zero/gemini/gemini_mgr.py' 2024-07-31T02:39:43,127 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2024-07-31T02:39:43,129 adding 'colossalai/zero/gemini/placement_policy.py' 2024-07-31T02:39:43,131 adding 'colossalai/zero/gemini/utils.py' 2024-07-31T02:39:43,132 adding 'colossalai/zero/gemini/chunk/__init__.py' 2024-07-31T02:39:43,135 adding 'colossalai/zero/gemini/chunk/chunk.py' 2024-07-31T02:39:43,138 adding 'colossalai/zero/gemini/chunk/manager.py' 2024-07-31T02:39:43,139 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2024-07-31T02:39:43,140 adding 'colossalai/zero/gemini/chunk/utils.py' 2024-07-31T02:39:43,142 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2024-07-31T02:39:43,143 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2024-07-31T02:39:43,145 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2024-07-31T02:39:43,146 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2024-07-31T02:39:43,148 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2024-07-31T02:39:43,149 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2024-07-31T02:39:43,150 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2024-07-31T02:39:43,151 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2024-07-31T02:39:43,153 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2024-07-31T02:39:43,154 adding 'colossalai/zero/low_level/__init__.py' 2024-07-31T02:39:43,156 adding 'colossalai/zero/low_level/_utils.py' 2024-07-31T02:39:43,161 adding 'colossalai/zero/low_level/low_level_optim.py' 2024-07-31T02:39:43,162 adding 'colossalai/zero/low_level/zero_hook.py' 2024-07-31T02:39:43,164 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2024-07-31T02:39:43,165 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2024-07-31T02:39:43,166 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2024-07-31T02:39:43,168 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2024-07-31T02:39:43,169 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2024-07-31T02:39:43,172 adding 'extensions/csrc/__init__.py' 2024-07-31T02:39:43,173 adding 'extensions/pybind/__init__.py' 2024-07-31T02:39:43,175 adding 'extensions/pybind/cpu_adam/__init__.py' 2024-07-31T02:39:43,176 adding 'extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-07-31T02:39:43,177 adding 'extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-07-31T02:39:43,179 adding 'extensions/pybind/flash_attention/__init__.py' 2024-07-31T02:39:43,181 adding 'extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-07-31T02:39:43,182 adding 'extensions/pybind/flash_attention/flash_attention_npu.py' 2024-07-31T02:39:43,183 adding 'extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-07-31T02:39:43,184 adding 'extensions/pybind/inference/__init__.py' 2024-07-31T02:39:43,185 adding 'extensions/pybind/inference/inference_ops_cuda.py' 2024-07-31T02:39:43,187 adding 'extensions/pybind/layernorm/__init__.py' 2024-07-31T02:39:43,188 adding 'extensions/pybind/layernorm/layernorm_cuda.py' 2024-07-31T02:39:43,190 adding 'extensions/pybind/moe/__init__.py' 2024-07-31T02:39:43,191 adding 'extensions/pybind/moe/moe_cuda.py' 2024-07-31T02:39:43,192 adding 'extensions/pybind/optimizer/__init__.py' 2024-07-31T02:39:43,194 adding 'extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-07-31T02:39:43,195 adding 'extensions/pybind/softmax/__init__.py' 2024-07-31T02:39:43,196 adding 'extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-07-31T02:39:43,198 adding 'extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-07-31T02:39:43,201 adding 'colossalai-0.4.2.dist-info/LICENSE' 2024-07-31T02:39:43,204 adding 'colossalai-0.4.2.dist-info/METADATA' 2024-07-31T02:39:43,205 adding 'colossalai-0.4.2.dist-info/WHEEL' 2024-07-31T02:39:43,206 adding 'colossalai-0.4.2.dist-info/entry_points.txt' 2024-07-31T02:39:43,207 adding 'colossalai-0.4.2.dist-info/top_level.txt' 2024-07-31T02:39:43,222 adding 'colossalai-0.4.2.dist-info/RECORD' 2024-07-31T02:39:43,249 removing build/bdist.linux-armv7l/wheel 2024-07-31T02:39:43,613 Building wheel for colossalai (setup.py): finished with status 'done' 2024-07-31T02:39:43,631 Created wheel for colossalai: filename=colossalai-0.4.2-py3-none-any.whl size=1564486 sha256=37c71db35629462ee7107007adb59e8a480ef50ec550a31198b6fe08fb8acc84 2024-07-31T02:39:43,633 Stored in directory: /tmp/pip-ephem-wheel-cache-wmwes89e/wheels/5b/aa/54/630bca7c245c9e208369dd14ee70839c4d58ab5b5373ae785f 2024-07-31T02:39:43,674 Successfully built colossalai 2024-07-31T02:39:43,724 Removed build tracker: '/tmp/pip-build-tracker-fm_z1lbu'