2024-09-10T02:59:14,633 Created temporary directory: /tmp/pip-build-tracker-dl_ww15u 2024-09-10T02:59:14,634 Initialized build tracking at /tmp/pip-build-tracker-dl_ww15u 2024-09-10T02:59:14,635 Created build tracker: /tmp/pip-build-tracker-dl_ww15u 2024-09-10T02:59:14,635 Entered build tracker: /tmp/pip-build-tracker-dl_ww15u 2024-09-10T02:59:14,636 Created temporary directory: /tmp/pip-wheel-vomwca7d 2024-09-10T02:59:14,640 Created temporary directory: /tmp/pip-ephem-wheel-cache-5hxyouce 2024-09-10T02:59:14,687 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-09-10T02:59:14,690 2 location(s) to search for versions of colossalai: 2024-09-10T02:59:14,690 * https://pypi.org/simple/colossalai/ 2024-09-10T02:59:14,690 * https://www.piwheels.org/simple/colossalai/ 2024-09-10T02:59:14,691 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2024-09-10T02:59:14,692 Getting page https://pypi.org/simple/colossalai/ 2024-09-10T02:59:14,693 Found index url https://pypi.org/simple/ 2024-09-10T02:59:14,906 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2024-09-10T02:59:14,912 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2024-09-10T02:59:14,913 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2024-09-10T02:59:14,914 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2024-09-10T02:59:14,915 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2024-09-10T02:59:14,916 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2024-09-10T02:59:14,917 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2024-09-10T02:59:14,918 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2024-09-10T02:59:14,919 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2024-09-10T02:59:14,920 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2024-09-10T02:59:14,921 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2024-09-10T02:59:14,922 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2024-09-10T02:59:14,923 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2024-09-10T02:59:14,923 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2024-09-10T02:59:14,925 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2024-09-10T02:59:14,925 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2024-09-10T02:59:14,926 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2024-09-10T02:59:14,927 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2024-09-10T02:59:14,928 Found link https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.8 2024-09-10T02:59:14,929 Found link https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.9 2024-09-10T02:59:14,929 Found link https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.0 2024-09-10T02:59:14,930 Found link https://files.pythonhosted.org/packages/3c/cd/206593b5c417a436382ca5e93c0188c031830341ee352c35e020ce83f57c/colossalai-0.4.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.1 2024-09-10T02:59:14,931 Found link https://files.pythonhosted.org/packages/0d/98/7adbf8fd663234fee2ea43382b065979c22612f319c322aa0eb675457327/colossalai-0.4.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.2 2024-09-10T02:59:14,933 Found link https://files.pythonhosted.org/packages/96/bd/716f9dbdee5a564da03d55d3d9e65b85c952cb62ed12519a8566adf63005/colossalai-0.4.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.3 2024-09-10T02:59:14,933 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2024-09-10T02:59:14,934 Getting page https://www.piwheels.org/simple/colossalai/ 2024-09-10T02:59:14,936 Found index url https://www.piwheels.org/simple/ 2024-09-10T02:59:15,089 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2024-09-10T02:59:15,096 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.2-py3-none-any.whl#sha256=37c71db35629462ee7107007adb59e8a480ef50ec550a31198b6fe08fb8acc84 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,097 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.1-py3-none-any.whl#sha256=5355444b4f627d0b5516a1053a0b99c3eb130a9bdde95abefa4dcd7a881b0119 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,098 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.0-py3-none-any.whl#sha256=bca14360afc924008f910785cbb07e07f1f743e3a7182103caa09a4d6c49d3a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,098 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.9-py3-none-any.whl#sha256=670e4e0d607a0803e8f0a7349996228f4cfa411d817bd631c07b1b2064e7af48 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,099 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.8-py3-none-any.whl#sha256=73a2dba29be661597422944d917c709df77c91843d30ab323f6c740173686dab (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,099 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.7-py3-none-any.whl#sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,100 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,100 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,101 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,101 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,102 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,102 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,103 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,103 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,104 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,104 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,105 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,106 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,106 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,107 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,107 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,108 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-10T02:59:15,108 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2024-09-10T02:59:15,109 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2024-09-10T02:59:15,130 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2024-09-10T02:59:15,132 Collecting colossalai==0.4.3 2024-09-10T02:59:15,134 Created temporary directory: /tmp/pip-unpack-x8knhor7 2024-09-10T02:59:15,350 Downloading colossalai-0.4.3.tar.gz (1.3 MB) 2024-09-10T02:59:17,780 Added colossalai==0.4.3 from https://files.pythonhosted.org/packages/96/bd/716f9dbdee5a564da03d55d3d9e65b85c952cb62ed12519a8566adf63005/colossalai-0.4.3.tar.gz to build tracker '/tmp/pip-build-tracker-dl_ww15u' 2024-09-10T02:59:17,782 Running setup.py (path:/tmp/pip-wheel-vomwca7d/colossalai_1af6721a2ad942bd908f824117b96736/setup.py) egg_info for package colossalai 2024-09-10T02:59:17,783 Created temporary directory: /tmp/pip-pip-egg-info-getwjl8n 2024-09-10T02:59:17,784 Preparing metadata (setup.py): started 2024-09-10T02:59:17,785 Running command python setup.py egg_info 2024-09-10T02:59:19,007 running egg_info 2024-09-10T02:59:19,008 creating /tmp/pip-pip-egg-info-getwjl8n/colossalai.egg-info 2024-09-10T02:59:19,036 writing /tmp/pip-pip-egg-info-getwjl8n/colossalai.egg-info/PKG-INFO 2024-09-10T02:59:19,040 writing dependency_links to /tmp/pip-pip-egg-info-getwjl8n/colossalai.egg-info/dependency_links.txt 2024-09-10T02:59:19,042 writing entry points to /tmp/pip-pip-egg-info-getwjl8n/colossalai.egg-info/entry_points.txt 2024-09-10T02:59:19,044 writing requirements to /tmp/pip-pip-egg-info-getwjl8n/colossalai.egg-info/requires.txt 2024-09-10T02:59:19,045 writing top-level names to /tmp/pip-pip-egg-info-getwjl8n/colossalai.egg-info/top_level.txt 2024-09-10T02:59:19,046 writing manifest file '/tmp/pip-pip-egg-info-getwjl8n/colossalai.egg-info/SOURCES.txt' 2024-09-10T02:59:19,349 reading manifest file '/tmp/pip-pip-egg-info-getwjl8n/colossalai.egg-info/SOURCES.txt' 2024-09-10T02:59:19,350 reading manifest template 'MANIFEST.in' 2024-09-10T02:59:20,640 warning: no files found matching '*.tr' under directory 'colossalai' 2024-09-10T02:59:21,296 warning: no files found matching '*.cc' under directory 'colossalai' 2024-09-10T02:59:21,627 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-09-10T02:59:21,771 warning: no files found matching '*.tr' under directory 'extensions' 2024-09-10T02:59:21,827 warning: no files found matching '*.cc' under directory 'extensions' 2024-09-10T02:59:21,856 warning: no files found matching '*.pyi' under directory 'extensions' 2024-09-10T02:59:21,856 adding license file 'LICENSE' 2024-09-10T02:59:21,887 writing manifest file '/tmp/pip-pip-egg-info-getwjl8n/colossalai.egg-info/SOURCES.txt' 2024-09-10T02:59:22,006 Preparing metadata (setup.py): finished with status 'done' 2024-09-10T02:59:22,012 Source in /tmp/pip-wheel-vomwca7d/colossalai_1af6721a2ad942bd908f824117b96736 has version 0.4.3, which satisfies requirement colossalai==0.4.3 from https://files.pythonhosted.org/packages/96/bd/716f9dbdee5a564da03d55d3d9e65b85c952cb62ed12519a8566adf63005/colossalai-0.4.3.tar.gz 2024-09-10T02:59:22,013 Removed colossalai==0.4.3 from https://files.pythonhosted.org/packages/96/bd/716f9dbdee5a564da03d55d3d9e65b85c952cb62ed12519a8566adf63005/colossalai-0.4.3.tar.gz from build tracker '/tmp/pip-build-tracker-dl_ww15u' 2024-09-10T02:59:22,026 Created temporary directory: /tmp/pip-unpack-id_yved6 2024-09-10T02:59:22,027 Created temporary directory: /tmp/pip-unpack-j55tp20y 2024-09-10T02:59:22,027 Building wheels for collected packages: colossalai 2024-09-10T02:59:22,031 Created temporary directory: /tmp/pip-wheel-ann8zngd 2024-09-10T02:59:22,032 Building wheel for colossalai (setup.py): started 2024-09-10T02:59:22,033 Destination directory: /tmp/pip-wheel-ann8zngd 2024-09-10T02:59:22,033 Running command python setup.py bdist_wheel 2024-09-10T02:59:23,180 running bdist_wheel 2024-09-10T02:59:23,350 running build 2024-09-10T02:59:23,350 running build_py 2024-09-10T02:59:23,383 creating build 2024-09-10T02:59:23,384 creating build/lib 2024-09-10T02:59:23,385 creating build/lib/colossalai 2024-09-10T02:59:23,386 copying colossalai/__init__.py -> build/lib/colossalai 2024-09-10T02:59:23,388 copying colossalai/initialize.py -> build/lib/colossalai 2024-09-10T02:59:23,391 copying colossalai/version.py -> build/lib/colossalai 2024-09-10T02:59:23,393 creating build/lib/colossalai/zero 2024-09-10T02:59:23,394 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2024-09-10T02:59:23,396 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2024-09-10T02:59:23,399 creating build/lib/colossalai/interface 2024-09-10T02:59:23,400 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2024-09-10T02:59:23,402 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2024-09-10T02:59:23,404 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2024-09-10T02:59:23,406 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2024-09-10T02:59:23,409 creating build/lib/colossalai/fx 2024-09-10T02:59:23,410 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2024-09-10T02:59:23,412 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2024-09-10T02:59:23,415 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2024-09-10T02:59:23,417 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2024-09-10T02:59:23,419 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2024-09-10T02:59:23,421 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2024-09-10T02:59:23,424 creating build/lib/colossalai/shardformer 2024-09-10T02:59:23,425 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2024-09-10T02:59:23,427 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2024-09-10T02:59:23,429 creating build/lib/colossalai/moe 2024-09-10T02:59:23,430 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2024-09-10T02:59:23,432 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2024-09-10T02:59:23,435 creating build/lib/colossalai/cli 2024-09-10T02:59:23,437 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2024-09-10T02:59:23,439 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2024-09-10T02:59:23,441 creating build/lib/colossalai/testing 2024-09-10T02:59:23,443 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2024-09-10T02:59:23,445 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2024-09-10T02:59:23,447 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2024-09-10T02:59:23,449 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2024-09-10T02:59:23,451 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2024-09-10T02:59:23,453 creating build/lib/colossalai/booster 2024-09-10T02:59:23,455 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2024-09-10T02:59:23,457 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2024-09-10T02:59:23,459 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2024-09-10T02:59:23,462 creating build/lib/colossalai/context 2024-09-10T02:59:23,463 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2024-09-10T02:59:23,465 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2024-09-10T02:59:23,467 copying colossalai/context/config.py -> build/lib/colossalai/context 2024-09-10T02:59:23,469 creating build/lib/colossalai/lazy 2024-09-10T02:59:23,470 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2024-09-10T02:59:23,472 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2024-09-10T02:59:23,475 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2024-09-10T02:59:23,477 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2024-09-10T02:59:23,480 creating build/lib/colossalai/device 2024-09-10T02:59:23,481 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2024-09-10T02:59:23,484 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2024-09-10T02:59:23,486 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2024-09-10T02:59:23,488 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2024-09-10T02:59:23,491 creating build/lib/colossalai/legacy 2024-09-10T02:59:23,492 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2024-09-10T02:59:23,494 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2024-09-10T02:59:23,495 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2024-09-10T02:59:23,497 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2024-09-10T02:59:23,499 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2024-09-10T02:59:23,501 creating build/lib/colossalai/_analyzer 2024-09-10T02:59:23,502 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2024-09-10T02:59:23,504 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2024-09-10T02:59:23,506 creating build/lib/colossalai/cluster 2024-09-10T02:59:23,507 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2024-09-10T02:59:23,509 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2024-09-10T02:59:23,511 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2024-09-10T02:59:23,512 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2024-09-10T02:59:23,514 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2024-09-10T02:59:23,517 creating build/lib/colossalai/kernel 2024-09-10T02:59:23,518 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2024-09-10T02:59:23,520 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2024-09-10T02:59:23,522 creating build/lib/colossalai/quantization 2024-09-10T02:59:23,523 copying colossalai/quantization/__init__.py -> build/lib/colossalai/quantization 2024-09-10T02:59:23,525 copying colossalai/quantization/bnb.py -> build/lib/colossalai/quantization 2024-09-10T02:59:23,527 copying colossalai/quantization/utils.py -> build/lib/colossalai/quantization 2024-09-10T02:59:23,529 copying colossalai/quantization/bnb_config.py -> build/lib/colossalai/quantization 2024-09-10T02:59:23,531 copying colossalai/quantization/fp8_hook.py -> build/lib/colossalai/quantization 2024-09-10T02:59:23,533 copying colossalai/quantization/fp8.py -> build/lib/colossalai/quantization 2024-09-10T02:59:23,536 creating build/lib/colossalai/amp 2024-09-10T02:59:23,536 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2024-09-10T02:59:23,538 creating build/lib/colossalai/logging 2024-09-10T02:59:23,539 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2024-09-10T02:59:23,541 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2024-09-10T02:59:23,543 creating build/lib/colossalai/checkpoint_io 2024-09-10T02:59:23,544 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2024-09-10T02:59:23,546 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2024-09-10T02:59:23,548 copying colossalai/checkpoint_io/moe_checkpoint.py -> build/lib/colossalai/checkpoint_io 2024-09-10T02:59:23,551 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-09-10T02:59:23,553 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2024-09-10T02:59:23,555 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-09-10T02:59:23,557 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2024-09-10T02:59:23,560 creating build/lib/colossalai/nn 2024-09-10T02:59:23,561 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2024-09-10T02:59:23,563 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2024-09-10T02:59:23,566 creating build/lib/colossalai/inference 2024-09-10T02:59:23,567 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2024-09-10T02:59:23,568 copying colossalai/inference/graph_runner.py -> build/lib/colossalai/inference 2024-09-10T02:59:23,570 copying colossalai/inference/sampler.py -> build/lib/colossalai/inference 2024-09-10T02:59:23,572 copying colossalai/inference/utils.py -> build/lib/colossalai/inference 2024-09-10T02:59:23,574 copying colossalai/inference/config.py -> build/lib/colossalai/inference 2024-09-10T02:59:23,577 copying colossalai/inference/batch_bucket.py -> build/lib/colossalai/inference 2024-09-10T02:59:23,579 copying colossalai/inference/logit_processors.py -> build/lib/colossalai/inference 2024-09-10T02:59:23,582 copying colossalai/inference/flash_decoding_utils.py -> build/lib/colossalai/inference 2024-09-10T02:59:23,583 copying colossalai/inference/struct.py -> build/lib/colossalai/inference 2024-09-10T02:59:23,586 creating build/lib/colossalai/pipeline 2024-09-10T02:59:23,587 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2024-09-10T02:59:23,589 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2024-09-10T02:59:23,592 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2024-09-10T02:59:23,594 creating build/lib/colossalai/tensor 2024-09-10T02:59:23,595 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2024-09-10T02:59:23,597 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2024-09-10T02:59:23,599 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2024-09-10T02:59:23,601 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2024-09-10T02:59:23,604 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2024-09-10T02:59:23,606 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2024-09-10T02:59:23,609 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2024-09-10T02:59:23,611 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2024-09-10T02:59:23,614 creating build/lib/colossalai/accelerator 2024-09-10T02:59:23,615 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2024-09-10T02:59:23,617 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2024-09-10T02:59:23,619 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2024-09-10T02:59:23,622 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2024-09-10T02:59:23,625 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2024-09-10T02:59:23,627 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2024-09-10T02:59:23,629 creating build/lib/colossalai/_C 2024-09-10T02:59:23,630 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2024-09-10T02:59:23,633 creating build/lib/colossalai/utils 2024-09-10T02:59:23,634 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2024-09-10T02:59:23,636 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2024-09-10T02:59:23,638 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2024-09-10T02:59:23,640 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2024-09-10T02:59:23,642 creating build/lib/colossalai/auto_parallel 2024-09-10T02:59:23,644 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2024-09-10T02:59:23,646 creating build/lib/colossalai/zero/low_level 2024-09-10T02:59:23,647 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2024-09-10T02:59:23,649 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2024-09-10T02:59:23,651 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2024-09-10T02:59:23,654 copying colossalai/zero/low_level/zero_hook.py -> build/lib/colossalai/zero/low_level 2024-09-10T02:59:23,657 creating build/lib/colossalai/zero/gemini 2024-09-10T02:59:23,658 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2024-09-10T02:59:23,659 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2024-09-10T02:59:23,662 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2024-09-10T02:59:23,665 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2024-09-10T02:59:23,667 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2024-09-10T02:59:23,669 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2024-09-10T02:59:23,671 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2024-09-10T02:59:23,674 creating build/lib/colossalai/zero/low_level/bookkeeping 2024-09-10T02:59:23,675 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-09-10T02:59:23,677 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-09-10T02:59:23,679 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-09-10T02:59:23,681 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-09-10T02:59:23,683 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-09-10T02:59:23,685 creating build/lib/colossalai/zero/gemini/chunk 2024-09-10T02:59:23,686 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2024-09-10T02:59:23,688 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-09-10T02:59:23,690 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-09-10T02:59:23,692 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2024-09-10T02:59:23,695 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2024-09-10T02:59:23,698 creating build/lib/colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:23,698 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:23,700 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:23,702 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:23,703 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:23,705 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:23,707 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:23,709 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:23,710 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:23,713 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:23,715 creating build/lib/colossalai/fx/passes 2024-09-10T02:59:23,716 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2024-09-10T02:59:23,717 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2024-09-10T02:59:23,720 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2024-09-10T02:59:23,722 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2024-09-10T02:59:23,724 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2024-09-10T02:59:23,726 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2024-09-10T02:59:23,729 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2024-09-10T02:59:23,731 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2024-09-10T02:59:23,734 creating build/lib/colossalai/fx/tracer 2024-09-10T02:59:23,735 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2024-09-10T02:59:23,736 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2024-09-10T02:59:23,738 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2024-09-10T02:59:23,740 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2024-09-10T02:59:23,742 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2024-09-10T02:59:23,744 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2024-09-10T02:59:23,746 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2024-09-10T02:59:23,749 creating build/lib/colossalai/fx/profiler 2024-09-10T02:59:23,750 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2024-09-10T02:59:23,752 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2024-09-10T02:59:23,754 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2024-09-10T02:59:23,756 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2024-09-10T02:59:23,758 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2024-09-10T02:59:23,761 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2024-09-10T02:59:23,763 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2024-09-10T02:59:23,765 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2024-09-10T02:59:23,768 creating build/lib/colossalai/fx/codegen 2024-09-10T02:59:23,768 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2024-09-10T02:59:23,770 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2024-09-10T02:59:23,780 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2024-09-10T02:59:23,781 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2024-09-10T02:59:23,783 creating build/lib/colossalai/fx/tracer/meta_patch 2024-09-10T02:59:23,784 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2024-09-10T02:59:23,786 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-10T02:59:23,787 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-10T02:59:23,790 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-10T02:59:23,792 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-10T02:59:23,794 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-10T02:59:23,796 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-10T02:59:23,799 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-10T02:59:23,800 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-10T02:59:23,802 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-10T02:59:23,804 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-10T02:59:23,806 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-10T02:59:23,810 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:23,811 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:23,813 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:23,815 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:23,818 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:23,820 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:23,822 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:23,824 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:23,826 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:23,830 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:23,831 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:23,833 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:23,835 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:23,837 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:23,839 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:23,842 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:23,844 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:23,846 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:23,848 creating build/lib/colossalai/fx/profiler/experimental 2024-09-10T02:59:23,849 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2024-09-10T02:59:23,852 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2024-09-10T02:59:23,854 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2024-09-10T02:59:23,856 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2024-09-10T02:59:23,858 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2024-09-10T02:59:23,861 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:23,862 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:23,865 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:23,867 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:23,869 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:23,871 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:23,874 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:23,876 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:23,878 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:23,880 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:23,882 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:23,884 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:23,887 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:23,888 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:23,890 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:23,893 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:23,894 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:23,897 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:23,899 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:23,902 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:23,903 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:23,905 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:23,908 creating build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,909 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,912 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,913 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,916 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,918 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,921 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,924 copying colossalai/shardformer/modeling/qwen2.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,927 copying colossalai/shardformer/modeling/command.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,930 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,933 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,936 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,939 copying colossalai/shardformer/modeling/mixtral.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,941 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,944 copying colossalai/shardformer/modeling/deepseek.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,947 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,949 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,953 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,955 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,958 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,961 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2024-09-10T02:59:23,964 creating build/lib/colossalai/shardformer/layer 2024-09-10T02:59:23,965 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2024-09-10T02:59:23,967 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2024-09-10T02:59:23,970 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2024-09-10T02:59:23,972 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2024-09-10T02:59:23,975 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2024-09-10T02:59:23,977 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2024-09-10T02:59:23,980 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2024-09-10T02:59:23,982 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2024-09-10T02:59:23,985 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2024-09-10T02:59:23,987 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2024-09-10T02:59:23,989 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2024-09-10T02:59:23,992 creating build/lib/colossalai/shardformer/shard 2024-09-10T02:59:23,993 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2024-09-10T02:59:23,995 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2024-09-10T02:59:23,997 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2024-09-10T02:59:23,998 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2024-09-10T02:59:24,001 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2024-09-10T02:59:24,003 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2024-09-10T02:59:24,006 creating build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,007 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,010 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,011 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,014 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,016 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,018 copying colossalai/shardformer/policies/qwen2.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,021 copying colossalai/shardformer/policies/command.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,023 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,026 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,028 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,030 copying colossalai/shardformer/policies/mixtral.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,033 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,035 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,038 copying colossalai/shardformer/policies/deepseek.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,041 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,044 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,047 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,050 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,052 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,055 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,058 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2024-09-10T02:59:24,061 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-09-10T02:59:24,063 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-09-10T02:59:24,066 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-09-10T02:59:24,069 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-09-10T02:59:24,071 creating build/lib/colossalai/cli/check 2024-09-10T02:59:24,073 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2024-09-10T02:59:24,075 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2024-09-10T02:59:24,078 creating build/lib/colossalai/cli/launcher 2024-09-10T02:59:24,079 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2024-09-10T02:59:24,082 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2024-09-10T02:59:24,085 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2024-09-10T02:59:24,088 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2024-09-10T02:59:24,092 creating build/lib/colossalai/booster/mixed_precision 2024-09-10T02:59:24,093 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2024-09-10T02:59:24,096 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2024-09-10T02:59:24,099 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2024-09-10T02:59:24,101 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2024-09-10T02:59:24,104 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2024-09-10T02:59:24,107 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2024-09-10T02:59:24,110 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2024-09-10T02:59:24,113 creating build/lib/colossalai/booster/plugin 2024-09-10T02:59:24,115 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2024-09-10T02:59:24,118 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-09-10T02:59:24,122 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2024-09-10T02:59:24,124 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2024-09-10T02:59:24,127 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2024-09-10T02:59:24,130 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-09-10T02:59:24,133 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-09-10T02:59:24,137 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2024-09-10T02:59:24,139 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-09-10T02:59:24,142 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2024-09-10T02:59:24,145 creating build/lib/colossalai/legacy/zero 2024-09-10T02:59:24,146 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2024-09-10T02:59:24,148 creating build/lib/colossalai/legacy/trainer 2024-09-10T02:59:24,149 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2024-09-10T02:59:24,152 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2024-09-10T02:59:24,155 creating build/lib/colossalai/legacy/communication 2024-09-10T02:59:24,156 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2024-09-10T02:59:24,158 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2024-09-10T02:59:24,161 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2024-09-10T02:59:24,163 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2024-09-10T02:59:24,166 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2024-09-10T02:59:24,169 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2024-09-10T02:59:24,171 creating build/lib/colossalai/legacy/engine 2024-09-10T02:59:24,172 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2024-09-10T02:59:24,174 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2024-09-10T02:59:24,177 creating build/lib/colossalai/legacy/context 2024-09-10T02:59:24,178 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2024-09-10T02:59:24,181 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2024-09-10T02:59:24,183 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2024-09-10T02:59:24,186 creating build/lib/colossalai/legacy/registry 2024-09-10T02:59:24,187 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2024-09-10T02:59:24,189 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2024-09-10T02:59:24,192 creating build/lib/colossalai/legacy/amp 2024-09-10T02:59:24,193 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2024-09-10T02:59:24,195 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2024-09-10T02:59:24,197 creating build/lib/colossalai/legacy/nn 2024-09-10T02:59:24,199 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2024-09-10T02:59:24,202 creating build/lib/colossalai/legacy/inference 2024-09-10T02:59:24,203 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2024-09-10T02:59:24,205 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2024-09-10T02:59:24,207 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2024-09-10T02:59:24,210 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2024-09-10T02:59:24,213 creating build/lib/colossalai/legacy/pipeline 2024-09-10T02:59:24,214 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2024-09-10T02:59:24,216 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2024-09-10T02:59:24,219 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2024-09-10T02:59:24,221 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2024-09-10T02:59:24,224 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2024-09-10T02:59:24,227 creating build/lib/colossalai/legacy/tensor 2024-09-10T02:59:24,228 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2024-09-10T02:59:24,230 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2024-09-10T02:59:24,232 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2024-09-10T02:59:24,234 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2024-09-10T02:59:24,236 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2024-09-10T02:59:24,238 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2024-09-10T02:59:24,240 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2024-09-10T02:59:24,243 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2024-09-10T02:59:24,245 creating build/lib/colossalai/legacy/builder 2024-09-10T02:59:24,246 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2024-09-10T02:59:24,248 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2024-09-10T02:59:24,251 creating build/lib/colossalai/legacy/utils 2024-09-10T02:59:24,252 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2024-09-10T02:59:24,254 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2024-09-10T02:59:24,257 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2024-09-10T02:59:24,259 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2024-09-10T02:59:24,262 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2024-09-10T02:59:24,265 creating build/lib/colossalai/legacy/zero/sharded_param 2024-09-10T02:59:24,266 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-09-10T02:59:24,268 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-09-10T02:59:24,270 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-09-10T02:59:24,273 creating build/lib/colossalai/legacy/zero/sharded_optim 2024-09-10T02:59:24,274 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-09-10T02:59:24,276 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-09-10T02:59:24,279 creating build/lib/colossalai/legacy/zero/shard_utils 2024-09-10T02:59:24,281 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-09-10T02:59:24,283 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-09-10T02:59:24,285 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-09-10T02:59:24,287 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-09-10T02:59:24,289 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-09-10T02:59:24,291 creating build/lib/colossalai/legacy/zero/init_ctx 2024-09-10T02:59:24,293 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-09-10T02:59:24,295 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-09-10T02:59:24,298 creating build/lib/colossalai/legacy/zero/gemini 2024-09-10T02:59:24,299 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-10T02:59:24,302 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-10T02:59:24,304 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-10T02:59:24,306 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-10T02:59:24,308 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-10T02:59:24,311 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-10T02:59:24,313 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-10T02:59:24,316 creating build/lib/colossalai/legacy/zero/sharded_model 2024-09-10T02:59:24,317 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-09-10T02:59:24,319 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-09-10T02:59:24,322 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-09-10T02:59:24,324 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-09-10T02:59:24,326 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-09-10T02:59:24,329 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-09-10T02:59:24,332 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2024-09-10T02:59:24,333 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-09-10T02:59:24,335 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-09-10T02:59:24,338 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-09-10T02:59:24,340 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-09-10T02:59:24,342 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-09-10T02:59:24,345 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-09-10T02:59:24,346 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-09-10T02:59:24,350 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-09-10T02:59:24,352 creating build/lib/colossalai/legacy/trainer/hooks 2024-09-10T02:59:24,353 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-10T02:59:24,356 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-10T02:59:24,358 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-10T02:59:24,361 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-10T02:59:24,364 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-10T02:59:24,366 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-10T02:59:24,368 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-10T02:59:24,371 creating build/lib/colossalai/legacy/engine/schedule 2024-09-10T02:59:24,372 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2024-09-10T02:59:24,374 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2024-09-10T02:59:24,377 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-09-10T02:59:24,381 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-09-10T02:59:24,383 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-09-10T02:59:24,386 creating build/lib/colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:24,387 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:24,390 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:24,391 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:24,394 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:24,396 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:24,398 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:24,399 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:24,402 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:24,404 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2024-09-10T02:59:24,405 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-09-10T02:59:24,408 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-09-10T02:59:24,411 creating build/lib/colossalai/legacy/context/random 2024-09-10T02:59:24,412 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2024-09-10T02:59:24,414 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2024-09-10T02:59:24,417 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2024-09-10T02:59:24,420 creating build/lib/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:24,421 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:24,423 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:24,426 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:24,429 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:24,431 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:24,433 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:24,436 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:24,438 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:24,440 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:24,443 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:24,445 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:24,448 creating build/lib/colossalai/legacy/amp/naive_amp 2024-09-10T02:59:24,449 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-09-10T02:59:24,452 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-09-10T02:59:24,454 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-09-10T02:59:24,457 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-09-10T02:59:24,459 creating build/lib/colossalai/legacy/amp/apex_amp 2024-09-10T02:59:24,460 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-09-10T02:59:24,463 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-09-10T02:59:24,465 creating build/lib/colossalai/legacy/amp/torch_amp 2024-09-10T02:59:24,466 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-09-10T02:59:24,469 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-09-10T02:59:24,471 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-09-10T02:59:24,475 creating build/lib/colossalai/legacy/nn/loss 2024-09-10T02:59:24,476 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2024-09-10T02:59:24,478 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2024-09-10T02:59:24,481 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2024-09-10T02:59:24,483 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2024-09-10T02:59:24,486 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2024-09-10T02:59:24,489 creating build/lib/colossalai/legacy/nn/layer 2024-09-10T02:59:24,490 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2024-09-10T02:59:24,492 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2024-09-10T02:59:24,494 creating build/lib/colossalai/legacy/nn/metric 2024-09-10T02:59:24,495 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2024-09-10T02:59:24,497 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2024-09-10T02:59:24,499 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2024-09-10T02:59:24,501 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2024-09-10T02:59:24,503 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2024-09-10T02:59:24,505 creating build/lib/colossalai/legacy/nn/parallel 2024-09-10T02:59:24,506 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2024-09-10T02:59:24,508 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2024-09-10T02:59:24,510 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2024-09-10T02:59:24,513 creating build/lib/colossalai/legacy/nn/_ops 2024-09-10T02:59:24,514 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2024-09-10T02:59:24,516 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2024-09-10T02:59:24,518 creating build/lib/colossalai/legacy/nn/layer/wrapper 2024-09-10T02:59:24,519 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-09-10T02:59:24,522 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-09-10T02:59:24,524 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:24,525 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:24,527 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:24,530 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:24,532 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:24,534 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:24,536 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:24,538 creating build/lib/colossalai/legacy/nn/layer/vanilla 2024-09-10T02:59:24,539 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-09-10T02:59:24,542 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-09-10T02:59:24,545 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-09-10T02:59:24,546 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-09-10T02:59:24,548 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-09-10T02:59:24,550 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-09-10T02:59:24,552 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-09-10T02:59:24,554 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-09-10T02:59:24,555 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-09-10T02:59:24,558 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-09-10T02:59:24,561 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-09-10T02:59:24,562 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-09-10T02:59:24,566 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-09-10T02:59:24,567 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-09-10T02:59:24,569 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-09-10T02:59:24,572 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-09-10T02:59:24,574 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-09-10T02:59:24,578 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-09-10T02:59:24,579 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-09-10T02:59:24,581 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-09-10T02:59:24,583 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-09-10T02:59:24,586 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-09-10T02:59:24,589 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-09-10T02:59:24,590 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-09-10T02:59:24,592 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-09-10T02:59:24,595 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-09-10T02:59:24,597 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-09-10T02:59:24,601 creating build/lib/colossalai/legacy/nn/layer/utils 2024-09-10T02:59:24,601 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-09-10T02:59:24,603 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-09-10T02:59:24,606 creating build/lib/colossalai/legacy/nn/parallel/layers 2024-09-10T02:59:24,607 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-09-10T02:59:24,609 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-09-10T02:59:24,610 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-09-10T02:59:24,612 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-09-10T02:59:24,615 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-09-10T02:59:24,617 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:24,618 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:24,620 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:24,622 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:24,625 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:24,627 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:24,629 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:24,631 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:24,633 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:24,635 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:24,638 creating build/lib/colossalai/legacy/inference/tensor_parallel 2024-09-10T02:59:24,639 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-09-10T02:59:24,642 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-09-10T02:59:24,645 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-09-10T02:59:24,647 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-09-10T02:59:24,650 creating build/lib/colossalai/legacy/inference/hybridengine 2024-09-10T02:59:24,651 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-09-10T02:59:24,653 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-09-10T02:59:24,656 creating build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:24,657 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:24,660 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:24,661 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:24,663 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:24,665 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:24,668 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:24,670 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:24,672 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:24,674 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:24,676 creating build/lib/colossalai/legacy/inference/pipeline 2024-09-10T02:59:24,677 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2024-09-10T02:59:24,679 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2024-09-10T02:59:24,682 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-10T02:59:24,682 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-10T02:59:24,684 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-10T02:59:24,687 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-10T02:59:24,689 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-10T02:59:24,692 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-10T02:59:24,695 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-09-10T02:59:24,696 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-09-10T02:59:24,698 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-09-10T02:59:24,700 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-09-10T02:59:24,703 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-09-10T02:59:24,705 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-09-10T02:59:24,706 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-09-10T02:59:24,709 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-09-10T02:59:24,711 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-09-10T02:59:24,714 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2024-09-10T02:59:24,715 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-09-10T02:59:24,717 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-09-10T02:59:24,719 creating build/lib/colossalai/legacy/pipeline/middleware 2024-09-10T02:59:24,720 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-09-10T02:59:24,722 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-09-10T02:59:24,725 creating build/lib/colossalai/legacy/pipeline/rpc 2024-09-10T02:59:24,726 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-09-10T02:59:24,727 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-09-10T02:59:24,731 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-09-10T02:59:24,733 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-09-10T02:59:24,736 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-09-10T02:59:24,737 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-09-10T02:59:24,739 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-09-10T02:59:24,742 creating build/lib/colossalai/legacy/utils/data_sampler 2024-09-10T02:59:24,743 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-09-10T02:59:24,745 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-09-10T02:59:24,747 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-09-10T02:59:24,749 creating build/lib/colossalai/legacy/utils/checkpoint 2024-09-10T02:59:24,750 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-09-10T02:59:24,752 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-09-10T02:59:24,754 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-09-10T02:59:24,757 creating build/lib/colossalai/legacy/utils/profiler 2024-09-10T02:59:24,758 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-09-10T02:59:24,760 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2024-09-10T02:59:24,762 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-09-10T02:59:24,764 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2024-09-10T02:59:24,766 creating build/lib/colossalai/legacy/utils/profiler/legacy 2024-09-10T02:59:24,767 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-09-10T02:59:24,770 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-09-10T02:59:24,772 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-09-10T02:59:24,774 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-09-10T02:59:24,777 creating build/lib/colossalai/_analyzer/fx 2024-09-10T02:59:24,778 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2024-09-10T02:59:24,780 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2024-09-10T02:59:24,782 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2024-09-10T02:59:24,784 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2024-09-10T02:59:24,786 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2024-09-10T02:59:24,789 creating build/lib/colossalai/_analyzer/_subclasses 2024-09-10T02:59:24,790 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2024-09-10T02:59:24,792 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-09-10T02:59:24,795 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2024-09-10T02:59:24,796 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2024-09-10T02:59:24,803 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-09-10T02:59:24,806 creating build/lib/colossalai/_analyzer/fx/passes 2024-09-10T02:59:24,807 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2024-09-10T02:59:24,809 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2024-09-10T02:59:24,811 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2024-09-10T02:59:24,814 creating build/lib/colossalai/_analyzer/fx/tracer 2024-09-10T02:59:24,815 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-09-10T02:59:24,817 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-09-10T02:59:24,819 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-09-10T02:59:24,821 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-09-10T02:59:24,823 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-09-10T02:59:24,825 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-09-10T02:59:24,828 creating build/lib/colossalai/kernel/extensions 2024-09-10T02:59:24,829 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2024-09-10T02:59:24,831 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2024-09-10T02:59:24,833 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2024-09-10T02:59:24,835 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2024-09-10T02:59:24,838 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2024-09-10T02:59:24,840 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2024-09-10T02:59:24,842 creating build/lib/colossalai/kernel/triton 2024-09-10T02:59:24,843 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2024-09-10T02:59:24,846 copying colossalai/kernel/triton/context_attn_unpad.py -> build/lib/colossalai/kernel/triton 2024-09-10T02:59:24,848 copying colossalai/kernel/triton/rms_layernorm.py -> build/lib/colossalai/kernel/triton 2024-09-10T02:59:24,850 copying colossalai/kernel/triton/fused_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-09-10T02:59:24,853 copying colossalai/kernel/triton/rotary_cache_copy.py -> build/lib/colossalai/kernel/triton 2024-09-10T02:59:24,855 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2024-09-10T02:59:24,857 copying colossalai/kernel/triton/kvcache_copy.py -> build/lib/colossalai/kernel/triton 2024-09-10T02:59:24,859 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2024-09-10T02:59:24,861 copying colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-09-10T02:59:24,864 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2024-09-10T02:59:24,866 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2024-09-10T02:59:24,869 creating build/lib/colossalai/kernel/jit 2024-09-10T02:59:24,870 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2024-09-10T02:59:24,872 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2024-09-10T02:59:24,873 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2024-09-10T02:59:24,875 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2024-09-10T02:59:24,878 creating build/lib/colossalai/kernel/extensions/pybind 2024-09-10T02:59:24,879 copying colossalai/kernel/extensions/pybind/__init__.py -> build/lib/colossalai/kernel/extensions/pybind 2024-09-10T02:59:24,881 creating build/lib/colossalai/kernel/extensions/csrc 2024-09-10T02:59:24,882 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2024-09-10T02:59:24,884 creating build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-09-10T02:59:24,885 copying colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-09-10T02:59:24,886 copying colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-09-10T02:59:24,889 creating build/lib/colossalai/kernel/extensions/pybind/softmax 2024-09-10T02:59:24,890 copying colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-09-10T02:59:24,892 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-09-10T02:59:24,894 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-09-10T02:59:24,896 creating build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-09-10T02:59:24,897 copying colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-09-10T02:59:24,899 copying colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-09-10T02:59:24,901 creating build/lib/colossalai/kernel/extensions/pybind/moe 2024-09-10T02:59:24,902 copying colossalai/kernel/extensions/pybind/moe/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-09-10T02:59:24,904 copying colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-09-10T02:59:24,907 creating build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-09-10T02:59:24,908 copying colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-09-10T02:59:24,909 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-09-10T02:59:24,911 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-09-10T02:59:24,913 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-09-10T02:59:24,916 creating build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-09-10T02:59:24,917 copying colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-09-10T02:59:24,918 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-09-10T02:59:24,920 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-09-10T02:59:24,922 creating build/lib/colossalai/kernel/extensions/pybind/inference 2024-09-10T02:59:24,923 copying colossalai/kernel/extensions/pybind/inference/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-09-10T02:59:24,925 copying colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-09-10T02:59:24,927 creating build/lib/colossalai/amp/naive_amp 2024-09-10T02:59:24,928 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2024-09-10T02:59:24,929 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2024-09-10T02:59:24,932 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2024-09-10T02:59:24,933 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-09-10T02:59:24,935 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-09-10T02:59:24,938 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-09-10T02:59:24,940 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-09-10T02:59:24,942 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-10T02:59:24,943 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-10T02:59:24,945 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-10T02:59:24,947 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-10T02:59:24,949 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-10T02:59:24,952 creating build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,953 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,955 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,957 copying colossalai/nn/optimizer/distributed_adafactor.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,960 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,962 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,965 copying colossalai/nn/optimizer/distributed_came.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,968 copying colossalai/nn/optimizer/distributed_galore.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,970 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,972 copying colossalai/nn/optimizer/came.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,975 copying colossalai/nn/optimizer/galore.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,977 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,979 copying colossalai/nn/optimizer/distributed_lamb.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,982 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,984 copying colossalai/nn/optimizer/adafactor.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,986 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,988 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2024-09-10T02:59:24,990 creating build/lib/colossalai/nn/loss 2024-09-10T02:59:24,991 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2024-09-10T02:59:24,994 creating build/lib/colossalai/nn/layer 2024-09-10T02:59:24,995 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2024-09-10T02:59:24,997 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2024-09-10T02:59:25,000 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2024-09-10T02:59:25,002 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2024-09-10T02:59:25,005 creating build/lib/colossalai/nn/lr_scheduler 2024-09-10T02:59:25,006 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-10T02:59:25,008 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-10T02:59:25,010 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-10T02:59:25,012 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-10T02:59:25,015 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-10T02:59:25,017 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-10T02:59:25,020 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-10T02:59:25,022 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-10T02:59:25,025 creating build/lib/colossalai/inference/kv_cache 2024-09-10T02:59:25,026 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2024-09-10T02:59:25,028 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2024-09-10T02:59:25,031 copying colossalai/inference/kv_cache/block_cache.py -> build/lib/colossalai/inference/kv_cache 2024-09-10T02:59:25,033 creating build/lib/colossalai/inference/core 2024-09-10T02:59:25,034 copying colossalai/inference/core/diffusion_engine.py -> build/lib/colossalai/inference/core 2024-09-10T02:59:25,037 copying colossalai/inference/core/__init__.py -> build/lib/colossalai/inference/core 2024-09-10T02:59:25,039 copying colossalai/inference/core/engine.py -> build/lib/colossalai/inference/core 2024-09-10T02:59:25,041 copying colossalai/inference/core/plugin.py -> build/lib/colossalai/inference/core 2024-09-10T02:59:25,043 copying colossalai/inference/core/llm_engine.py -> build/lib/colossalai/inference/core 2024-09-10T02:59:25,046 copying colossalai/inference/core/async_engine.py -> build/lib/colossalai/inference/core 2024-09-10T02:59:25,048 copying colossalai/inference/core/rpc_engine.py -> build/lib/colossalai/inference/core 2024-09-10T02:59:25,051 copying colossalai/inference/core/base_engine.py -> build/lib/colossalai/inference/core 2024-09-10T02:59:25,053 copying colossalai/inference/core/request_handler.py -> build/lib/colossalai/inference/core 2024-09-10T02:59:25,056 creating build/lib/colossalai/inference/modeling 2024-09-10T02:59:25,057 copying colossalai/inference/modeling/__init__.py -> build/lib/colossalai/inference/modeling 2024-09-10T02:59:25,059 creating build/lib/colossalai/inference/server 2024-09-10T02:59:25,060 copying colossalai/inference/server/__init__.py -> build/lib/colossalai/inference/server 2024-09-10T02:59:25,062 copying colossalai/inference/server/completion_service.py -> build/lib/colossalai/inference/server 2024-09-10T02:59:25,064 copying colossalai/inference/server/utils.py -> build/lib/colossalai/inference/server 2024-09-10T02:59:25,066 copying colossalai/inference/server/chat_service.py -> build/lib/colossalai/inference/server 2024-09-10T02:59:25,068 copying colossalai/inference/server/api_server.py -> build/lib/colossalai/inference/server 2024-09-10T02:59:25,070 creating build/lib/colossalai/inference/spec 2024-09-10T02:59:25,071 copying colossalai/inference/spec/__init__.py -> build/lib/colossalai/inference/spec 2024-09-10T02:59:25,073 copying colossalai/inference/spec/drafter.py -> build/lib/colossalai/inference/spec 2024-09-10T02:59:25,076 copying colossalai/inference/spec/struct.py -> build/lib/colossalai/inference/spec 2024-09-10T02:59:25,078 creating build/lib/colossalai/inference/executor 2024-09-10T02:59:25,079 copying colossalai/inference/executor/__init__.py -> build/lib/colossalai/inference/executor 2024-09-10T02:59:25,081 copying colossalai/inference/executor/rpc_worker.py -> build/lib/colossalai/inference/executor 2024-09-10T02:59:25,084 creating build/lib/colossalai/inference/modeling/models 2024-09-10T02:59:25,085 copying colossalai/inference/modeling/models/__init__.py -> build/lib/colossalai/inference/modeling/models 2024-09-10T02:59:25,086 copying colossalai/inference/modeling/models/glide_llama.py -> build/lib/colossalai/inference/modeling/models 2024-09-10T02:59:25,089 copying colossalai/inference/modeling/models/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/models 2024-09-10T02:59:25,091 copying colossalai/inference/modeling/models/pixart_alpha.py -> build/lib/colossalai/inference/modeling/models 2024-09-10T02:59:25,094 copying colossalai/inference/modeling/models/nopadding_llama.py -> build/lib/colossalai/inference/modeling/models 2024-09-10T02:59:25,097 copying colossalai/inference/modeling/models/stablediffusion3.py -> build/lib/colossalai/inference/modeling/models 2024-09-10T02:59:25,100 creating build/lib/colossalai/inference/modeling/backends 2024-09-10T02:59:25,101 copying colossalai/inference/modeling/backends/__init__.py -> build/lib/colossalai/inference/modeling/backends 2024-09-10T02:59:25,102 copying colossalai/inference/modeling/backends/pre_attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-09-10T02:59:25,105 copying colossalai/inference/modeling/backends/attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-09-10T02:59:25,107 creating build/lib/colossalai/inference/modeling/policy 2024-09-10T02:59:25,108 copying colossalai/inference/modeling/policy/__init__.py -> build/lib/colossalai/inference/modeling/policy 2024-09-10T02:59:25,110 copying colossalai/inference/modeling/policy/glide_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-09-10T02:59:25,112 copying colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/policy 2024-09-10T02:59:25,115 copying colossalai/inference/modeling/policy/pixart_alpha.py -> build/lib/colossalai/inference/modeling/policy 2024-09-10T02:59:25,117 copying colossalai/inference/modeling/policy/nopadding_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-09-10T02:59:25,119 copying colossalai/inference/modeling/policy/stablediffusion3.py -> build/lib/colossalai/inference/modeling/policy 2024-09-10T02:59:25,122 creating build/lib/colossalai/inference/modeling/layers 2024-09-10T02:59:25,123 copying colossalai/inference/modeling/layers/__init__.py -> build/lib/colossalai/inference/modeling/layers 2024-09-10T02:59:25,125 copying colossalai/inference/modeling/layers/diffusion.py -> build/lib/colossalai/inference/modeling/layers 2024-09-10T02:59:25,127 copying colossalai/inference/modeling/layers/distrifusion.py -> build/lib/colossalai/inference/modeling/layers 2024-09-10T02:59:25,129 copying colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/lib/colossalai/inference/modeling/layers 2024-09-10T02:59:25,131 copying colossalai/inference/modeling/layers/attention.py -> build/lib/colossalai/inference/modeling/layers 2024-09-10T02:59:25,134 creating build/lib/colossalai/pipeline/schedule 2024-09-10T02:59:25,135 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2024-09-10T02:59:25,137 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2024-09-10T02:59:25,140 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2024-09-10T02:59:25,142 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2024-09-10T02:59:25,144 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2024-09-10T02:59:25,146 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2024-09-10T02:59:25,150 creating build/lib/colossalai/tensor/d_tensor 2024-09-10T02:59:25,150 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2024-09-10T02:59:25,153 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2024-09-10T02:59:25,154 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-09-10T02:59:25,157 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-09-10T02:59:25,159 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2024-09-10T02:59:25,161 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2024-09-10T02:59:25,163 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2024-09-10T02:59:25,165 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2024-09-10T02:59:25,169 creating build/lib/colossalai/tensor/padded_tensor 2024-09-10T02:59:25,170 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2024-09-10T02:59:25,172 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2024-09-10T02:59:25,174 creating build/lib/colossalai/tensor/moe_tensor 2024-09-10T02:59:25,175 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2024-09-10T02:59:25,177 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2024-09-10T02:59:25,179 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2024-09-10T02:59:25,182 creating build/lib/colossalai/utils/tensor_detector 2024-09-10T02:59:25,183 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2024-09-10T02:59:25,185 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2024-09-10T02:59:25,188 creating build/lib/colossalai/utils/rank_recorder 2024-09-10T02:59:25,189 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2024-09-10T02:59:25,191 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2024-09-10T02:59:25,194 creating build/lib/colossalai/utils/model 2024-09-10T02:59:25,195 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2024-09-10T02:59:25,196 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2024-09-10T02:59:25,199 creating build/lib/colossalai/utils/multi_tensor_apply 2024-09-10T02:59:25,200 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-09-10T02:59:25,202 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-09-10T02:59:25,204 creating build/lib/colossalai/auto_parallel/passes 2024-09-10T02:59:25,205 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2024-09-10T02:59:25,207 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2024-09-10T02:59:25,210 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-09-10T02:59:25,221 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2024-09-10T02:59:25,223 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-09-10T02:59:25,225 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-09-10T02:59:25,228 creating build/lib/colossalai/auto_parallel/tensor_shard 2024-09-10T02:59:25,229 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-09-10T02:59:25,231 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-09-10T02:59:25,233 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-09-10T02:59:25,235 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-09-10T02:59:25,237 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-09-10T02:59:25,240 creating build/lib/colossalai/auto_parallel/checkpoint 2024-09-10T02:59:25,241 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-09-10T02:59:25,243 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-09-10T02:59:25,245 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-09-10T02:59:25,247 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-09-10T02:59:25,250 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-09-10T02:59:25,252 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-09-10T02:59:25,254 creating build/lib/colossalai/auto_parallel/pipeline_shard 2024-09-10T02:59:25,255 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2024-09-10T02:59:25,257 creating build/lib/colossalai/auto_parallel/meta_profiler 2024-09-10T02:59:25,258 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-09-10T02:59:25,261 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-09-10T02:59:25,263 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-09-10T02:59:25,265 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-09-10T02:59:25,267 creating build/lib/colossalai/auto_parallel/offload 2024-09-10T02:59:25,268 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2024-09-10T02:59:25,270 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2024-09-10T02:59:25,273 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2024-09-10T02:59:25,275 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2024-09-10T02:59:25,277 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2024-09-10T02:59:25,280 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2024-09-10T02:59:25,283 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2024-09-10T02:59:25,286 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2024-09-10T02:59:25,288 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2024-09-10T02:59:25,291 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2024-09-10T02:59:25,294 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,295 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,298 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,299 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,302 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,304 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,306 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,308 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,310 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,313 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,315 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,317 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,319 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,321 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,324 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,326 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,329 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,331 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,334 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,335 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,338 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,341 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,343 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,345 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,347 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,349 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,351 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,353 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:25,356 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-09-10T02:59:25,357 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-09-10T02:59:25,359 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-09-10T02:59:25,361 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-09-10T02:59:25,364 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-09-10T02:59:25,367 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-09-10T02:59:25,370 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:25,371 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:25,374 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:25,376 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:25,378 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:25,381 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:25,383 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:25,387 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,388 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,391 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,393 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,395 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,398 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,400 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,403 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,406 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,408 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,411 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,413 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,416 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,418 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,421 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,424 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,426 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,429 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,432 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,434 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:25,438 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:25,439 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:25,441 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:25,445 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:25,447 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:25,448 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:25,451 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:25,453 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:25,455 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:25,457 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:25,460 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:25,462 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:25,464 creating build/lib/extensions 2024-09-10T02:59:25,465 creating build/lib/extensions/pybind 2024-09-10T02:59:25,466 copying extensions/pybind/__init__.py -> build/lib/extensions/pybind 2024-09-10T02:59:25,468 creating build/lib/extensions/csrc 2024-09-10T02:59:25,469 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2024-09-10T02:59:25,471 creating build/lib/extensions/pybind/optimizer 2024-09-10T02:59:25,472 copying extensions/pybind/optimizer/__init__.py -> build/lib/extensions/pybind/optimizer 2024-09-10T02:59:25,474 copying extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/pybind/optimizer 2024-09-10T02:59:25,476 creating build/lib/extensions/pybind/softmax 2024-09-10T02:59:25,477 copying extensions/pybind/softmax/__init__.py -> build/lib/extensions/pybind/softmax 2024-09-10T02:59:25,479 copying extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-09-10T02:59:25,480 copying extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-09-10T02:59:25,489 creating build/lib/extensions/pybind/layernorm 2024-09-10T02:59:25,490 copying extensions/pybind/layernorm/__init__.py -> build/lib/extensions/pybind/layernorm 2024-09-10T02:59:25,491 copying extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/extensions/pybind/layernorm 2024-09-10T02:59:25,494 creating build/lib/extensions/pybind/moe 2024-09-10T02:59:25,495 copying extensions/pybind/moe/__init__.py -> build/lib/extensions/pybind/moe 2024-09-10T02:59:25,497 copying extensions/pybind/moe/moe_cuda.py -> build/lib/extensions/pybind/moe 2024-09-10T02:59:25,499 creating build/lib/extensions/pybind/flash_attention 2024-09-10T02:59:25,500 copying extensions/pybind/flash_attention/__init__.py -> build/lib/extensions/pybind/flash_attention 2024-09-10T02:59:25,502 copying extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/extensions/pybind/flash_attention 2024-09-10T02:59:25,503 copying extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-09-10T02:59:25,505 copying extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-09-10T02:59:25,507 creating build/lib/extensions/pybind/cpu_adam 2024-09-10T02:59:25,509 copying extensions/pybind/cpu_adam/__init__.py -> build/lib/extensions/pybind/cpu_adam 2024-09-10T02:59:25,511 copying extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/pybind/cpu_adam 2024-09-10T02:59:25,513 copying extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/pybind/cpu_adam 2024-09-10T02:59:25,515 creating build/lib/extensions/pybind/inference 2024-09-10T02:59:25,516 copying extensions/pybind/inference/__init__.py -> build/lib/extensions/pybind/inference 2024-09-10T02:59:25,518 copying extensions/pybind/inference/inference_ops_cuda.py -> build/lib/extensions/pybind/inference 2024-09-10T02:59:25,632 creating build/lib/colossalai/kernel/extensions/csrc/common 2024-09-10T02:59:25,633 copying colossalai/kernel/extensions/csrc/common/data_type.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-09-10T02:59:25,636 copying colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-09-10T02:59:25,639 copying colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-09-10T02:59:25,641 copying colossalai/kernel/extensions/csrc/common/target.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-09-10T02:59:25,644 copying colossalai/kernel/extensions/csrc/common/micros.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-09-10T02:59:25,647 creating build/lib/colossalai/kernel/extensions/csrc/kernel 2024-09-10T02:59:25,648 creating build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-09-10T02:59:25,649 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-09-10T02:59:25,651 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-09-10T02:59:25,654 creating build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-09-10T02:59:25,655 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-09-10T02:59:25,658 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-09-10T02:59:25,660 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,661 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,663 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,666 copying colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,668 copying colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,671 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,674 copying colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,677 copying colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,679 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,682 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,684 copying colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,687 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,689 copying colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,692 copying colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,694 copying colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,697 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,700 copying colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,702 copying colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,705 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:25,707 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-09-10T02:59:25,708 copying colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-09-10T02:59:25,711 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-10T02:59:25,712 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-10T02:59:25,714 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-10T02:59:25,716 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-10T02:59:25,718 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-10T02:59:25,720 creating build/lib/colossalai/kernel/extensions/csrc/funcs 2024-09-10T02:59:25,721 copying colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-09-10T02:59:25,723 copying colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-09-10T02:59:25,725 copying colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-09-10T02:59:25,727 copying colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-09-10T02:59:25,730 copying colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-09-10T02:59:25,733 copying colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-09-10T02:59:25,736 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-09-10T02:59:25,739 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-09-10T02:59:25,742 copying colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-09-10T02:59:25,745 copying colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-09-10T02:59:25,750 copying colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-09-10T02:59:25,858 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-09-10T02:59:25,859 !! 2024-09-10T02:59:25,860 ******************************************************************************** 2024-09-10T02:59:25,861 Please avoid running ``setup.py`` directly. 2024-09-10T02:59:25,861 Instead, use pypa/build, pypa/installer or other 2024-09-10T02:59:25,862 standards-based tools. 2024-09-10T02:59:25,863 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-09-10T02:59:25,864 ******************************************************************************** 2024-09-10T02:59:25,865 !! 2024-09-10T02:59:25,865 self.initialize_options() 2024-09-10T02:59:25,886 installing to build/bdist.linux-armv7l/wheel 2024-09-10T02:59:25,887 running install 2024-09-10T02:59:25,911 running install_lib 2024-09-10T02:59:25,938 creating build/bdist.linux-armv7l 2024-09-10T02:59:25,939 creating build/bdist.linux-armv7l/wheel 2024-09-10T02:59:25,941 creating build/bdist.linux-armv7l/wheel/colossalai 2024-09-10T02:59:25,942 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2024-09-10T02:59:25,943 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2024-09-10T02:59:25,946 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-09-10T02:59:25,947 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-09-10T02:59:25,949 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-09-10T02:59:25,950 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-09-10T02:59:25,952 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-09-10T02:59:25,955 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-09-10T02:59:25,957 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-09-10T02:59:25,959 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-09-10T02:59:25,961 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-09-10T02:59:25,964 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-09-10T02:59:25,967 copying build/lib/colossalai/zero/low_level/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-09-10T02:59:25,969 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-09-10T02:59:25,971 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-10T02:59:25,973 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-09-10T02:59:25,974 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-09-10T02:59:25,977 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-09-10T02:59:25,980 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-09-10T02:59:25,982 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-09-10T02:59:25,985 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-09-10T02:59:25,988 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-10T02:59:25,991 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-10T02:59:25,994 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-10T02:59:25,997 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-10T02:59:25,999 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-10T02:59:26,002 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-10T02:59:26,005 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:26,006 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:26,008 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:26,010 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:26,012 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:26,014 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:26,016 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:26,018 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:26,021 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:26,023 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-10T02:59:26,025 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2024-09-10T02:59:26,027 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai 2024-09-10T02:59:26,030 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2024-09-10T02:59:26,031 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-09-10T02:59:26,033 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-09-10T02:59:26,034 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-09-10T02:59:26,036 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-09-10T02:59:26,039 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2024-09-10T02:59:26,040 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-09-10T02:59:26,042 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-09-10T02:59:26,045 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-09-10T02:59:26,046 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-10T02:59:26,048 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-10T02:59:26,051 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-10T02:59:26,053 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-10T02:59:26,056 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-10T02:59:26,058 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-10T02:59:26,060 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-10T02:59:26,063 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-10T02:59:26,065 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-09-10T02:59:26,068 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-09-10T02:59:26,070 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-09-10T02:59:26,073 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-09-10T02:59:26,074 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-10T02:59:26,076 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-10T02:59:26,078 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-09-10T02:59:26,079 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch 2024-09-10T02:59:26,082 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-10T02:59:26,083 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-10T02:59:26,084 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-10T02:59:26,086 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-10T02:59:26,089 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-10T02:59:26,090 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-10T02:59:26,093 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-10T02:59:26,094 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-10T02:59:26,096 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-10T02:59:26,098 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-10T02:59:26,099 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-10T02:59:26,102 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-10T02:59:26,104 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-10T02:59:26,106 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-09-10T02:59:26,107 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch 2024-09-10T02:59:26,110 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:26,110 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:26,113 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:26,115 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:26,117 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:26,119 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:26,121 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:26,122 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:26,124 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-10T02:59:26,127 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:26,128 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:26,130 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:26,132 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:26,135 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:26,137 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:26,139 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:26,141 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:26,143 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-10T02:59:26,145 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-10T02:59:26,148 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-10T02:59:26,149 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-10T02:59:26,152 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-09-10T02:59:26,154 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-09-10T02:59:26,155 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-10T02:59:26,157 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-10T02:59:26,159 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-10T02:59:26,162 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-10T02:59:26,163 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-10T02:59:26,166 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-10T02:59:26,169 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-09-10T02:59:26,171 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:26,172 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:26,174 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:26,175 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:26,177 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:26,179 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:26,181 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:26,183 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:26,185 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:26,187 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:26,188 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:26,190 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-10T02:59:26,192 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-09-10T02:59:26,194 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-09-10T02:59:26,197 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:26,198 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:26,200 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:26,202 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:26,204 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:26,215 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:26,217 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:26,219 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:26,221 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:26,223 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-10T02:59:26,225 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-09-10T02:59:26,226 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-09-10T02:59:26,229 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-09-10T02:59:26,230 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-10T02:59:26,233 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-10T02:59:26,235 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-09-10T02:59:26,236 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2024-09-10T02:59:26,238 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2024-09-10T02:59:26,241 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai 2024-09-10T02:59:26,243 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-09-10T02:59:26,244 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2024-09-10T02:59:26,247 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-09-10T02:59:26,248 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,249 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,251 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,253 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,255 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,258 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,261 copying build/lib/colossalai/shardformer/modeling/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,264 copying build/lib/colossalai/shardformer/modeling/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,267 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-09-10T02:59:26,268 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2024-09-10T02:59:26,271 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2024-09-10T02:59:26,273 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2024-09-10T02:59:26,275 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,279 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,281 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,284 copying build/lib/colossalai/shardformer/modeling/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,287 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,290 copying build/lib/colossalai/shardformer/modeling/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,293 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,295 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,298 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,301 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,304 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,307 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-10T02:59:26,312 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-09-10T02:59:26,313 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-10T02:59:26,314 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-10T02:59:26,317 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-10T02:59:26,320 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-10T02:59:26,329 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-10T02:59:26,331 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-10T02:59:26,336 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-10T02:59:26,338 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-10T02:59:26,342 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-10T02:59:26,344 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-10T02:59:26,346 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-10T02:59:26,349 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-09-10T02:59:26,350 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-09-10T02:59:26,352 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-09-10T02:59:26,355 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-09-10T02:59:26,357 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-09-10T02:59:26,360 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-09-10T02:59:26,363 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-09-10T02:59:26,366 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2024-09-10T02:59:26,369 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-09-10T02:59:26,370 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,374 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,376 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,379 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,383 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,387 copying build/lib/colossalai/shardformer/policies/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,390 copying build/lib/colossalai/shardformer/policies/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,393 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,397 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,400 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,404 copying build/lib/colossalai/shardformer/policies/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,408 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,411 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,415 copying build/lib/colossalai/shardformer/policies/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,419 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,423 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,426 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,430 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,433 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,437 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,441 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-10T02:59:26,445 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2024-09-10T02:59:26,446 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2024-09-10T02:59:26,449 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2024-09-10T02:59:26,453 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/./colossalai 2024-09-10T02:59:26,455 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2024-09-10T02:59:26,456 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2024-09-10T02:59:26,458 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-09-10T02:59:26,459 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2024-09-10T02:59:26,460 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2024-09-10T02:59:26,463 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-09-10T02:59:26,464 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-09-10T02:59:26,466 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-09-10T02:59:26,468 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-09-10T02:59:26,470 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-09-10T02:59:26,472 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2024-09-10T02:59:26,474 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2024-09-10T02:59:26,475 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-09-10T02:59:26,477 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-09-10T02:59:26,479 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-09-10T02:59:26,482 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-09-10T02:59:26,484 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-09-10T02:59:26,486 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2024-09-10T02:59:26,487 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-09-10T02:59:26,488 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-10T02:59:26,490 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-10T02:59:26,492 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-10T02:59:26,494 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-10T02:59:26,497 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-10T02:59:26,498 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-10T02:59:26,500 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-10T02:59:26,502 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2024-09-10T02:59:26,504 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2024-09-10T02:59:26,507 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2024-09-10T02:59:26,509 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-09-10T02:59:26,510 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-10T02:59:26,513 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-10T02:59:26,515 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-10T02:59:26,517 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-10T02:59:26,520 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-10T02:59:26,522 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-10T02:59:26,524 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-10T02:59:26,527 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-10T02:59:26,529 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-10T02:59:26,531 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-10T02:59:26,535 creating build/bdist.linux-armv7l/wheel/colossalai/context 2024-09-10T02:59:26,535 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2024-09-10T02:59:26,537 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2024-09-10T02:59:26,539 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2024-09-10T02:59:26,542 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-09-10T02:59:26,543 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-09-10T02:59:26,545 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-09-10T02:59:26,547 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-09-10T02:59:26,550 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-09-10T02:59:26,553 creating build/bdist.linux-armv7l/wheel/colossalai/device 2024-09-10T02:59:26,553 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-09-10T02:59:26,556 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-09-10T02:59:26,558 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-09-10T02:59:26,561 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-09-10T02:59:26,564 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-09-10T02:59:26,565 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-09-10T02:59:26,567 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-09-10T02:59:26,568 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2024-09-10T02:59:26,570 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2024-09-10T02:59:26,573 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2024-09-10T02:59:26,575 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero 2024-09-10T02:59:26,577 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-09-10T02:59:26,578 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2024-09-10T02:59:26,580 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2024-09-10T02:59:26,583 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-09-10T02:59:26,584 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-09-10T02:59:26,586 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-09-10T02:59:26,588 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-09-10T02:59:26,590 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-09-10T02:59:26,592 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-09-10T02:59:26,594 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-09-10T02:59:26,595 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2024-09-10T02:59:26,597 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2024-09-10T02:59:26,600 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-09-10T02:59:26,601 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-09-10T02:59:26,602 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-09-10T02:59:26,605 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-09-10T02:59:26,607 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-09-10T02:59:26,609 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-09-10T02:59:26,611 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-09-10T02:59:26,613 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-10T02:59:26,615 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-10T02:59:26,617 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-10T02:59:26,619 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-10T02:59:26,622 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-10T02:59:26,624 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-10T02:59:26,627 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-09-10T02:59:26,628 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2024-09-10T02:59:26,630 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2024-09-10T02:59:26,631 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-10T02:59:26,634 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-09-10T02:59:26,635 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-09-10T02:59:26,637 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-09-10T02:59:26,639 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-09-10T02:59:26,641 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-09-10T02:59:26,643 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-09-10T02:59:26,645 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-09-10T02:59:26,652 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-09-10T02:59:26,654 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-09-10T02:59:26,655 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-09-10T02:59:26,656 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-10T02:59:26,658 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-10T02:59:26,661 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-10T02:59:26,663 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-10T02:59:26,665 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-10T02:59:26,667 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-10T02:59:26,669 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-10T02:59:26,671 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2024-09-10T02:59:26,673 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2024-09-10T02:59:26,675 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-09-10T02:59:26,676 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-09-10T02:59:26,678 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-09-10T02:59:26,680 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-09-10T02:59:26,683 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-09-10T02:59:26,685 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-09-10T02:59:26,687 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-09-10T02:59:26,689 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-09-10T02:59:26,691 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-09-10T02:59:26,694 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-09-10T02:59:26,695 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-09-10T02:59:26,696 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-09-10T02:59:26,698 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-09-10T02:59:26,700 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-09-10T02:59:26,702 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-09-10T02:59:26,704 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-09-10T02:59:26,707 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2024-09-10T02:59:26,709 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:26,710 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:26,712 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:26,714 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:26,716 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:26,718 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:26,719 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:26,721 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:26,723 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-10T02:59:26,725 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2024-09-10T02:59:26,727 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-09-10T02:59:26,728 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2024-09-10T02:59:26,730 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2024-09-10T02:59:26,733 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-09-10T02:59:26,734 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-09-10T02:59:26,735 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2024-09-10T02:59:26,737 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2024-09-10T02:59:26,739 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2024-09-10T02:59:26,741 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2024-09-10T02:59:26,743 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2024-09-10T02:59:26,745 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2024-09-10T02:59:26,748 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:26,748 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:26,750 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:26,753 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:26,755 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:26,757 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:26,759 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:26,761 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:26,762 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:26,764 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:26,766 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:26,769 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-10T02:59:26,771 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-09-10T02:59:26,772 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2024-09-10T02:59:26,774 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2024-09-10T02:59:26,777 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-09-10T02:59:26,778 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-09-10T02:59:26,779 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-09-10T02:59:26,781 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-09-10T02:59:26,784 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-09-10T02:59:26,785 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-09-10T02:59:26,788 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2024-09-10T02:59:26,790 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-09-10T02:59:26,791 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2024-09-10T02:59:26,793 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2024-09-10T02:59:26,795 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-09-10T02:59:26,796 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2024-09-10T02:59:26,798 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2024-09-10T02:59:26,799 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2024-09-10T02:59:26,802 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2024-09-10T02:59:26,804 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-09-10T02:59:26,805 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-09-10T02:59:26,806 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-09-10T02:59:26,808 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-09-10T02:59:26,811 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-09-10T02:59:26,813 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-09-10T02:59:26,819 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-09-10T02:59:26,821 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn 2024-09-10T02:59:26,823 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-09-10T02:59:26,824 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2024-09-10T02:59:26,826 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-09-10T02:59:26,827 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2024-09-10T02:59:26,829 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2024-09-10T02:59:26,832 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:26,833 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:26,835 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:26,837 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:26,839 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:26,841 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:26,843 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-09-10T02:59:26,846 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-09-10T02:59:26,847 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2024-09-10T02:59:26,849 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2024-09-10T02:59:26,851 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-09-10T02:59:26,852 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-09-10T02:59:26,854 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-09-10T02:59:26,857 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-09-10T02:59:26,858 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-09-10T02:59:26,861 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-09-10T02:59:26,862 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-09-10T02:59:26,864 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-09-10T02:59:26,868 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-09-10T02:59:26,871 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-09-10T02:59:26,876 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-09-10T02:59:26,877 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-09-10T02:59:26,880 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-09-10T02:59:26,882 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-09-10T02:59:26,884 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-09-10T02:59:26,887 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2024-09-10T02:59:26,890 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-09-10T02:59:26,891 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-09-10T02:59:26,893 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-09-10T02:59:26,894 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-09-10T02:59:26,897 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-09-10T02:59:26,900 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-09-10T02:59:26,901 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-09-10T02:59:26,903 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-09-10T02:59:26,906 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-09-10T02:59:26,908 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-09-10T02:59:26,911 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-09-10T02:59:26,912 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2024-09-10T02:59:26,914 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2024-09-10T02:59:26,917 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-09-10T02:59:26,917 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-09-10T02:59:26,919 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-09-10T02:59:26,921 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-09-10T02:59:26,922 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-09-10T02:59:26,924 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-09-10T02:59:26,927 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-09-10T02:59:26,927 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2024-09-10T02:59:26,929 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2024-09-10T02:59:26,931 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2024-09-10T02:59:26,934 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-09-10T02:59:26,935 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-09-10T02:59:26,937 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-09-10T02:59:26,939 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-09-10T02:59:26,940 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-09-10T02:59:26,943 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-09-10T02:59:26,945 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:26,946 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:26,948 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:26,950 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:26,952 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:26,954 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:26,957 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:26,959 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:26,961 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:26,963 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-10T02:59:26,966 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-09-10T02:59:26,967 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2024-09-10T02:59:26,969 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2024-09-10T02:59:26,971 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-09-10T02:59:26,973 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-09-10T02:59:26,976 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-09-10T02:59:26,977 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-09-10T02:59:26,979 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-09-10T02:59:26,980 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-09-10T02:59:26,982 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-10T02:59:26,983 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-09-10T02:59:26,985 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-09-10T02:59:26,988 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-09-10T02:59:26,990 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-09-10T02:59:26,993 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-09-10T02:59:26,995 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-09-10T02:59:26,998 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-09-10T02:59:27,000 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-09-10T02:59:27,001 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-09-10T02:59:27,003 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-09-10T02:59:27,005 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-09-10T02:59:27,007 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-09-10T02:59:27,009 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-09-10T02:59:27,012 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-09-10T02:59:27,013 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2024-09-10T02:59:27,015 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-09-10T02:59:27,016 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2024-09-10T02:59:27,018 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2024-09-10T02:59:27,020 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2024-09-10T02:59:27,023 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2024-09-10T02:59:27,026 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-09-10T02:59:27,027 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2024-09-10T02:59:27,029 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2024-09-10T02:59:27,031 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:27,032 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:27,035 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:27,037 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:27,039 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:27,041 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:27,043 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:27,045 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:27,048 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:27,050 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-10T02:59:27,052 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-09-10T02:59:27,054 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-09-10T02:59:27,057 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-09-10T02:59:27,057 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2024-09-10T02:59:27,059 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2024-09-10T02:59:27,062 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-09-10T02:59:27,065 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-09-10T02:59:27,065 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-09-10T02:59:27,068 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-09-10T02:59:27,069 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2024-09-10T02:59:27,071 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-09-10T02:59:27,072 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2024-09-10T02:59:27,074 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2024-09-10T02:59:27,076 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2024-09-10T02:59:27,078 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-09-10T02:59:27,081 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-09-10T02:59:27,083 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-09-10T02:59:27,084 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-09-10T02:59:27,086 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-09-10T02:59:27,089 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-09-10T02:59:27,091 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-09-10T02:59:27,094 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-09-10T02:59:27,096 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-09-10T02:59:27,099 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-09-10T02:59:27,100 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-10T02:59:27,102 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-10T02:59:27,104 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-10T02:59:27,106 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-10T02:59:27,108 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-10T02:59:27,109 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-10T02:59:27,111 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-10T02:59:27,114 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-10T02:59:27,116 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-09-10T02:59:27,117 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2024-09-10T02:59:27,119 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2024-09-10T02:59:27,121 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-09-10T02:59:27,122 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-09-10T02:59:27,124 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-09-10T02:59:27,125 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2024-09-10T02:59:27,127 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2024-09-10T02:59:27,130 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2024-09-10T02:59:27,132 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-09-10T02:59:27,134 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-09-10T02:59:27,137 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-09-10T02:59:27,138 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2024-09-10T02:59:27,140 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2024-09-10T02:59:27,142 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2024-09-10T02:59:27,144 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-09-10T02:59:27,147 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-09-10T02:59:27,150 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-09-10T02:59:27,151 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-09-10T02:59:27,153 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-09-10T02:59:27,155 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-09-10T02:59:27,156 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-09-10T02:59:27,158 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-09-10T02:59:27,161 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-09-10T02:59:27,163 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-09-10T02:59:27,165 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-09-10T02:59:27,167 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-09-10T02:59:27,170 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-09-10T02:59:27,171 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2024-09-10T02:59:27,173 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-09-10T02:59:27,174 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-09-10T02:59:27,176 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-09-10T02:59:27,178 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-09-10T02:59:27,222 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-09-10T02:59:27,223 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2024-09-10T02:59:27,225 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2024-09-10T02:59:27,236 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2024-09-10T02:59:27,239 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-09-10T02:59:27,241 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-09-10T02:59:27,244 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-09-10T02:59:27,245 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-09-10T02:59:27,247 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-09-10T02:59:27,249 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-09-10T02:59:27,251 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-09-10T02:59:27,253 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-09-10T02:59:27,255 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-09-10T02:59:27,259 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-09-10T02:59:27,260 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-09-10T02:59:27,261 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-09-10T02:59:27,264 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-09-10T02:59:27,266 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-09-10T02:59:27,269 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-09-10T02:59:27,271 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2024-09-10T02:59:27,273 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-09-10T02:59:27,274 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-09-10T02:59:27,276 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-09-10T02:59:27,278 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-09-10T02:59:27,280 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-09-10T02:59:27,282 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-09-10T02:59:27,285 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-09-10T02:59:27,286 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2024-09-10T02:59:27,287 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2024-09-10T02:59:27,290 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-09-10T02:59:27,291 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-09-10T02:59:27,293 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-09-10T02:59:27,295 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-09-10T02:59:27,297 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-09-10T02:59:27,299 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-09-10T02:59:27,301 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-09-10T02:59:27,302 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2024-09-10T02:59:27,304 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2024-09-10T02:59:27,306 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2024-09-10T02:59:27,308 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-09-10T02:59:27,309 copying build/lib/colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-09-10T02:59:27,311 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-09-10T02:59:27,313 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-09-10T02:59:27,315 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-09-10T02:59:27,325 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-09-10T02:59:27,327 copying build/lib/colossalai/kernel/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind 2024-09-10T02:59:27,329 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-09-10T02:59:27,330 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2024-09-10T02:59:27,332 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2024-09-10T02:59:27,334 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2024-09-10T02:59:27,337 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-09-10T02:59:27,338 copying build/lib/colossalai/kernel/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2024-09-10T02:59:27,339 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2024-09-10T02:59:27,341 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2024-09-10T02:59:27,344 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-09-10T02:59:27,345 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-09-10T02:59:27,347 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-09-10T02:59:27,349 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-09-10T02:59:27,351 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-09-10T02:59:27,354 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-09-10T02:59:27,355 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2024-09-10T02:59:27,357 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2024-09-10T02:59:27,359 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2024-09-10T02:59:27,361 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-09-10T02:59:27,362 copying build/lib/colossalai/kernel/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2024-09-10T02:59:27,365 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2024-09-10T02:59:27,367 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2024-09-10T02:59:27,369 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-09-10T02:59:27,372 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-09-10T02:59:27,373 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc 2024-09-10T02:59:27,375 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-09-10T02:59:27,376 copying build/lib/colossalai/kernel/extensions/csrc/common/data_type.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-09-10T02:59:27,378 copying build/lib/colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-09-10T02:59:27,380 copying build/lib/colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-09-10T02:59:27,382 copying build/lib/colossalai/kernel/extensions/csrc/common/target.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-09-10T02:59:27,384 copying build/lib/colossalai/kernel/extensions/csrc/common/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-09-10T02:59:27,387 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel 2024-09-10T02:59:27,388 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-09-10T02:59:27,389 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2024-09-10T02:59:27,391 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2024-09-10T02:59:27,395 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-09-10T02:59:27,396 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2024-09-10T02:59:27,398 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2024-09-10T02:59:27,401 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,402 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,405 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,407 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,410 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,412 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,415 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,418 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,419 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,422 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,425 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,427 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,430 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,433 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,435 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-09-10T02:59:27,436 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-09-10T02:59:27,438 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,441 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,443 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,446 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,449 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-10T02:59:27,451 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-10T02:59:27,453 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-10T02:59:27,455 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-10T02:59:27,457 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-10T02:59:27,459 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-10T02:59:27,461 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-09-10T02:59:27,463 copying build/lib/colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-09-10T02:59:27,465 copying build/lib/colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-09-10T02:59:27,467 copying build/lib/colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-09-10T02:59:27,469 copying build/lib/colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-09-10T02:59:27,472 copying build/lib/colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-09-10T02:59:27,474 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-09-10T02:59:27,476 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-09-10T02:59:27,477 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-10T02:59:27,479 copying build/lib/colossalai/kernel/triton/context_attn_unpad.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-10T02:59:27,481 copying build/lib/colossalai/kernel/triton/rms_layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-10T02:59:27,483 copying build/lib/colossalai/kernel/triton/fused_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-10T02:59:27,485 copying build/lib/colossalai/kernel/triton/rotary_cache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-10T02:59:27,488 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-10T02:59:27,489 copying build/lib/colossalai/kernel/triton/kvcache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-10T02:59:27,492 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-10T02:59:27,494 copying build/lib/colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-10T02:59:27,497 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-10T02:59:27,499 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-10T02:59:27,502 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-09-10T02:59:27,503 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-09-10T02:59:27,505 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-09-10T02:59:27,506 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-09-10T02:59:27,508 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-09-10T02:59:27,511 creating build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-09-10T02:59:27,511 copying build/lib/colossalai/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-09-10T02:59:27,513 copying build/lib/colossalai/quantization/bnb.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-09-10T02:59:27,516 copying build/lib/colossalai/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-09-10T02:59:27,518 copying build/lib/colossalai/quantization/bnb_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-09-10T02:59:27,520 copying build/lib/colossalai/quantization/fp8_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-09-10T02:59:27,522 copying build/lib/colossalai/quantization/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-09-10T02:59:27,525 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2024-09-10T02:59:27,526 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-09-10T02:59:27,527 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2024-09-10T02:59:27,529 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-09-10T02:59:27,530 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-09-10T02:59:27,532 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-09-10T02:59:27,535 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-09-10T02:59:27,537 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-09-10T02:59:27,539 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-10T02:59:27,540 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-10T02:59:27,541 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-10T02:59:27,543 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-10T02:59:27,545 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-10T02:59:27,547 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2024-09-10T02:59:27,549 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp 2024-09-10T02:59:27,551 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2024-09-10T02:59:27,553 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2024-09-10T02:59:27,554 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2024-09-10T02:59:27,557 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-09-10T02:59:27,558 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-10T02:59:27,560 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-10T02:59:27,562 copying build/lib/colossalai/checkpoint_io/moe_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-10T02:59:27,565 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-10T02:59:27,568 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-10T02:59:27,570 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-10T02:59:27,573 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-10T02:59:27,577 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2024-09-10T02:59:27,578 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-09-10T02:59:27,579 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,581 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,584 copying build/lib/colossalai/nn/optimizer/distributed_adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,586 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,589 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,591 copying build/lib/colossalai/nn/optimizer/distributed_came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,594 copying build/lib/colossalai/nn/optimizer/distributed_galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,596 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,598 copying build/lib/colossalai/nn/optimizer/came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,600 copying build/lib/colossalai/nn/optimizer/galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,603 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,605 copying build/lib/colossalai/nn/optimizer/distributed_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,607 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,609 copying build/lib/colossalai/nn/optimizer/adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,611 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,613 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-10T02:59:27,616 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-09-10T02:59:27,616 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/loss 2024-09-10T02:59:27,618 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2024-09-10T02:59:27,620 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-09-10T02:59:27,621 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-09-10T02:59:27,623 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-09-10T02:59:27,625 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-09-10T02:59:27,627 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-09-10T02:59:27,629 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-09-10T02:59:27,630 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-10T02:59:27,632 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-10T02:59:27,634 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-10T02:59:27,636 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-10T02:59:27,639 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-10T02:59:27,641 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-10T02:59:27,643 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-10T02:59:27,645 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-10T02:59:27,647 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2024-09-10T02:59:27,650 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2024-09-10T02:59:27,651 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-09-10T02:59:27,652 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2024-09-10T02:59:27,654 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2024-09-10T02:59:27,657 copying build/lib/colossalai/inference/kv_cache/block_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2024-09-10T02:59:27,659 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-10T02:59:27,661 creating build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-09-10T02:59:27,662 copying build/lib/colossalai/inference/core/diffusion_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-10T02:59:27,664 copying build/lib/colossalai/inference/core/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-10T02:59:27,666 copying build/lib/colossalai/inference/core/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-10T02:59:27,668 copying build/lib/colossalai/inference/core/plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-10T02:59:27,670 copying build/lib/colossalai/inference/core/llm_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-10T02:59:27,673 copying build/lib/colossalai/inference/core/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-10T02:59:27,676 copying build/lib/colossalai/inference/core/rpc_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-10T02:59:27,678 copying build/lib/colossalai/inference/core/base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-10T02:59:27,680 copying build/lib/colossalai/inference/core/request_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-10T02:59:27,683 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-09-10T02:59:27,684 copying build/lib/colossalai/inference/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling 2024-09-10T02:59:27,686 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-09-10T02:59:27,687 copying build/lib/colossalai/inference/modeling/models/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-09-10T02:59:27,688 copying build/lib/colossalai/inference/modeling/models/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-09-10T02:59:27,691 copying build/lib/colossalai/inference/modeling/models/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-09-10T02:59:27,693 copying build/lib/colossalai/inference/modeling/models/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-09-10T02:59:27,695 copying build/lib/colossalai/inference/modeling/models/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-09-10T02:59:27,698 copying build/lib/colossalai/inference/modeling/models/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-09-10T02:59:27,701 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-09-10T02:59:27,702 copying build/lib/colossalai/inference/modeling/backends/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2024-09-10T02:59:27,704 copying build/lib/colossalai/inference/modeling/backends/pre_attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2024-09-10T02:59:27,706 copying build/lib/colossalai/inference/modeling/backends/attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2024-09-10T02:59:27,709 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-09-10T02:59:27,710 copying build/lib/colossalai/inference/modeling/policy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-09-10T02:59:27,712 copying build/lib/colossalai/inference/modeling/policy/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-09-10T02:59:27,714 copying build/lib/colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-09-10T02:59:27,716 copying build/lib/colossalai/inference/modeling/policy/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-09-10T02:59:27,718 copying build/lib/colossalai/inference/modeling/policy/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-09-10T02:59:27,720 copying build/lib/colossalai/inference/modeling/policy/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-09-10T02:59:27,722 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-09-10T02:59:27,723 copying build/lib/colossalai/inference/modeling/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-09-10T02:59:27,725 copying build/lib/colossalai/inference/modeling/layers/diffusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-09-10T02:59:27,726 copying build/lib/colossalai/inference/modeling/layers/distrifusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-09-10T02:59:27,729 copying build/lib/colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-09-10T02:59:27,731 copying build/lib/colossalai/inference/modeling/layers/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-09-10T02:59:27,734 copying build/lib/colossalai/inference/graph_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-10T02:59:27,736 creating build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-09-10T02:59:27,737 copying build/lib/colossalai/inference/server/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-09-10T02:59:27,739 copying build/lib/colossalai/inference/server/completion_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-09-10T02:59:27,741 copying build/lib/colossalai/inference/server/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-09-10T02:59:27,742 copying build/lib/colossalai/inference/server/chat_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-09-10T02:59:27,745 copying build/lib/colossalai/inference/server/api_server.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-09-10T02:59:27,747 copying build/lib/colossalai/inference/sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-10T02:59:27,749 copying build/lib/colossalai/inference/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-10T02:59:27,751 copying build/lib/colossalai/inference/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-10T02:59:27,754 copying build/lib/colossalai/inference/batch_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-10T02:59:27,758 creating build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-09-10T02:59:27,759 copying build/lib/colossalai/inference/spec/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2024-09-10T02:59:27,761 copying build/lib/colossalai/inference/spec/drafter.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2024-09-10T02:59:27,763 copying build/lib/colossalai/inference/spec/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2024-09-10T02:59:27,765 creating build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-09-10T02:59:27,766 copying build/lib/colossalai/inference/executor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2024-09-10T02:59:27,768 copying build/lib/colossalai/inference/executor/rpc_worker.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2024-09-10T02:59:27,770 copying build/lib/colossalai/inference/logit_processors.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-10T02:59:27,773 copying build/lib/colossalai/inference/flash_decoding_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-10T02:59:27,774 copying build/lib/colossalai/inference/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-10T02:59:27,777 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-09-10T02:59:27,778 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-09-10T02:59:27,779 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-09-10T02:59:27,782 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-09-10T02:59:27,785 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-09-10T02:59:27,786 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-09-10T02:59:27,789 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-09-10T02:59:27,791 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-09-10T02:59:27,794 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2024-09-10T02:59:27,795 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2024-09-10T02:59:27,798 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2024-09-10T02:59:27,801 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-09-10T02:59:27,803 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-09-10T02:59:27,804 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-10T02:59:27,806 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-10T02:59:27,808 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-10T02:59:27,810 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-10T02:59:27,813 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-10T02:59:27,814 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-10T02:59:27,817 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-10T02:59:27,819 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-10T02:59:27,822 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-10T02:59:27,825 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-10T02:59:27,826 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-10T02:59:27,829 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-09-10T02:59:27,830 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2024-09-10T02:59:27,832 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2024-09-10T02:59:27,834 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-10T02:59:27,837 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-10T02:59:27,839 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-10T02:59:27,841 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-10T02:59:27,843 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-10T02:59:27,846 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-09-10T02:59:27,847 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2024-09-10T02:59:27,849 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2024-09-10T02:59:27,851 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2024-09-10T02:59:27,853 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-09-10T02:59:27,854 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-09-10T02:59:27,856 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-09-10T02:59:27,858 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-09-10T02:59:27,861 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-09-10T02:59:27,863 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-09-10T02:59:27,865 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-09-10T02:59:27,867 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2024-09-10T02:59:27,869 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_C 2024-09-10T02:59:27,871 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2024-09-10T02:59:27,872 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-09-10T02:59:27,874 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-09-10T02:59:27,875 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2024-09-10T02:59:27,877 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2024-09-10T02:59:27,880 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-09-10T02:59:27,881 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2024-09-10T02:59:27,883 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2024-09-10T02:59:27,885 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-09-10T02:59:27,888 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-09-10T02:59:27,889 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2024-09-10T02:59:27,891 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2024-09-10T02:59:27,893 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-09-10T02:59:27,895 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2024-09-10T02:59:27,897 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2024-09-10T02:59:27,899 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-09-10T02:59:27,901 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-09-10T02:59:27,904 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-09-10T02:59:27,905 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel 2024-09-10T02:59:27,908 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-09-10T02:59:27,909 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-09-10T02:59:27,911 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-09-10T02:59:27,914 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-09-10T02:59:27,916 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-09-10T02:59:27,919 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-09-10T02:59:27,921 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-09-10T02:59:27,924 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-09-10T02:59:27,925 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-09-10T02:59:27,927 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-09-10T02:59:27,931 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:27,933 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:27,935 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:27,937 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:27,940 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:27,942 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:27,944 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,946 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,948 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,950 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,953 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,955 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,958 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,961 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,963 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,966 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,968 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,971 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,974 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,976 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,979 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,981 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,983 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,987 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,989 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,992 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-10T02:59:27,995 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:27,998 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,000 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,003 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,005 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,007 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,010 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,012 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,014 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,017 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,019 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,022 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,024 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,026 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,029 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,032 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,034 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,036 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,039 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,041 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,044 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,046 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-10T02:59:28,049 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-09-10T02:59:28,050 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-09-10T02:59:28,052 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-09-10T02:59:28,054 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-09-10T02:59:28,057 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-09-10T02:59:28,059 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-09-10T02:59:28,061 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-09-10T02:59:28,063 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-09-10T02:59:28,065 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-09-10T02:59:28,068 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:28,069 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:28,071 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:28,073 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:28,076 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:28,078 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:28,080 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-09-10T02:59:28,083 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-09-10T02:59:28,084 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-09-10T02:59:28,086 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-09-10T02:59:28,088 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-09-10T02:59:28,091 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-09-10T02:59:28,094 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-09-10T02:59:28,096 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-09-10T02:59:28,098 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-09-10T02:59:28,099 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/pipeline_shard 2024-09-10T02:59:28,101 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-09-10T02:59:28,102 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-09-10T02:59:28,105 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-09-10T02:59:28,106 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-09-10T02:59:28,109 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:28,110 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:28,111 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:28,114 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:28,116 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:28,118 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:28,121 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:28,123 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:28,125 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:28,127 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:28,129 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:28,131 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-10T02:59:28,133 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-09-10T02:59:28,135 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-09-10T02:59:28,136 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-10T02:59:28,138 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-10T02:59:28,140 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-10T02:59:28,143 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-10T02:59:28,145 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-10T02:59:28,147 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-10T02:59:28,150 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-10T02:59:28,152 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-10T02:59:28,155 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-10T02:59:28,156 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-10T02:59:28,159 creating build/bdist.linux-armv7l/wheel/extensions 2024-09-10T02:59:28,160 creating build/bdist.linux-armv7l/wheel/extensions/pybind 2024-09-10T02:59:28,161 creating build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-09-10T02:59:28,163 copying build/lib/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2024-09-10T02:59:28,165 copying build/lib/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2024-09-10T02:59:28,167 creating build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-09-10T02:59:28,167 copying build/lib/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2024-09-10T02:59:28,169 copying build/lib/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2024-09-10T02:59:28,171 copying build/lib/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2024-09-10T02:59:28,173 copying build/lib/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind 2024-09-10T02:59:28,175 creating build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-09-10T02:59:28,175 copying build/lib/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2024-09-10T02:59:28,177 copying build/lib/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2024-09-10T02:59:28,179 creating build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-09-10T02:59:28,180 copying build/lib/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2024-09-10T02:59:28,182 copying build/lib/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2024-09-10T02:59:28,185 creating build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-09-10T02:59:28,185 copying build/lib/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-09-10T02:59:28,187 copying build/lib/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-09-10T02:59:28,189 copying build/lib/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-09-10T02:59:28,191 copying build/lib/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-09-10T02:59:28,194 creating build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-09-10T02:59:28,195 copying build/lib/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2024-09-10T02:59:28,197 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2024-09-10T02:59:28,199 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2024-09-10T02:59:28,201 creating build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-09-10T02:59:28,202 copying build/lib/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2024-09-10T02:59:28,204 copying build/lib/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2024-09-10T02:59:28,206 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2024-09-10T02:59:28,207 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/csrc 2024-09-10T02:59:28,208 running install_egg_info 2024-09-10T02:59:28,241 running egg_info 2024-09-10T02:59:28,268 writing colossalai.egg-info/PKG-INFO 2024-09-10T02:59:28,273 writing dependency_links to colossalai.egg-info/dependency_links.txt 2024-09-10T02:59:28,274 writing entry points to colossalai.egg-info/entry_points.txt 2024-09-10T02:59:28,275 writing requirements to colossalai.egg-info/requires.txt 2024-09-10T02:59:28,277 writing top-level names to colossalai.egg-info/top_level.txt 2024-09-10T02:59:28,533 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2024-09-10T02:59:28,634 reading manifest template 'MANIFEST.in' 2024-09-10T02:59:29,960 warning: no files found matching '*.tr' under directory 'colossalai' 2024-09-10T02:59:30,607 warning: no files found matching '*.cc' under directory 'colossalai' 2024-09-10T02:59:30,934 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-09-10T02:59:31,094 warning: no files found matching '*.tr' under directory 'extensions' 2024-09-10T02:59:31,147 warning: no files found matching '*.cc' under directory 'extensions' 2024-09-10T02:59:31,174 warning: no files found matching '*.pyi' under directory 'extensions' 2024-09-10T02:59:31,175 adding license file 'LICENSE' 2024-09-10T02:59:31,223 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2024-09-10T02:59:31,226 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/./colossalai-0.4.3-py3.11.egg-info 2024-09-10T02:59:31,238 running install_scripts 2024-09-10T02:59:31,264 creating build/bdist.linux-armv7l/wheel/colossalai-0.4.3.dist-info/WHEEL 2024-09-10T02:59:31,266 creating '/tmp/pip-wheel-ann8zngd/colossalai-0.4.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-09-10T02:59:31,269 adding 'colossalai/__init__.py' 2024-09-10T02:59:31,270 adding 'colossalai/initialize.py' 2024-09-10T02:59:31,272 adding 'colossalai/version.py' 2024-09-10T02:59:31,273 adding 'colossalai/_C/__init__.py' 2024-09-10T02:59:31,275 adding 'colossalai/_analyzer/__init__.py' 2024-09-10T02:59:31,276 adding 'colossalai/_analyzer/envs.py' 2024-09-10T02:59:31,278 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2024-09-10T02:59:31,281 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2024-09-10T02:59:31,282 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2024-09-10T02:59:31,284 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2024-09-10T02:59:31,286 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2024-09-10T02:59:31,288 adding 'colossalai/_analyzer/fx/__init__.py' 2024-09-10T02:59:31,291 adding 'colossalai/_analyzer/fx/codegen.py' 2024-09-10T02:59:31,293 adding 'colossalai/_analyzer/fx/graph_module.py' 2024-09-10T02:59:31,294 adding 'colossalai/_analyzer/fx/node_util.py' 2024-09-10T02:59:31,296 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2024-09-10T02:59:31,297 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2024-09-10T02:59:31,299 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2024-09-10T02:59:31,301 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2024-09-10T02:59:31,303 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2024-09-10T02:59:31,304 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2024-09-10T02:59:31,306 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2024-09-10T02:59:31,307 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2024-09-10T02:59:31,309 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2024-09-10T02:59:31,311 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2024-09-10T02:59:31,313 adding 'colossalai/accelerator/__init__.py' 2024-09-10T02:59:31,314 adding 'colossalai/accelerator/api.py' 2024-09-10T02:59:31,315 adding 'colossalai/accelerator/base_accelerator.py' 2024-09-10T02:59:31,317 adding 'colossalai/accelerator/cpu_accelerator.py' 2024-09-10T02:59:31,318 adding 'colossalai/accelerator/cuda_accelerator.py' 2024-09-10T02:59:31,320 adding 'colossalai/accelerator/npu_accelerator.py' 2024-09-10T02:59:31,321 adding 'colossalai/amp/__init__.py' 2024-09-10T02:59:31,323 adding 'colossalai/amp/naive_amp/__init__.py' 2024-09-10T02:59:31,324 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2024-09-10T02:59:31,326 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2024-09-10T02:59:31,327 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2024-09-10T02:59:31,328 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2024-09-10T02:59:31,329 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2024-09-10T02:59:31,331 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2024-09-10T02:59:31,332 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2024-09-10T02:59:31,333 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2024-09-10T02:59:31,334 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2024-09-10T02:59:31,336 adding 'colossalai/auto_parallel/__init__.py' 2024-09-10T02:59:31,338 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2024-09-10T02:59:31,339 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2024-09-10T02:59:31,341 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2024-09-10T02:59:31,342 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2024-09-10T02:59:31,344 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2024-09-10T02:59:31,346 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2024-09-10T02:59:31,348 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2024-09-10T02:59:31,349 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2024-09-10T02:59:31,350 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2024-09-10T02:59:31,352 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2024-09-10T02:59:31,353 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2024-09-10T02:59:31,355 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2024-09-10T02:59:31,356 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2024-09-10T02:59:31,358 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2024-09-10T02:59:31,359 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2024-09-10T02:59:31,361 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2024-09-10T02:59:31,363 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2024-09-10T02:59:31,364 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2024-09-10T02:59:31,366 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2024-09-10T02:59:31,367 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2024-09-10T02:59:31,369 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2024-09-10T02:59:31,370 adding 'colossalai/auto_parallel/offload/__init__.py' 2024-09-10T02:59:31,372 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2024-09-10T02:59:31,374 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2024-09-10T02:59:31,375 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2024-09-10T02:59:31,376 adding 'colossalai/auto_parallel/offload/region.py' 2024-09-10T02:59:31,379 adding 'colossalai/auto_parallel/offload/region_manager.py' 2024-09-10T02:59:31,381 adding 'colossalai/auto_parallel/offload/runtime.py' 2024-09-10T02:59:31,383 adding 'colossalai/auto_parallel/offload/solver.py' 2024-09-10T02:59:31,385 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2024-09-10T02:59:31,386 adding 'colossalai/auto_parallel/offload/util.py' 2024-09-10T02:59:31,388 adding 'colossalai/auto_parallel/passes/__init__.py' 2024-09-10T02:59:31,389 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2024-09-10T02:59:31,391 adding 'colossalai/auto_parallel/passes/constants.py' 2024-09-10T02:59:31,392 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2024-09-10T02:59:31,394 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2024-09-10T02:59:31,397 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2024-09-10T02:59:31,399 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2024-09-10T02:59:31,400 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2024-09-10T02:59:31,401 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2024-09-10T02:59:31,404 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2024-09-10T02:59:31,405 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2024-09-10T02:59:31,407 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2024-09-10T02:59:31,409 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2024-09-10T02:59:31,411 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2024-09-10T02:59:31,412 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2024-09-10T02:59:31,413 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2024-09-10T02:59:31,415 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2024-09-10T02:59:31,416 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2024-09-10T02:59:31,418 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2024-09-10T02:59:31,419 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2024-09-10T02:59:31,421 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2024-09-10T02:59:31,422 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2024-09-10T02:59:31,424 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2024-09-10T02:59:31,426 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2024-09-10T02:59:31,428 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2024-09-10T02:59:31,430 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2024-09-10T02:59:31,432 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2024-09-10T02:59:31,433 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2024-09-10T02:59:31,435 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2024-09-10T02:59:31,436 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2024-09-10T02:59:31,437 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2024-09-10T02:59:31,439 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2024-09-10T02:59:31,440 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2024-09-10T02:59:31,442 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2024-09-10T02:59:31,443 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2024-09-10T02:59:31,444 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2024-09-10T02:59:31,446 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2024-09-10T02:59:31,447 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2024-09-10T02:59:31,448 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2024-09-10T02:59:31,450 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2024-09-10T02:59:31,452 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2024-09-10T02:59:31,454 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2024-09-10T02:59:31,462 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2024-09-10T02:59:31,464 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2024-09-10T02:59:31,465 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2024-09-10T02:59:31,468 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2024-09-10T02:59:31,470 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2024-09-10T02:59:31,473 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2024-09-10T02:59:31,475 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2024-09-10T02:59:31,476 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2024-09-10T02:59:31,478 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2024-09-10T02:59:31,480 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2024-09-10T02:59:31,482 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2024-09-10T02:59:31,484 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2024-09-10T02:59:31,485 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2024-09-10T02:59:31,487 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2024-09-10T02:59:31,488 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2024-09-10T02:59:31,490 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2024-09-10T02:59:31,492 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2024-09-10T02:59:31,494 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2024-09-10T02:59:31,495 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2024-09-10T02:59:31,498 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2024-09-10T02:59:31,500 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2024-09-10T02:59:31,502 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2024-09-10T02:59:31,503 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2024-09-10T02:59:31,505 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2024-09-10T02:59:31,506 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2024-09-10T02:59:31,508 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2024-09-10T02:59:31,509 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2024-09-10T02:59:31,511 adding 'colossalai/booster/__init__.py' 2024-09-10T02:59:31,513 adding 'colossalai/booster/accelerator.py' 2024-09-10T02:59:31,515 adding 'colossalai/booster/booster.py' 2024-09-10T02:59:31,517 adding 'colossalai/booster/mixed_precision/__init__.py' 2024-09-10T02:59:31,518 adding 'colossalai/booster/mixed_precision/bf16.py' 2024-09-10T02:59:31,519 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2024-09-10T02:59:31,521 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2024-09-10T02:59:31,522 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2024-09-10T02:59:31,523 adding 'colossalai/booster/mixed_precision/fp8.py' 2024-09-10T02:59:31,524 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2024-09-10T02:59:31,526 adding 'colossalai/booster/plugin/__init__.py' 2024-09-10T02:59:31,527 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2024-09-10T02:59:31,531 adding 'colossalai/booster/plugin/gemini_plugin.py' 2024-09-10T02:59:31,538 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2024-09-10T02:59:31,541 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2024-09-10T02:59:31,544 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2024-09-10T02:59:31,546 adding 'colossalai/booster/plugin/plugin_base.py' 2024-09-10T02:59:31,547 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2024-09-10T02:59:31,548 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2024-09-10T02:59:31,550 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2024-09-10T02:59:31,552 adding 'colossalai/checkpoint_io/__init__.py' 2024-09-10T02:59:31,554 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2024-09-10T02:59:31,556 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2024-09-10T02:59:31,560 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2024-09-10T02:59:31,562 adding 'colossalai/checkpoint_io/index_file.py' 2024-09-10T02:59:31,566 adding 'colossalai/checkpoint_io/moe_checkpoint.py' 2024-09-10T02:59:31,570 adding 'colossalai/checkpoint_io/utils.py' 2024-09-10T02:59:31,571 adding 'colossalai/cli/__init__.py' 2024-09-10T02:59:31,573 adding 'colossalai/cli/cli.py' 2024-09-10T02:59:31,574 adding 'colossalai/cli/check/__init__.py' 2024-09-10T02:59:31,576 adding 'colossalai/cli/check/check_installation.py' 2024-09-10T02:59:31,578 adding 'colossalai/cli/launcher/__init__.py' 2024-09-10T02:59:31,579 adding 'colossalai/cli/launcher/hostinfo.py' 2024-09-10T02:59:31,581 adding 'colossalai/cli/launcher/multinode_runner.py' 2024-09-10T02:59:31,582 adding 'colossalai/cli/launcher/run.py' 2024-09-10T02:59:31,584 adding 'colossalai/cluster/__init__.py' 2024-09-10T02:59:31,586 adding 'colossalai/cluster/device_mesh_manager.py' 2024-09-10T02:59:31,587 adding 'colossalai/cluster/dist_coordinator.py' 2024-09-10T02:59:31,588 adding 'colossalai/cluster/process_group_manager.py' 2024-09-10T02:59:31,590 adding 'colossalai/cluster/process_group_mesh.py' 2024-09-10T02:59:31,592 adding 'colossalai/context/__init__.py' 2024-09-10T02:59:31,593 adding 'colossalai/context/config.py' 2024-09-10T02:59:31,594 adding 'colossalai/context/singleton_meta.py' 2024-09-10T02:59:31,596 adding 'colossalai/device/__init__.py' 2024-09-10T02:59:31,599 adding 'colossalai/device/alpha_beta_profiler.py' 2024-09-10T02:59:31,600 adding 'colossalai/device/calc_pipeline_strategy.py' 2024-09-10T02:59:31,603 adding 'colossalai/device/device_mesh.py' 2024-09-10T02:59:31,605 adding 'colossalai/fx/__init__.py' 2024-09-10T02:59:31,606 adding 'colossalai/fx/_compatibility.py' 2024-09-10T02:59:31,608 adding 'colossalai/fx/_meta_regist_12.py' 2024-09-10T02:59:31,610 adding 'colossalai/fx/_meta_regist_13.py' 2024-09-10T02:59:31,612 adding 'colossalai/fx/graph_module.py' 2024-09-10T02:59:31,613 adding 'colossalai/fx/proxy.py' 2024-09-10T02:59:31,615 adding 'colossalai/fx/codegen/__init__.py' 2024-09-10T02:59:31,619 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2024-09-10T02:59:31,621 adding 'colossalai/fx/passes/__init__.py' 2024-09-10T02:59:31,624 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2024-09-10T02:59:31,626 adding 'colossalai/fx/passes/concrete_info_prop.py' 2024-09-10T02:59:31,628 adding 'colossalai/fx/passes/meta_info_prop.py' 2024-09-10T02:59:31,631 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2024-09-10T02:59:31,632 adding 'colossalai/fx/passes/shard_1d_pass.py' 2024-09-10T02:59:31,635 adding 'colossalai/fx/passes/split_module.py' 2024-09-10T02:59:31,637 adding 'colossalai/fx/passes/utils.py' 2024-09-10T02:59:31,639 adding 'colossalai/fx/profiler/__init__.py' 2024-09-10T02:59:31,640 adding 'colossalai/fx/profiler/constants.py' 2024-09-10T02:59:31,642 adding 'colossalai/fx/profiler/dataflow.py' 2024-09-10T02:59:31,643 adding 'colossalai/fx/profiler/memory_utils.py' 2024-09-10T02:59:31,645 adding 'colossalai/fx/profiler/opcount.py' 2024-09-10T02:59:31,647 adding 'colossalai/fx/profiler/profiler.py' 2024-09-10T02:59:31,649 adding 'colossalai/fx/profiler/shard_utils.py' 2024-09-10T02:59:31,650 adding 'colossalai/fx/profiler/tensor.py' 2024-09-10T02:59:31,652 adding 'colossalai/fx/profiler/experimental/__init__.py' 2024-09-10T02:59:31,653 adding 'colossalai/fx/profiler/experimental/constants.py' 2024-09-10T02:59:31,655 adding 'colossalai/fx/profiler/experimental/profiler.py' 2024-09-10T02:59:31,656 adding 'colossalai/fx/profiler/experimental/registry.py' 2024-09-10T02:59:31,657 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2024-09-10T02:59:31,659 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2024-09-10T02:59:31,660 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2024-09-10T02:59:31,661 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2024-09-10T02:59:31,662 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2024-09-10T02:59:31,664 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2024-09-10T02:59:31,665 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2024-09-10T02:59:31,666 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2024-09-10T02:59:31,667 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2024-09-10T02:59:31,669 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2024-09-10T02:59:31,670 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2024-09-10T02:59:31,672 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2024-09-10T02:59:31,673 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2024-09-10T02:59:31,674 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2024-09-10T02:59:31,676 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2024-09-10T02:59:31,677 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2024-09-10T02:59:31,678 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2024-09-10T02:59:31,679 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2024-09-10T02:59:31,681 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2024-09-10T02:59:31,682 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2024-09-10T02:59:31,683 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2024-09-10T02:59:31,685 adding 'colossalai/fx/tracer/__init__.py' 2024-09-10T02:59:31,687 adding 'colossalai/fx/tracer/_meta_trace.py' 2024-09-10T02:59:31,688 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2024-09-10T02:59:31,689 adding 'colossalai/fx/tracer/_tracer_utils.py' 2024-09-10T02:59:31,692 adding 'colossalai/fx/tracer/experimental.py' 2024-09-10T02:59:31,694 adding 'colossalai/fx/tracer/registry.py' 2024-09-10T02:59:31,697 adding 'colossalai/fx/tracer/tracer.py' 2024-09-10T02:59:31,699 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2024-09-10T02:59:31,701 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2024-09-10T02:59:31,702 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2024-09-10T02:59:31,703 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2024-09-10T02:59:31,705 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2024-09-10T02:59:31,706 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2024-09-10T02:59:31,708 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2024-09-10T02:59:31,709 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2024-09-10T02:59:31,710 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2024-09-10T02:59:31,711 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2024-09-10T02:59:31,713 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2024-09-10T02:59:31,715 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2024-09-10T02:59:31,716 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2024-09-10T02:59:31,717 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2024-09-10T02:59:31,718 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2024-09-10T02:59:31,719 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2024-09-10T02:59:31,721 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2024-09-10T02:59:31,722 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2024-09-10T02:59:31,724 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2024-09-10T02:59:31,726 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2024-09-10T02:59:31,727 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2024-09-10T02:59:31,728 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2024-09-10T02:59:31,729 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2024-09-10T02:59:31,730 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2024-09-10T02:59:31,732 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2024-09-10T02:59:31,733 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2024-09-10T02:59:31,734 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2024-09-10T02:59:31,736 adding 'colossalai/inference/__init__.py' 2024-09-10T02:59:31,739 adding 'colossalai/inference/batch_bucket.py' 2024-09-10T02:59:31,742 adding 'colossalai/inference/config.py' 2024-09-10T02:59:31,743 adding 'colossalai/inference/flash_decoding_utils.py' 2024-09-10T02:59:31,745 adding 'colossalai/inference/graph_runner.py' 2024-09-10T02:59:31,746 adding 'colossalai/inference/logit_processors.py' 2024-09-10T02:59:31,748 adding 'colossalai/inference/sampler.py' 2024-09-10T02:59:31,749 adding 'colossalai/inference/struct.py' 2024-09-10T02:59:31,751 adding 'colossalai/inference/utils.py' 2024-09-10T02:59:31,753 adding 'colossalai/inference/core/__init__.py' 2024-09-10T02:59:31,755 adding 'colossalai/inference/core/async_engine.py' 2024-09-10T02:59:31,756 adding 'colossalai/inference/core/base_engine.py' 2024-09-10T02:59:31,758 adding 'colossalai/inference/core/diffusion_engine.py' 2024-09-10T02:59:31,760 adding 'colossalai/inference/core/engine.py' 2024-09-10T02:59:31,764 adding 'colossalai/inference/core/llm_engine.py' 2024-09-10T02:59:31,766 adding 'colossalai/inference/core/plugin.py' 2024-09-10T02:59:31,769 adding 'colossalai/inference/core/request_handler.py' 2024-09-10T02:59:31,771 adding 'colossalai/inference/core/rpc_engine.py' 2024-09-10T02:59:31,773 adding 'colossalai/inference/executor/__init__.py' 2024-09-10T02:59:31,775 adding 'colossalai/inference/executor/rpc_worker.py' 2024-09-10T02:59:31,778 adding 'colossalai/inference/kv_cache/__init__.py' 2024-09-10T02:59:31,779 adding 'colossalai/inference/kv_cache/block_cache.py' 2024-09-10T02:59:31,783 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2024-09-10T02:59:31,785 adding 'colossalai/inference/modeling/__init__.py' 2024-09-10T02:59:31,787 adding 'colossalai/inference/modeling/backends/__init__.py' 2024-09-10T02:59:31,788 adding 'colossalai/inference/modeling/backends/attention_backend.py' 2024-09-10T02:59:31,790 adding 'colossalai/inference/modeling/backends/pre_attention_backend.py' 2024-09-10T02:59:31,792 adding 'colossalai/inference/modeling/layers/__init__.py' 2024-09-10T02:59:31,795 adding 'colossalai/inference/modeling/layers/attention.py' 2024-09-10T02:59:31,796 adding 'colossalai/inference/modeling/layers/baichuan_tp_linear.py' 2024-09-10T02:59:31,798 adding 'colossalai/inference/modeling/layers/diffusion.py' 2024-09-10T02:59:31,802 adding 'colossalai/inference/modeling/layers/distrifusion.py' 2024-09-10T02:59:31,804 adding 'colossalai/inference/modeling/models/__init__.py' 2024-09-10T02:59:31,812 adding 'colossalai/inference/modeling/models/glide_llama.py' 2024-09-10T02:59:31,813 adding 'colossalai/inference/modeling/models/nopadding_baichuan.py' 2024-09-10T02:59:31,817 adding 'colossalai/inference/modeling/models/nopadding_llama.py' 2024-09-10T02:59:31,819 adding 'colossalai/inference/modeling/models/pixart_alpha.py' 2024-09-10T02:59:31,820 adding 'colossalai/inference/modeling/models/stablediffusion3.py' 2024-09-10T02:59:31,822 adding 'colossalai/inference/modeling/policy/__init__.py' 2024-09-10T02:59:31,823 adding 'colossalai/inference/modeling/policy/glide_llama.py' 2024-09-10T02:59:31,825 adding 'colossalai/inference/modeling/policy/nopadding_baichuan.py' 2024-09-10T02:59:31,826 adding 'colossalai/inference/modeling/policy/nopadding_llama.py' 2024-09-10T02:59:31,828 adding 'colossalai/inference/modeling/policy/pixart_alpha.py' 2024-09-10T02:59:31,829 adding 'colossalai/inference/modeling/policy/stablediffusion3.py' 2024-09-10T02:59:31,831 adding 'colossalai/inference/server/__init__.py' 2024-09-10T02:59:31,833 adding 'colossalai/inference/server/api_server.py' 2024-09-10T02:59:31,835 adding 'colossalai/inference/server/chat_service.py' 2024-09-10T02:59:31,836 adding 'colossalai/inference/server/completion_service.py' 2024-09-10T02:59:31,837 adding 'colossalai/inference/server/utils.py' 2024-09-10T02:59:31,839 adding 'colossalai/inference/spec/__init__.py' 2024-09-10T02:59:31,840 adding 'colossalai/inference/spec/drafter.py' 2024-09-10T02:59:31,842 adding 'colossalai/inference/spec/struct.py' 2024-09-10T02:59:31,844 adding 'colossalai/interface/__init__.py' 2024-09-10T02:59:31,845 adding 'colossalai/interface/model.py' 2024-09-10T02:59:31,847 adding 'colossalai/interface/optimizer.py' 2024-09-10T02:59:31,848 adding 'colossalai/interface/pretrained.py' 2024-09-10T02:59:31,849 adding 'colossalai/kernel/__init__.py' 2024-09-10T02:59:31,851 adding 'colossalai/kernel/kernel_loader.py' 2024-09-10T02:59:31,853 adding 'colossalai/kernel/extensions/__init__.py' 2024-09-10T02:59:31,854 adding 'colossalai/kernel/extensions/base_extension.py' 2024-09-10T02:59:31,856 adding 'colossalai/kernel/extensions/cpp_extension.py' 2024-09-10T02:59:31,857 adding 'colossalai/kernel/extensions/cuda_extension.py' 2024-09-10T02:59:31,858 adding 'colossalai/kernel/extensions/triton_extension.py' 2024-09-10T02:59:31,860 adding 'colossalai/kernel/extensions/utils.py' 2024-09-10T02:59:31,862 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2024-09-10T02:59:31,863 adding 'colossalai/kernel/extensions/csrc/common/data_type.h' 2024-09-10T02:59:31,865 adding 'colossalai/kernel/extensions/csrc/common/micros.h' 2024-09-10T02:59:31,867 adding 'colossalai/kernel/extensions/csrc/common/mp_type_traits.h' 2024-09-10T02:59:31,869 adding 'colossalai/kernel/extensions/csrc/common/target.h' 2024-09-10T02:59:31,870 adding 'colossalai/kernel/extensions/csrc/common/vec_type_traits.h' 2024-09-10T02:59:31,873 adding 'colossalai/kernel/extensions/csrc/funcs/binary_functor.h' 2024-09-10T02:59:31,875 adding 'colossalai/kernel/extensions/csrc/funcs/cast_functor.h' 2024-09-10T02:59:31,877 adding 'colossalai/kernel/extensions/csrc/funcs/reduce_function.h' 2024-09-10T02:59:31,879 adding 'colossalai/kernel/extensions/csrc/funcs/ternary_functor.h' 2024-09-10T02:59:31,881 adding 'colossalai/kernel/extensions/csrc/funcs/unary_functor.h' 2024-09-10T02:59:31,884 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp' 2024-09-10T02:59:31,886 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h' 2024-09-10T02:59:31,889 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu' 2024-09-10T02:59:31,891 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu' 2024-09-10T02:59:31,893 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu' 2024-09-10T02:59:31,895 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu' 2024-09-10T02:59:31,899 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu' 2024-09-10T02:59:31,902 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu' 2024-09-10T02:59:31,904 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu' 2024-09-10T02:59:31,908 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu' 2024-09-10T02:59:31,911 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu' 2024-09-10T02:59:31,913 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu' 2024-09-10T02:59:31,915 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh' 2024-09-10T02:59:31,918 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu' 2024-09-10T02:59:31,920 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu' 2024-09-10T02:59:31,922 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu' 2024-09-10T02:59:31,924 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu' 2024-09-10T02:59:31,927 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu' 2024-09-10T02:59:31,930 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu' 2024-09-10T02:59:31,932 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu' 2024-09-10T02:59:31,935 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h' 2024-09-10T02:59:31,937 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h' 2024-09-10T02:59:31,939 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h' 2024-09-10T02:59:31,941 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h' 2024-09-10T02:59:31,943 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h' 2024-09-10T02:59:31,945 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp' 2024-09-10T02:59:31,947 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h' 2024-09-10T02:59:31,949 adding 'colossalai/kernel/extensions/pybind/__init__.py' 2024-09-10T02:59:31,950 adding 'colossalai/kernel/extensions/pybind/cpu_adam/__init__.py' 2024-09-10T02:59:31,952 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-09-10T02:59:31,953 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-09-10T02:59:31,955 adding 'colossalai/kernel/extensions/pybind/flash_attention/__init__.py' 2024-09-10T02:59:31,956 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-09-10T02:59:31,957 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py' 2024-09-10T02:59:31,958 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-09-10T02:59:31,960 adding 'colossalai/kernel/extensions/pybind/inference/__init__.py' 2024-09-10T02:59:31,962 adding 'colossalai/kernel/extensions/pybind/inference/inference.cpp' 2024-09-10T02:59:31,963 adding 'colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py' 2024-09-10T02:59:31,965 adding 'colossalai/kernel/extensions/pybind/layernorm/__init__.py' 2024-09-10T02:59:31,966 adding 'colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp' 2024-09-10T02:59:31,967 adding 'colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py' 2024-09-10T02:59:31,969 adding 'colossalai/kernel/extensions/pybind/moe/__init__.py' 2024-09-10T02:59:31,970 adding 'colossalai/kernel/extensions/pybind/moe/moe.cpp' 2024-09-10T02:59:31,971 adding 'colossalai/kernel/extensions/pybind/moe/moe_cuda.py' 2024-09-10T02:59:31,973 adding 'colossalai/kernel/extensions/pybind/optimizer/__init__.py' 2024-09-10T02:59:31,974 adding 'colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-09-10T02:59:31,976 adding 'colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp' 2024-09-10T02:59:31,977 adding 'colossalai/kernel/extensions/pybind/softmax/__init__.py' 2024-09-10T02:59:31,979 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp' 2024-09-10T02:59:31,980 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-09-10T02:59:31,981 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp' 2024-09-10T02:59:31,982 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-09-10T02:59:31,984 adding 'colossalai/kernel/jit/__init__.py' 2024-09-10T02:59:31,985 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2024-09-10T02:59:31,986 adding 'colossalai/kernel/jit/bias_gelu.py' 2024-09-10T02:59:31,988 adding 'colossalai/kernel/jit/option.py' 2024-09-10T02:59:31,989 adding 'colossalai/kernel/triton/__init__.py' 2024-09-10T02:59:31,992 adding 'colossalai/kernel/triton/context_attn_unpad.py' 2024-09-10T02:59:31,995 adding 'colossalai/kernel/triton/flash_decoding.py' 2024-09-10T02:59:31,996 adding 'colossalai/kernel/triton/fused_rotary_embedding.py' 2024-09-10T02:59:31,998 adding 'colossalai/kernel/triton/kvcache_copy.py' 2024-09-10T02:59:31,999 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2024-09-10T02:59:32,002 adding 'colossalai/kernel/triton/no_pad_rotary_embedding.py' 2024-09-10T02:59:32,004 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2024-09-10T02:59:32,005 adding 'colossalai/kernel/triton/rms_layernorm.py' 2024-09-10T02:59:32,006 adding 'colossalai/kernel/triton/rotary_cache_copy.py' 2024-09-10T02:59:32,008 adding 'colossalai/kernel/triton/softmax.py' 2024-09-10T02:59:32,010 adding 'colossalai/lazy/__init__.py' 2024-09-10T02:59:32,011 adding 'colossalai/lazy/construction.py' 2024-09-10T02:59:32,014 adding 'colossalai/lazy/lazy_init.py' 2024-09-10T02:59:32,016 adding 'colossalai/lazy/pretrained.py' 2024-09-10T02:59:32,018 adding 'colossalai/legacy/__init__.py' 2024-09-10T02:59:32,020 adding 'colossalai/legacy/constants.py' 2024-09-10T02:59:32,021 adding 'colossalai/legacy/core.py' 2024-09-10T02:59:32,022 adding 'colossalai/legacy/global_variables.py' 2024-09-10T02:59:32,025 adding 'colossalai/legacy/initialize.py' 2024-09-10T02:59:32,026 adding 'colossalai/legacy/amp/__init__.py' 2024-09-10T02:59:32,028 adding 'colossalai/legacy/amp/amp_type.py' 2024-09-10T02:59:32,030 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2024-09-10T02:59:32,031 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2024-09-10T02:59:32,033 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2024-09-10T02:59:32,035 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2024-09-10T02:59:32,036 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2024-09-10T02:59:32,038 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2024-09-10T02:59:32,040 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2024-09-10T02:59:32,043 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2024-09-10T02:59:32,045 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2024-09-10T02:59:32,047 adding 'colossalai/legacy/builder/__init__.py' 2024-09-10T02:59:32,048 adding 'colossalai/legacy/builder/builder.py' 2024-09-10T02:59:32,050 adding 'colossalai/legacy/communication/__init__.py' 2024-09-10T02:59:32,052 adding 'colossalai/legacy/communication/collective.py' 2024-09-10T02:59:32,054 adding 'colossalai/legacy/communication/p2p.py' 2024-09-10T02:59:32,056 adding 'colossalai/legacy/communication/p2p_v2.py' 2024-09-10T02:59:32,057 adding 'colossalai/legacy/communication/ring.py' 2024-09-10T02:59:32,059 adding 'colossalai/legacy/communication/utils.py' 2024-09-10T02:59:32,060 adding 'colossalai/legacy/context/__init__.py' 2024-09-10T02:59:32,063 adding 'colossalai/legacy/context/parallel_context.py' 2024-09-10T02:59:32,064 adding 'colossalai/legacy/context/parallel_mode.py' 2024-09-10T02:59:32,066 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2024-09-10T02:59:32,067 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2024-09-10T02:59:32,068 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2024-09-10T02:59:32,070 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2024-09-10T02:59:32,072 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2024-09-10T02:59:32,073 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2024-09-10T02:59:32,074 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2024-09-10T02:59:32,076 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2024-09-10T02:59:32,077 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2024-09-10T02:59:32,078 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2024-09-10T02:59:32,080 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2024-09-10T02:59:32,081 adding 'colossalai/legacy/context/random/__init__.py' 2024-09-10T02:59:32,083 adding 'colossalai/legacy/context/random/_helper.py' 2024-09-10T02:59:32,084 adding 'colossalai/legacy/context/random/seed_manager.py' 2024-09-10T02:59:32,086 adding 'colossalai/legacy/engine/__init__.py' 2024-09-10T02:59:32,088 adding 'colossalai/legacy/engine/_base_engine.py' 2024-09-10T02:59:32,090 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2024-09-10T02:59:32,091 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2024-09-10T02:59:32,093 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2024-09-10T02:59:32,094 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2024-09-10T02:59:32,096 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2024-09-10T02:59:32,097 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2024-09-10T02:59:32,098 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2024-09-10T02:59:32,100 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2024-09-10T02:59:32,101 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2024-09-10T02:59:32,102 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2024-09-10T02:59:32,104 adding 'colossalai/legacy/engine/schedule/__init__.py' 2024-09-10T02:59:32,105 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2024-09-10T02:59:32,107 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2024-09-10T02:59:32,111 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2024-09-10T02:59:32,112 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2024-09-10T02:59:32,114 adding 'colossalai/legacy/inference/__init__.py' 2024-09-10T02:59:32,116 adding 'colossalai/legacy/inference/async_engine.py' 2024-09-10T02:59:32,117 adding 'colossalai/legacy/inference/async_manager.py' 2024-09-10T02:59:32,119 adding 'colossalai/legacy/inference/manager.py' 2024-09-10T02:59:32,121 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2024-09-10T02:59:32,122 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2024-09-10T02:59:32,124 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2024-09-10T02:59:32,126 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2024-09-10T02:59:32,127 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2024-09-10T02:59:32,128 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2024-09-10T02:59:32,130 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2024-09-10T02:59:32,131 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2024-09-10T02:59:32,132 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2024-09-10T02:59:32,134 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2024-09-10T02:59:32,135 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2024-09-10T02:59:32,137 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2024-09-10T02:59:32,138 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2024-09-10T02:59:32,141 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2024-09-10T02:59:32,142 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2024-09-10T02:59:32,144 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2024-09-10T02:59:32,146 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2024-09-10T02:59:32,147 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2024-09-10T02:59:32,149 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2024-09-10T02:59:32,150 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2024-09-10T02:59:32,153 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2024-09-10T02:59:32,155 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2024-09-10T02:59:32,157 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2024-09-10T02:59:32,158 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2024-09-10T02:59:32,161 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2024-09-10T02:59:32,163 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2024-09-10T02:59:32,166 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2024-09-10T02:59:32,168 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2024-09-10T02:59:32,169 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2024-09-10T02:59:32,171 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2024-09-10T02:59:32,172 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2024-09-10T02:59:32,174 adding 'colossalai/legacy/nn/__init__.py' 2024-09-10T02:59:32,175 adding 'colossalai/legacy/nn/_ops/__init__.py' 2024-09-10T02:59:32,177 adding 'colossalai/legacy/nn/_ops/_utils.py' 2024-09-10T02:59:32,179 adding 'colossalai/legacy/nn/layer/__init__.py' 2024-09-10T02:59:32,180 adding 'colossalai/legacy/nn/layer/base_layer.py' 2024-09-10T02:59:32,182 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2024-09-10T02:59:32,183 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2024-09-10T02:59:32,185 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2024-09-10T02:59:32,186 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2024-09-10T02:59:32,188 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2024-09-10T02:59:32,189 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2024-09-10T02:59:32,191 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2024-09-10T02:59:32,192 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2024-09-10T02:59:32,193 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2024-09-10T02:59:32,197 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2024-09-10T02:59:32,199 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2024-09-10T02:59:32,202 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2024-09-10T02:59:32,203 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2024-09-10T02:59:32,207 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2024-09-10T02:59:32,209 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2024-09-10T02:59:32,212 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2024-09-10T02:59:32,213 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2024-09-10T02:59:32,216 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2024-09-10T02:59:32,218 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2024-09-10T02:59:32,220 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2024-09-10T02:59:32,222 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2024-09-10T02:59:32,225 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2024-09-10T02:59:32,227 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2024-09-10T02:59:32,228 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2024-09-10T02:59:32,230 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2024-09-10T02:59:32,231 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2024-09-10T02:59:32,233 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2024-09-10T02:59:32,234 adding 'colossalai/legacy/nn/layer/utils/common.py' 2024-09-10T02:59:32,236 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2024-09-10T02:59:32,238 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2024-09-10T02:59:32,239 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2024-09-10T02:59:32,241 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2024-09-10T02:59:32,243 adding 'colossalai/legacy/nn/loss/__init__.py' 2024-09-10T02:59:32,244 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2024-09-10T02:59:32,246 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2024-09-10T02:59:32,247 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2024-09-10T02:59:32,249 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2024-09-10T02:59:32,251 adding 'colossalai/legacy/nn/metric/__init__.py' 2024-09-10T02:59:32,252 adding 'colossalai/legacy/nn/metric/_utils.py' 2024-09-10T02:59:32,253 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2024-09-10T02:59:32,254 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2024-09-10T02:59:32,256 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2024-09-10T02:59:32,257 adding 'colossalai/legacy/nn/parallel/__init__.py' 2024-09-10T02:59:32,259 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2024-09-10T02:59:32,260 adding 'colossalai/legacy/nn/parallel/reducer.py' 2024-09-10T02:59:32,262 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2024-09-10T02:59:32,263 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2024-09-10T02:59:32,265 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2024-09-10T02:59:32,266 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2024-09-10T02:59:32,268 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2024-09-10T02:59:32,270 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2024-09-10T02:59:32,271 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2024-09-10T02:59:32,274 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2024-09-10T02:59:32,276 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2024-09-10T02:59:32,277 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2024-09-10T02:59:32,279 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2024-09-10T02:59:32,280 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2024-09-10T02:59:32,282 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2024-09-10T02:59:32,284 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2024-09-10T02:59:32,286 adding 'colossalai/legacy/pipeline/__init__.py' 2024-09-10T02:59:32,287 adding 'colossalai/legacy/pipeline/layer_spec.py' 2024-09-10T02:59:32,288 adding 'colossalai/legacy/pipeline/pipelinable.py' 2024-09-10T02:59:32,290 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2024-09-10T02:59:32,292 adding 'colossalai/legacy/pipeline/utils.py' 2024-09-10T02:59:32,293 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2024-09-10T02:59:32,295 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2024-09-10T02:59:32,296 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2024-09-10T02:59:32,298 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2024-09-10T02:59:32,299 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2024-09-10T02:59:32,305 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2024-09-10T02:59:32,307 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2024-09-10T02:59:32,309 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2024-09-10T02:59:32,311 adding 'colossalai/legacy/registry/__init__.py' 2024-09-10T02:59:32,312 adding 'colossalai/legacy/registry/registry.py' 2024-09-10T02:59:32,314 adding 'colossalai/legacy/tensor/__init__.py' 2024-09-10T02:59:32,315 adding 'colossalai/legacy/tensor/compute_spec.py' 2024-09-10T02:59:32,316 adding 'colossalai/legacy/tensor/const.py' 2024-09-10T02:59:32,317 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2024-09-10T02:59:32,319 adding 'colossalai/legacy/tensor/distspec.py' 2024-09-10T02:59:32,320 adding 'colossalai/legacy/tensor/op_wrapper.py' 2024-09-10T02:59:32,322 adding 'colossalai/legacy/tensor/process_group.py' 2024-09-10T02:59:32,323 adding 'colossalai/legacy/tensor/tensor_spec.py' 2024-09-10T02:59:32,325 adding 'colossalai/legacy/trainer/__init__.py' 2024-09-10T02:59:32,327 adding 'colossalai/legacy/trainer/_trainer.py' 2024-09-10T02:59:32,329 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2024-09-10T02:59:32,330 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2024-09-10T02:59:32,331 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2024-09-10T02:59:32,333 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2024-09-10T02:59:32,335 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2024-09-10T02:59:32,336 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2024-09-10T02:59:32,338 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2024-09-10T02:59:32,340 adding 'colossalai/legacy/utils/__init__.py' 2024-09-10T02:59:32,342 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2024-09-10T02:59:32,343 adding 'colossalai/legacy/utils/checkpointing.py' 2024-09-10T02:59:32,346 adding 'colossalai/legacy/utils/common.py' 2024-09-10T02:59:32,348 adding 'colossalai/legacy/utils/memory.py' 2024-09-10T02:59:32,349 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2024-09-10T02:59:32,351 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2024-09-10T02:59:32,352 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2024-09-10T02:59:32,354 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2024-09-10T02:59:32,355 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2024-09-10T02:59:32,357 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2024-09-10T02:59:32,358 adding 'colossalai/legacy/utils/profiler/__init__.py' 2024-09-10T02:59:32,360 adding 'colossalai/legacy/utils/profiler/extention.py' 2024-09-10T02:59:32,361 adding 'colossalai/legacy/utils/profiler/profiler.py' 2024-09-10T02:59:32,363 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2024-09-10T02:59:32,365 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2024-09-10T02:59:32,366 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2024-09-10T02:59:32,368 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2024-09-10T02:59:32,369 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2024-09-10T02:59:32,371 adding 'colossalai/legacy/zero/__init__.py' 2024-09-10T02:59:32,373 adding 'colossalai/legacy/zero/gemini/__init__.py' 2024-09-10T02:59:32,374 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2024-09-10T02:59:32,375 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2024-09-10T02:59:32,377 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2024-09-10T02:59:32,378 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2024-09-10T02:59:32,380 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2024-09-10T02:59:32,381 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2024-09-10T02:59:32,383 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2024-09-10T02:59:32,384 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2024-09-10T02:59:32,385 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2024-09-10T02:59:32,387 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2024-09-10T02:59:32,388 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2024-09-10T02:59:32,390 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2024-09-10T02:59:32,391 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2024-09-10T02:59:32,392 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2024-09-10T02:59:32,394 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2024-09-10T02:59:32,396 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2024-09-10T02:59:32,397 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2024-09-10T02:59:32,398 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2024-09-10T02:59:32,400 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2024-09-10T02:59:32,401 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2024-09-10T02:59:32,403 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2024-09-10T02:59:32,404 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2024-09-10T02:59:32,406 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2024-09-10T02:59:32,410 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2024-09-10T02:59:32,411 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2024-09-10T02:59:32,412 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2024-09-10T02:59:32,414 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2024-09-10T02:59:32,416 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2024-09-10T02:59:32,418 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2024-09-10T02:59:32,419 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2024-09-10T02:59:32,421 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2024-09-10T02:59:32,423 adding 'colossalai/logging/__init__.py' 2024-09-10T02:59:32,424 adding 'colossalai/logging/logger.py' 2024-09-10T02:59:32,426 adding 'colossalai/moe/__init__.py' 2024-09-10T02:59:32,428 adding 'colossalai/moe/_operation.py' 2024-09-10T02:59:32,429 adding 'colossalai/nn/__init__.py' 2024-09-10T02:59:32,431 adding 'colossalai/nn/init.py' 2024-09-10T02:59:32,433 adding 'colossalai/nn/layer/__init__.py' 2024-09-10T02:59:32,434 adding 'colossalai/nn/layer/layernorm.py' 2024-09-10T02:59:32,436 adding 'colossalai/nn/layer/scaled_softmax.py' 2024-09-10T02:59:32,437 adding 'colossalai/nn/layer/utils.py' 2024-09-10T02:59:32,438 adding 'colossalai/nn/loss/__init__.py' 2024-09-10T02:59:32,440 adding 'colossalai/nn/lr_scheduler/__init__.py' 2024-09-10T02:59:32,442 adding 'colossalai/nn/lr_scheduler/cosine.py' 2024-09-10T02:59:32,443 adding 'colossalai/nn/lr_scheduler/delayed.py' 2024-09-10T02:59:32,444 adding 'colossalai/nn/lr_scheduler/linear.py' 2024-09-10T02:59:32,446 adding 'colossalai/nn/lr_scheduler/multistep.py' 2024-09-10T02:59:32,447 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2024-09-10T02:59:32,448 adding 'colossalai/nn/lr_scheduler/poly.py' 2024-09-10T02:59:32,450 adding 'colossalai/nn/lr_scheduler/torch.py' 2024-09-10T02:59:32,451 adding 'colossalai/nn/optimizer/__init__.py' 2024-09-10T02:59:32,453 adding 'colossalai/nn/optimizer/adafactor.py' 2024-09-10T02:59:32,454 adding 'colossalai/nn/optimizer/came.py' 2024-09-10T02:59:32,456 adding 'colossalai/nn/optimizer/cpu_adam.py' 2024-09-10T02:59:32,459 adding 'colossalai/nn/optimizer/distributed_adafactor.py' 2024-09-10T02:59:32,461 adding 'colossalai/nn/optimizer/distributed_came.py' 2024-09-10T02:59:32,464 adding 'colossalai/nn/optimizer/distributed_galore.py' 2024-09-10T02:59:32,465 adding 'colossalai/nn/optimizer/distributed_lamb.py' 2024-09-10T02:59:32,467 adding 'colossalai/nn/optimizer/fused_adam.py' 2024-09-10T02:59:32,469 adding 'colossalai/nn/optimizer/fused_lamb.py' 2024-09-10T02:59:32,470 adding 'colossalai/nn/optimizer/fused_sgd.py' 2024-09-10T02:59:32,472 adding 'colossalai/nn/optimizer/galore.py' 2024-09-10T02:59:32,474 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2024-09-10T02:59:32,475 adding 'colossalai/nn/optimizer/lamb.py' 2024-09-10T02:59:32,477 adding 'colossalai/nn/optimizer/lars.py' 2024-09-10T02:59:32,479 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2024-09-10T02:59:32,480 adding 'colossalai/pipeline/__init__.py' 2024-09-10T02:59:32,483 adding 'colossalai/pipeline/p2p.py' 2024-09-10T02:59:32,485 adding 'colossalai/pipeline/stage_manager.py' 2024-09-10T02:59:32,487 adding 'colossalai/pipeline/schedule/__init__.py' 2024-09-10T02:59:32,488 adding 'colossalai/pipeline/schedule/_utils.py' 2024-09-10T02:59:32,489 adding 'colossalai/pipeline/schedule/base.py' 2024-09-10T02:59:32,492 adding 'colossalai/pipeline/schedule/generate.py' 2024-09-10T02:59:32,495 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2024-09-10T02:59:32,497 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2024-09-10T02:59:32,499 adding 'colossalai/quantization/__init__.py' 2024-09-10T02:59:32,501 adding 'colossalai/quantization/bnb.py' 2024-09-10T02:59:32,502 adding 'colossalai/quantization/bnb_config.py' 2024-09-10T02:59:32,506 adding 'colossalai/quantization/fp8.py' 2024-09-10T02:59:32,508 adding 'colossalai/quantization/fp8_hook.py' 2024-09-10T02:59:32,509 adding 'colossalai/quantization/utils.py' 2024-09-10T02:59:32,511 adding 'colossalai/shardformer/__init__.py' 2024-09-10T02:59:32,512 adding 'colossalai/shardformer/_utils.py' 2024-09-10T02:59:32,514 adding 'colossalai/shardformer/layer/__init__.py' 2024-09-10T02:59:32,518 adding 'colossalai/shardformer/layer/_operation.py' 2024-09-10T02:59:32,523 adding 'colossalai/shardformer/layer/attn.py' 2024-09-10T02:59:32,525 adding 'colossalai/shardformer/layer/dropout.py' 2024-09-10T02:59:32,527 adding 'colossalai/shardformer/layer/embedding.py' 2024-09-10T02:59:32,529 adding 'colossalai/shardformer/layer/linear.py' 2024-09-10T02:59:32,531 adding 'colossalai/shardformer/layer/loss.py' 2024-09-10T02:59:32,533 adding 'colossalai/shardformer/layer/normalization.py' 2024-09-10T02:59:32,535 adding 'colossalai/shardformer/layer/parallel_module.py' 2024-09-10T02:59:32,538 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2024-09-10T02:59:32,541 adding 'colossalai/shardformer/layer/utils.py' 2024-09-10T02:59:32,543 adding 'colossalai/shardformer/modeling/__init__.py' 2024-09-10T02:59:32,547 adding 'colossalai/shardformer/modeling/bert.py' 2024-09-10T02:59:32,549 adding 'colossalai/shardformer/modeling/blip2.py' 2024-09-10T02:59:32,553 adding 'colossalai/shardformer/modeling/bloom.py' 2024-09-10T02:59:32,556 adding 'colossalai/shardformer/modeling/chatglm2.py' 2024-09-10T02:59:32,559 adding 'colossalai/shardformer/modeling/command.py' 2024-09-10T02:59:32,563 adding 'colossalai/shardformer/modeling/deepseek.py' 2024-09-10T02:59:32,566 adding 'colossalai/shardformer/modeling/falcon.py' 2024-09-10T02:59:32,571 adding 'colossalai/shardformer/modeling/gpt2.py' 2024-09-10T02:59:32,575 adding 'colossalai/shardformer/modeling/gptj.py' 2024-09-10T02:59:32,576 adding 'colossalai/shardformer/modeling/jit.py' 2024-09-10T02:59:32,580 adding 'colossalai/shardformer/modeling/llama.py' 2024-09-10T02:59:32,582 adding 'colossalai/shardformer/modeling/mistral.py' 2024-09-10T02:59:32,586 adding 'colossalai/shardformer/modeling/mixtral.py' 2024-09-10T02:59:32,590 adding 'colossalai/shardformer/modeling/opt.py' 2024-09-10T02:59:32,594 adding 'colossalai/shardformer/modeling/qwen2.py' 2024-09-10T02:59:32,595 adding 'colossalai/shardformer/modeling/sam.py' 2024-09-10T02:59:32,599 adding 'colossalai/shardformer/modeling/t5.py' 2024-09-10T02:59:32,601 adding 'colossalai/shardformer/modeling/vit.py' 2024-09-10T02:59:32,606 adding 'colossalai/shardformer/modeling/whisper.py' 2024-09-10T02:59:32,608 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2024-09-10T02:59:32,609 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2024-09-10T02:59:32,615 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2024-09-10T02:59:32,617 adding 'colossalai/shardformer/policies/__init__.py' 2024-09-10T02:59:32,618 adding 'colossalai/shardformer/policies/auto_policy.py' 2024-09-10T02:59:32,620 adding 'colossalai/shardformer/policies/base_policy.py' 2024-09-10T02:59:32,622 adding 'colossalai/shardformer/policies/bert.py' 2024-09-10T02:59:32,624 adding 'colossalai/shardformer/policies/blip2.py' 2024-09-10T02:59:32,626 adding 'colossalai/shardformer/policies/bloom.py' 2024-09-10T02:59:32,628 adding 'colossalai/shardformer/policies/chatglm2.py' 2024-09-10T02:59:32,630 adding 'colossalai/shardformer/policies/command.py' 2024-09-10T02:59:32,632 adding 'colossalai/shardformer/policies/deepseek.py' 2024-09-10T02:59:32,638 adding 'colossalai/shardformer/policies/falcon.py' 2024-09-10T02:59:32,641 adding 'colossalai/shardformer/policies/gpt2.py' 2024-09-10T02:59:32,642 adding 'colossalai/shardformer/policies/gptj.py' 2024-09-10T02:59:32,644 adding 'colossalai/shardformer/policies/llama.py' 2024-09-10T02:59:32,646 adding 'colossalai/shardformer/policies/mistral.py' 2024-09-10T02:59:32,648 adding 'colossalai/shardformer/policies/mixtral.py' 2024-09-10T02:59:32,650 adding 'colossalai/shardformer/policies/opt.py' 2024-09-10T02:59:32,652 adding 'colossalai/shardformer/policies/qwen2.py' 2024-09-10T02:59:32,654 adding 'colossalai/shardformer/policies/sam.py' 2024-09-10T02:59:32,656 adding 'colossalai/shardformer/policies/t5.py' 2024-09-10T02:59:32,658 adding 'colossalai/shardformer/policies/vit.py' 2024-09-10T02:59:32,660 adding 'colossalai/shardformer/policies/whisper.py' 2024-09-10T02:59:32,662 adding 'colossalai/shardformer/shard/__init__.py' 2024-09-10T02:59:32,663 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2024-09-10T02:59:32,665 adding 'colossalai/shardformer/shard/shard_config.py' 2024-09-10T02:59:32,667 adding 'colossalai/shardformer/shard/sharder.py' 2024-09-10T02:59:32,668 adding 'colossalai/shardformer/shard/shardformer.py' 2024-09-10T02:59:32,669 adding 'colossalai/shardformer/shard/utils.py' 2024-09-10T02:59:32,671 adding 'colossalai/tensor/__init__.py' 2024-09-10T02:59:32,673 adding 'colossalai/tensor/colo_parameter.py' 2024-09-10T02:59:32,674 adding 'colossalai/tensor/colo_tensor.py' 2024-09-10T02:59:32,677 adding 'colossalai/tensor/comm_spec.py' 2024-09-10T02:59:32,678 adding 'colossalai/tensor/param_op_hook.py' 2024-09-10T02:59:32,682 adding 'colossalai/tensor/shape_consistency.py' 2024-09-10T02:59:32,684 adding 'colossalai/tensor/sharding_spec.py' 2024-09-10T02:59:32,686 adding 'colossalai/tensor/utils.py' 2024-09-10T02:59:32,688 adding 'colossalai/tensor/d_tensor/__init__.py' 2024-09-10T02:59:32,690 adding 'colossalai/tensor/d_tensor/api.py' 2024-09-10T02:59:32,692 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2024-09-10T02:59:32,693 adding 'colossalai/tensor/d_tensor/layout.py' 2024-09-10T02:59:32,696 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2024-09-10T02:59:32,697 adding 'colossalai/tensor/d_tensor/misc.py' 2024-09-10T02:59:32,699 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2024-09-10T02:59:32,700 adding 'colossalai/tensor/d_tensor/utils.py' 2024-09-10T02:59:32,701 adding 'colossalai/tensor/moe_tensor/__init__.py' 2024-09-10T02:59:32,703 adding 'colossalai/tensor/moe_tensor/api.py' 2024-09-10T02:59:32,704 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2024-09-10T02:59:32,705 adding 'colossalai/tensor/padded_tensor/__init__.py' 2024-09-10T02:59:32,707 adding 'colossalai/tensor/padded_tensor/api.py' 2024-09-10T02:59:32,708 adding 'colossalai/testing/__init__.py' 2024-09-10T02:59:32,710 adding 'colossalai/testing/comparison.py' 2024-09-10T02:59:32,711 adding 'colossalai/testing/pytest_wrapper.py' 2024-09-10T02:59:32,712 adding 'colossalai/testing/random.py' 2024-09-10T02:59:32,714 adding 'colossalai/testing/utils.py' 2024-09-10T02:59:32,715 adding 'colossalai/utils/__init__.py' 2024-09-10T02:59:32,716 adding 'colossalai/utils/common.py' 2024-09-10T02:59:32,718 adding 'colossalai/utils/memory.py' 2024-09-10T02:59:32,719 adding 'colossalai/utils/timer.py' 2024-09-10T02:59:32,721 adding 'colossalai/utils/model/__init__.py' 2024-09-10T02:59:32,722 adding 'colossalai/utils/model/utils.py' 2024-09-10T02:59:32,723 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2024-09-10T02:59:32,725 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2024-09-10T02:59:32,726 adding 'colossalai/utils/rank_recorder/__init__.py' 2024-09-10T02:59:32,728 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2024-09-10T02:59:32,729 adding 'colossalai/utils/tensor_detector/__init__.py' 2024-09-10T02:59:32,731 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2024-09-10T02:59:32,733 adding 'colossalai/zero/__init__.py' 2024-09-10T02:59:32,734 adding 'colossalai/zero/wrapper.py' 2024-09-10T02:59:32,736 adding 'colossalai/zero/gemini/__init__.py' 2024-09-10T02:59:32,741 adding 'colossalai/zero/gemini/gemini_ddp.py' 2024-09-10T02:59:32,743 adding 'colossalai/zero/gemini/gemini_hook.py' 2024-09-10T02:59:32,744 adding 'colossalai/zero/gemini/gemini_mgr.py' 2024-09-10T02:59:32,748 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2024-09-10T02:59:32,750 adding 'colossalai/zero/gemini/placement_policy.py' 2024-09-10T02:59:32,752 adding 'colossalai/zero/gemini/utils.py' 2024-09-10T02:59:32,754 adding 'colossalai/zero/gemini/chunk/__init__.py' 2024-09-10T02:59:32,757 adding 'colossalai/zero/gemini/chunk/chunk.py' 2024-09-10T02:59:32,759 adding 'colossalai/zero/gemini/chunk/manager.py' 2024-09-10T02:59:32,761 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2024-09-10T02:59:32,762 adding 'colossalai/zero/gemini/chunk/utils.py' 2024-09-10T02:59:32,764 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2024-09-10T02:59:32,765 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2024-09-10T02:59:32,766 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2024-09-10T02:59:32,768 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2024-09-10T02:59:32,769 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2024-09-10T02:59:32,770 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2024-09-10T02:59:32,772 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2024-09-10T02:59:32,773 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2024-09-10T02:59:32,774 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2024-09-10T02:59:32,776 adding 'colossalai/zero/low_level/__init__.py' 2024-09-10T02:59:32,778 adding 'colossalai/zero/low_level/_utils.py' 2024-09-10T02:59:32,782 adding 'colossalai/zero/low_level/low_level_optim.py' 2024-09-10T02:59:32,783 adding 'colossalai/zero/low_level/zero_hook.py' 2024-09-10T02:59:32,785 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2024-09-10T02:59:32,786 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2024-09-10T02:59:32,788 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2024-09-10T02:59:32,789 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2024-09-10T02:59:32,790 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2024-09-10T02:59:32,794 adding 'extensions/csrc/__init__.py' 2024-09-10T02:59:32,795 adding 'extensions/pybind/__init__.py' 2024-09-10T02:59:32,797 adding 'extensions/pybind/cpu_adam/__init__.py' 2024-09-10T02:59:32,798 adding 'extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-09-10T02:59:32,799 adding 'extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-09-10T02:59:32,801 adding 'extensions/pybind/flash_attention/__init__.py' 2024-09-10T02:59:32,802 adding 'extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-09-10T02:59:32,803 adding 'extensions/pybind/flash_attention/flash_attention_npu.py' 2024-09-10T02:59:32,805 adding 'extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-09-10T02:59:32,806 adding 'extensions/pybind/inference/__init__.py' 2024-09-10T02:59:32,807 adding 'extensions/pybind/inference/inference_ops_cuda.py' 2024-09-10T02:59:32,809 adding 'extensions/pybind/layernorm/__init__.py' 2024-09-10T02:59:32,810 adding 'extensions/pybind/layernorm/layernorm_cuda.py' 2024-09-10T02:59:32,812 adding 'extensions/pybind/moe/__init__.py' 2024-09-10T02:59:32,813 adding 'extensions/pybind/moe/moe_cuda.py' 2024-09-10T02:59:32,814 adding 'extensions/pybind/optimizer/__init__.py' 2024-09-10T02:59:32,816 adding 'extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-09-10T02:59:32,817 adding 'extensions/pybind/softmax/__init__.py' 2024-09-10T02:59:32,818 adding 'extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-09-10T02:59:32,820 adding 'extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-09-10T02:59:32,823 adding 'colossalai-0.4.3.dist-info/LICENSE' 2024-09-10T02:59:32,826 adding 'colossalai-0.4.3.dist-info/METADATA' 2024-09-10T02:59:32,827 adding 'colossalai-0.4.3.dist-info/WHEEL' 2024-09-10T02:59:32,828 adding 'colossalai-0.4.3.dist-info/entry_points.txt' 2024-09-10T02:59:32,829 adding 'colossalai-0.4.3.dist-info/top_level.txt' 2024-09-10T02:59:32,844 adding 'colossalai-0.4.3.dist-info/RECORD' 2024-09-10T02:59:32,878 removing build/bdist.linux-armv7l/wheel 2024-09-10T02:59:33,242 Building wheel for colossalai (setup.py): finished with status 'done' 2024-09-10T02:59:33,268 Created wheel for colossalai: filename=colossalai-0.4.3-py3-none-any.whl size=1583688 sha256=115c0c1bbbe23afda2be79a19e1dab17148c834545824e974d5653b545a9e604 2024-09-10T02:59:33,270 Stored in directory: /tmp/pip-ephem-wheel-cache-5hxyouce/wheels/dc/16/1c/773f05e2dd620095b8b8d1f764daf6540f2c4eea4950896f3d 2024-09-10T02:59:33,324 Successfully built colossalai 2024-09-10T02:59:33,363 Removed build tracker: '/tmp/pip-build-tracker-dl_ww15u'