2024-09-19T03:42:32,794 Created temporary directory: /tmp/pip-build-tracker-bdm0yffn 2024-09-19T03:42:32,795 Initialized build tracking at /tmp/pip-build-tracker-bdm0yffn 2024-09-19T03:42:32,796 Created build tracker: /tmp/pip-build-tracker-bdm0yffn 2024-09-19T03:42:32,796 Entered build tracker: /tmp/pip-build-tracker-bdm0yffn 2024-09-19T03:42:32,797 Created temporary directory: /tmp/pip-wheel-ctnempgz 2024-09-19T03:42:32,801 Created temporary directory: /tmp/pip-ephem-wheel-cache-t8xir8wv 2024-09-19T03:42:32,845 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-09-19T03:42:32,848 2 location(s) to search for versions of colossalai: 2024-09-19T03:42:32,848 * https://pypi.org/simple/colossalai/ 2024-09-19T03:42:32,848 * https://www.piwheels.org/simple/colossalai/ 2024-09-19T03:42:32,848 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2024-09-19T03:42:32,849 Getting page https://pypi.org/simple/colossalai/ 2024-09-19T03:42:32,851 Found index url https://pypi.org/simple/ 2024-09-19T03:42:33,063 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2024-09-19T03:42:33,068 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2024-09-19T03:42:33,069 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2024-09-19T03:42:33,071 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2024-09-19T03:42:33,071 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2024-09-19T03:42:33,072 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2024-09-19T03:42:33,073 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2024-09-19T03:42:33,074 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2024-09-19T03:42:33,076 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2024-09-19T03:42:33,077 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2024-09-19T03:42:33,077 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2024-09-19T03:42:33,078 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2024-09-19T03:42:33,079 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2024-09-19T03:42:33,080 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2024-09-19T03:42:33,082 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2024-09-19T03:42:33,082 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2024-09-19T03:42:33,083 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2024-09-19T03:42:33,084 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2024-09-19T03:42:33,085 Found link https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.8 2024-09-19T03:42:33,086 Found link https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.9 2024-09-19T03:42:33,086 Found link https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.0 2024-09-19T03:42:33,087 Found link https://files.pythonhosted.org/packages/3c/cd/206593b5c417a436382ca5e93c0188c031830341ee352c35e020ce83f57c/colossalai-0.4.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.1 2024-09-19T03:42:33,088 Found link https://files.pythonhosted.org/packages/0d/98/7adbf8fd663234fee2ea43382b065979c22612f319c322aa0eb675457327/colossalai-0.4.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.2 2024-09-19T03:42:33,089 Found link https://files.pythonhosted.org/packages/96/bd/716f9dbdee5a564da03d55d3d9e65b85c952cb62ed12519a8566adf63005/colossalai-0.4.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.3 2024-09-19T03:42:33,090 Found link https://files.pythonhosted.org/packages/93/17/64f0e6b72626bb060b6951461ffc62e5f34ce3efed2f4e2214fa2967d313/colossalai-0.4.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.4 2024-09-19T03:42:33,091 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2024-09-19T03:42:33,092 Getting page https://www.piwheels.org/simple/colossalai/ 2024-09-19T03:42:33,093 Found index url https://www.piwheels.org/simple/ 2024-09-19T03:42:33,250 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2024-09-19T03:42:33,257 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.3-py3-none-any.whl#sha256=115c0c1bbbe23afda2be79a19e1dab17148c834545824e974d5653b545a9e604 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,258 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.2-py3-none-any.whl#sha256=37c71db35629462ee7107007adb59e8a480ef50ec550a31198b6fe08fb8acc84 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,258 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.1-py3-none-any.whl#sha256=5355444b4f627d0b5516a1053a0b99c3eb130a9bdde95abefa4dcd7a881b0119 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,259 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.0-py3-none-any.whl#sha256=bca14360afc924008f910785cbb07e07f1f743e3a7182103caa09a4d6c49d3a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,260 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.9-py3-none-any.whl#sha256=670e4e0d607a0803e8f0a7349996228f4cfa411d817bd631c07b1b2064e7af48 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,260 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.8-py3-none-any.whl#sha256=73a2dba29be661597422944d917c709df77c91843d30ab323f6c740173686dab (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,261 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.7-py3-none-any.whl#sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,261 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,261 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,262 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,263 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,263 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,264 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,265 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,265 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,266 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,266 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,267 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,267 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,268 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,268 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,269 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,269 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-09-19T03:42:33,270 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2024-09-19T03:42:33,270 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2024-09-19T03:42:33,292 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2024-09-19T03:42:33,294 Collecting colossalai==0.4.4 2024-09-19T03:42:33,296 Created temporary directory: /tmp/pip-unpack-ifz0v1bj 2024-09-19T03:42:33,525 Downloading colossalai-0.4.4.tar.gz (1.3 MB) 2024-09-19T03:42:35,932 Added colossalai==0.4.4 from https://files.pythonhosted.org/packages/93/17/64f0e6b72626bb060b6951461ffc62e5f34ce3efed2f4e2214fa2967d313/colossalai-0.4.4.tar.gz to build tracker '/tmp/pip-build-tracker-bdm0yffn' 2024-09-19T03:42:35,934 Running setup.py (path:/tmp/pip-wheel-ctnempgz/colossalai_b7c9cae50e4d45009bd85a7a684992ba/setup.py) egg_info for package colossalai 2024-09-19T03:42:35,935 Created temporary directory: /tmp/pip-pip-egg-info-b7r7a_xf 2024-09-19T03:42:35,936 Preparing metadata (setup.py): started 2024-09-19T03:42:35,937 Running command python setup.py egg_info 2024-09-19T03:42:37,128 running egg_info 2024-09-19T03:42:37,130 creating /tmp/pip-pip-egg-info-b7r7a_xf/colossalai.egg-info 2024-09-19T03:42:37,158 writing /tmp/pip-pip-egg-info-b7r7a_xf/colossalai.egg-info/PKG-INFO 2024-09-19T03:42:37,162 writing dependency_links to /tmp/pip-pip-egg-info-b7r7a_xf/colossalai.egg-info/dependency_links.txt 2024-09-19T03:42:37,164 writing entry points to /tmp/pip-pip-egg-info-b7r7a_xf/colossalai.egg-info/entry_points.txt 2024-09-19T03:42:37,166 writing requirements to /tmp/pip-pip-egg-info-b7r7a_xf/colossalai.egg-info/requires.txt 2024-09-19T03:42:37,167 writing top-level names to /tmp/pip-pip-egg-info-b7r7a_xf/colossalai.egg-info/top_level.txt 2024-09-19T03:42:37,169 writing manifest file '/tmp/pip-pip-egg-info-b7r7a_xf/colossalai.egg-info/SOURCES.txt' 2024-09-19T03:42:37,459 reading manifest file '/tmp/pip-pip-egg-info-b7r7a_xf/colossalai.egg-info/SOURCES.txt' 2024-09-19T03:42:37,461 reading manifest template 'MANIFEST.in' 2024-09-19T03:42:38,748 warning: no files found matching '*.tr' under directory 'colossalai' 2024-09-19T03:42:39,382 warning: no files found matching '*.cc' under directory 'colossalai' 2024-09-19T03:42:39,694 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-09-19T03:42:39,830 warning: no files found matching '*.tr' under directory 'extensions' 2024-09-19T03:42:39,883 warning: no files found matching '*.cc' under directory 'extensions' 2024-09-19T03:42:39,911 warning: no files found matching '*.pyi' under directory 'extensions' 2024-09-19T03:42:39,912 adding license file 'LICENSE' 2024-09-19T03:42:39,943 writing manifest file '/tmp/pip-pip-egg-info-b7r7a_xf/colossalai.egg-info/SOURCES.txt' 2024-09-19T03:42:40,057 Preparing metadata (setup.py): finished with status 'done' 2024-09-19T03:42:40,063 Source in /tmp/pip-wheel-ctnempgz/colossalai_b7c9cae50e4d45009bd85a7a684992ba has version 0.4.4, which satisfies requirement colossalai==0.4.4 from https://files.pythonhosted.org/packages/93/17/64f0e6b72626bb060b6951461ffc62e5f34ce3efed2f4e2214fa2967d313/colossalai-0.4.4.tar.gz 2024-09-19T03:42:40,064 Removed colossalai==0.4.4 from https://files.pythonhosted.org/packages/93/17/64f0e6b72626bb060b6951461ffc62e5f34ce3efed2f4e2214fa2967d313/colossalai-0.4.4.tar.gz from build tracker '/tmp/pip-build-tracker-bdm0yffn' 2024-09-19T03:42:40,077 Created temporary directory: /tmp/pip-unpack-3y2bl9sf 2024-09-19T03:42:40,077 Created temporary directory: /tmp/pip-unpack-5ryy5duw 2024-09-19T03:42:40,078 Building wheels for collected packages: colossalai 2024-09-19T03:42:40,082 Created temporary directory: /tmp/pip-wheel-41ximyzw 2024-09-19T03:42:40,083 Building wheel for colossalai (setup.py): started 2024-09-19T03:42:40,084 Destination directory: /tmp/pip-wheel-41ximyzw 2024-09-19T03:42:40,085 Running command python setup.py bdist_wheel 2024-09-19T03:42:41,215 running bdist_wheel 2024-09-19T03:42:41,354 running build 2024-09-19T03:42:41,354 running build_py 2024-09-19T03:42:41,387 creating build 2024-09-19T03:42:41,388 creating build/lib 2024-09-19T03:42:41,389 creating build/lib/colossalai 2024-09-19T03:42:41,390 copying colossalai/version.py -> build/lib/colossalai 2024-09-19T03:42:41,392 copying colossalai/initialize.py -> build/lib/colossalai 2024-09-19T03:42:41,395 copying colossalai/__init__.py -> build/lib/colossalai 2024-09-19T03:42:41,397 creating build/lib/extensions 2024-09-19T03:42:41,398 creating build/lib/extensions/pybind 2024-09-19T03:42:41,399 copying extensions/pybind/__init__.py -> build/lib/extensions/pybind 2024-09-19T03:42:41,402 creating build/lib/extensions/csrc 2024-09-19T03:42:41,403 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2024-09-19T03:42:41,405 creating build/lib/extensions/pybind/softmax 2024-09-19T03:42:41,406 copying extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-09-19T03:42:41,408 copying extensions/pybind/softmax/__init__.py -> build/lib/extensions/pybind/softmax 2024-09-19T03:42:41,410 copying extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-09-19T03:42:41,413 creating build/lib/extensions/pybind/layernorm 2024-09-19T03:42:41,414 copying extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/extensions/pybind/layernorm 2024-09-19T03:42:41,416 copying extensions/pybind/layernorm/__init__.py -> build/lib/extensions/pybind/layernorm 2024-09-19T03:42:41,418 creating build/lib/extensions/pybind/moe 2024-09-19T03:42:41,420 copying extensions/pybind/moe/__init__.py -> build/lib/extensions/pybind/moe 2024-09-19T03:42:41,422 copying extensions/pybind/moe/moe_cuda.py -> build/lib/extensions/pybind/moe 2024-09-19T03:42:41,425 creating build/lib/extensions/pybind/flash_attention 2024-09-19T03:42:41,426 copying extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-09-19T03:42:41,428 copying extensions/pybind/flash_attention/__init__.py -> build/lib/extensions/pybind/flash_attention 2024-09-19T03:42:41,430 copying extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-09-19T03:42:41,432 copying extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/extensions/pybind/flash_attention 2024-09-19T03:42:41,435 creating build/lib/extensions/pybind/cpu_adam 2024-09-19T03:42:41,436 copying extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/pybind/cpu_adam 2024-09-19T03:42:41,438 copying extensions/pybind/cpu_adam/__init__.py -> build/lib/extensions/pybind/cpu_adam 2024-09-19T03:42:41,440 copying extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/pybind/cpu_adam 2024-09-19T03:42:41,442 creating build/lib/extensions/pybind/inference 2024-09-19T03:42:41,443 copying extensions/pybind/inference/inference_ops_cuda.py -> build/lib/extensions/pybind/inference 2024-09-19T03:42:41,445 copying extensions/pybind/inference/__init__.py -> build/lib/extensions/pybind/inference 2024-09-19T03:42:41,447 creating build/lib/extensions/pybind/optimizer 2024-09-19T03:42:41,449 copying extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/pybind/optimizer 2024-09-19T03:42:41,451 copying extensions/pybind/optimizer/__init__.py -> build/lib/extensions/pybind/optimizer 2024-09-19T03:42:41,453 creating build/lib/colossalai/device 2024-09-19T03:42:41,454 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2024-09-19T03:42:41,457 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2024-09-19T03:42:41,460 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2024-09-19T03:42:41,462 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2024-09-19T03:42:41,464 creating build/lib/colossalai/shardformer 2024-09-19T03:42:41,465 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2024-09-19T03:42:41,467 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2024-09-19T03:42:41,470 creating build/lib/colossalai/booster 2024-09-19T03:42:41,471 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2024-09-19T03:42:41,473 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2024-09-19T03:42:41,475 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2024-09-19T03:42:41,478 creating build/lib/colossalai/context 2024-09-19T03:42:41,479 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2024-09-19T03:42:41,481 copying colossalai/context/config.py -> build/lib/colossalai/context 2024-09-19T03:42:41,483 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2024-09-19T03:42:41,486 creating build/lib/colossalai/interface 2024-09-19T03:42:41,487 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2024-09-19T03:42:41,490 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2024-09-19T03:42:41,492 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2024-09-19T03:42:41,494 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2024-09-19T03:42:41,497 creating build/lib/colossalai/tensor 2024-09-19T03:42:41,498 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2024-09-19T03:42:41,501 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2024-09-19T03:42:41,503 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2024-09-19T03:42:41,506 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2024-09-19T03:42:41,509 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2024-09-19T03:42:41,511 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2024-09-19T03:42:41,513 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2024-09-19T03:42:41,515 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2024-09-19T03:42:41,518 creating build/lib/colossalai/checkpoint_io 2024-09-19T03:42:41,519 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2024-09-19T03:42:41,522 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-09-19T03:42:41,525 copying colossalai/checkpoint_io/moe_checkpoint.py -> build/lib/colossalai/checkpoint_io 2024-09-19T03:42:41,528 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2024-09-19T03:42:41,530 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2024-09-19T03:42:41,532 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2024-09-19T03:42:41,535 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-09-19T03:42:41,538 creating build/lib/colossalai/legacy 2024-09-19T03:42:41,540 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2024-09-19T03:42:41,542 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2024-09-19T03:42:41,544 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2024-09-19T03:42:41,547 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2024-09-19T03:42:41,549 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2024-09-19T03:42:41,551 creating build/lib/colossalai/moe 2024-09-19T03:42:41,552 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2024-09-19T03:42:41,555 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2024-09-19T03:42:41,557 creating build/lib/colossalai/_analyzer 2024-09-19T03:42:41,558 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2024-09-19T03:42:41,561 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2024-09-19T03:42:41,563 creating build/lib/colossalai/testing 2024-09-19T03:42:41,564 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2024-09-19T03:42:41,567 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2024-09-19T03:42:41,569 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2024-09-19T03:42:41,571 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2024-09-19T03:42:41,573 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2024-09-19T03:42:41,576 creating build/lib/colossalai/utils 2024-09-19T03:42:41,577 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2024-09-19T03:42:41,579 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2024-09-19T03:42:41,581 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2024-09-19T03:42:41,584 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2024-09-19T03:42:41,586 creating build/lib/colossalai/accelerator 2024-09-19T03:42:41,587 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2024-09-19T03:42:41,589 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2024-09-19T03:42:41,592 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2024-09-19T03:42:41,594 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2024-09-19T03:42:41,597 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2024-09-19T03:42:41,600 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2024-09-19T03:42:41,603 creating build/lib/colossalai/logging 2024-09-19T03:42:41,604 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2024-09-19T03:42:41,606 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2024-09-19T03:42:41,609 creating build/lib/colossalai/inference 2024-09-19T03:42:41,610 copying colossalai/inference/utils.py -> build/lib/colossalai/inference 2024-09-19T03:42:41,613 copying colossalai/inference/graph_runner.py -> build/lib/colossalai/inference 2024-09-19T03:42:41,615 copying colossalai/inference/sampler.py -> build/lib/colossalai/inference 2024-09-19T03:42:41,617 copying colossalai/inference/batch_bucket.py -> build/lib/colossalai/inference 2024-09-19T03:42:41,620 copying colossalai/inference/config.py -> build/lib/colossalai/inference 2024-09-19T03:42:41,623 copying colossalai/inference/struct.py -> build/lib/colossalai/inference 2024-09-19T03:42:41,625 copying colossalai/inference/logit_processors.py -> build/lib/colossalai/inference 2024-09-19T03:42:41,628 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2024-09-19T03:42:41,630 copying colossalai/inference/flash_decoding_utils.py -> build/lib/colossalai/inference 2024-09-19T03:42:41,632 creating build/lib/colossalai/cli 2024-09-19T03:42:41,633 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2024-09-19T03:42:41,635 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2024-09-19T03:42:41,638 creating build/lib/colossalai/fx 2024-09-19T03:42:41,639 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2024-09-19T03:42:41,641 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2024-09-19T03:42:41,644 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2024-09-19T03:42:41,646 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2024-09-19T03:42:41,648 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2024-09-19T03:42:41,650 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2024-09-19T03:42:41,652 creating build/lib/colossalai/zero 2024-09-19T03:42:41,653 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2024-09-19T03:42:41,656 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2024-09-19T03:42:41,658 creating build/lib/colossalai/nn 2024-09-19T03:42:41,659 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2024-09-19T03:42:41,662 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2024-09-19T03:42:41,665 creating build/lib/colossalai/cluster 2024-09-19T03:42:41,666 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2024-09-19T03:42:41,668 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2024-09-19T03:42:41,670 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2024-09-19T03:42:41,673 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2024-09-19T03:42:41,675 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2024-09-19T03:42:41,678 creating build/lib/colossalai/quantization 2024-09-19T03:42:41,679 copying colossalai/quantization/utils.py -> build/lib/colossalai/quantization 2024-09-19T03:42:41,682 copying colossalai/quantization/bnb_config.py -> build/lib/colossalai/quantization 2024-09-19T03:42:41,684 copying colossalai/quantization/fp8.py -> build/lib/colossalai/quantization 2024-09-19T03:42:41,686 copying colossalai/quantization/fp8_hook.py -> build/lib/colossalai/quantization 2024-09-19T03:42:41,688 copying colossalai/quantization/bnb.py -> build/lib/colossalai/quantization 2024-09-19T03:42:41,690 copying colossalai/quantization/__init__.py -> build/lib/colossalai/quantization 2024-09-19T03:42:41,693 creating build/lib/colossalai/_C 2024-09-19T03:42:41,693 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2024-09-19T03:42:41,695 creating build/lib/colossalai/amp 2024-09-19T03:42:41,696 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2024-09-19T03:42:41,698 creating build/lib/colossalai/auto_parallel 2024-09-19T03:42:41,699 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2024-09-19T03:42:41,701 creating build/lib/colossalai/lazy 2024-09-19T03:42:41,702 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2024-09-19T03:42:41,705 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2024-09-19T03:42:41,706 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2024-09-19T03:42:41,709 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2024-09-19T03:42:41,711 creating build/lib/colossalai/pipeline 2024-09-19T03:42:41,712 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2024-09-19T03:42:41,714 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2024-09-19T03:42:41,717 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2024-09-19T03:42:41,718 creating build/lib/colossalai/kernel 2024-09-19T03:42:41,719 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2024-09-19T03:42:41,721 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2024-09-19T03:42:41,723 creating build/lib/colossalai/shardformer/layer 2024-09-19T03:42:41,724 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2024-09-19T03:42:41,727 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2024-09-19T03:42:41,729 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2024-09-19T03:42:41,732 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2024-09-19T03:42:41,734 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2024-09-19T03:42:41,737 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2024-09-19T03:42:41,740 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2024-09-19T03:42:41,742 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2024-09-19T03:42:41,744 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2024-09-19T03:42:41,746 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2024-09-19T03:42:41,749 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2024-09-19T03:42:41,753 creating build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,753 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,756 copying colossalai/shardformer/policies/qwen2.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,759 copying colossalai/shardformer/policies/command.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,761 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,763 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,765 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,768 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,771 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,773 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,775 copying colossalai/shardformer/policies/deepseek.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,778 copying colossalai/shardformer/policies/mixtral.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,780 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,782 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,784 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,786 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,789 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,791 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,793 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,796 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,798 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,801 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2024-09-19T03:42:41,804 creating build/lib/colossalai/shardformer/shard 2024-09-19T03:42:41,805 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2024-09-19T03:42:41,806 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2024-09-19T03:42:41,808 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2024-09-19T03:42:41,810 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2024-09-19T03:42:41,812 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2024-09-19T03:42:41,813 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2024-09-19T03:42:41,816 creating build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,817 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,820 copying colossalai/shardformer/modeling/qwen2.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,823 copying colossalai/shardformer/modeling/command.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,826 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,829 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,832 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,834 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,837 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,840 copying colossalai/shardformer/modeling/deepseek.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,843 copying colossalai/shardformer/modeling/mixtral.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,846 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,848 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,849 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,852 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,854 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,856 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,858 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,860 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,863 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,866 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2024-09-19T03:42:41,870 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-09-19T03:42:41,870 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-09-19T03:42:41,872 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-09-19T03:42:41,873 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-09-19T03:42:41,877 creating build/lib/colossalai/booster/mixed_precision 2024-09-19T03:42:41,877 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2024-09-19T03:42:41,879 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2024-09-19T03:42:41,881 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2024-09-19T03:42:41,883 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2024-09-19T03:42:41,884 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2024-09-19T03:42:41,886 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2024-09-19T03:42:41,887 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2024-09-19T03:42:41,889 creating build/lib/colossalai/booster/plugin 2024-09-19T03:42:41,890 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2024-09-19T03:42:41,893 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-09-19T03:42:41,896 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2024-09-19T03:42:41,898 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-09-19T03:42:41,900 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-09-19T03:42:41,903 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-09-19T03:42:41,905 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2024-09-19T03:42:41,907 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2024-09-19T03:42:41,909 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2024-09-19T03:42:41,911 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2024-09-19T03:42:41,913 creating build/lib/colossalai/tensor/padded_tensor 2024-09-19T03:42:41,914 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2024-09-19T03:42:41,916 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2024-09-19T03:42:41,918 creating build/lib/colossalai/tensor/d_tensor 2024-09-19T03:42:41,919 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2024-09-19T03:42:41,921 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2024-09-19T03:42:41,923 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2024-09-19T03:42:41,925 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-09-19T03:42:41,927 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2024-09-19T03:42:41,930 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2024-09-19T03:42:41,932 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2024-09-19T03:42:41,934 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-09-19T03:42:41,937 creating build/lib/colossalai/tensor/moe_tensor 2024-09-19T03:42:41,937 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2024-09-19T03:42:41,939 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2024-09-19T03:42:41,941 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2024-09-19T03:42:41,943 creating build/lib/colossalai/legacy/builder 2024-09-19T03:42:41,944 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2024-09-19T03:42:41,945 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2024-09-19T03:42:41,947 creating build/lib/colossalai/legacy/engine 2024-09-19T03:42:41,948 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2024-09-19T03:42:41,950 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2024-09-19T03:42:41,953 creating build/lib/colossalai/legacy/context 2024-09-19T03:42:41,953 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2024-09-19T03:42:41,956 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2024-09-19T03:42:41,958 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2024-09-19T03:42:41,960 creating build/lib/colossalai/legacy/tensor 2024-09-19T03:42:41,961 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2024-09-19T03:42:41,963 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2024-09-19T03:42:41,964 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2024-09-19T03:42:41,966 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2024-09-19T03:42:41,968 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2024-09-19T03:42:41,969 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2024-09-19T03:42:41,971 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2024-09-19T03:42:41,973 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2024-09-19T03:42:41,976 creating build/lib/colossalai/legacy/registry 2024-09-19T03:42:41,977 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2024-09-19T03:42:41,979 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2024-09-19T03:42:41,981 creating build/lib/colossalai/legacy/utils 2024-09-19T03:42:41,982 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2024-09-19T03:42:41,985 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2024-09-19T03:42:41,987 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2024-09-19T03:42:41,989 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2024-09-19T03:42:41,992 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2024-09-19T03:42:41,994 creating build/lib/colossalai/legacy/inference 2024-09-19T03:42:41,995 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2024-09-19T03:42:41,997 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2024-09-19T03:42:42,000 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2024-09-19T03:42:42,001 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2024-09-19T03:42:42,005 creating build/lib/colossalai/legacy/zero 2024-09-19T03:42:42,006 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2024-09-19T03:42:42,008 creating build/lib/colossalai/legacy/nn 2024-09-19T03:42:42,009 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2024-09-19T03:42:42,011 creating build/lib/colossalai/legacy/amp 2024-09-19T03:42:42,012 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2024-09-19T03:42:42,014 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2024-09-19T03:42:42,016 creating build/lib/colossalai/legacy/trainer 2024-09-19T03:42:42,017 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2024-09-19T03:42:42,019 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2024-09-19T03:42:42,021 creating build/lib/colossalai/legacy/communication 2024-09-19T03:42:42,022 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2024-09-19T03:42:42,024 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2024-09-19T03:42:42,026 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2024-09-19T03:42:42,028 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2024-09-19T03:42:42,030 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2024-09-19T03:42:42,032 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2024-09-19T03:42:42,035 creating build/lib/colossalai/legacy/pipeline 2024-09-19T03:42:42,035 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2024-09-19T03:42:42,038 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2024-09-19T03:42:42,040 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2024-09-19T03:42:42,042 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2024-09-19T03:42:42,044 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2024-09-19T03:42:42,046 creating build/lib/colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:42,047 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:42,049 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:42,051 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:42,053 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:42,054 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:42,056 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:42,058 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:42,060 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:42,062 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2024-09-19T03:42:42,063 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-09-19T03:42:42,065 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-09-19T03:42:42,067 creating build/lib/colossalai/legacy/engine/schedule 2024-09-19T03:42:42,069 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2024-09-19T03:42:42,071 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-09-19T03:42:42,073 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-09-19T03:42:42,075 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-09-19T03:42:42,077 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2024-09-19T03:42:42,079 creating build/lib/colossalai/legacy/context/random 2024-09-19T03:42:42,080 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2024-09-19T03:42:42,082 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2024-09-19T03:42:42,084 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2024-09-19T03:42:42,086 creating build/lib/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:42,087 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:42,090 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:42,091 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:42,093 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:42,095 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:42,097 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:42,098 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:42,101 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:42,102 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:42,104 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:42,106 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:42,109 creating build/lib/colossalai/legacy/utils/data_sampler 2024-09-19T03:42:42,110 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-09-19T03:42:42,111 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-09-19T03:42:42,114 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-09-19T03:42:42,116 creating build/lib/colossalai/legacy/utils/profiler 2024-09-19T03:42:42,117 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-09-19T03:42:42,119 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-09-19T03:42:42,121 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2024-09-19T03:42:42,122 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2024-09-19T03:42:42,125 creating build/lib/colossalai/legacy/utils/checkpoint 2024-09-19T03:42:42,125 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-09-19T03:42:42,127 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-09-19T03:42:42,129 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-09-19T03:42:42,131 creating build/lib/colossalai/legacy/utils/profiler/legacy 2024-09-19T03:42:42,132 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-09-19T03:42:42,134 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-09-19T03:42:42,136 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-09-19T03:42:42,138 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-09-19T03:42:42,140 creating build/lib/colossalai/legacy/inference/tensor_parallel 2024-09-19T03:42:42,141 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-09-19T03:42:42,143 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-09-19T03:42:42,145 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-09-19T03:42:42,147 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-09-19T03:42:42,150 creating build/lib/colossalai/legacy/inference/hybridengine 2024-09-19T03:42:42,150 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-09-19T03:42:42,152 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-09-19T03:42:42,155 creating build/lib/colossalai/legacy/inference/pipeline 2024-09-19T03:42:42,155 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2024-09-19T03:42:42,158 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2024-09-19T03:42:42,160 creating build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:42,161 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:42,163 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:42,165 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:42,167 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:42,169 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:42,171 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:42,172 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:42,175 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:42,176 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:42,179 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-09-19T03:42:42,180 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-09-19T03:42:42,182 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-09-19T03:42:42,183 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-09-19T03:42:42,185 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-09-19T03:42:42,188 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-19T03:42:42,189 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-19T03:42:42,190 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-19T03:42:42,193 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-19T03:42:42,195 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-19T03:42:42,197 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-19T03:42:42,200 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2024-09-19T03:42:42,201 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-09-19T03:42:42,202 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-09-19T03:42:42,205 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-09-19T03:42:42,206 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-09-19T03:42:42,208 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-09-19T03:42:42,209 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-09-19T03:42:42,213 creating build/lib/colossalai/legacy/zero/init_ctx 2024-09-19T03:42:42,213 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-09-19T03:42:42,216 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-09-19T03:42:42,218 creating build/lib/colossalai/legacy/zero/gemini 2024-09-19T03:42:42,219 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-19T03:42:42,221 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-19T03:42:42,223 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-19T03:42:42,225 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-19T03:42:42,226 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-19T03:42:42,229 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-19T03:42:42,231 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2024-09-19T03:42:42,233 creating build/lib/colossalai/legacy/zero/sharded_model 2024-09-19T03:42:42,234 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-09-19T03:42:42,236 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-09-19T03:42:42,239 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-09-19T03:42:42,240 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-09-19T03:42:42,242 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-09-19T03:42:42,244 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-09-19T03:42:42,246 creating build/lib/colossalai/legacy/zero/sharded_param 2024-09-19T03:42:42,247 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-09-19T03:42:42,249 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-09-19T03:42:42,251 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-09-19T03:42:42,253 creating build/lib/colossalai/legacy/zero/sharded_optim 2024-09-19T03:42:42,253 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-09-19T03:42:42,256 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-09-19T03:42:42,258 creating build/lib/colossalai/legacy/zero/shard_utils 2024-09-19T03:42:42,259 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-09-19T03:42:42,261 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-09-19T03:42:42,262 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-09-19T03:42:42,264 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-09-19T03:42:42,266 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-09-19T03:42:42,268 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2024-09-19T03:42:42,269 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-09-19T03:42:42,271 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-09-19T03:42:42,273 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-09-19T03:42:42,274 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-09-19T03:42:42,276 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-09-19T03:42:42,278 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-09-19T03:42:42,279 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-09-19T03:42:42,281 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-09-19T03:42:42,283 creating build/lib/colossalai/legacy/nn/layer 2024-09-19T03:42:42,285 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2024-09-19T03:42:42,286 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2024-09-19T03:42:42,289 creating build/lib/colossalai/legacy/nn/loss 2024-09-19T03:42:42,289 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2024-09-19T03:42:42,292 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2024-09-19T03:42:42,294 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2024-09-19T03:42:42,296 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2024-09-19T03:42:42,298 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2024-09-19T03:42:42,300 creating build/lib/colossalai/legacy/nn/parallel 2024-09-19T03:42:42,301 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2024-09-19T03:42:42,303 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2024-09-19T03:42:42,305 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2024-09-19T03:42:42,306 creating build/lib/colossalai/legacy/nn/metric 2024-09-19T03:42:42,307 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2024-09-19T03:42:42,309 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2024-09-19T03:42:42,311 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2024-09-19T03:42:42,312 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2024-09-19T03:42:42,314 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2024-09-19T03:42:42,316 creating build/lib/colossalai/legacy/nn/_ops 2024-09-19T03:42:42,317 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2024-09-19T03:42:42,318 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2024-09-19T03:42:42,321 creating build/lib/colossalai/legacy/nn/layer/vanilla 2024-09-19T03:42:42,322 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-09-19T03:42:42,323 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-09-19T03:42:42,326 creating build/lib/colossalai/legacy/nn/layer/wrapper 2024-09-19T03:42:42,327 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-09-19T03:42:42,328 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-09-19T03:42:42,331 creating build/lib/colossalai/legacy/nn/layer/utils 2024-09-19T03:42:42,331 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-09-19T03:42:42,333 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-09-19T03:42:42,335 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-09-19T03:42:42,336 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-09-19T03:42:42,338 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-09-19T03:42:42,340 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-09-19T03:42:42,342 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-09-19T03:42:42,345 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-09-19T03:42:42,346 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-09-19T03:42:42,349 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-09-19T03:42:42,351 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-09-19T03:42:42,353 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-09-19T03:42:42,356 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-09-19T03:42:42,357 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-09-19T03:42:42,360 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-09-19T03:42:42,361 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-09-19T03:42:42,363 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-09-19T03:42:42,366 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:42,367 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:42,369 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:42,370 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:42,373 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:42,374 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:42,376 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:42,379 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-09-19T03:42:42,379 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-09-19T03:42:42,382 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-09-19T03:42:42,384 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-09-19T03:42:42,386 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-09-19T03:42:42,389 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-09-19T03:42:42,390 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-09-19T03:42:42,392 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-09-19T03:42:42,394 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-09-19T03:42:42,395 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-09-19T03:42:42,398 creating build/lib/colossalai/legacy/nn/parallel/layers 2024-09-19T03:42:42,399 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-09-19T03:42:42,402 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-09-19T03:42:42,403 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-09-19T03:42:42,405 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-09-19T03:42:42,407 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-09-19T03:42:42,410 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:42,411 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:42,413 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:42,415 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:42,418 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:42,421 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:42,423 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:42,425 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:42,427 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:42,429 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:42,432 creating build/lib/colossalai/legacy/amp/naive_amp 2024-09-19T03:42:42,433 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-09-19T03:42:42,435 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-09-19T03:42:42,437 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-09-19T03:42:42,439 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-09-19T03:42:42,442 creating build/lib/colossalai/legacy/amp/torch_amp 2024-09-19T03:42:42,444 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-09-19T03:42:42,446 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-09-19T03:42:42,449 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-09-19T03:42:42,451 creating build/lib/colossalai/legacy/amp/apex_amp 2024-09-19T03:42:42,452 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-09-19T03:42:42,454 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-09-19T03:42:42,457 creating build/lib/colossalai/legacy/trainer/hooks 2024-09-19T03:42:42,458 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-19T03:42:42,460 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-19T03:42:42,463 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-19T03:42:42,465 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-19T03:42:42,467 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-19T03:42:42,469 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-19T03:42:42,471 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-09-19T03:42:42,474 creating build/lib/colossalai/legacy/pipeline/rpc 2024-09-19T03:42:42,475 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-09-19T03:42:42,478 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-09-19T03:42:42,480 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-09-19T03:42:42,482 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-09-19T03:42:42,486 creating build/lib/colossalai/legacy/pipeline/middleware 2024-09-19T03:42:42,487 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-09-19T03:42:42,489 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-09-19T03:42:42,493 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-09-19T03:42:42,494 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-09-19T03:42:42,496 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-09-19T03:42:42,499 creating build/lib/colossalai/_analyzer/fx 2024-09-19T03:42:42,500 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2024-09-19T03:42:42,502 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2024-09-19T03:42:42,504 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2024-09-19T03:42:42,506 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2024-09-19T03:42:42,509 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2024-09-19T03:42:42,512 creating build/lib/colossalai/_analyzer/_subclasses 2024-09-19T03:42:42,513 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2024-09-19T03:42:42,516 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-09-19T03:42:42,518 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2024-09-19T03:42:42,521 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2024-09-19T03:42:42,523 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-09-19T03:42:42,526 creating build/lib/colossalai/_analyzer/fx/passes 2024-09-19T03:42:42,528 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2024-09-19T03:42:42,531 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2024-09-19T03:42:42,534 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2024-09-19T03:42:42,537 creating build/lib/colossalai/_analyzer/fx/tracer 2024-09-19T03:42:42,538 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-09-19T03:42:42,541 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-09-19T03:42:42,544 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-09-19T03:42:42,546 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-09-19T03:42:42,549 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-09-19T03:42:42,551 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-09-19T03:42:42,553 creating build/lib/colossalai/utils/multi_tensor_apply 2024-09-19T03:42:42,555 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-09-19T03:42:42,557 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-09-19T03:42:42,560 creating build/lib/colossalai/utils/rank_recorder 2024-09-19T03:42:42,562 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2024-09-19T03:42:42,564 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2024-09-19T03:42:42,567 creating build/lib/colossalai/utils/model 2024-09-19T03:42:42,569 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2024-09-19T03:42:42,571 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2024-09-19T03:42:42,574 creating build/lib/colossalai/utils/tensor_detector 2024-09-19T03:42:42,575 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2024-09-19T03:42:42,577 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2024-09-19T03:42:42,580 creating build/lib/colossalai/inference/executor 2024-09-19T03:42:42,582 copying colossalai/inference/executor/rpc_worker.py -> build/lib/colossalai/inference/executor 2024-09-19T03:42:42,584 copying colossalai/inference/executor/__init__.py -> build/lib/colossalai/inference/executor 2024-09-19T03:42:42,586 creating build/lib/colossalai/inference/server 2024-09-19T03:42:42,588 copying colossalai/inference/server/utils.py -> build/lib/colossalai/inference/server 2024-09-19T03:42:42,590 copying colossalai/inference/server/api_server.py -> build/lib/colossalai/inference/server 2024-09-19T03:42:42,593 copying colossalai/inference/server/completion_service.py -> build/lib/colossalai/inference/server 2024-09-19T03:42:42,595 copying colossalai/inference/server/__init__.py -> build/lib/colossalai/inference/server 2024-09-19T03:42:42,597 copying colossalai/inference/server/chat_service.py -> build/lib/colossalai/inference/server 2024-09-19T03:42:42,599 creating build/lib/colossalai/inference/kv_cache 2024-09-19T03:42:42,601 copying colossalai/inference/kv_cache/block_cache.py -> build/lib/colossalai/inference/kv_cache 2024-09-19T03:42:42,603 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2024-09-19T03:42:42,605 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2024-09-19T03:42:42,609 creating build/lib/colossalai/inference/modeling 2024-09-19T03:42:42,610 copying colossalai/inference/modeling/__init__.py -> build/lib/colossalai/inference/modeling 2024-09-19T03:42:42,613 creating build/lib/colossalai/inference/core 2024-09-19T03:42:42,615 copying colossalai/inference/core/plugin.py -> build/lib/colossalai/inference/core 2024-09-19T03:42:42,618 copying colossalai/inference/core/rpc_engine.py -> build/lib/colossalai/inference/core 2024-09-19T03:42:42,621 copying colossalai/inference/core/request_handler.py -> build/lib/colossalai/inference/core 2024-09-19T03:42:42,624 copying colossalai/inference/core/llm_engine.py -> build/lib/colossalai/inference/core 2024-09-19T03:42:42,627 copying colossalai/inference/core/base_engine.py -> build/lib/colossalai/inference/core 2024-09-19T03:42:42,629 copying colossalai/inference/core/diffusion_engine.py -> build/lib/colossalai/inference/core 2024-09-19T03:42:42,632 copying colossalai/inference/core/async_engine.py -> build/lib/colossalai/inference/core 2024-09-19T03:42:42,634 copying colossalai/inference/core/__init__.py -> build/lib/colossalai/inference/core 2024-09-19T03:42:42,636 copying colossalai/inference/core/engine.py -> build/lib/colossalai/inference/core 2024-09-19T03:42:42,639 creating build/lib/colossalai/inference/spec 2024-09-19T03:42:42,641 copying colossalai/inference/spec/drafter.py -> build/lib/colossalai/inference/spec 2024-09-19T03:42:42,643 copying colossalai/inference/spec/struct.py -> build/lib/colossalai/inference/spec 2024-09-19T03:42:42,645 copying colossalai/inference/spec/__init__.py -> build/lib/colossalai/inference/spec 2024-09-19T03:42:42,648 creating build/lib/colossalai/inference/modeling/layers 2024-09-19T03:42:42,649 copying colossalai/inference/modeling/layers/diffusion.py -> build/lib/colossalai/inference/modeling/layers 2024-09-19T03:42:42,652 copying colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/lib/colossalai/inference/modeling/layers 2024-09-19T03:42:42,654 copying colossalai/inference/modeling/layers/__init__.py -> build/lib/colossalai/inference/modeling/layers 2024-09-19T03:42:42,655 copying colossalai/inference/modeling/layers/attention.py -> build/lib/colossalai/inference/modeling/layers 2024-09-19T03:42:42,658 copying colossalai/inference/modeling/layers/distrifusion.py -> build/lib/colossalai/inference/modeling/layers 2024-09-19T03:42:42,662 creating build/lib/colossalai/inference/modeling/policy 2024-09-19T03:42:42,663 copying colossalai/inference/modeling/policy/stablediffusion3.py -> build/lib/colossalai/inference/modeling/policy 2024-09-19T03:42:42,666 copying colossalai/inference/modeling/policy/pixart_alpha.py -> build/lib/colossalai/inference/modeling/policy 2024-09-19T03:42:42,668 copying colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/policy 2024-09-19T03:42:42,670 copying colossalai/inference/modeling/policy/__init__.py -> build/lib/colossalai/inference/modeling/policy 2024-09-19T03:42:42,673 copying colossalai/inference/modeling/policy/nopadding_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-09-19T03:42:42,675 copying colossalai/inference/modeling/policy/glide_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-09-19T03:42:42,678 creating build/lib/colossalai/inference/modeling/models 2024-09-19T03:42:42,679 copying colossalai/inference/modeling/models/stablediffusion3.py -> build/lib/colossalai/inference/modeling/models 2024-09-19T03:42:42,682 copying colossalai/inference/modeling/models/pixart_alpha.py -> build/lib/colossalai/inference/modeling/models 2024-09-19T03:42:42,685 copying colossalai/inference/modeling/models/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/models 2024-09-19T03:42:42,687 copying colossalai/inference/modeling/models/__init__.py -> build/lib/colossalai/inference/modeling/models 2024-09-19T03:42:42,689 copying colossalai/inference/modeling/models/nopadding_llama.py -> build/lib/colossalai/inference/modeling/models 2024-09-19T03:42:42,693 copying colossalai/inference/modeling/models/glide_llama.py -> build/lib/colossalai/inference/modeling/models 2024-09-19T03:42:42,696 creating build/lib/colossalai/inference/modeling/backends 2024-09-19T03:42:42,697 copying colossalai/inference/modeling/backends/attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-09-19T03:42:42,700 copying colossalai/inference/modeling/backends/__init__.py -> build/lib/colossalai/inference/modeling/backends 2024-09-19T03:42:42,702 copying colossalai/inference/modeling/backends/pre_attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-09-19T03:42:42,704 creating build/lib/colossalai/cli/check 2024-09-19T03:42:42,705 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2024-09-19T03:42:42,707 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2024-09-19T03:42:42,710 creating build/lib/colossalai/cli/launcher 2024-09-19T03:42:42,711 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2024-09-19T03:42:42,714 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2024-09-19T03:42:42,716 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2024-09-19T03:42:42,718 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2024-09-19T03:42:42,720 creating build/lib/colossalai/fx/profiler 2024-09-19T03:42:42,721 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2024-09-19T03:42:42,724 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2024-09-19T03:42:42,726 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2024-09-19T03:42:42,728 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2024-09-19T03:42:42,730 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2024-09-19T03:42:42,732 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2024-09-19T03:42:42,734 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2024-09-19T03:42:42,737 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2024-09-19T03:42:42,739 creating build/lib/colossalai/fx/codegen 2024-09-19T03:42:42,740 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2024-09-19T03:42:42,743 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2024-09-19T03:42:42,745 creating build/lib/colossalai/fx/passes 2024-09-19T03:42:42,746 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2024-09-19T03:42:42,748 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2024-09-19T03:42:42,751 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2024-09-19T03:42:42,753 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2024-09-19T03:42:42,755 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2024-09-19T03:42:42,757 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2024-09-19T03:42:42,759 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2024-09-19T03:42:42,761 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2024-09-19T03:42:42,764 creating build/lib/colossalai/fx/tracer 2024-09-19T03:42:42,765 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2024-09-19T03:42:42,767 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2024-09-19T03:42:42,769 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2024-09-19T03:42:42,771 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2024-09-19T03:42:42,773 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2024-09-19T03:42:42,776 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2024-09-19T03:42:42,778 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2024-09-19T03:42:42,786 creating build/lib/colossalai/fx/profiler/experimental 2024-09-19T03:42:42,787 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2024-09-19T03:42:42,789 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2024-09-19T03:42:42,790 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2024-09-19T03:42:42,792 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2024-09-19T03:42:42,794 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2024-09-19T03:42:42,797 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:42,798 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:42,800 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:42,802 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:42,804 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:42,806 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:42,809 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:42,811 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:42,813 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:42,816 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:42,819 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:42,820 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:42,822 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:42,824 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:42,827 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:42,829 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:42,831 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:42,833 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:42,835 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:42,837 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:42,839 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:42,842 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:42,845 creating build/lib/colossalai/fx/tracer/meta_patch 2024-09-19T03:42:42,846 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2024-09-19T03:42:42,849 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2024-09-19T03:42:42,850 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2024-09-19T03:42:42,853 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:42,854 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:42,856 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:42,859 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:42,861 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:42,864 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:42,866 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:42,868 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:42,870 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:42,874 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:42,875 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:42,877 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:42,880 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:42,882 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:42,885 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:42,887 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:42,889 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:42,891 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:42,894 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-19T03:42:42,895 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-19T03:42:42,897 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-19T03:42:42,899 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-19T03:42:42,901 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-19T03:42:42,904 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-19T03:42:42,906 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-19T03:42:42,907 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-19T03:42:42,910 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-19T03:42:42,911 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-19T03:42:42,913 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-19T03:42:42,916 creating build/lib/colossalai/zero/gemini 2024-09-19T03:42:42,917 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2024-09-19T03:42:42,919 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2024-09-19T03:42:42,922 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2024-09-19T03:42:42,924 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2024-09-19T03:42:42,926 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2024-09-19T03:42:42,928 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2024-09-19T03:42:42,931 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2024-09-19T03:42:42,933 creating build/lib/colossalai/zero/low_level 2024-09-19T03:42:42,934 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2024-09-19T03:42:42,937 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2024-09-19T03:42:42,939 copying colossalai/zero/low_level/zero_hook.py -> build/lib/colossalai/zero/low_level 2024-09-19T03:42:42,941 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2024-09-19T03:42:42,943 creating build/lib/colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:42,944 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:42,946 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:42,948 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:42,950 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:42,951 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:42,953 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:42,955 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:42,957 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:42,959 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:42,961 creating build/lib/colossalai/zero/gemini/chunk 2024-09-19T03:42:42,962 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-09-19T03:42:42,964 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-09-19T03:42:42,966 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2024-09-19T03:42:42,968 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2024-09-19T03:42:42,971 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2024-09-19T03:42:42,974 creating build/lib/colossalai/zero/low_level/bookkeeping 2024-09-19T03:42:42,975 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-09-19T03:42:42,977 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-09-19T03:42:42,979 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-09-19T03:42:42,981 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-09-19T03:42:42,983 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-09-19T03:42:42,986 creating build/lib/colossalai/nn/layer 2024-09-19T03:42:42,987 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2024-09-19T03:42:42,989 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2024-09-19T03:42:42,991 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2024-09-19T03:42:42,993 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2024-09-19T03:42:42,995 creating build/lib/colossalai/nn/loss 2024-09-19T03:42:42,996 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2024-09-19T03:42:42,998 creating build/lib/colossalai/nn/lr_scheduler 2024-09-19T03:42:42,999 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-19T03:42:43,001 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-19T03:42:43,003 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-19T03:42:43,006 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-19T03:42:43,007 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-19T03:42:43,009 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-19T03:42:43,011 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-19T03:42:43,012 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2024-09-19T03:42:43,015 creating build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,016 copying colossalai/nn/optimizer/distributed_adafactor.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,018 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,020 copying colossalai/nn/optimizer/distributed_lamb.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,022 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,025 copying colossalai/nn/optimizer/distributed_galore.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,027 copying colossalai/nn/optimizer/galore.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,030 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,032 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,034 copying colossalai/nn/optimizer/came.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,036 copying colossalai/nn/optimizer/distributed_came.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,039 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,041 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,043 copying colossalai/nn/optimizer/adafactor.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,045 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,047 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,050 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2024-09-19T03:42:43,052 creating build/lib/colossalai/amp/naive_amp 2024-09-19T03:42:43,053 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2024-09-19T03:42:43,054 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2024-09-19T03:42:43,057 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-19T03:42:43,058 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-19T03:42:43,060 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-19T03:42:43,061 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-19T03:42:43,063 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-19T03:42:43,066 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2024-09-19T03:42:43,067 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-09-19T03:42:43,069 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-09-19T03:42:43,071 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-09-19T03:42:43,073 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-09-19T03:42:43,075 creating build/lib/colossalai/auto_parallel/offload 2024-09-19T03:42:43,076 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2024-09-19T03:42:43,079 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2024-09-19T03:42:43,081 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2024-09-19T03:42:43,083 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2024-09-19T03:42:43,085 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2024-09-19T03:42:43,087 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2024-09-19T03:42:43,090 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2024-09-19T03:42:43,092 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2024-09-19T03:42:43,094 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2024-09-19T03:42:43,095 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2024-09-19T03:42:43,098 creating build/lib/colossalai/auto_parallel/tensor_shard 2024-09-19T03:42:43,099 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-09-19T03:42:43,101 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-09-19T03:42:43,104 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-09-19T03:42:43,105 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-09-19T03:42:43,107 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-09-19T03:42:43,109 creating build/lib/colossalai/auto_parallel/passes 2024-09-19T03:42:43,110 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-09-19T03:42:43,113 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-09-19T03:42:43,115 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-09-19T03:42:43,117 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2024-09-19T03:42:43,120 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2024-09-19T03:42:43,121 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2024-09-19T03:42:43,123 creating build/lib/colossalai/auto_parallel/meta_profiler 2024-09-19T03:42:43,125 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-09-19T03:42:43,127 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-09-19T03:42:43,129 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-09-19T03:42:43,130 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-09-19T03:42:43,133 creating build/lib/colossalai/auto_parallel/pipeline_shard 2024-09-19T03:42:43,134 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2024-09-19T03:42:43,136 creating build/lib/colossalai/auto_parallel/checkpoint 2024-09-19T03:42:43,137 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-09-19T03:42:43,138 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-09-19T03:42:43,141 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-09-19T03:42:43,143 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-09-19T03:42:43,145 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-09-19T03:42:43,147 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-09-19T03:42:43,150 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,151 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,153 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,155 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,157 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,159 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,161 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,163 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,165 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,167 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,169 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,170 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,172 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,175 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,177 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,179 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,181 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,183 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,185 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,187 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,189 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,191 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,192 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,194 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,197 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,199 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,201 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,203 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:43,205 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:43,206 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:43,208 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:43,210 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:43,213 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:43,215 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:43,218 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:43,221 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-09-19T03:42:43,222 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-09-19T03:42:43,225 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-09-19T03:42:43,228 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-09-19T03:42:43,230 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-09-19T03:42:43,233 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-09-19T03:42:43,236 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,237 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,240 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,242 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,245 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,248 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,249 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,252 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,254 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,255 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,258 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,260 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,262 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,265 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,267 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,269 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,271 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,273 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,276 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,278 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:43,281 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:43,282 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:43,284 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:43,286 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:43,288 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:43,290 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:43,292 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:43,294 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:43,296 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:43,298 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:43,300 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:43,303 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:43,306 creating build/lib/colossalai/pipeline/schedule 2024-09-19T03:42:43,306 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2024-09-19T03:42:43,309 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2024-09-19T03:42:43,311 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2024-09-19T03:42:43,314 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2024-09-19T03:42:43,315 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2024-09-19T03:42:43,317 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2024-09-19T03:42:43,320 creating build/lib/colossalai/kernel/jit 2024-09-19T03:42:43,321 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2024-09-19T03:42:43,323 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2024-09-19T03:42:43,325 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2024-09-19T03:42:43,327 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2024-09-19T03:42:43,330 creating build/lib/colossalai/kernel/triton 2024-09-19T03:42:43,330 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2024-09-19T03:42:43,333 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2024-09-19T03:42:43,335 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2024-09-19T03:42:43,338 copying colossalai/kernel/triton/kvcache_copy.py -> build/lib/colossalai/kernel/triton 2024-09-19T03:42:43,340 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2024-09-19T03:42:43,342 copying colossalai/kernel/triton/rms_layernorm.py -> build/lib/colossalai/kernel/triton 2024-09-19T03:42:43,344 copying colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-09-19T03:42:43,347 copying colossalai/kernel/triton/rotary_cache_copy.py -> build/lib/colossalai/kernel/triton 2024-09-19T03:42:43,349 copying colossalai/kernel/triton/context_attn_unpad.py -> build/lib/colossalai/kernel/triton 2024-09-19T03:42:43,352 copying colossalai/kernel/triton/fused_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-09-19T03:42:43,354 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2024-09-19T03:42:43,357 creating build/lib/colossalai/kernel/extensions 2024-09-19T03:42:43,358 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2024-09-19T03:42:43,360 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2024-09-19T03:42:43,362 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2024-09-19T03:42:43,364 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2024-09-19T03:42:43,366 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2024-09-19T03:42:43,368 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2024-09-19T03:42:43,370 creating build/lib/colossalai/kernel/extensions/pybind 2024-09-19T03:42:43,371 copying colossalai/kernel/extensions/pybind/__init__.py -> build/lib/colossalai/kernel/extensions/pybind 2024-09-19T03:42:43,373 creating build/lib/colossalai/kernel/extensions/csrc 2024-09-19T03:42:43,374 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2024-09-19T03:42:43,376 creating build/lib/colossalai/kernel/extensions/pybind/softmax 2024-09-19T03:42:43,377 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-09-19T03:42:43,379 copying colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-09-19T03:42:43,380 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-09-19T03:42:43,382 creating build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-09-19T03:42:43,383 copying colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-09-19T03:42:43,385 copying colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-09-19T03:42:43,387 creating build/lib/colossalai/kernel/extensions/pybind/moe 2024-09-19T03:42:43,388 copying colossalai/kernel/extensions/pybind/moe/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-09-19T03:42:43,390 copying colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-09-19T03:42:43,392 creating build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-09-19T03:42:43,393 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-09-19T03:42:43,395 copying colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-09-19T03:42:43,397 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-09-19T03:42:43,399 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-09-19T03:42:43,401 creating build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-09-19T03:42:43,402 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-09-19T03:42:43,404 copying colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-09-19T03:42:43,406 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-09-19T03:42:43,408 creating build/lib/colossalai/kernel/extensions/pybind/inference 2024-09-19T03:42:43,409 copying colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-09-19T03:42:43,411 copying colossalai/kernel/extensions/pybind/inference/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-09-19T03:42:43,413 creating build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-09-19T03:42:43,414 copying colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-09-19T03:42:43,416 copying colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-09-19T03:42:43,506 creating build/lib/colossalai/kernel/extensions/csrc/funcs 2024-09-19T03:42:43,507 copying colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-09-19T03:42:43,509 copying colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-09-19T03:42:43,511 copying colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-09-19T03:42:43,514 copying colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-09-19T03:42:43,516 copying colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-09-19T03:42:43,519 creating build/lib/colossalai/kernel/extensions/csrc/common 2024-09-19T03:42:43,520 copying colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-09-19T03:42:43,522 copying colossalai/kernel/extensions/csrc/common/data_type.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-09-19T03:42:43,524 copying colossalai/kernel/extensions/csrc/common/micros.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-09-19T03:42:43,526 copying colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-09-19T03:42:43,528 copying colossalai/kernel/extensions/csrc/common/target.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-09-19T03:42:43,530 creating build/lib/colossalai/kernel/extensions/csrc/kernel 2024-09-19T03:42:43,530 creating build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-09-19T03:42:43,531 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-09-19T03:42:43,534 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-09-19T03:42:43,536 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,537 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,540 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,543 copying colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,545 copying colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,548 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,551 copying colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,554 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,556 copying colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,558 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,561 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,563 copying colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,566 copying colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,569 copying colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,571 copying colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,574 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,576 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,578 copying colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,581 copying colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:43,583 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-19T03:42:43,584 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-19T03:42:43,586 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-19T03:42:43,589 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-19T03:42:43,591 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-19T03:42:43,592 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-09-19T03:42:43,593 copying colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-09-19T03:42:43,596 creating build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-09-19T03:42:43,597 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-09-19T03:42:43,599 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-09-19T03:42:43,602 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-09-19T03:42:43,605 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-09-19T03:42:43,608 copying colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-09-19T03:42:43,611 copying colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-09-19T03:42:43,618 copying colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-09-19T03:42:43,623 copying colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-09-19T03:42:43,758 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-09-19T03:42:43,759 !! 2024-09-19T03:42:43,761 ******************************************************************************** 2024-09-19T03:42:43,761 Please avoid running ``setup.py`` directly. 2024-09-19T03:42:43,762 Instead, use pypa/build, pypa/installer or other 2024-09-19T03:42:43,762 standards-based tools. 2024-09-19T03:42:43,764 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-09-19T03:42:43,765 ******************************************************************************** 2024-09-19T03:42:43,766 !! 2024-09-19T03:42:43,767 self.initialize_options() 2024-09-19T03:42:43,787 installing to build/bdist.linux-armv7l/wheel 2024-09-19T03:42:43,788 running install 2024-09-19T03:42:43,813 running install_lib 2024-09-19T03:42:43,840 creating build/bdist.linux-armv7l 2024-09-19T03:42:43,841 creating build/bdist.linux-armv7l/wheel 2024-09-19T03:42:43,842 creating build/bdist.linux-armv7l/wheel/extensions 2024-09-19T03:42:43,844 creating build/bdist.linux-armv7l/wheel/extensions/pybind 2024-09-19T03:42:43,845 creating build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-09-19T03:42:43,846 copying build/lib/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2024-09-19T03:42:43,848 copying build/lib/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2024-09-19T03:42:43,849 copying build/lib/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2024-09-19T03:42:43,852 creating build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-09-19T03:42:43,853 copying build/lib/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2024-09-19T03:42:43,855 copying build/lib/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2024-09-19T03:42:43,857 creating build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-09-19T03:42:43,858 copying build/lib/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2024-09-19T03:42:43,859 copying build/lib/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2024-09-19T03:42:43,862 creating build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-09-19T03:42:43,862 copying build/lib/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-09-19T03:42:43,865 copying build/lib/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-09-19T03:42:43,866 copying build/lib/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-09-19T03:42:43,868 copying build/lib/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-09-19T03:42:43,870 creating build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-09-19T03:42:43,871 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2024-09-19T03:42:43,873 copying build/lib/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2024-09-19T03:42:43,875 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2024-09-19T03:42:43,877 creating build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-09-19T03:42:43,878 copying build/lib/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2024-09-19T03:42:43,880 copying build/lib/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2024-09-19T03:42:43,882 creating build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-09-19T03:42:43,883 copying build/lib/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2024-09-19T03:42:43,885 copying build/lib/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2024-09-19T03:42:43,887 copying build/lib/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind 2024-09-19T03:42:43,889 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2024-09-19T03:42:43,890 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/csrc 2024-09-19T03:42:43,892 creating build/bdist.linux-armv7l/wheel/colossalai 2024-09-19T03:42:43,893 creating build/bdist.linux-armv7l/wheel/colossalai/device 2024-09-19T03:42:43,894 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-09-19T03:42:43,897 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-09-19T03:42:43,899 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-09-19T03:42:43,901 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-09-19T03:42:43,903 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/./colossalai 2024-09-19T03:42:43,905 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai 2024-09-19T03:42:43,908 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-09-19T03:42:43,909 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-09-19T03:42:43,910 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-19T03:42:43,913 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-19T03:42:43,915 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-19T03:42:43,918 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-19T03:42:43,920 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-19T03:42:43,923 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-19T03:42:43,926 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-19T03:42:43,927 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-19T03:42:43,930 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-19T03:42:43,932 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-19T03:42:43,935 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-09-19T03:42:43,938 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-09-19T03:42:43,939 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,942 copying build/lib/colossalai/shardformer/policies/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,944 copying build/lib/colossalai/shardformer/policies/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,946 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,949 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,952 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,954 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,957 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,959 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,962 copying build/lib/colossalai/shardformer/policies/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,964 copying build/lib/colossalai/shardformer/policies/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,967 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,969 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,971 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,973 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,976 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,978 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,981 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,984 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,987 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,990 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-09-19T03:42:43,993 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-09-19T03:42:43,994 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-09-19T03:42:43,996 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-09-19T03:42:43,999 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-09-19T03:42:44,001 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-09-19T03:42:44,003 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-09-19T03:42:44,005 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-09-19T03:42:44,008 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-09-19T03:42:44,010 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,013 copying build/lib/colossalai/shardformer/modeling/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,016 copying build/lib/colossalai/shardformer/modeling/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,019 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,023 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,026 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,029 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,033 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,036 copying build/lib/colossalai/shardformer/modeling/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,039 copying build/lib/colossalai/shardformer/modeling/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,042 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,044 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,046 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,049 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,051 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,053 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,056 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-09-19T03:42:44,057 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2024-09-19T03:42:44,059 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2024-09-19T03:42:44,061 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2024-09-19T03:42:44,064 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,067 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,071 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,074 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-09-19T03:42:44,078 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2024-09-19T03:42:44,080 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2024-09-19T03:42:44,083 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2024-09-19T03:42:44,084 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-09-19T03:42:44,085 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-19T03:42:44,088 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-19T03:42:44,090 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-19T03:42:44,092 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-19T03:42:44,094 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-19T03:42:44,096 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-19T03:42:44,098 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-09-19T03:42:44,100 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2024-09-19T03:42:44,103 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-09-19T03:42:44,104 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-19T03:42:44,107 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-19T03:42:44,110 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-19T03:42:44,112 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-19T03:42:44,114 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-19T03:42:44,118 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-19T03:42:44,120 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-19T03:42:44,123 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-19T03:42:44,126 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-19T03:42:44,127 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-09-19T03:42:44,129 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2024-09-19T03:42:44,132 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2024-09-19T03:42:44,134 creating build/bdist.linux-armv7l/wheel/colossalai/context 2024-09-19T03:42:44,135 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2024-09-19T03:42:44,137 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2024-09-19T03:42:44,139 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2024-09-19T03:42:44,141 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2024-09-19T03:42:44,142 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-09-19T03:42:44,145 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-09-19T03:42:44,147 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-09-19T03:42:44,149 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-09-19T03:42:44,151 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-09-19T03:42:44,152 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-19T03:42:44,154 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-09-19T03:42:44,155 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2024-09-19T03:42:44,158 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2024-09-19T03:42:44,159 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-19T03:42:44,162 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-09-19T03:42:44,163 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-19T03:42:44,165 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-19T03:42:44,167 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-19T03:42:44,168 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-19T03:42:44,171 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-19T03:42:44,173 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-19T03:42:44,176 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-19T03:42:44,178 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-09-19T03:42:44,180 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-19T03:42:44,182 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-19T03:42:44,185 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-19T03:42:44,187 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-19T03:42:44,189 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-19T03:42:44,191 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-09-19T03:42:44,192 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2024-09-19T03:42:44,194 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2024-09-19T03:42:44,196 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2024-09-19T03:42:44,198 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-09-19T03:42:44,201 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-09-19T03:42:44,202 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-19T03:42:44,204 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-19T03:42:44,206 copying build/lib/colossalai/checkpoint_io/moe_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-19T03:42:44,209 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-19T03:42:44,211 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-19T03:42:44,214 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-19T03:42:44,216 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-09-19T03:42:44,220 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-09-19T03:42:44,221 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-09-19T03:42:44,224 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-09-19T03:42:44,225 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2024-09-19T03:42:44,227 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2024-09-19T03:42:44,229 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-09-19T03:42:44,230 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:44,231 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:44,233 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:44,235 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:44,237 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:44,239 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:44,240 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:44,242 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:44,244 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-09-19T03:42:44,246 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-09-19T03:42:44,247 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2024-09-19T03:42:44,250 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2024-09-19T03:42:44,251 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2024-09-19T03:42:44,254 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-09-19T03:42:44,255 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-09-19T03:42:44,257 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-09-19T03:42:44,259 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-09-19T03:42:44,262 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-09-19T03:42:44,264 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-09-19T03:42:44,266 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2024-09-19T03:42:44,269 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-09-19T03:42:44,270 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-09-19T03:42:44,272 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2024-09-19T03:42:44,274 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2024-09-19T03:42:44,276 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2024-09-19T03:42:44,278 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:44,279 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:44,282 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:44,284 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:44,286 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:44,288 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:44,290 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:44,292 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:44,294 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:44,296 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:44,298 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:44,300 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-09-19T03:42:44,302 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2024-09-19T03:42:44,305 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2024-09-19T03:42:44,307 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2024-09-19T03:42:44,309 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-09-19T03:42:44,310 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-19T03:42:44,313 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-19T03:42:44,315 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-19T03:42:44,317 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-19T03:42:44,319 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-19T03:42:44,321 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-19T03:42:44,323 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-19T03:42:44,325 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-09-19T03:42:44,328 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-09-19T03:42:44,329 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2024-09-19T03:42:44,330 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2024-09-19T03:42:44,333 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-09-19T03:42:44,333 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-09-19T03:42:44,336 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-09-19T03:42:44,338 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-09-19T03:42:44,341 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-09-19T03:42:44,343 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-09-19T03:42:44,344 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2024-09-19T03:42:44,346 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2024-09-19T03:42:44,348 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2024-09-19T03:42:44,350 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-09-19T03:42:44,351 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-09-19T03:42:44,354 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-09-19T03:42:44,355 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-09-19T03:42:44,357 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-09-19T03:42:44,359 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-09-19T03:42:44,361 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-09-19T03:42:44,363 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-09-19T03:42:44,365 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-09-19T03:42:44,367 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-09-19T03:42:44,369 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-09-19T03:42:44,371 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-09-19T03:42:44,372 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2024-09-19T03:42:44,374 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2024-09-19T03:42:44,377 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2024-09-19T03:42:44,379 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-09-19T03:42:44,380 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-09-19T03:42:44,382 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-09-19T03:42:44,384 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-09-19T03:42:44,386 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-09-19T03:42:44,387 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-09-19T03:42:44,388 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-09-19T03:42:44,390 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-09-19T03:42:44,392 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-09-19T03:42:44,394 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-09-19T03:42:44,397 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-09-19T03:42:44,399 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-09-19T03:42:44,400 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-09-19T03:42:44,402 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-09-19T03:42:44,405 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-09-19T03:42:44,407 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-09-19T03:42:44,410 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-09-19T03:42:44,412 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-09-19T03:42:44,414 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-09-19T03:42:44,418 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-09-19T03:42:44,422 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-09-19T03:42:44,423 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-09-19T03:42:44,425 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2024-09-19T03:42:44,428 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2024-09-19T03:42:44,431 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-09-19T03:42:44,433 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2024-09-19T03:42:44,435 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2024-09-19T03:42:44,437 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2024-09-19T03:42:44,440 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2024-09-19T03:42:44,443 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2024-09-19T03:42:44,446 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-09-19T03:42:44,447 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2024-09-19T03:42:44,450 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2024-09-19T03:42:44,454 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:44,455 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:44,458 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:44,460 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:44,463 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:44,465 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:44,468 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:44,470 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:44,473 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:44,475 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-09-19T03:42:44,478 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-09-19T03:42:44,482 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-09-19T03:42:44,484 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-09-19T03:42:44,485 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2024-09-19T03:42:44,488 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2024-09-19T03:42:44,491 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-09-19T03:42:44,493 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-09-19T03:42:44,495 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-09-19T03:42:44,498 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-09-19T03:42:44,500 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-09-19T03:42:44,502 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-09-19T03:42:44,504 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-09-19T03:42:44,507 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-19T03:42:44,510 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-19T03:42:44,513 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-19T03:42:44,515 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-19T03:42:44,517 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-19T03:42:44,519 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-19T03:42:44,522 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-09-19T03:42:44,523 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2024-09-19T03:42:44,525 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2024-09-19T03:42:44,526 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-09-19T03:42:44,529 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-09-19T03:42:44,530 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-09-19T03:42:44,532 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-09-19T03:42:44,535 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-09-19T03:42:44,537 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-09-19T03:42:44,539 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-09-19T03:42:44,541 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-09-19T03:42:44,544 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-09-19T03:42:44,545 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2024-09-19T03:42:44,547 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2024-09-19T03:42:44,549 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2024-09-19T03:42:44,551 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-09-19T03:42:44,552 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2024-09-19T03:42:44,555 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2024-09-19T03:42:44,556 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero 2024-09-19T03:42:44,558 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-09-19T03:42:44,559 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-09-19T03:42:44,561 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-09-19T03:42:44,563 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-09-19T03:42:44,565 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-09-19T03:42:44,567 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-09-19T03:42:44,569 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-09-19T03:42:44,570 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-09-19T03:42:44,572 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-09-19T03:42:44,573 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2024-09-19T03:42:44,575 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2024-09-19T03:42:44,578 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-09-19T03:42:44,579 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2024-09-19T03:42:44,581 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2024-09-19T03:42:44,583 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-09-19T03:42:44,584 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2024-09-19T03:42:44,586 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2024-09-19T03:42:44,588 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-09-19T03:42:44,589 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-09-19T03:42:44,591 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-09-19T03:42:44,593 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-09-19T03:42:44,595 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-09-19T03:42:44,599 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-09-19T03:42:44,600 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-09-19T03:42:44,603 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-09-19T03:42:44,605 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-09-19T03:42:44,606 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-09-19T03:42:44,610 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2024-09-19T03:42:44,612 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-09-19T03:42:44,613 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-09-19T03:42:44,616 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-09-19T03:42:44,618 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-09-19T03:42:44,619 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-09-19T03:42:44,623 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:44,624 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:44,626 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:44,628 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:44,630 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:44,632 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:44,634 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-09-19T03:42:44,636 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-09-19T03:42:44,637 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-09-19T03:42:44,640 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-09-19T03:42:44,642 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-09-19T03:42:44,644 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-09-19T03:42:44,647 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-09-19T03:42:44,648 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-09-19T03:42:44,651 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-09-19T03:42:44,652 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-09-19T03:42:44,654 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-09-19T03:42:44,657 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2024-09-19T03:42:44,659 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-09-19T03:42:44,660 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-09-19T03:42:44,662 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-09-19T03:42:44,664 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-09-19T03:42:44,666 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-09-19T03:42:44,669 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-09-19T03:42:44,671 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-09-19T03:42:44,672 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2024-09-19T03:42:44,674 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-09-19T03:42:44,675 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-09-19T03:42:44,678 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-09-19T03:42:44,679 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-09-19T03:42:44,681 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-09-19T03:42:44,684 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:44,685 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:44,687 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:44,689 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:44,692 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:44,694 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:44,696 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:44,698 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:44,701 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:44,703 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-09-19T03:42:44,705 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-09-19T03:42:44,706 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2024-09-19T03:42:44,708 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2024-09-19T03:42:44,710 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-09-19T03:42:44,711 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-09-19T03:42:44,713 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-09-19T03:42:44,715 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-09-19T03:42:44,717 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-09-19T03:42:44,719 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-09-19T03:42:44,721 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn 2024-09-19T03:42:44,723 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-09-19T03:42:44,724 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2024-09-19T03:42:44,726 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2024-09-19T03:42:44,728 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-09-19T03:42:44,730 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-09-19T03:42:44,732 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-09-19T03:42:44,740 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-09-19T03:42:44,742 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-09-19T03:42:44,744 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-09-19T03:42:44,746 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-09-19T03:42:44,749 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-09-19T03:42:44,750 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2024-09-19T03:42:44,752 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2024-09-19T03:42:44,755 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2024-09-19T03:42:44,757 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-09-19T03:42:44,758 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2024-09-19T03:42:44,760 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2024-09-19T03:42:44,762 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2024-09-19T03:42:44,763 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2024-09-19T03:42:44,766 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-09-19T03:42:44,767 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2024-09-19T03:42:44,770 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-09-19T03:42:44,771 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-19T03:42:44,773 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-19T03:42:44,775 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-19T03:42:44,777 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-19T03:42:44,779 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-19T03:42:44,781 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-19T03:42:44,782 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-09-19T03:42:44,785 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2024-09-19T03:42:44,787 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-09-19T03:42:44,788 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-09-19T03:42:44,791 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-09-19T03:42:44,793 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-09-19T03:42:44,795 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-09-19T03:42:44,803 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-09-19T03:42:44,805 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-09-19T03:42:44,808 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-09-19T03:42:44,810 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-09-19T03:42:44,812 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-09-19T03:42:44,813 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-09-19T03:42:44,815 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-09-19T03:42:44,818 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-09-19T03:42:44,819 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-09-19T03:42:44,822 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-09-19T03:42:44,824 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-09-19T03:42:44,826 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-09-19T03:42:44,829 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-09-19T03:42:44,832 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-09-19T03:42:44,833 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-09-19T03:42:44,834 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2024-09-19T03:42:44,837 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2024-09-19T03:42:44,838 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2024-09-19T03:42:44,841 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2024-09-19T03:42:44,843 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-09-19T03:42:44,845 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-09-19T03:42:44,847 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-09-19T03:42:44,849 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2024-09-19T03:42:44,850 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2024-09-19T03:42:44,852 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2024-09-19T03:42:44,854 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-09-19T03:42:44,855 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2024-09-19T03:42:44,857 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-09-19T03:42:44,858 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-09-19T03:42:44,861 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-09-19T03:42:44,862 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-09-19T03:42:44,865 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-09-19T03:42:44,866 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2024-09-19T03:42:44,869 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2024-09-19T03:42:44,871 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2024-09-19T03:42:44,874 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-09-19T03:42:44,874 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-09-19T03:42:44,877 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-09-19T03:42:44,879 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-09-19T03:42:44,882 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-09-19T03:42:44,883 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-09-19T03:42:44,885 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-09-19T03:42:44,887 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-09-19T03:42:44,890 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-09-19T03:42:44,891 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2024-09-19T03:42:44,893 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-09-19T03:42:44,894 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-09-19T03:42:44,897 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-09-19T03:42:44,899 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-09-19T03:42:44,901 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-09-19T03:42:44,903 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-09-19T03:42:44,905 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2024-09-19T03:42:44,906 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-09-19T03:42:44,909 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-09-19T03:42:44,910 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-09-19T03:42:44,912 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-09-19T03:42:44,914 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-09-19T03:42:44,917 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2024-09-19T03:42:44,918 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-09-19T03:42:44,919 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2024-09-19T03:42:44,921 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2024-09-19T03:42:44,923 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-09-19T03:42:44,924 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2024-09-19T03:42:44,927 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2024-09-19T03:42:44,929 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-09-19T03:42:44,931 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-09-19T03:42:44,933 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-09-19T03:42:44,935 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-09-19T03:42:44,936 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2024-09-19T03:42:44,938 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2024-09-19T03:42:44,940 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-09-19T03:42:44,941 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2024-09-19T03:42:44,943 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2024-09-19T03:42:44,945 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-09-19T03:42:44,947 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-09-19T03:42:44,948 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-09-19T03:42:44,950 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-09-19T03:42:44,951 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-09-19T03:42:44,954 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-09-19T03:42:44,956 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-09-19T03:42:44,958 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-09-19T03:42:44,961 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2024-09-19T03:42:44,962 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2024-09-19T03:42:44,964 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2024-09-19T03:42:44,967 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2024-09-19T03:42:44,968 creating build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-09-19T03:42:44,969 copying build/lib/colossalai/inference/executor/rpc_worker.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2024-09-19T03:42:44,972 copying build/lib/colossalai/inference/executor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2024-09-19T03:42:44,974 copying build/lib/colossalai/inference/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-19T03:42:44,976 creating build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-09-19T03:42:44,977 copying build/lib/colossalai/inference/server/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-09-19T03:42:44,979 copying build/lib/colossalai/inference/server/api_server.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-09-19T03:42:44,981 copying build/lib/colossalai/inference/server/completion_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-09-19T03:42:44,983 copying build/lib/colossalai/inference/server/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-09-19T03:42:44,984 copying build/lib/colossalai/inference/server/chat_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-09-19T03:42:44,986 copying build/lib/colossalai/inference/graph_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-19T03:42:44,988 copying build/lib/colossalai/inference/sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-19T03:42:44,990 copying build/lib/colossalai/inference/batch_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-19T03:42:44,993 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-09-19T03:42:44,994 copying build/lib/colossalai/inference/kv_cache/block_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2024-09-19T03:42:44,997 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2024-09-19T03:42:44,998 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2024-09-19T03:42:45,001 copying build/lib/colossalai/inference/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-19T03:42:45,004 copying build/lib/colossalai/inference/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-19T03:42:45,006 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-09-19T03:42:45,007 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-09-19T03:42:45,008 copying build/lib/colossalai/inference/modeling/layers/diffusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-09-19T03:42:45,010 copying build/lib/colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-09-19T03:42:45,012 copying build/lib/colossalai/inference/modeling/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-09-19T03:42:45,014 copying build/lib/colossalai/inference/modeling/layers/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-09-19T03:42:45,016 copying build/lib/colossalai/inference/modeling/layers/distrifusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-09-19T03:42:45,019 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-09-19T03:42:45,020 copying build/lib/colossalai/inference/modeling/policy/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-09-19T03:42:45,022 copying build/lib/colossalai/inference/modeling/policy/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-09-19T03:42:45,024 copying build/lib/colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-09-19T03:42:45,026 copying build/lib/colossalai/inference/modeling/policy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-09-19T03:42:45,028 copying build/lib/colossalai/inference/modeling/policy/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-09-19T03:42:45,030 copying build/lib/colossalai/inference/modeling/policy/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-09-19T03:42:45,033 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-09-19T03:42:45,034 copying build/lib/colossalai/inference/modeling/models/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-09-19T03:42:45,036 copying build/lib/colossalai/inference/modeling/models/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-09-19T03:42:45,038 copying build/lib/colossalai/inference/modeling/models/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-09-19T03:42:45,041 copying build/lib/colossalai/inference/modeling/models/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-09-19T03:42:45,042 copying build/lib/colossalai/inference/modeling/models/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-09-19T03:42:45,045 copying build/lib/colossalai/inference/modeling/models/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-09-19T03:42:45,048 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-09-19T03:42:45,049 copying build/lib/colossalai/inference/modeling/backends/attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2024-09-19T03:42:45,051 copying build/lib/colossalai/inference/modeling/backends/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2024-09-19T03:42:45,053 copying build/lib/colossalai/inference/modeling/backends/pre_attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2024-09-19T03:42:45,055 copying build/lib/colossalai/inference/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling 2024-09-19T03:42:45,056 copying build/lib/colossalai/inference/logit_processors.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-19T03:42:45,059 creating build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-09-19T03:42:45,059 copying build/lib/colossalai/inference/core/plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-19T03:42:45,062 copying build/lib/colossalai/inference/core/rpc_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-19T03:42:45,064 copying build/lib/colossalai/inference/core/request_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-19T03:42:45,066 copying build/lib/colossalai/inference/core/llm_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-19T03:42:45,069 copying build/lib/colossalai/inference/core/base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-19T03:42:45,071 copying build/lib/colossalai/inference/core/diffusion_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-19T03:42:45,073 copying build/lib/colossalai/inference/core/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-19T03:42:45,075 copying build/lib/colossalai/inference/core/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-19T03:42:45,077 copying build/lib/colossalai/inference/core/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-09-19T03:42:45,079 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-19T03:42:45,081 copying build/lib/colossalai/inference/flash_decoding_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-09-19T03:42:45,083 creating build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-09-19T03:42:45,084 copying build/lib/colossalai/inference/spec/drafter.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2024-09-19T03:42:45,086 copying build/lib/colossalai/inference/spec/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2024-09-19T03:42:45,088 copying build/lib/colossalai/inference/spec/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2024-09-19T03:42:45,090 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2024-09-19T03:42:45,091 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-09-19T03:42:45,092 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2024-09-19T03:42:45,094 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2024-09-19T03:42:45,096 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2024-09-19T03:42:45,098 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2024-09-19T03:42:45,100 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-09-19T03:42:45,101 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-09-19T03:42:45,103 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-09-19T03:42:45,105 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-09-19T03:42:45,107 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-09-19T03:42:45,109 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2024-09-19T03:42:45,111 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-09-19T03:42:45,113 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-09-19T03:42:45,115 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-09-19T03:42:45,117 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-09-19T03:42:45,119 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-09-19T03:42:45,121 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-09-19T03:42:45,122 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-09-19T03:42:45,124 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:45,125 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:45,126 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:45,128 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:45,130 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:45,132 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:45,133 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:45,135 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:45,137 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:45,139 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-09-19T03:42:45,141 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:45,142 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:45,144 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:45,146 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:45,148 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:45,150 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:45,152 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:45,153 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:45,155 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:45,157 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:45,159 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:45,161 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-09-19T03:42:45,163 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-09-19T03:42:45,164 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-09-19T03:42:45,166 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-09-19T03:42:45,168 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-09-19T03:42:45,170 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-19T03:42:45,172 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-19T03:42:45,174 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-19T03:42:45,176 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-19T03:42:45,178 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-19T03:42:45,180 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-19T03:42:45,182 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-19T03:42:45,185 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-09-19T03:42:45,187 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-09-19T03:42:45,188 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2024-09-19T03:42:45,191 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2024-09-19T03:42:45,194 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-09-19T03:42:45,194 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-19T03:42:45,197 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-19T03:42:45,199 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-19T03:42:45,202 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-19T03:42:45,204 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-19T03:42:45,207 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-19T03:42:45,209 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-19T03:42:45,211 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-09-19T03:42:45,214 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-09-19T03:42:45,215 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-19T03:42:45,217 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-19T03:42:45,218 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-19T03:42:45,222 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-19T03:42:45,225 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-09-19T03:42:45,226 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:45,228 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:45,230 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:45,233 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:45,235 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:45,237 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:45,240 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:45,242 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:45,244 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-09-19T03:42:45,246 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch 2024-09-19T03:42:45,248 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:45,249 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:45,252 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:45,254 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:45,256 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:45,259 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:45,261 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:45,263 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:45,265 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-09-19T03:42:45,267 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-19T03:42:45,270 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-19T03:42:45,274 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-09-19T03:42:45,275 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-19T03:42:45,276 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-19T03:42:45,278 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-19T03:42:45,281 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-19T03:42:45,283 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-19T03:42:45,285 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-09-19T03:42:45,288 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-19T03:42:45,289 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-19T03:42:45,292 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-19T03:42:45,294 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-19T03:42:45,296 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-09-19T03:42:45,298 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch 2024-09-19T03:42:45,300 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-09-19T03:42:45,302 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-09-19T03:42:45,304 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-09-19T03:42:45,307 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2024-09-19T03:42:45,308 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2024-09-19T03:42:45,312 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-09-19T03:42:45,313 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-19T03:42:45,316 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-19T03:42:45,320 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:45,321 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:45,323 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:45,325 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:45,327 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:45,329 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:45,331 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:45,333 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:45,334 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:45,336 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-09-19T03:42:45,339 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-19T03:42:45,341 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-09-19T03:42:45,342 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-09-19T03:42:45,344 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-09-19T03:42:45,346 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-09-19T03:42:45,348 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-09-19T03:42:45,351 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-09-19T03:42:45,353 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-19T03:42:45,355 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-19T03:42:45,357 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-19T03:42:45,359 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-09-19T03:42:45,362 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-09-19T03:42:45,363 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-09-19T03:42:45,364 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-09-19T03:42:45,366 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-09-19T03:42:45,368 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-09-19T03:42:45,370 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-09-19T03:42:45,372 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-09-19T03:42:45,374 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-09-19T03:42:45,377 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-09-19T03:42:45,378 copying build/lib/colossalai/zero/low_level/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-09-19T03:42:45,380 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-09-19T03:42:45,382 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2024-09-19T03:42:45,384 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2024-09-19T03:42:45,385 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-09-19T03:42:45,386 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-09-19T03:42:45,388 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-09-19T03:42:45,390 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-09-19T03:42:45,392 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-09-19T03:42:45,394 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-09-19T03:42:45,395 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/loss 2024-09-19T03:42:45,397 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-09-19T03:42:45,397 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-19T03:42:45,399 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-19T03:42:45,402 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-19T03:42:45,403 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-19T03:42:45,405 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-19T03:42:45,407 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-19T03:42:45,409 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-19T03:42:45,411 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-09-19T03:42:45,413 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-09-19T03:42:45,414 copying build/lib/colossalai/nn/optimizer/distributed_adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,417 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,419 copying build/lib/colossalai/nn/optimizer/distributed_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,421 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,423 copying build/lib/colossalai/nn/optimizer/distributed_galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,426 copying build/lib/colossalai/nn/optimizer/galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,428 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,430 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,432 copying build/lib/colossalai/nn/optimizer/came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,434 copying build/lib/colossalai/nn/optimizer/distributed_came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,437 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,439 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,441 copying build/lib/colossalai/nn/optimizer/adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,443 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,445 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,447 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-09-19T03:42:45,449 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2024-09-19T03:42:45,451 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2024-09-19T03:42:45,454 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-09-19T03:42:45,455 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-09-19T03:42:45,457 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-09-19T03:42:45,459 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-09-19T03:42:45,462 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-09-19T03:42:45,464 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-09-19T03:42:45,466 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai 2024-09-19T03:42:45,468 creating build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-09-19T03:42:45,469 copying build/lib/colossalai/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-09-19T03:42:45,471 copying build/lib/colossalai/quantization/bnb_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-09-19T03:42:45,473 copying build/lib/colossalai/quantization/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-09-19T03:42:45,476 copying build/lib/colossalai/quantization/fp8_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-09-19T03:42:45,478 copying build/lib/colossalai/quantization/bnb.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-09-19T03:42:45,480 copying build/lib/colossalai/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-09-19T03:42:45,482 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2024-09-19T03:42:45,483 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_C 2024-09-19T03:42:45,485 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2024-09-19T03:42:45,487 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-09-19T03:42:45,488 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-19T03:42:45,489 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-19T03:42:45,491 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-19T03:42:45,493 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-19T03:42:45,495 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-09-19T03:42:45,497 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-09-19T03:42:45,498 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-09-19T03:42:45,501 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-09-19T03:42:45,502 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-09-19T03:42:45,504 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-09-19T03:42:45,506 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2024-09-19T03:42:45,507 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2024-09-19T03:42:45,509 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp 2024-09-19T03:42:45,511 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-09-19T03:42:45,512 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-09-19T03:42:45,513 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-19T03:42:45,516 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-19T03:42:45,518 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-19T03:42:45,520 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-19T03:42:45,522 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-19T03:42:45,525 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-19T03:42:45,527 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-19T03:42:45,529 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-19T03:42:45,531 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-19T03:42:45,533 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-09-19T03:42:45,535 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-09-19T03:42:45,537 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,538 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,540 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,542 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,545 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,546 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,548 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,550 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,552 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,553 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,555 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,557 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,559 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,561 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,563 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,565 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,567 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,568 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,571 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,573 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,576 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,578 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,580 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,583 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,585 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,587 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,589 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,591 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,594 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,596 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,598 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,600 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,602 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,604 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,606 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,609 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-09-19T03:42:45,611 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,612 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,614 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,616 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,618 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,620 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,621 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,623 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,626 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,628 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,630 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,632 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-09-19T03:42:45,634 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-09-19T03:42:45,637 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:45,637 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:45,639 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:45,642 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:45,644 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:45,646 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:45,648 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-09-19T03:42:45,650 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-09-19T03:42:45,651 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-09-19T03:42:45,654 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-09-19T03:42:45,656 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-09-19T03:42:45,658 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-09-19T03:42:45,660 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-09-19T03:42:45,662 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-09-19T03:42:45,665 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-09-19T03:42:45,666 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-09-19T03:42:45,668 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-09-19T03:42:45,670 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-09-19T03:42:45,671 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-09-19T03:42:45,673 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-09-19T03:42:45,676 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-09-19T03:42:45,678 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-09-19T03:42:45,680 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-09-19T03:42:45,682 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-09-19T03:42:45,684 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-09-19T03:42:45,685 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-09-19T03:42:45,687 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-09-19T03:42:45,689 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-09-19T03:42:45,691 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:45,692 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:45,694 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:45,696 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:45,698 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:45,699 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:45,702 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:45,704 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:45,706 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:45,708 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:45,710 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:45,713 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-09-19T03:42:45,715 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-09-19T03:42:45,718 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel 2024-09-19T03:42:45,719 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-09-19T03:42:45,720 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/pipeline_shard 2024-09-19T03:42:45,722 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-09-19T03:42:45,723 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-09-19T03:42:45,725 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-09-19T03:42:45,727 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-09-19T03:42:45,730 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-09-19T03:42:45,731 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-09-19T03:42:45,733 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-09-19T03:42:45,736 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-09-19T03:42:45,737 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-09-19T03:42:45,739 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-09-19T03:42:45,741 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-09-19T03:42:45,743 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-09-19T03:42:45,746 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-09-19T03:42:45,746 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2024-09-19T03:42:45,749 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2024-09-19T03:42:45,752 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2024-09-19T03:42:45,754 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-09-19T03:42:45,755 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-09-19T03:42:45,758 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-09-19T03:42:45,759 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-09-19T03:42:45,762 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-09-19T03:42:45,764 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-09-19T03:42:45,767 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-09-19T03:42:45,770 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-09-19T03:42:45,771 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-09-19T03:42:45,772 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-09-19T03:42:45,774 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-09-19T03:42:45,776 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-09-19T03:42:45,777 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-09-19T03:42:45,779 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2024-09-19T03:42:45,781 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-09-19T03:42:45,782 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-19T03:42:45,785 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-19T03:42:45,787 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-19T03:42:45,789 copying build/lib/colossalai/kernel/triton/kvcache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-19T03:42:45,797 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-19T03:42:45,799 copying build/lib/colossalai/kernel/triton/rms_layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-19T03:42:45,801 copying build/lib/colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-19T03:42:45,804 copying build/lib/colossalai/kernel/triton/rotary_cache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-19T03:42:45,806 copying build/lib/colossalai/kernel/triton/context_attn_unpad.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-19T03:42:45,808 copying build/lib/colossalai/kernel/triton/fused_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-19T03:42:45,810 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-09-19T03:42:45,813 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-09-19T03:42:45,814 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-09-19T03:42:45,816 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-09-19T03:42:45,818 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-09-19T03:42:45,820 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-09-19T03:42:45,821 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-09-19T03:42:45,823 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-09-19T03:42:45,825 copying build/lib/colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-09-19T03:42:45,827 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-09-19T03:42:45,829 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-09-19T03:42:45,831 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-09-19T03:42:45,833 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2024-09-19T03:42:45,834 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2024-09-19T03:42:45,837 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2024-09-19T03:42:45,839 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-09-19T03:42:45,840 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2024-09-19T03:42:45,842 copying build/lib/colossalai/kernel/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2024-09-19T03:42:45,843 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2024-09-19T03:42:45,846 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-09-19T03:42:45,846 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-09-19T03:42:45,848 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-09-19T03:42:45,850 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-09-19T03:42:45,852 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-09-19T03:42:45,854 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-09-19T03:42:45,855 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2024-09-19T03:42:45,857 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2024-09-19T03:42:45,859 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2024-09-19T03:42:45,861 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-09-19T03:42:45,862 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2024-09-19T03:42:45,865 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2024-09-19T03:42:45,866 copying build/lib/colossalai/kernel/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2024-09-19T03:42:45,869 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-09-19T03:42:45,870 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2024-09-19T03:42:45,872 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2024-09-19T03:42:45,874 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2024-09-19T03:42:45,875 copying build/lib/colossalai/kernel/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind 2024-09-19T03:42:45,877 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-09-19T03:42:45,879 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-09-19T03:42:45,881 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-09-19T03:42:45,883 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-09-19T03:42:45,885 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-09-19T03:42:45,886 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-09-19T03:42:45,887 copying build/lib/colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-09-19T03:42:45,889 copying build/lib/colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-09-19T03:42:45,891 copying build/lib/colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-09-19T03:42:45,894 copying build/lib/colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-09-19T03:42:45,896 copying build/lib/colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-09-19T03:42:45,898 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc 2024-09-19T03:42:45,900 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-09-19T03:42:45,901 copying build/lib/colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-09-19T03:42:45,903 copying build/lib/colossalai/kernel/extensions/csrc/common/data_type.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-09-19T03:42:45,905 copying build/lib/colossalai/kernel/extensions/csrc/common/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-09-19T03:42:45,908 copying build/lib/colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-09-19T03:42:45,910 copying build/lib/colossalai/kernel/extensions/csrc/common/target.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-09-19T03:42:45,912 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel 2024-09-19T03:42:45,913 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-09-19T03:42:45,914 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2024-09-19T03:42:45,917 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2024-09-19T03:42:45,920 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,921 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,924 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,926 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,929 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,932 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,934 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,937 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-19T03:42:45,938 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-19T03:42:45,940 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-19T03:42:45,942 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-19T03:42:45,943 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-09-19T03:42:45,945 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,947 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,949 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,951 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,954 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-09-19T03:42:45,955 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-09-19T03:42:45,957 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,960 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,962 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,965 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,967 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,970 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,972 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,975 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-09-19T03:42:45,977 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-09-19T03:42:45,978 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2024-09-19T03:42:45,981 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2024-09-19T03:42:45,983 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2024-09-19T03:42:45,984 running install_egg_info 2024-09-19T03:42:46,016 running egg_info 2024-09-19T03:42:46,052 writing colossalai.egg-info/PKG-INFO 2024-09-19T03:42:46,058 writing dependency_links to colossalai.egg-info/dependency_links.txt 2024-09-19T03:42:46,060 writing entry points to colossalai.egg-info/entry_points.txt 2024-09-19T03:42:46,062 writing requirements to colossalai.egg-info/requires.txt 2024-09-19T03:42:46,064 writing top-level names to colossalai.egg-info/top_level.txt 2024-09-19T03:42:46,329 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2024-09-19T03:42:46,411 reading manifest template 'MANIFEST.in' 2024-09-19T03:42:47,689 warning: no files found matching '*.tr' under directory 'colossalai' 2024-09-19T03:42:48,310 warning: no files found matching '*.cc' under directory 'colossalai' 2024-09-19T03:42:48,642 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-09-19T03:42:48,778 warning: no files found matching '*.tr' under directory 'extensions' 2024-09-19T03:42:48,836 warning: no files found matching '*.cc' under directory 'extensions' 2024-09-19T03:42:48,863 warning: no files found matching '*.pyi' under directory 'extensions' 2024-09-19T03:42:48,864 adding license file 'LICENSE' 2024-09-19T03:42:48,911 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2024-09-19T03:42:48,914 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/./colossalai-0.4.4-py3.11.egg-info 2024-09-19T03:42:48,927 running install_scripts 2024-09-19T03:42:48,951 creating build/bdist.linux-armv7l/wheel/colossalai-0.4.4.dist-info/WHEEL 2024-09-19T03:42:48,954 creating '/tmp/pip-wheel-41ximyzw/colossalai-0.4.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-09-19T03:42:48,956 adding 'colossalai/__init__.py' 2024-09-19T03:42:48,958 adding 'colossalai/initialize.py' 2024-09-19T03:42:48,959 adding 'colossalai/version.py' 2024-09-19T03:42:48,961 adding 'colossalai/_C/__init__.py' 2024-09-19T03:42:48,962 adding 'colossalai/_analyzer/__init__.py' 2024-09-19T03:42:48,963 adding 'colossalai/_analyzer/envs.py' 2024-09-19T03:42:48,965 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2024-09-19T03:42:48,968 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2024-09-19T03:42:48,969 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2024-09-19T03:42:48,972 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2024-09-19T03:42:48,974 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2024-09-19T03:42:48,975 adding 'colossalai/_analyzer/fx/__init__.py' 2024-09-19T03:42:48,978 adding 'colossalai/_analyzer/fx/codegen.py' 2024-09-19T03:42:48,980 adding 'colossalai/_analyzer/fx/graph_module.py' 2024-09-19T03:42:48,982 adding 'colossalai/_analyzer/fx/node_util.py' 2024-09-19T03:42:48,983 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2024-09-19T03:42:48,985 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2024-09-19T03:42:48,987 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2024-09-19T03:42:48,989 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2024-09-19T03:42:48,991 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2024-09-19T03:42:48,992 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2024-09-19T03:42:48,993 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2024-09-19T03:42:48,995 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2024-09-19T03:42:48,996 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2024-09-19T03:42:48,998 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2024-09-19T03:42:49,000 adding 'colossalai/accelerator/__init__.py' 2024-09-19T03:42:49,001 adding 'colossalai/accelerator/api.py' 2024-09-19T03:42:49,003 adding 'colossalai/accelerator/base_accelerator.py' 2024-09-19T03:42:49,005 adding 'colossalai/accelerator/cpu_accelerator.py' 2024-09-19T03:42:49,006 adding 'colossalai/accelerator/cuda_accelerator.py' 2024-09-19T03:42:49,008 adding 'colossalai/accelerator/npu_accelerator.py' 2024-09-19T03:42:49,010 adding 'colossalai/amp/__init__.py' 2024-09-19T03:42:49,011 adding 'colossalai/amp/naive_amp/__init__.py' 2024-09-19T03:42:49,013 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2024-09-19T03:42:49,014 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2024-09-19T03:42:49,015 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2024-09-19T03:42:49,017 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2024-09-19T03:42:49,018 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2024-09-19T03:42:49,020 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2024-09-19T03:42:49,021 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2024-09-19T03:42:49,023 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2024-09-19T03:42:49,024 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2024-09-19T03:42:49,026 adding 'colossalai/auto_parallel/__init__.py' 2024-09-19T03:42:49,027 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2024-09-19T03:42:49,028 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2024-09-19T03:42:49,030 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2024-09-19T03:42:49,032 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2024-09-19T03:42:49,034 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2024-09-19T03:42:49,036 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2024-09-19T03:42:49,037 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2024-09-19T03:42:49,039 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2024-09-19T03:42:49,040 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2024-09-19T03:42:49,041 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2024-09-19T03:42:49,043 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2024-09-19T03:42:49,045 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2024-09-19T03:42:49,046 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2024-09-19T03:42:49,047 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2024-09-19T03:42:49,049 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2024-09-19T03:42:49,051 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2024-09-19T03:42:49,053 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2024-09-19T03:42:49,054 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2024-09-19T03:42:49,056 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2024-09-19T03:42:49,057 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2024-09-19T03:42:49,059 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2024-09-19T03:42:49,061 adding 'colossalai/auto_parallel/offload/__init__.py' 2024-09-19T03:42:49,062 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2024-09-19T03:42:49,064 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2024-09-19T03:42:49,065 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2024-09-19T03:42:49,066 adding 'colossalai/auto_parallel/offload/region.py' 2024-09-19T03:42:49,069 adding 'colossalai/auto_parallel/offload/region_manager.py' 2024-09-19T03:42:49,071 adding 'colossalai/auto_parallel/offload/runtime.py' 2024-09-19T03:42:49,073 adding 'colossalai/auto_parallel/offload/solver.py' 2024-09-19T03:42:49,075 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2024-09-19T03:42:49,077 adding 'colossalai/auto_parallel/offload/util.py' 2024-09-19T03:42:49,078 adding 'colossalai/auto_parallel/passes/__init__.py' 2024-09-19T03:42:49,079 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2024-09-19T03:42:49,081 adding 'colossalai/auto_parallel/passes/constants.py' 2024-09-19T03:42:49,082 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2024-09-19T03:42:49,084 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2024-09-19T03:42:49,087 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2024-09-19T03:42:49,089 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2024-09-19T03:42:49,090 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2024-09-19T03:42:49,092 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2024-09-19T03:42:49,094 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2024-09-19T03:42:49,096 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2024-09-19T03:42:49,098 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2024-09-19T03:42:49,100 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2024-09-19T03:42:49,101 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2024-09-19T03:42:49,103 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2024-09-19T03:42:49,104 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2024-09-19T03:42:49,106 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2024-09-19T03:42:49,107 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2024-09-19T03:42:49,108 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2024-09-19T03:42:49,110 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2024-09-19T03:42:49,111 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2024-09-19T03:42:49,113 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2024-09-19T03:42:49,114 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2024-09-19T03:42:49,116 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2024-09-19T03:42:49,118 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2024-09-19T03:42:49,121 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2024-09-19T03:42:49,122 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2024-09-19T03:42:49,123 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2024-09-19T03:42:49,125 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2024-09-19T03:42:49,126 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2024-09-19T03:42:49,127 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2024-09-19T03:42:49,129 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2024-09-19T03:42:49,130 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2024-09-19T03:42:49,131 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2024-09-19T03:42:49,133 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2024-09-19T03:42:49,134 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2024-09-19T03:42:49,135 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2024-09-19T03:42:49,136 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2024-09-19T03:42:49,138 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2024-09-19T03:42:49,140 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2024-09-19T03:42:49,142 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2024-09-19T03:42:49,143 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2024-09-19T03:42:49,145 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2024-09-19T03:42:49,147 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2024-09-19T03:42:49,149 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2024-09-19T03:42:49,151 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2024-09-19T03:42:49,153 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2024-09-19T03:42:49,157 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2024-09-19T03:42:49,159 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2024-09-19T03:42:49,161 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2024-09-19T03:42:49,163 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2024-09-19T03:42:49,166 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2024-09-19T03:42:49,168 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2024-09-19T03:42:49,171 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2024-09-19T03:42:49,173 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2024-09-19T03:42:49,175 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2024-09-19T03:42:49,177 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2024-09-19T03:42:49,179 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2024-09-19T03:42:49,181 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2024-09-19T03:42:49,184 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2024-09-19T03:42:49,186 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2024-09-19T03:42:49,190 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2024-09-19T03:42:49,192 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2024-09-19T03:42:49,194 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2024-09-19T03:42:49,197 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2024-09-19T03:42:49,199 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2024-09-19T03:42:49,201 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2024-09-19T03:42:49,203 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2024-09-19T03:42:49,205 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2024-09-19T03:42:49,207 adding 'colossalai/booster/__init__.py' 2024-09-19T03:42:49,209 adding 'colossalai/booster/accelerator.py' 2024-09-19T03:42:49,213 adding 'colossalai/booster/booster.py' 2024-09-19T03:42:49,215 adding 'colossalai/booster/mixed_precision/__init__.py' 2024-09-19T03:42:49,217 adding 'colossalai/booster/mixed_precision/bf16.py' 2024-09-19T03:42:49,218 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2024-09-19T03:42:49,220 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2024-09-19T03:42:49,221 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2024-09-19T03:42:49,223 adding 'colossalai/booster/mixed_precision/fp8.py' 2024-09-19T03:42:49,224 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2024-09-19T03:42:49,226 adding 'colossalai/booster/plugin/__init__.py' 2024-09-19T03:42:49,228 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2024-09-19T03:42:49,233 adding 'colossalai/booster/plugin/gemini_plugin.py' 2024-09-19T03:42:49,243 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2024-09-19T03:42:49,247 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2024-09-19T03:42:49,251 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2024-09-19T03:42:49,252 adding 'colossalai/booster/plugin/plugin_base.py' 2024-09-19T03:42:49,253 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2024-09-19T03:42:49,255 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2024-09-19T03:42:49,257 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2024-09-19T03:42:49,259 adding 'colossalai/checkpoint_io/__init__.py' 2024-09-19T03:42:49,261 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2024-09-19T03:42:49,262 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2024-09-19T03:42:49,267 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2024-09-19T03:42:49,268 adding 'colossalai/checkpoint_io/index_file.py' 2024-09-19T03:42:49,272 adding 'colossalai/checkpoint_io/moe_checkpoint.py' 2024-09-19T03:42:49,276 adding 'colossalai/checkpoint_io/utils.py' 2024-09-19T03:42:49,278 adding 'colossalai/cli/__init__.py' 2024-09-19T03:42:49,279 adding 'colossalai/cli/cli.py' 2024-09-19T03:42:49,281 adding 'colossalai/cli/check/__init__.py' 2024-09-19T03:42:49,283 adding 'colossalai/cli/check/check_installation.py' 2024-09-19T03:42:49,285 adding 'colossalai/cli/launcher/__init__.py' 2024-09-19T03:42:49,286 adding 'colossalai/cli/launcher/hostinfo.py' 2024-09-19T03:42:49,287 adding 'colossalai/cli/launcher/multinode_runner.py' 2024-09-19T03:42:49,289 adding 'colossalai/cli/launcher/run.py' 2024-09-19T03:42:49,291 adding 'colossalai/cluster/__init__.py' 2024-09-19T03:42:49,292 adding 'colossalai/cluster/device_mesh_manager.py' 2024-09-19T03:42:49,294 adding 'colossalai/cluster/dist_coordinator.py' 2024-09-19T03:42:49,295 adding 'colossalai/cluster/process_group_manager.py' 2024-09-19T03:42:49,297 adding 'colossalai/cluster/process_group_mesh.py' 2024-09-19T03:42:49,299 adding 'colossalai/context/__init__.py' 2024-09-19T03:42:49,300 adding 'colossalai/context/config.py' 2024-09-19T03:42:49,301 adding 'colossalai/context/singleton_meta.py' 2024-09-19T03:42:49,303 adding 'colossalai/device/__init__.py' 2024-09-19T03:42:49,305 adding 'colossalai/device/alpha_beta_profiler.py' 2024-09-19T03:42:49,307 adding 'colossalai/device/calc_pipeline_strategy.py' 2024-09-19T03:42:49,310 adding 'colossalai/device/device_mesh.py' 2024-09-19T03:42:49,312 adding 'colossalai/fx/__init__.py' 2024-09-19T03:42:49,313 adding 'colossalai/fx/_compatibility.py' 2024-09-19T03:42:49,315 adding 'colossalai/fx/_meta_regist_12.py' 2024-09-19T03:42:49,317 adding 'colossalai/fx/_meta_regist_13.py' 2024-09-19T03:42:49,318 adding 'colossalai/fx/graph_module.py' 2024-09-19T03:42:49,320 adding 'colossalai/fx/proxy.py' 2024-09-19T03:42:49,321 adding 'colossalai/fx/codegen/__init__.py' 2024-09-19T03:42:49,326 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2024-09-19T03:42:49,328 adding 'colossalai/fx/passes/__init__.py' 2024-09-19T03:42:49,330 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2024-09-19T03:42:49,332 adding 'colossalai/fx/passes/concrete_info_prop.py' 2024-09-19T03:42:49,334 adding 'colossalai/fx/passes/meta_info_prop.py' 2024-09-19T03:42:49,336 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2024-09-19T03:42:49,338 adding 'colossalai/fx/passes/shard_1d_pass.py' 2024-09-19T03:42:49,340 adding 'colossalai/fx/passes/split_module.py' 2024-09-19T03:42:49,341 adding 'colossalai/fx/passes/utils.py' 2024-09-19T03:42:49,343 adding 'colossalai/fx/profiler/__init__.py' 2024-09-19T03:42:49,344 adding 'colossalai/fx/profiler/constants.py' 2024-09-19T03:42:49,346 adding 'colossalai/fx/profiler/dataflow.py' 2024-09-19T03:42:49,347 adding 'colossalai/fx/profiler/memory_utils.py' 2024-09-19T03:42:49,349 adding 'colossalai/fx/profiler/opcount.py' 2024-09-19T03:42:49,351 adding 'colossalai/fx/profiler/profiler.py' 2024-09-19T03:42:49,353 adding 'colossalai/fx/profiler/shard_utils.py' 2024-09-19T03:42:49,354 adding 'colossalai/fx/profiler/tensor.py' 2024-09-19T03:42:49,355 adding 'colossalai/fx/profiler/experimental/__init__.py' 2024-09-19T03:42:49,357 adding 'colossalai/fx/profiler/experimental/constants.py' 2024-09-19T03:42:49,359 adding 'colossalai/fx/profiler/experimental/profiler.py' 2024-09-19T03:42:49,360 adding 'colossalai/fx/profiler/experimental/registry.py' 2024-09-19T03:42:49,361 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2024-09-19T03:42:49,363 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2024-09-19T03:42:49,364 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2024-09-19T03:42:49,366 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2024-09-19T03:42:49,367 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2024-09-19T03:42:49,368 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2024-09-19T03:42:49,369 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2024-09-19T03:42:49,371 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2024-09-19T03:42:49,372 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2024-09-19T03:42:49,373 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2024-09-19T03:42:49,375 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2024-09-19T03:42:49,376 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2024-09-19T03:42:49,378 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2024-09-19T03:42:49,379 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2024-09-19T03:42:49,380 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2024-09-19T03:42:49,381 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2024-09-19T03:42:49,383 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2024-09-19T03:42:49,384 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2024-09-19T03:42:49,385 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2024-09-19T03:42:49,386 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2024-09-19T03:42:49,387 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2024-09-19T03:42:49,390 adding 'colossalai/fx/tracer/__init__.py' 2024-09-19T03:42:49,391 adding 'colossalai/fx/tracer/_meta_trace.py' 2024-09-19T03:42:49,392 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2024-09-19T03:42:49,394 adding 'colossalai/fx/tracer/_tracer_utils.py' 2024-09-19T03:42:49,397 adding 'colossalai/fx/tracer/experimental.py' 2024-09-19T03:42:49,398 adding 'colossalai/fx/tracer/registry.py' 2024-09-19T03:42:49,401 adding 'colossalai/fx/tracer/tracer.py' 2024-09-19T03:42:49,403 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2024-09-19T03:42:49,405 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2024-09-19T03:42:49,406 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2024-09-19T03:42:49,407 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2024-09-19T03:42:49,409 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2024-09-19T03:42:49,410 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2024-09-19T03:42:49,411 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2024-09-19T03:42:49,413 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2024-09-19T03:42:49,414 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2024-09-19T03:42:49,415 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2024-09-19T03:42:49,416 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2024-09-19T03:42:49,418 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2024-09-19T03:42:49,419 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2024-09-19T03:42:49,420 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2024-09-19T03:42:49,422 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2024-09-19T03:42:49,423 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2024-09-19T03:42:49,424 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2024-09-19T03:42:49,425 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2024-09-19T03:42:49,427 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2024-09-19T03:42:49,429 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2024-09-19T03:42:49,430 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2024-09-19T03:42:49,431 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2024-09-19T03:42:49,432 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2024-09-19T03:42:49,433 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2024-09-19T03:42:49,435 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2024-09-19T03:42:49,436 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2024-09-19T03:42:49,437 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2024-09-19T03:42:49,439 adding 'colossalai/inference/__init__.py' 2024-09-19T03:42:49,442 adding 'colossalai/inference/batch_bucket.py' 2024-09-19T03:42:49,445 adding 'colossalai/inference/config.py' 2024-09-19T03:42:49,447 adding 'colossalai/inference/flash_decoding_utils.py' 2024-09-19T03:42:49,448 adding 'colossalai/inference/graph_runner.py' 2024-09-19T03:42:49,450 adding 'colossalai/inference/logit_processors.py' 2024-09-19T03:42:49,451 adding 'colossalai/inference/sampler.py' 2024-09-19T03:42:49,453 adding 'colossalai/inference/struct.py' 2024-09-19T03:42:49,454 adding 'colossalai/inference/utils.py' 2024-09-19T03:42:49,456 adding 'colossalai/inference/core/__init__.py' 2024-09-19T03:42:49,458 adding 'colossalai/inference/core/async_engine.py' 2024-09-19T03:42:49,459 adding 'colossalai/inference/core/base_engine.py' 2024-09-19T03:42:49,461 adding 'colossalai/inference/core/diffusion_engine.py' 2024-09-19T03:42:49,462 adding 'colossalai/inference/core/engine.py' 2024-09-19T03:42:49,466 adding 'colossalai/inference/core/llm_engine.py' 2024-09-19T03:42:49,468 adding 'colossalai/inference/core/plugin.py' 2024-09-19T03:42:49,471 adding 'colossalai/inference/core/request_handler.py' 2024-09-19T03:42:49,473 adding 'colossalai/inference/core/rpc_engine.py' 2024-09-19T03:42:49,474 adding 'colossalai/inference/executor/__init__.py' 2024-09-19T03:42:49,476 adding 'colossalai/inference/executor/rpc_worker.py' 2024-09-19T03:42:49,478 adding 'colossalai/inference/kv_cache/__init__.py' 2024-09-19T03:42:49,479 adding 'colossalai/inference/kv_cache/block_cache.py' 2024-09-19T03:42:49,482 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2024-09-19T03:42:49,484 adding 'colossalai/inference/modeling/__init__.py' 2024-09-19T03:42:49,485 adding 'colossalai/inference/modeling/backends/__init__.py' 2024-09-19T03:42:49,486 adding 'colossalai/inference/modeling/backends/attention_backend.py' 2024-09-19T03:42:49,488 adding 'colossalai/inference/modeling/backends/pre_attention_backend.py' 2024-09-19T03:42:49,489 adding 'colossalai/inference/modeling/layers/__init__.py' 2024-09-19T03:42:49,491 adding 'colossalai/inference/modeling/layers/attention.py' 2024-09-19T03:42:49,492 adding 'colossalai/inference/modeling/layers/baichuan_tp_linear.py' 2024-09-19T03:42:49,494 adding 'colossalai/inference/modeling/layers/diffusion.py' 2024-09-19T03:42:49,497 adding 'colossalai/inference/modeling/layers/distrifusion.py' 2024-09-19T03:42:49,498 adding 'colossalai/inference/modeling/models/__init__.py' 2024-09-19T03:42:49,501 adding 'colossalai/inference/modeling/models/glide_llama.py' 2024-09-19T03:42:49,503 adding 'colossalai/inference/modeling/models/nopadding_baichuan.py' 2024-09-19T03:42:49,506 adding 'colossalai/inference/modeling/models/nopadding_llama.py' 2024-09-19T03:42:49,508 adding 'colossalai/inference/modeling/models/pixart_alpha.py' 2024-09-19T03:42:49,509 adding 'colossalai/inference/modeling/models/stablediffusion3.py' 2024-09-19T03:42:49,511 adding 'colossalai/inference/modeling/policy/__init__.py' 2024-09-19T03:42:49,512 adding 'colossalai/inference/modeling/policy/glide_llama.py' 2024-09-19T03:42:49,514 adding 'colossalai/inference/modeling/policy/nopadding_baichuan.py' 2024-09-19T03:42:49,515 adding 'colossalai/inference/modeling/policy/nopadding_llama.py' 2024-09-19T03:42:49,516 adding 'colossalai/inference/modeling/policy/pixart_alpha.py' 2024-09-19T03:42:49,518 adding 'colossalai/inference/modeling/policy/stablediffusion3.py' 2024-09-19T03:42:49,519 adding 'colossalai/inference/server/__init__.py' 2024-09-19T03:42:49,521 adding 'colossalai/inference/server/api_server.py' 2024-09-19T03:42:49,522 adding 'colossalai/inference/server/chat_service.py' 2024-09-19T03:42:49,524 adding 'colossalai/inference/server/completion_service.py' 2024-09-19T03:42:49,525 adding 'colossalai/inference/server/utils.py' 2024-09-19T03:42:49,527 adding 'colossalai/inference/spec/__init__.py' 2024-09-19T03:42:49,528 adding 'colossalai/inference/spec/drafter.py' 2024-09-19T03:42:49,529 adding 'colossalai/inference/spec/struct.py' 2024-09-19T03:42:49,531 adding 'colossalai/interface/__init__.py' 2024-09-19T03:42:49,532 adding 'colossalai/interface/model.py' 2024-09-19T03:42:49,534 adding 'colossalai/interface/optimizer.py' 2024-09-19T03:42:49,535 adding 'colossalai/interface/pretrained.py' 2024-09-19T03:42:49,536 adding 'colossalai/kernel/__init__.py' 2024-09-19T03:42:49,538 adding 'colossalai/kernel/kernel_loader.py' 2024-09-19T03:42:49,540 adding 'colossalai/kernel/extensions/__init__.py' 2024-09-19T03:42:49,541 adding 'colossalai/kernel/extensions/base_extension.py' 2024-09-19T03:42:49,543 adding 'colossalai/kernel/extensions/cpp_extension.py' 2024-09-19T03:42:49,544 adding 'colossalai/kernel/extensions/cuda_extension.py' 2024-09-19T03:42:49,545 adding 'colossalai/kernel/extensions/triton_extension.py' 2024-09-19T03:42:49,547 adding 'colossalai/kernel/extensions/utils.py' 2024-09-19T03:42:49,548 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2024-09-19T03:42:49,550 adding 'colossalai/kernel/extensions/csrc/common/data_type.h' 2024-09-19T03:42:49,552 adding 'colossalai/kernel/extensions/csrc/common/micros.h' 2024-09-19T03:42:49,553 adding 'colossalai/kernel/extensions/csrc/common/mp_type_traits.h' 2024-09-19T03:42:49,555 adding 'colossalai/kernel/extensions/csrc/common/target.h' 2024-09-19T03:42:49,556 adding 'colossalai/kernel/extensions/csrc/common/vec_type_traits.h' 2024-09-19T03:42:49,558 adding 'colossalai/kernel/extensions/csrc/funcs/binary_functor.h' 2024-09-19T03:42:49,560 adding 'colossalai/kernel/extensions/csrc/funcs/cast_functor.h' 2024-09-19T03:42:49,562 adding 'colossalai/kernel/extensions/csrc/funcs/reduce_function.h' 2024-09-19T03:42:49,563 adding 'colossalai/kernel/extensions/csrc/funcs/ternary_functor.h' 2024-09-19T03:42:49,564 adding 'colossalai/kernel/extensions/csrc/funcs/unary_functor.h' 2024-09-19T03:42:49,567 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp' 2024-09-19T03:42:49,568 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h' 2024-09-19T03:42:49,570 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu' 2024-09-19T03:42:49,572 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu' 2024-09-19T03:42:49,573 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu' 2024-09-19T03:42:49,575 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu' 2024-09-19T03:42:49,578 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu' 2024-09-19T03:42:49,581 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu' 2024-09-19T03:42:49,582 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu' 2024-09-19T03:42:49,585 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu' 2024-09-19T03:42:49,588 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu' 2024-09-19T03:42:49,589 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu' 2024-09-19T03:42:49,591 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh' 2024-09-19T03:42:49,593 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu' 2024-09-19T03:42:49,595 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu' 2024-09-19T03:42:49,596 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu' 2024-09-19T03:42:49,598 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu' 2024-09-19T03:42:49,600 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu' 2024-09-19T03:42:49,602 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu' 2024-09-19T03:42:49,604 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu' 2024-09-19T03:42:49,607 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h' 2024-09-19T03:42:49,608 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h' 2024-09-19T03:42:49,610 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h' 2024-09-19T03:42:49,611 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h' 2024-09-19T03:42:49,612 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h' 2024-09-19T03:42:49,615 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp' 2024-09-19T03:42:49,616 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h' 2024-09-19T03:42:49,618 adding 'colossalai/kernel/extensions/pybind/__init__.py' 2024-09-19T03:42:49,620 adding 'colossalai/kernel/extensions/pybind/cpu_adam/__init__.py' 2024-09-19T03:42:49,621 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-09-19T03:42:49,622 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-09-19T03:42:49,624 adding 'colossalai/kernel/extensions/pybind/flash_attention/__init__.py' 2024-09-19T03:42:49,625 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-09-19T03:42:49,627 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py' 2024-09-19T03:42:49,628 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-09-19T03:42:49,630 adding 'colossalai/kernel/extensions/pybind/inference/__init__.py' 2024-09-19T03:42:49,631 adding 'colossalai/kernel/extensions/pybind/inference/inference.cpp' 2024-09-19T03:42:49,632 adding 'colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py' 2024-09-19T03:42:49,634 adding 'colossalai/kernel/extensions/pybind/layernorm/__init__.py' 2024-09-19T03:42:49,635 adding 'colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp' 2024-09-19T03:42:49,637 adding 'colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py' 2024-09-19T03:42:49,638 adding 'colossalai/kernel/extensions/pybind/moe/__init__.py' 2024-09-19T03:42:49,639 adding 'colossalai/kernel/extensions/pybind/moe/moe.cpp' 2024-09-19T03:42:49,640 adding 'colossalai/kernel/extensions/pybind/moe/moe_cuda.py' 2024-09-19T03:42:49,642 adding 'colossalai/kernel/extensions/pybind/optimizer/__init__.py' 2024-09-19T03:42:49,643 adding 'colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-09-19T03:42:49,644 adding 'colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp' 2024-09-19T03:42:49,646 adding 'colossalai/kernel/extensions/pybind/softmax/__init__.py' 2024-09-19T03:42:49,647 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp' 2024-09-19T03:42:49,648 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-09-19T03:42:49,650 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp' 2024-09-19T03:42:49,651 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-09-19T03:42:49,653 adding 'colossalai/kernel/jit/__init__.py' 2024-09-19T03:42:49,654 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2024-09-19T03:42:49,655 adding 'colossalai/kernel/jit/bias_gelu.py' 2024-09-19T03:42:49,656 adding 'colossalai/kernel/jit/option.py' 2024-09-19T03:42:49,658 adding 'colossalai/kernel/triton/__init__.py' 2024-09-19T03:42:49,661 adding 'colossalai/kernel/triton/context_attn_unpad.py' 2024-09-19T03:42:49,664 adding 'colossalai/kernel/triton/flash_decoding.py' 2024-09-19T03:42:49,665 adding 'colossalai/kernel/triton/fused_rotary_embedding.py' 2024-09-19T03:42:49,667 adding 'colossalai/kernel/triton/kvcache_copy.py' 2024-09-19T03:42:49,668 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2024-09-19T03:42:49,671 adding 'colossalai/kernel/triton/no_pad_rotary_embedding.py' 2024-09-19T03:42:49,672 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2024-09-19T03:42:49,674 adding 'colossalai/kernel/triton/rms_layernorm.py' 2024-09-19T03:42:49,675 adding 'colossalai/kernel/triton/rotary_cache_copy.py' 2024-09-19T03:42:49,676 adding 'colossalai/kernel/triton/softmax.py' 2024-09-19T03:42:49,678 adding 'colossalai/lazy/__init__.py' 2024-09-19T03:42:49,679 adding 'colossalai/lazy/construction.py' 2024-09-19T03:42:49,683 adding 'colossalai/lazy/lazy_init.py' 2024-09-19T03:42:49,685 adding 'colossalai/lazy/pretrained.py' 2024-09-19T03:42:49,687 adding 'colossalai/legacy/__init__.py' 2024-09-19T03:42:49,688 adding 'colossalai/legacy/constants.py' 2024-09-19T03:42:49,689 adding 'colossalai/legacy/core.py' 2024-09-19T03:42:49,691 adding 'colossalai/legacy/global_variables.py' 2024-09-19T03:42:49,693 adding 'colossalai/legacy/initialize.py' 2024-09-19T03:42:49,695 adding 'colossalai/legacy/amp/__init__.py' 2024-09-19T03:42:49,696 adding 'colossalai/legacy/amp/amp_type.py' 2024-09-19T03:42:49,698 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2024-09-19T03:42:49,699 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2024-09-19T03:42:49,701 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2024-09-19T03:42:49,703 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2024-09-19T03:42:49,705 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2024-09-19T03:42:49,706 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2024-09-19T03:42:49,708 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2024-09-19T03:42:49,711 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2024-09-19T03:42:49,713 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2024-09-19T03:42:49,715 adding 'colossalai/legacy/builder/__init__.py' 2024-09-19T03:42:49,716 adding 'colossalai/legacy/builder/builder.py' 2024-09-19T03:42:49,718 adding 'colossalai/legacy/communication/__init__.py' 2024-09-19T03:42:49,719 adding 'colossalai/legacy/communication/collective.py' 2024-09-19T03:42:49,721 adding 'colossalai/legacy/communication/p2p.py' 2024-09-19T03:42:49,723 adding 'colossalai/legacy/communication/p2p_v2.py' 2024-09-19T03:42:49,725 adding 'colossalai/legacy/communication/ring.py' 2024-09-19T03:42:49,726 adding 'colossalai/legacy/communication/utils.py' 2024-09-19T03:42:49,728 adding 'colossalai/legacy/context/__init__.py' 2024-09-19T03:42:49,731 adding 'colossalai/legacy/context/parallel_context.py' 2024-09-19T03:42:49,732 adding 'colossalai/legacy/context/parallel_mode.py' 2024-09-19T03:42:49,734 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2024-09-19T03:42:49,735 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2024-09-19T03:42:49,736 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2024-09-19T03:42:49,738 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2024-09-19T03:42:49,740 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2024-09-19T03:42:49,741 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2024-09-19T03:42:49,742 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2024-09-19T03:42:49,744 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2024-09-19T03:42:49,745 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2024-09-19T03:42:49,746 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2024-09-19T03:42:49,748 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2024-09-19T03:42:49,750 adding 'colossalai/legacy/context/random/__init__.py' 2024-09-19T03:42:49,751 adding 'colossalai/legacy/context/random/_helper.py' 2024-09-19T03:42:49,752 adding 'colossalai/legacy/context/random/seed_manager.py' 2024-09-19T03:42:49,754 adding 'colossalai/legacy/engine/__init__.py' 2024-09-19T03:42:49,756 adding 'colossalai/legacy/engine/_base_engine.py' 2024-09-19T03:42:49,758 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2024-09-19T03:42:49,759 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2024-09-19T03:42:49,761 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2024-09-19T03:42:49,763 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2024-09-19T03:42:49,764 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2024-09-19T03:42:49,765 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2024-09-19T03:42:49,767 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2024-09-19T03:42:49,768 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2024-09-19T03:42:49,770 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2024-09-19T03:42:49,771 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2024-09-19T03:42:49,773 adding 'colossalai/legacy/engine/schedule/__init__.py' 2024-09-19T03:42:49,775 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2024-09-19T03:42:49,776 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2024-09-19T03:42:49,780 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2024-09-19T03:42:49,782 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2024-09-19T03:42:49,784 adding 'colossalai/legacy/inference/__init__.py' 2024-09-19T03:42:49,785 adding 'colossalai/legacy/inference/async_engine.py' 2024-09-19T03:42:49,787 adding 'colossalai/legacy/inference/async_manager.py' 2024-09-19T03:42:49,788 adding 'colossalai/legacy/inference/manager.py' 2024-09-19T03:42:49,790 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2024-09-19T03:42:49,791 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2024-09-19T03:42:49,793 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2024-09-19T03:42:49,795 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2024-09-19T03:42:49,796 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2024-09-19T03:42:49,798 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2024-09-19T03:42:49,799 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2024-09-19T03:42:49,800 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2024-09-19T03:42:49,802 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2024-09-19T03:42:49,803 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2024-09-19T03:42:49,805 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2024-09-19T03:42:49,807 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2024-09-19T03:42:49,808 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2024-09-19T03:42:49,811 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2024-09-19T03:42:49,813 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2024-09-19T03:42:49,814 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2024-09-19T03:42:49,816 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2024-09-19T03:42:49,818 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2024-09-19T03:42:49,820 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2024-09-19T03:42:49,821 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2024-09-19T03:42:49,824 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2024-09-19T03:42:49,826 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2024-09-19T03:42:49,827 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2024-09-19T03:42:49,829 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2024-09-19T03:42:49,832 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2024-09-19T03:42:49,835 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2024-09-19T03:42:49,837 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2024-09-19T03:42:49,839 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2024-09-19T03:42:49,840 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2024-09-19T03:42:49,842 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2024-09-19T03:42:49,843 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2024-09-19T03:42:49,845 adding 'colossalai/legacy/nn/__init__.py' 2024-09-19T03:42:49,847 adding 'colossalai/legacy/nn/_ops/__init__.py' 2024-09-19T03:42:49,848 adding 'colossalai/legacy/nn/_ops/_utils.py' 2024-09-19T03:42:49,850 adding 'colossalai/legacy/nn/layer/__init__.py' 2024-09-19T03:42:49,852 adding 'colossalai/legacy/nn/layer/base_layer.py' 2024-09-19T03:42:49,853 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2024-09-19T03:42:49,855 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2024-09-19T03:42:49,856 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2024-09-19T03:42:49,857 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2024-09-19T03:42:49,859 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2024-09-19T03:42:49,861 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2024-09-19T03:42:49,862 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2024-09-19T03:42:49,863 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2024-09-19T03:42:49,865 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2024-09-19T03:42:49,868 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2024-09-19T03:42:49,870 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2024-09-19T03:42:49,873 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2024-09-19T03:42:49,875 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2024-09-19T03:42:49,878 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2024-09-19T03:42:49,880 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2024-09-19T03:42:49,883 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2024-09-19T03:42:49,885 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2024-09-19T03:42:49,889 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2024-09-19T03:42:49,891 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2024-09-19T03:42:49,893 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2024-09-19T03:42:49,894 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2024-09-19T03:42:49,898 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2024-09-19T03:42:49,899 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2024-09-19T03:42:49,901 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2024-09-19T03:42:49,902 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2024-09-19T03:42:49,904 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2024-09-19T03:42:49,906 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2024-09-19T03:42:49,907 adding 'colossalai/legacy/nn/layer/utils/common.py' 2024-09-19T03:42:49,909 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2024-09-19T03:42:49,911 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2024-09-19T03:42:49,913 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2024-09-19T03:42:49,914 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2024-09-19T03:42:49,916 adding 'colossalai/legacy/nn/loss/__init__.py' 2024-09-19T03:42:49,918 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2024-09-19T03:42:49,919 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2024-09-19T03:42:49,921 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2024-09-19T03:42:49,922 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2024-09-19T03:42:49,924 adding 'colossalai/legacy/nn/metric/__init__.py' 2024-09-19T03:42:49,925 adding 'colossalai/legacy/nn/metric/_utils.py' 2024-09-19T03:42:49,926 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2024-09-19T03:42:49,928 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2024-09-19T03:42:49,929 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2024-09-19T03:42:49,931 adding 'colossalai/legacy/nn/parallel/__init__.py' 2024-09-19T03:42:49,932 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2024-09-19T03:42:49,934 adding 'colossalai/legacy/nn/parallel/reducer.py' 2024-09-19T03:42:49,936 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2024-09-19T03:42:49,937 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2024-09-19T03:42:49,938 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2024-09-19T03:42:49,940 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2024-09-19T03:42:49,941 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2024-09-19T03:42:49,943 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2024-09-19T03:42:49,944 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2024-09-19T03:42:49,947 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2024-09-19T03:42:49,949 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2024-09-19T03:42:49,951 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2024-09-19T03:42:49,952 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2024-09-19T03:42:49,953 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2024-09-19T03:42:49,955 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2024-09-19T03:42:49,957 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2024-09-19T03:42:49,958 adding 'colossalai/legacy/pipeline/__init__.py' 2024-09-19T03:42:49,959 adding 'colossalai/legacy/pipeline/layer_spec.py' 2024-09-19T03:42:49,961 adding 'colossalai/legacy/pipeline/pipelinable.py' 2024-09-19T03:42:49,963 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2024-09-19T03:42:49,964 adding 'colossalai/legacy/pipeline/utils.py' 2024-09-19T03:42:49,966 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2024-09-19T03:42:49,968 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2024-09-19T03:42:49,969 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2024-09-19T03:42:49,971 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2024-09-19T03:42:49,972 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2024-09-19T03:42:49,978 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2024-09-19T03:42:49,981 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2024-09-19T03:42:49,982 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2024-09-19T03:42:49,984 adding 'colossalai/legacy/registry/__init__.py' 2024-09-19T03:42:49,985 adding 'colossalai/legacy/registry/registry.py' 2024-09-19T03:42:49,987 adding 'colossalai/legacy/tensor/__init__.py' 2024-09-19T03:42:49,988 adding 'colossalai/legacy/tensor/compute_spec.py' 2024-09-19T03:42:49,989 adding 'colossalai/legacy/tensor/const.py' 2024-09-19T03:42:49,991 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2024-09-19T03:42:49,992 adding 'colossalai/legacy/tensor/distspec.py' 2024-09-19T03:42:49,994 adding 'colossalai/legacy/tensor/op_wrapper.py' 2024-09-19T03:42:49,995 adding 'colossalai/legacy/tensor/process_group.py' 2024-09-19T03:42:49,997 adding 'colossalai/legacy/tensor/tensor_spec.py' 2024-09-19T03:42:49,999 adding 'colossalai/legacy/trainer/__init__.py' 2024-09-19T03:42:50,001 adding 'colossalai/legacy/trainer/_trainer.py' 2024-09-19T03:42:50,002 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2024-09-19T03:42:50,004 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2024-09-19T03:42:50,005 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2024-09-19T03:42:50,006 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2024-09-19T03:42:50,008 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2024-09-19T03:42:50,010 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2024-09-19T03:42:50,012 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2024-09-19T03:42:50,014 adding 'colossalai/legacy/utils/__init__.py' 2024-09-19T03:42:50,016 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2024-09-19T03:42:50,018 adding 'colossalai/legacy/utils/checkpointing.py' 2024-09-19T03:42:50,020 adding 'colossalai/legacy/utils/common.py' 2024-09-19T03:42:50,022 adding 'colossalai/legacy/utils/memory.py' 2024-09-19T03:42:50,024 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2024-09-19T03:42:50,025 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2024-09-19T03:42:50,026 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2024-09-19T03:42:50,028 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2024-09-19T03:42:50,029 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2024-09-19T03:42:50,031 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2024-09-19T03:42:50,033 adding 'colossalai/legacy/utils/profiler/__init__.py' 2024-09-19T03:42:50,034 adding 'colossalai/legacy/utils/profiler/extention.py' 2024-09-19T03:42:50,036 adding 'colossalai/legacy/utils/profiler/profiler.py' 2024-09-19T03:42:50,037 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2024-09-19T03:42:50,039 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2024-09-19T03:42:50,041 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2024-09-19T03:42:50,042 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2024-09-19T03:42:50,043 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2024-09-19T03:42:50,045 adding 'colossalai/legacy/zero/__init__.py' 2024-09-19T03:42:50,047 adding 'colossalai/legacy/zero/gemini/__init__.py' 2024-09-19T03:42:50,048 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2024-09-19T03:42:50,050 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2024-09-19T03:42:50,051 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2024-09-19T03:42:50,053 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2024-09-19T03:42:50,054 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2024-09-19T03:42:50,056 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2024-09-19T03:42:50,058 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2024-09-19T03:42:50,059 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2024-09-19T03:42:50,060 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2024-09-19T03:42:50,062 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2024-09-19T03:42:50,063 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2024-09-19T03:42:50,065 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2024-09-19T03:42:50,066 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2024-09-19T03:42:50,068 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2024-09-19T03:42:50,070 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2024-09-19T03:42:50,072 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2024-09-19T03:42:50,073 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2024-09-19T03:42:50,075 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2024-09-19T03:42:50,076 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2024-09-19T03:42:50,078 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2024-09-19T03:42:50,079 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2024-09-19T03:42:50,081 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2024-09-19T03:42:50,082 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2024-09-19T03:42:50,086 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2024-09-19T03:42:50,087 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2024-09-19T03:42:50,089 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2024-09-19T03:42:50,091 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2024-09-19T03:42:50,093 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2024-09-19T03:42:50,095 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2024-09-19T03:42:50,096 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2024-09-19T03:42:50,097 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2024-09-19T03:42:50,099 adding 'colossalai/logging/__init__.py' 2024-09-19T03:42:50,101 adding 'colossalai/logging/logger.py' 2024-09-19T03:42:50,102 adding 'colossalai/moe/__init__.py' 2024-09-19T03:42:50,104 adding 'colossalai/moe/_operation.py' 2024-09-19T03:42:50,106 adding 'colossalai/nn/__init__.py' 2024-09-19T03:42:50,107 adding 'colossalai/nn/init.py' 2024-09-19T03:42:50,109 adding 'colossalai/nn/layer/__init__.py' 2024-09-19T03:42:50,110 adding 'colossalai/nn/layer/layernorm.py' 2024-09-19T03:42:50,112 adding 'colossalai/nn/layer/scaled_softmax.py' 2024-09-19T03:42:50,113 adding 'colossalai/nn/layer/utils.py' 2024-09-19T03:42:50,115 adding 'colossalai/nn/loss/__init__.py' 2024-09-19T03:42:50,116 adding 'colossalai/nn/lr_scheduler/__init__.py' 2024-09-19T03:42:50,117 adding 'colossalai/nn/lr_scheduler/cosine.py' 2024-09-19T03:42:50,119 adding 'colossalai/nn/lr_scheduler/delayed.py' 2024-09-19T03:42:50,120 adding 'colossalai/nn/lr_scheduler/linear.py' 2024-09-19T03:42:50,121 adding 'colossalai/nn/lr_scheduler/multistep.py' 2024-09-19T03:42:50,123 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2024-09-19T03:42:50,124 adding 'colossalai/nn/lr_scheduler/poly.py' 2024-09-19T03:42:50,125 adding 'colossalai/nn/lr_scheduler/torch.py' 2024-09-19T03:42:50,127 adding 'colossalai/nn/optimizer/__init__.py' 2024-09-19T03:42:50,128 adding 'colossalai/nn/optimizer/adafactor.py' 2024-09-19T03:42:50,130 adding 'colossalai/nn/optimizer/came.py' 2024-09-19T03:42:50,132 adding 'colossalai/nn/optimizer/cpu_adam.py' 2024-09-19T03:42:50,134 adding 'colossalai/nn/optimizer/distributed_adafactor.py' 2024-09-19T03:42:50,137 adding 'colossalai/nn/optimizer/distributed_came.py' 2024-09-19T03:42:50,139 adding 'colossalai/nn/optimizer/distributed_galore.py' 2024-09-19T03:42:50,141 adding 'colossalai/nn/optimizer/distributed_lamb.py' 2024-09-19T03:42:50,143 adding 'colossalai/nn/optimizer/fused_adam.py' 2024-09-19T03:42:50,144 adding 'colossalai/nn/optimizer/fused_lamb.py' 2024-09-19T03:42:50,146 adding 'colossalai/nn/optimizer/fused_sgd.py' 2024-09-19T03:42:50,148 adding 'colossalai/nn/optimizer/galore.py' 2024-09-19T03:42:50,150 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2024-09-19T03:42:50,151 adding 'colossalai/nn/optimizer/lamb.py' 2024-09-19T03:42:50,153 adding 'colossalai/nn/optimizer/lars.py' 2024-09-19T03:42:50,154 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2024-09-19T03:42:50,156 adding 'colossalai/pipeline/__init__.py' 2024-09-19T03:42:50,159 adding 'colossalai/pipeline/p2p.py' 2024-09-19T03:42:50,161 adding 'colossalai/pipeline/stage_manager.py' 2024-09-19T03:42:50,163 adding 'colossalai/pipeline/schedule/__init__.py' 2024-09-19T03:42:50,164 adding 'colossalai/pipeline/schedule/_utils.py' 2024-09-19T03:42:50,166 adding 'colossalai/pipeline/schedule/base.py' 2024-09-19T03:42:50,168 adding 'colossalai/pipeline/schedule/generate.py' 2024-09-19T03:42:50,171 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2024-09-19T03:42:50,174 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2024-09-19T03:42:50,176 adding 'colossalai/quantization/__init__.py' 2024-09-19T03:42:50,178 adding 'colossalai/quantization/bnb.py' 2024-09-19T03:42:50,179 adding 'colossalai/quantization/bnb_config.py' 2024-09-19T03:42:50,183 adding 'colossalai/quantization/fp8.py' 2024-09-19T03:42:50,185 adding 'colossalai/quantization/fp8_hook.py' 2024-09-19T03:42:50,186 adding 'colossalai/quantization/utils.py' 2024-09-19T03:42:50,188 adding 'colossalai/shardformer/__init__.py' 2024-09-19T03:42:50,190 adding 'colossalai/shardformer/_utils.py' 2024-09-19T03:42:50,191 adding 'colossalai/shardformer/layer/__init__.py' 2024-09-19T03:42:50,195 adding 'colossalai/shardformer/layer/_operation.py' 2024-09-19T03:42:50,201 adding 'colossalai/shardformer/layer/attn.py' 2024-09-19T03:42:50,203 adding 'colossalai/shardformer/layer/dropout.py' 2024-09-19T03:42:50,205 adding 'colossalai/shardformer/layer/embedding.py' 2024-09-19T03:42:50,207 adding 'colossalai/shardformer/layer/linear.py' 2024-09-19T03:42:50,210 adding 'colossalai/shardformer/layer/loss.py' 2024-09-19T03:42:50,211 adding 'colossalai/shardformer/layer/normalization.py' 2024-09-19T03:42:50,214 adding 'colossalai/shardformer/layer/parallel_module.py' 2024-09-19T03:42:50,217 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2024-09-19T03:42:50,219 adding 'colossalai/shardformer/layer/utils.py' 2024-09-19T03:42:50,221 adding 'colossalai/shardformer/modeling/__init__.py' 2024-09-19T03:42:50,225 adding 'colossalai/shardformer/modeling/bert.py' 2024-09-19T03:42:50,227 adding 'colossalai/shardformer/modeling/blip2.py' 2024-09-19T03:42:50,231 adding 'colossalai/shardformer/modeling/bloom.py' 2024-09-19T03:42:50,234 adding 'colossalai/shardformer/modeling/chatglm2.py' 2024-09-19T03:42:50,238 adding 'colossalai/shardformer/modeling/command.py' 2024-09-19T03:42:50,242 adding 'colossalai/shardformer/modeling/deepseek.py' 2024-09-19T03:42:50,245 adding 'colossalai/shardformer/modeling/falcon.py' 2024-09-19T03:42:50,249 adding 'colossalai/shardformer/modeling/gpt2.py' 2024-09-19T03:42:50,253 adding 'colossalai/shardformer/modeling/gptj.py' 2024-09-19T03:42:50,254 adding 'colossalai/shardformer/modeling/jit.py' 2024-09-19T03:42:50,257 adding 'colossalai/shardformer/modeling/llama.py' 2024-09-19T03:42:50,260 adding 'colossalai/shardformer/modeling/mistral.py' 2024-09-19T03:42:50,265 adding 'colossalai/shardformer/modeling/mixtral.py' 2024-09-19T03:42:50,269 adding 'colossalai/shardformer/modeling/opt.py' 2024-09-19T03:42:50,273 adding 'colossalai/shardformer/modeling/qwen2.py' 2024-09-19T03:42:50,274 adding 'colossalai/shardformer/modeling/sam.py' 2024-09-19T03:42:50,278 adding 'colossalai/shardformer/modeling/t5.py' 2024-09-19T03:42:50,280 adding 'colossalai/shardformer/modeling/vit.py' 2024-09-19T03:42:50,285 adding 'colossalai/shardformer/modeling/whisper.py' 2024-09-19T03:42:50,287 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2024-09-19T03:42:50,288 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2024-09-19T03:42:50,294 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2024-09-19T03:42:50,296 adding 'colossalai/shardformer/policies/__init__.py' 2024-09-19T03:42:50,298 adding 'colossalai/shardformer/policies/auto_policy.py' 2024-09-19T03:42:50,300 adding 'colossalai/shardformer/policies/base_policy.py' 2024-09-19T03:42:50,302 adding 'colossalai/shardformer/policies/bert.py' 2024-09-19T03:42:50,304 adding 'colossalai/shardformer/policies/blip2.py' 2024-09-19T03:42:50,306 adding 'colossalai/shardformer/policies/bloom.py' 2024-09-19T03:42:50,309 adding 'colossalai/shardformer/policies/chatglm2.py' 2024-09-19T03:42:50,311 adding 'colossalai/shardformer/policies/command.py' 2024-09-19T03:42:50,313 adding 'colossalai/shardformer/policies/deepseek.py' 2024-09-19T03:42:50,315 adding 'colossalai/shardformer/policies/falcon.py' 2024-09-19T03:42:50,317 adding 'colossalai/shardformer/policies/gpt2.py' 2024-09-19T03:42:50,319 adding 'colossalai/shardformer/policies/gptj.py' 2024-09-19T03:42:50,321 adding 'colossalai/shardformer/policies/llama.py' 2024-09-19T03:42:50,323 adding 'colossalai/shardformer/policies/mistral.py' 2024-09-19T03:42:50,325 adding 'colossalai/shardformer/policies/mixtral.py' 2024-09-19T03:42:50,327 adding 'colossalai/shardformer/policies/opt.py' 2024-09-19T03:42:50,329 adding 'colossalai/shardformer/policies/qwen2.py' 2024-09-19T03:42:50,331 adding 'colossalai/shardformer/policies/sam.py' 2024-09-19T03:42:50,333 adding 'colossalai/shardformer/policies/t5.py' 2024-09-19T03:42:50,335 adding 'colossalai/shardformer/policies/vit.py' 2024-09-19T03:42:50,338 adding 'colossalai/shardformer/policies/whisper.py' 2024-09-19T03:42:50,339 adding 'colossalai/shardformer/shard/__init__.py' 2024-09-19T03:42:50,341 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2024-09-19T03:42:50,343 adding 'colossalai/shardformer/shard/shard_config.py' 2024-09-19T03:42:50,344 adding 'colossalai/shardformer/shard/sharder.py' 2024-09-19T03:42:50,346 adding 'colossalai/shardformer/shard/shardformer.py' 2024-09-19T03:42:50,347 adding 'colossalai/shardformer/shard/utils.py' 2024-09-19T03:42:50,349 adding 'colossalai/tensor/__init__.py' 2024-09-19T03:42:50,350 adding 'colossalai/tensor/colo_parameter.py' 2024-09-19T03:42:50,352 adding 'colossalai/tensor/colo_tensor.py' 2024-09-19T03:42:50,354 adding 'colossalai/tensor/comm_spec.py' 2024-09-19T03:42:50,356 adding 'colossalai/tensor/param_op_hook.py' 2024-09-19T03:42:50,360 adding 'colossalai/tensor/shape_consistency.py' 2024-09-19T03:42:50,362 adding 'colossalai/tensor/sharding_spec.py' 2024-09-19T03:42:50,363 adding 'colossalai/tensor/utils.py' 2024-09-19T03:42:50,365 adding 'colossalai/tensor/d_tensor/__init__.py' 2024-09-19T03:42:50,367 adding 'colossalai/tensor/d_tensor/api.py' 2024-09-19T03:42:50,369 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2024-09-19T03:42:50,370 adding 'colossalai/tensor/d_tensor/layout.py' 2024-09-19T03:42:50,373 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2024-09-19T03:42:50,374 adding 'colossalai/tensor/d_tensor/misc.py' 2024-09-19T03:42:50,376 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2024-09-19T03:42:50,377 adding 'colossalai/tensor/d_tensor/utils.py' 2024-09-19T03:42:50,379 adding 'colossalai/tensor/moe_tensor/__init__.py' 2024-09-19T03:42:50,380 adding 'colossalai/tensor/moe_tensor/api.py' 2024-09-19T03:42:50,382 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2024-09-19T03:42:50,383 adding 'colossalai/tensor/padded_tensor/__init__.py' 2024-09-19T03:42:50,384 adding 'colossalai/tensor/padded_tensor/api.py' 2024-09-19T03:42:50,386 adding 'colossalai/testing/__init__.py' 2024-09-19T03:42:50,388 adding 'colossalai/testing/comparison.py' 2024-09-19T03:42:50,389 adding 'colossalai/testing/pytest_wrapper.py' 2024-09-19T03:42:50,390 adding 'colossalai/testing/random.py' 2024-09-19T03:42:50,392 adding 'colossalai/testing/utils.py' 2024-09-19T03:42:50,394 adding 'colossalai/utils/__init__.py' 2024-09-19T03:42:50,395 adding 'colossalai/utils/common.py' 2024-09-19T03:42:50,396 adding 'colossalai/utils/memory.py' 2024-09-19T03:42:50,398 adding 'colossalai/utils/timer.py' 2024-09-19T03:42:50,399 adding 'colossalai/utils/model/__init__.py' 2024-09-19T03:42:50,401 adding 'colossalai/utils/model/utils.py' 2024-09-19T03:42:50,403 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2024-09-19T03:42:50,404 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2024-09-19T03:42:50,406 adding 'colossalai/utils/rank_recorder/__init__.py' 2024-09-19T03:42:50,407 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2024-09-19T03:42:50,409 adding 'colossalai/utils/tensor_detector/__init__.py' 2024-09-19T03:42:50,411 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2024-09-19T03:42:50,413 adding 'colossalai/zero/__init__.py' 2024-09-19T03:42:50,414 adding 'colossalai/zero/wrapper.py' 2024-09-19T03:42:50,416 adding 'colossalai/zero/gemini/__init__.py' 2024-09-19T03:42:50,421 adding 'colossalai/zero/gemini/gemini_ddp.py' 2024-09-19T03:42:50,423 adding 'colossalai/zero/gemini/gemini_hook.py' 2024-09-19T03:42:50,424 adding 'colossalai/zero/gemini/gemini_mgr.py' 2024-09-19T03:42:50,428 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2024-09-19T03:42:50,431 adding 'colossalai/zero/gemini/placement_policy.py' 2024-09-19T03:42:50,432 adding 'colossalai/zero/gemini/utils.py' 2024-09-19T03:42:50,434 adding 'colossalai/zero/gemini/chunk/__init__.py' 2024-09-19T03:42:50,437 adding 'colossalai/zero/gemini/chunk/chunk.py' 2024-09-19T03:42:50,439 adding 'colossalai/zero/gemini/chunk/manager.py' 2024-09-19T03:42:50,441 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2024-09-19T03:42:50,442 adding 'colossalai/zero/gemini/chunk/utils.py' 2024-09-19T03:42:50,444 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2024-09-19T03:42:50,445 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2024-09-19T03:42:50,447 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2024-09-19T03:42:50,448 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2024-09-19T03:42:50,450 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2024-09-19T03:42:50,451 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2024-09-19T03:42:50,452 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2024-09-19T03:42:50,454 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2024-09-19T03:42:50,455 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2024-09-19T03:42:50,457 adding 'colossalai/zero/low_level/__init__.py' 2024-09-19T03:42:50,459 adding 'colossalai/zero/low_level/_utils.py' 2024-09-19T03:42:50,463 adding 'colossalai/zero/low_level/low_level_optim.py' 2024-09-19T03:42:50,464 adding 'colossalai/zero/low_level/zero_hook.py' 2024-09-19T03:42:50,466 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2024-09-19T03:42:50,467 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2024-09-19T03:42:50,468 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2024-09-19T03:42:50,470 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2024-09-19T03:42:50,471 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2024-09-19T03:42:50,474 adding 'extensions/csrc/__init__.py' 2024-09-19T03:42:50,475 adding 'extensions/pybind/__init__.py' 2024-09-19T03:42:50,477 adding 'extensions/pybind/cpu_adam/__init__.py' 2024-09-19T03:42:50,478 adding 'extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-09-19T03:42:50,479 adding 'extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-09-19T03:42:50,481 adding 'extensions/pybind/flash_attention/__init__.py' 2024-09-19T03:42:50,482 adding 'extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-09-19T03:42:50,484 adding 'extensions/pybind/flash_attention/flash_attention_npu.py' 2024-09-19T03:42:50,485 adding 'extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-09-19T03:42:50,486 adding 'extensions/pybind/inference/__init__.py' 2024-09-19T03:42:50,488 adding 'extensions/pybind/inference/inference_ops_cuda.py' 2024-09-19T03:42:50,489 adding 'extensions/pybind/layernorm/__init__.py' 2024-09-19T03:42:50,491 adding 'extensions/pybind/layernorm/layernorm_cuda.py' 2024-09-19T03:42:50,492 adding 'extensions/pybind/moe/__init__.py' 2024-09-19T03:42:50,493 adding 'extensions/pybind/moe/moe_cuda.py' 2024-09-19T03:42:50,495 adding 'extensions/pybind/optimizer/__init__.py' 2024-09-19T03:42:50,496 adding 'extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-09-19T03:42:50,498 adding 'extensions/pybind/softmax/__init__.py' 2024-09-19T03:42:50,499 adding 'extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-09-19T03:42:50,500 adding 'extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-09-19T03:42:50,503 adding 'colossalai-0.4.4.dist-info/LICENSE' 2024-09-19T03:42:50,507 adding 'colossalai-0.4.4.dist-info/METADATA' 2024-09-19T03:42:50,508 adding 'colossalai-0.4.4.dist-info/WHEEL' 2024-09-19T03:42:50,509 adding 'colossalai-0.4.4.dist-info/entry_points.txt' 2024-09-19T03:42:50,510 adding 'colossalai-0.4.4.dist-info/top_level.txt' 2024-09-19T03:42:50,525 adding 'colossalai-0.4.4.dist-info/RECORD' 2024-09-19T03:42:50,554 removing build/bdist.linux-armv7l/wheel 2024-09-19T03:42:50,914 Building wheel for colossalai (setup.py): finished with status 'done' 2024-09-19T03:42:50,934 Created wheel for colossalai: filename=colossalai-0.4.4-py3-none-any.whl size=1583078 sha256=7d8fd2b8d24966631e13d0535ee83e0c38e2e190292b5e5902dec15673818a6d 2024-09-19T03:42:50,935 Stored in directory: /tmp/pip-ephem-wheel-cache-t8xir8wv/wheels/aa/33/14/812f5ae96b76da6f9d9c5a5be7c5d981d5db2826d6fa555865 2024-09-19T03:42:50,978 Successfully built colossalai 2024-09-19T03:42:51,019 Removed build tracker: '/tmp/pip-build-tracker-bdm0yffn'