2024-11-04T09:46:33,351 Created temporary directory: /tmp/pip-build-tracker-wy0txrbw 2024-11-04T09:46:33,352 Initialized build tracking at /tmp/pip-build-tracker-wy0txrbw 2024-11-04T09:46:33,353 Created build tracker: /tmp/pip-build-tracker-wy0txrbw 2024-11-04T09:46:33,353 Entered build tracker: /tmp/pip-build-tracker-wy0txrbw 2024-11-04T09:46:33,354 Created temporary directory: /tmp/pip-wheel-_hfjkms1 2024-11-04T09:46:33,405 Created temporary directory: /tmp/pip-ephem-wheel-cache-dno_vtj8 2024-11-04T09:46:33,452 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-11-04T09:46:33,455 2 location(s) to search for versions of colossalai: 2024-11-04T09:46:33,455 * https://pypi.org/simple/colossalai/ 2024-11-04T09:46:33,455 * https://www.piwheels.org/simple/colossalai/ 2024-11-04T09:46:33,456 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2024-11-04T09:46:33,457 Getting page https://pypi.org/simple/colossalai/ 2024-11-04T09:46:33,458 Found index url https://pypi.org/simple/ 2024-11-04T09:46:33,717 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2024-11-04T09:46:33,983 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2024-11-04T09:46:34,031 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2024-11-04T09:46:34,047 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2024-11-04T09:46:34,181 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2024-11-04T09:46:34,183 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2024-11-04T09:46:34,185 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2024-11-04T09:46:34,187 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2024-11-04T09:46:34,189 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2024-11-04T09:46:34,191 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2024-11-04T09:46:34,193 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2024-11-04T09:46:34,195 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2024-11-04T09:46:34,197 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2024-11-04T09:46:34,199 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2024-11-04T09:46:34,201 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2024-11-04T09:46:34,203 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2024-11-04T09:46:34,205 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2024-11-04T09:46:34,206 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2024-11-04T09:46:34,208 Found link https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.8 2024-11-04T09:46:34,210 Found link https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.9 2024-11-04T09:46:34,212 Found link https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.0 2024-11-04T09:46:34,214 Found link https://files.pythonhosted.org/packages/3c/cd/206593b5c417a436382ca5e93c0188c031830341ee352c35e020ce83f57c/colossalai-0.4.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.1 2024-11-04T09:46:34,217 Found link https://files.pythonhosted.org/packages/0d/98/7adbf8fd663234fee2ea43382b065979c22612f319c322aa0eb675457327/colossalai-0.4.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.2 2024-11-04T09:46:34,226 Found link https://files.pythonhosted.org/packages/96/bd/716f9dbdee5a564da03d55d3d9e65b85c952cb62ed12519a8566adf63005/colossalai-0.4.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.3 2024-11-04T09:46:34,227 Found link https://files.pythonhosted.org/packages/93/17/64f0e6b72626bb060b6951461ffc62e5f34ce3efed2f4e2214fa2967d313/colossalai-0.4.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.4 2024-11-04T09:46:34,229 Found link https://files.pythonhosted.org/packages/cb/59/6a454c672176686c5932d4de99a457374d852427601f98751b3c96594fa3/colossalai-0.4.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.5 2024-11-04T09:46:34,231 Found link https://files.pythonhosted.org/packages/53/ea/d5a51f58dc88a1aaea451a0a95af6cfec99cd6a7d7c4abdf9e04851bb992/colossalai-0.4.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.6 2024-11-04T09:46:34,233 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2024-11-04T09:46:34,234 Getting page https://www.piwheels.org/simple/colossalai/ 2024-11-04T09:46:34,237 Found index url https://www.piwheels.org/simple/ 2024-11-04T09:46:34,429 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2024-11-04T09:46:34,437 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.5-py3-none-any.whl#sha256=f94d4dad77d236b0cc6ea08c8a0016d2cd518bc546095a9e65c47fe4486cacfb (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,438 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.4-py3-none-any.whl#sha256=7d8fd2b8d24966631e13d0535ee83e0c38e2e190292b5e5902dec15673818a6d (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,439 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.3-py3-none-any.whl#sha256=115c0c1bbbe23afda2be79a19e1dab17148c834545824e974d5653b545a9e604 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,439 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.2-py3-none-any.whl#sha256=37c71db35629462ee7107007adb59e8a480ef50ec550a31198b6fe08fb8acc84 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,440 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.1-py3-none-any.whl#sha256=5355444b4f627d0b5516a1053a0b99c3eb130a9bdde95abefa4dcd7a881b0119 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,440 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.0-py3-none-any.whl#sha256=bca14360afc924008f910785cbb07e07f1f743e3a7182103caa09a4d6c49d3a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,441 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.9-py3-none-any.whl#sha256=670e4e0d607a0803e8f0a7349996228f4cfa411d817bd631c07b1b2064e7af48 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,441 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.8-py3-none-any.whl#sha256=73a2dba29be661597422944d917c709df77c91843d30ab323f6c740173686dab (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,448 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.7-py3-none-any.whl#sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,449 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,450 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,451 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,451 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,452 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,452 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,453 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,454 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,455 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,455 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,456 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,456 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,457 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,457 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,458 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,459 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-11-04T09:46:34,459 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2024-11-04T09:46:34,460 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2024-11-04T09:46:34,482 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2024-11-04T09:46:34,484 Collecting colossalai==0.4.6 2024-11-04T09:46:34,487 Created temporary directory: /tmp/pip-unpack-7ark2a35 2024-11-04T09:46:34,704 Downloading colossalai-0.4.6.tar.gz (1.3 MB) 2024-11-04T09:46:37,298 Added colossalai==0.4.6 from https://files.pythonhosted.org/packages/53/ea/d5a51f58dc88a1aaea451a0a95af6cfec99cd6a7d7c4abdf9e04851bb992/colossalai-0.4.6.tar.gz to build tracker '/tmp/pip-build-tracker-wy0txrbw' 2024-11-04T09:46:37,300 Running setup.py (path:/tmp/pip-wheel-_hfjkms1/colossalai_e87e2f4ec9f74e4d870499a66c01464d/setup.py) egg_info for package colossalai 2024-11-04T09:46:37,301 Created temporary directory: /tmp/pip-pip-egg-info-6fuiu9yj 2024-11-04T09:46:37,302 Preparing metadata (setup.py): started 2024-11-04T09:46:37,303 Running command python setup.py egg_info 2024-11-04T09:46:38,461 running egg_info 2024-11-04T09:46:38,490 creating /tmp/pip-pip-egg-info-6fuiu9yj/colossalai.egg-info 2024-11-04T09:46:38,493 writing /tmp/pip-pip-egg-info-6fuiu9yj/colossalai.egg-info/PKG-INFO 2024-11-04T09:46:38,498 writing dependency_links to /tmp/pip-pip-egg-info-6fuiu9yj/colossalai.egg-info/dependency_links.txt 2024-11-04T09:46:38,499 writing entry points to /tmp/pip-pip-egg-info-6fuiu9yj/colossalai.egg-info/entry_points.txt 2024-11-04T09:46:38,501 writing requirements to /tmp/pip-pip-egg-info-6fuiu9yj/colossalai.egg-info/requires.txt 2024-11-04T09:46:38,502 writing top-level names to /tmp/pip-pip-egg-info-6fuiu9yj/colossalai.egg-info/top_level.txt 2024-11-04T09:46:38,503 writing manifest file '/tmp/pip-pip-egg-info-6fuiu9yj/colossalai.egg-info/SOURCES.txt' 2024-11-04T09:46:38,809 reading manifest file '/tmp/pip-pip-egg-info-6fuiu9yj/colossalai.egg-info/SOURCES.txt' 2024-11-04T09:46:38,810 reading manifest template 'MANIFEST.in' 2024-11-04T09:46:40,110 warning: no files found matching '*.tr' under directory 'colossalai' 2024-11-04T09:46:40,734 warning: no files found matching '*.cc' under directory 'colossalai' 2024-11-04T09:46:41,080 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-11-04T09:46:41,221 warning: no files found matching '*.tr' under directory 'extensions' 2024-11-04T09:46:41,282 warning: no files found matching '*.cc' under directory 'extensions' 2024-11-04T09:46:41,309 warning: no files found matching '*.pyi' under directory 'extensions' 2024-11-04T09:46:41,309 adding license file 'LICENSE' 2024-11-04T09:46:41,341 writing manifest file '/tmp/pip-pip-egg-info-6fuiu9yj/colossalai.egg-info/SOURCES.txt' 2024-11-04T09:46:41,452 Preparing metadata (setup.py): finished with status 'done' 2024-11-04T09:46:41,458 Source in /tmp/pip-wheel-_hfjkms1/colossalai_e87e2f4ec9f74e4d870499a66c01464d has version 0.4.6, which satisfies requirement colossalai==0.4.6 from https://files.pythonhosted.org/packages/53/ea/d5a51f58dc88a1aaea451a0a95af6cfec99cd6a7d7c4abdf9e04851bb992/colossalai-0.4.6.tar.gz 2024-11-04T09:46:41,459 Removed colossalai==0.4.6 from https://files.pythonhosted.org/packages/53/ea/d5a51f58dc88a1aaea451a0a95af6cfec99cd6a7d7c4abdf9e04851bb992/colossalai-0.4.6.tar.gz from build tracker '/tmp/pip-build-tracker-wy0txrbw' 2024-11-04T09:46:41,471 Created temporary directory: /tmp/pip-unpack-xav8ngmf 2024-11-04T09:46:41,473 Created temporary directory: /tmp/pip-unpack-641gpczn 2024-11-04T09:46:41,473 Building wheels for collected packages: colossalai 2024-11-04T09:46:41,477 Created temporary directory: /tmp/pip-wheel-0nvkffg4 2024-11-04T09:46:41,478 Building wheel for colossalai (setup.py): started 2024-11-04T09:46:41,479 Destination directory: /tmp/pip-wheel-0nvkffg4 2024-11-04T09:46:41,480 Running command python setup.py bdist_wheel 2024-11-04T09:46:42,567 running bdist_wheel 2024-11-04T09:46:42,700 running build 2024-11-04T09:46:42,701 running build_py 2024-11-04T09:46:42,730 creating build/lib/colossalai 2024-11-04T09:46:42,733 copying colossalai/initialize.py -> build/lib/colossalai 2024-11-04T09:46:42,735 copying colossalai/__init__.py -> build/lib/colossalai 2024-11-04T09:46:42,737 copying colossalai/version.py -> build/lib/colossalai 2024-11-04T09:46:42,739 creating build/lib/colossalai/booster 2024-11-04T09:46:42,740 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2024-11-04T09:46:42,742 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2024-11-04T09:46:42,745 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2024-11-04T09:46:42,747 creating build/lib/colossalai/_C 2024-11-04T09:46:42,748 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2024-11-04T09:46:42,750 creating build/lib/colossalai/nn 2024-11-04T09:46:42,751 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2024-11-04T09:46:42,753 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2024-11-04T09:46:42,756 creating build/lib/colossalai/auto_parallel 2024-11-04T09:46:42,757 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2024-11-04T09:46:42,759 creating build/lib/colossalai/amp 2024-11-04T09:46:42,760 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2024-11-04T09:46:42,762 creating build/lib/colossalai/shardformer 2024-11-04T09:46:42,763 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2024-11-04T09:46:42,765 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2024-11-04T09:46:42,768 creating build/lib/colossalai/inference 2024-11-04T09:46:42,769 copying colossalai/inference/flash_decoding_utils.py -> build/lib/colossalai/inference 2024-11-04T09:46:42,770 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2024-11-04T09:46:42,772 copying colossalai/inference/logit_processors.py -> build/lib/colossalai/inference 2024-11-04T09:46:42,775 copying colossalai/inference/sampler.py -> build/lib/colossalai/inference 2024-11-04T09:46:42,777 copying colossalai/inference/struct.py -> build/lib/colossalai/inference 2024-11-04T09:46:42,779 copying colossalai/inference/config.py -> build/lib/colossalai/inference 2024-11-04T09:46:42,787 copying colossalai/inference/utils.py -> build/lib/colossalai/inference 2024-11-04T09:46:42,790 copying colossalai/inference/graph_runner.py -> build/lib/colossalai/inference 2024-11-04T09:46:42,792 copying colossalai/inference/batch_bucket.py -> build/lib/colossalai/inference 2024-11-04T09:46:42,795 creating build/lib/colossalai/quantization 2024-11-04T09:46:42,796 copying colossalai/quantization/__init__.py -> build/lib/colossalai/quantization 2024-11-04T09:46:42,798 copying colossalai/quantization/fp8.py -> build/lib/colossalai/quantization 2024-11-04T09:46:42,800 copying colossalai/quantization/fp8_hook.py -> build/lib/colossalai/quantization 2024-11-04T09:46:42,802 copying colossalai/quantization/bnb.py -> build/lib/colossalai/quantization 2024-11-04T09:46:42,805 copying colossalai/quantization/fp8_config.py -> build/lib/colossalai/quantization 2024-11-04T09:46:42,806 copying colossalai/quantization/bnb_config.py -> build/lib/colossalai/quantization 2024-11-04T09:46:42,809 copying colossalai/quantization/utils.py -> build/lib/colossalai/quantization 2024-11-04T09:46:42,811 creating build/lib/colossalai/interface 2024-11-04T09:46:42,812 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2024-11-04T09:46:42,814 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2024-11-04T09:46:42,816 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2024-11-04T09:46:42,818 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2024-11-04T09:46:42,820 creating build/lib/colossalai/_analyzer 2024-11-04T09:46:42,821 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2024-11-04T09:46:42,823 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2024-11-04T09:46:42,825 creating build/lib/colossalai/moe 2024-11-04T09:46:42,826 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2024-11-04T09:46:42,828 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2024-11-04T09:46:42,831 creating build/lib/colossalai/cluster 2024-11-04T09:46:42,832 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2024-11-04T09:46:42,834 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2024-11-04T09:46:42,835 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2024-11-04T09:46:42,838 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2024-11-04T09:46:42,840 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2024-11-04T09:46:42,843 creating build/lib/colossalai/accelerator 2024-11-04T09:46:42,844 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2024-11-04T09:46:42,846 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2024-11-04T09:46:42,849 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2024-11-04T09:46:42,850 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2024-11-04T09:46:42,853 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2024-11-04T09:46:42,855 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2024-11-04T09:46:42,858 creating build/lib/colossalai/lazy 2024-11-04T09:46:42,859 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2024-11-04T09:46:42,860 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2024-11-04T09:46:42,863 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2024-11-04T09:46:42,866 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2024-11-04T09:46:42,868 creating build/lib/colossalai/checkpoint_io 2024-11-04T09:46:42,869 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-11-04T09:46:42,872 copying colossalai/checkpoint_io/moe_checkpoint.py -> build/lib/colossalai/checkpoint_io 2024-11-04T09:46:42,875 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2024-11-04T09:46:42,877 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2024-11-04T09:46:42,879 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-11-04T09:46:42,883 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2024-11-04T09:46:42,885 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2024-11-04T09:46:42,888 creating build/lib/colossalai/utils 2024-11-04T09:46:42,889 copying colossalai/utils/safetensors.py -> build/lib/colossalai/utils 2024-11-04T09:46:42,891 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2024-11-04T09:46:42,893 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2024-11-04T09:46:42,895 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2024-11-04T09:46:42,897 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2024-11-04T09:46:42,900 creating build/lib/colossalai/pipeline 2024-11-04T09:46:42,901 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2024-11-04T09:46:42,904 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2024-11-04T09:46:42,906 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2024-11-04T09:46:42,909 creating build/lib/colossalai/context 2024-11-04T09:46:42,910 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2024-11-04T09:46:42,912 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2024-11-04T09:46:42,914 copying colossalai/context/config.py -> build/lib/colossalai/context 2024-11-04T09:46:42,916 creating build/lib/colossalai/fx 2024-11-04T09:46:42,917 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2024-11-04T09:46:42,920 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2024-11-04T09:46:42,922 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2024-11-04T09:46:42,924 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2024-11-04T09:46:42,926 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2024-11-04T09:46:42,928 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2024-11-04T09:46:42,930 creating build/lib/colossalai/kernel 2024-11-04T09:46:42,932 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2024-11-04T09:46:42,934 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2024-11-04T09:46:42,936 creating build/lib/colossalai/device 2024-11-04T09:46:42,937 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2024-11-04T09:46:42,939 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2024-11-04T09:46:42,941 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2024-11-04T09:46:42,943 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2024-11-04T09:46:42,946 creating build/lib/colossalai/testing 2024-11-04T09:46:42,947 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2024-11-04T09:46:42,949 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2024-11-04T09:46:42,951 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2024-11-04T09:46:42,953 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2024-11-04T09:46:42,955 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2024-11-04T09:46:42,958 creating build/lib/colossalai/legacy 2024-11-04T09:46:42,959 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2024-11-04T09:46:42,962 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2024-11-04T09:46:42,963 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2024-11-04T09:46:42,965 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2024-11-04T09:46:42,967 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2024-11-04T09:46:42,969 creating build/lib/colossalai/zero 2024-11-04T09:46:42,970 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2024-11-04T09:46:42,973 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2024-11-04T09:46:42,975 creating build/lib/colossalai/cli 2024-11-04T09:46:42,977 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2024-11-04T09:46:42,978 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2024-11-04T09:46:42,981 creating build/lib/colossalai/logging 2024-11-04T09:46:42,982 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2024-11-04T09:46:42,984 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2024-11-04T09:46:42,986 creating build/lib/colossalai/tensor 2024-11-04T09:46:42,987 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2024-11-04T09:46:42,990 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2024-11-04T09:46:42,991 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2024-11-04T09:46:42,994 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2024-11-04T09:46:42,997 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2024-11-04T09:46:42,998 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2024-11-04T09:46:43,001 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2024-11-04T09:46:43,003 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2024-11-04T09:46:43,006 creating build/lib/colossalai/booster/mixed_precision 2024-11-04T09:46:43,007 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2024-11-04T09:46:43,009 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2024-11-04T09:46:43,011 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2024-11-04T09:46:43,013 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2024-11-04T09:46:43,015 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2024-11-04T09:46:43,017 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2024-11-04T09:46:43,019 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2024-11-04T09:46:43,022 creating build/lib/colossalai/booster/plugin 2024-11-04T09:46:43,023 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2024-11-04T09:46:43,025 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2024-11-04T09:46:43,027 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2024-11-04T09:46:43,029 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2024-11-04T09:46:43,032 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2024-11-04T09:46:43,034 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2024-11-04T09:46:43,036 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-11-04T09:46:43,039 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-11-04T09:46:43,042 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-11-04T09:46:43,044 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-11-04T09:46:43,046 creating build/lib/colossalai/nn/layer 2024-11-04T09:46:43,047 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2024-11-04T09:46:43,049 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2024-11-04T09:46:43,052 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2024-11-04T09:46:43,053 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2024-11-04T09:46:43,056 creating build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,057 copying colossalai/nn/optimizer/distributed_adafactor.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,060 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,062 copying colossalai/nn/optimizer/galore.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,064 copying colossalai/nn/optimizer/adafactor.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,066 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,069 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,071 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,073 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,075 copying colossalai/nn/optimizer/came.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,078 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,080 copying colossalai/nn/optimizer/distributed_came.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,082 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,085 copying colossalai/nn/optimizer/distributed_galore.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,087 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,089 copying colossalai/nn/optimizer/distributed_lamb.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,091 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2024-11-04T09:46:43,094 creating build/lib/colossalai/nn/loss 2024-11-04T09:46:43,095 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2024-11-04T09:46:43,098 creating build/lib/colossalai/nn/lr_scheduler 2024-11-04T09:46:43,099 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2024-11-04T09:46:43,101 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2024-11-04T09:46:43,103 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2024-11-04T09:46:43,105 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2024-11-04T09:46:43,106 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2024-11-04T09:46:43,109 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2024-11-04T09:46:43,110 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2024-11-04T09:46:43,112 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2024-11-04T09:46:43,115 creating build/lib/colossalai/auto_parallel/pipeline_shard 2024-11-04T09:46:43,116 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2024-11-04T09:46:43,118 creating build/lib/colossalai/auto_parallel/checkpoint 2024-11-04T09:46:43,119 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-11-04T09:46:43,121 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-11-04T09:46:43,123 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-11-04T09:46:43,125 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-11-04T09:46:43,127 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-11-04T09:46:43,130 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-11-04T09:46:43,132 creating build/lib/colossalai/auto_parallel/offload 2024-11-04T09:46:43,133 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2024-11-04T09:46:43,136 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2024-11-04T09:46:43,138 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2024-11-04T09:46:43,142 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2024-11-04T09:46:43,144 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2024-11-04T09:46:43,148 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2024-11-04T09:46:43,150 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2024-11-04T09:46:43,152 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2024-11-04T09:46:43,155 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2024-11-04T09:46:43,157 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2024-11-04T09:46:43,159 creating build/lib/colossalai/auto_parallel/tensor_shard 2024-11-04T09:46:43,161 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-11-04T09:46:43,163 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-11-04T09:46:43,165 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-11-04T09:46:43,167 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-11-04T09:46:43,169 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-11-04T09:46:43,172 creating build/lib/colossalai/auto_parallel/passes 2024-11-04T09:46:43,173 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2024-11-04T09:46:43,175 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2024-11-04T09:46:43,177 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-11-04T09:46:43,179 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-11-04T09:46:43,181 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-11-04T09:46:43,183 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2024-11-04T09:46:43,186 creating build/lib/colossalai/auto_parallel/meta_profiler 2024-11-04T09:46:43,187 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-11-04T09:46:43,189 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-11-04T09:46:43,191 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-11-04T09:46:43,192 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-11-04T09:46:43,195 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:43,196 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:43,198 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:43,200 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:43,202 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:43,205 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:43,207 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:43,210 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-11-04T09:46:43,211 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-11-04T09:46:43,214 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-11-04T09:46:43,216 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-11-04T09:46:43,218 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-11-04T09:46:43,220 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-11-04T09:46:43,223 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,225 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,227 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,229 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,232 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,234 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,235 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,237 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,239 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,241 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,243 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,245 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,246 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,248 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,250 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,252 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,254 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,256 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,258 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,260 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,262 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,265 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,266 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,269 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,271 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,273 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,275 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,277 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:43,281 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,282 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,284 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,286 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,288 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,291 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,292 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,294 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,297 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,299 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,302 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,305 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,306 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,309 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,311 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,313 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,315 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,317 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,320 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,322 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:43,325 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:43,326 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:43,329 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:43,330 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:43,333 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:43,335 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:43,337 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:43,339 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:43,342 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:43,343 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:43,345 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:43,348 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:43,350 creating build/lib/colossalai/amp/naive_amp 2024-11-04T09:46:43,351 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2024-11-04T09:46:43,353 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2024-11-04T09:46:43,356 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2024-11-04T09:46:43,357 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-11-04T09:46:43,359 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-11-04T09:46:43,361 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-11-04T09:46:43,362 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-11-04T09:46:43,365 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-11-04T09:46:43,366 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-11-04T09:46:43,368 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-11-04T09:46:43,370 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-11-04T09:46:43,372 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-11-04T09:46:43,375 creating build/lib/colossalai/shardformer/shard 2024-11-04T09:46:43,376 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2024-11-04T09:46:43,378 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2024-11-04T09:46:43,380 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2024-11-04T09:46:43,382 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2024-11-04T09:46:43,384 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2024-11-04T09:46:43,386 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2024-11-04T09:46:43,389 creating build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,390 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,392 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,395 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,397 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,399 copying colossalai/shardformer/policies/deepseek.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,401 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,404 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,407 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,409 copying colossalai/shardformer/policies/qwen2.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,412 copying colossalai/shardformer/policies/command.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,414 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,417 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,420 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,422 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,425 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,427 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,430 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,433 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,435 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,438 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,440 copying colossalai/shardformer/policies/mixtral.py -> build/lib/colossalai/shardformer/policies 2024-11-04T09:46:43,443 creating build/lib/colossalai/shardformer/layer 2024-11-04T09:46:43,445 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2024-11-04T09:46:43,447 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2024-11-04T09:46:43,449 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2024-11-04T09:46:43,451 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2024-11-04T09:46:43,453 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2024-11-04T09:46:43,456 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2024-11-04T09:46:43,459 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2024-11-04T09:46:43,462 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2024-11-04T09:46:43,464 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2024-11-04T09:46:43,467 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2024-11-04T09:46:43,470 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2024-11-04T09:46:43,474 creating build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,475 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,478 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,481 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,482 copying colossalai/shardformer/modeling/deepseek.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,485 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,488 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,490 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,493 copying colossalai/shardformer/modeling/qwen2.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,496 copying colossalai/shardformer/modeling/command.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,499 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,502 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,505 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,507 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,510 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,513 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,515 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,518 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,520 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,523 copying colossalai/shardformer/modeling/mixtral.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,526 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2024-11-04T09:46:43,528 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-11-04T09:46:43,529 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-11-04T09:46:43,531 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-11-04T09:46:43,534 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-11-04T09:46:43,537 creating build/lib/colossalai/inference/kv_cache 2024-11-04T09:46:43,538 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2024-11-04T09:46:43,540 copying colossalai/inference/kv_cache/block_cache.py -> build/lib/colossalai/inference/kv_cache 2024-11-04T09:46:43,541 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2024-11-04T09:46:43,545 creating build/lib/colossalai/inference/executor 2024-11-04T09:46:43,546 copying colossalai/inference/executor/rpc_worker.py -> build/lib/colossalai/inference/executor 2024-11-04T09:46:43,548 copying colossalai/inference/executor/__init__.py -> build/lib/colossalai/inference/executor 2024-11-04T09:46:43,550 creating build/lib/colossalai/inference/server 2024-11-04T09:46:43,551 copying colossalai/inference/server/chat_service.py -> build/lib/colossalai/inference/server 2024-11-04T09:46:43,554 copying colossalai/inference/server/__init__.py -> build/lib/colossalai/inference/server 2024-11-04T09:46:43,556 copying colossalai/inference/server/api_server.py -> build/lib/colossalai/inference/server 2024-11-04T09:46:43,558 copying colossalai/inference/server/completion_service.py -> build/lib/colossalai/inference/server 2024-11-04T09:46:43,560 copying colossalai/inference/server/utils.py -> build/lib/colossalai/inference/server 2024-11-04T09:46:43,562 creating build/lib/colossalai/inference/modeling 2024-11-04T09:46:43,563 copying colossalai/inference/modeling/__init__.py -> build/lib/colossalai/inference/modeling 2024-11-04T09:46:43,566 creating build/lib/colossalai/inference/core 2024-11-04T09:46:43,567 copying colossalai/inference/core/request_handler.py -> build/lib/colossalai/inference/core 2024-11-04T09:46:43,570 copying colossalai/inference/core/async_engine.py -> build/lib/colossalai/inference/core 2024-11-04T09:46:43,572 copying colossalai/inference/core/__init__.py -> build/lib/colossalai/inference/core 2024-11-04T09:46:43,574 copying colossalai/inference/core/engine.py -> build/lib/colossalai/inference/core 2024-11-04T09:46:43,576 copying colossalai/inference/core/rpc_engine.py -> build/lib/colossalai/inference/core 2024-11-04T09:46:43,579 copying colossalai/inference/core/base_engine.py -> build/lib/colossalai/inference/core 2024-11-04T09:46:43,581 copying colossalai/inference/core/diffusion_engine.py -> build/lib/colossalai/inference/core 2024-11-04T09:46:43,583 copying colossalai/inference/core/plugin.py -> build/lib/colossalai/inference/core 2024-11-04T09:46:43,585 copying colossalai/inference/core/llm_engine.py -> build/lib/colossalai/inference/core 2024-11-04T09:46:43,588 creating build/lib/colossalai/inference/spec 2024-11-04T09:46:43,589 copying colossalai/inference/spec/__init__.py -> build/lib/colossalai/inference/spec 2024-11-04T09:46:43,591 copying colossalai/inference/spec/struct.py -> build/lib/colossalai/inference/spec 2024-11-04T09:46:43,593 copying colossalai/inference/spec/drafter.py -> build/lib/colossalai/inference/spec 2024-11-04T09:46:43,596 creating build/lib/colossalai/inference/modeling/models 2024-11-04T09:46:43,597 copying colossalai/inference/modeling/models/nopadding_llama.py -> build/lib/colossalai/inference/modeling/models 2024-11-04T09:46:43,600 copying colossalai/inference/modeling/models/pixart_alpha.py -> build/lib/colossalai/inference/modeling/models 2024-11-04T09:46:43,602 copying colossalai/inference/modeling/models/__init__.py -> build/lib/colossalai/inference/modeling/models 2024-11-04T09:46:43,604 copying colossalai/inference/modeling/models/glide_llama.py -> build/lib/colossalai/inference/modeling/models 2024-11-04T09:46:43,607 copying colossalai/inference/modeling/models/stablediffusion3.py -> build/lib/colossalai/inference/modeling/models 2024-11-04T09:46:43,609 copying colossalai/inference/modeling/models/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/models 2024-11-04T09:46:43,612 creating build/lib/colossalai/inference/modeling/layers 2024-11-04T09:46:43,613 copying colossalai/inference/modeling/layers/attention.py -> build/lib/colossalai/inference/modeling/layers 2024-11-04T09:46:43,616 copying colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/lib/colossalai/inference/modeling/layers 2024-11-04T09:46:43,618 copying colossalai/inference/modeling/layers/__init__.py -> build/lib/colossalai/inference/modeling/layers 2024-11-04T09:46:43,619 copying colossalai/inference/modeling/layers/diffusion.py -> build/lib/colossalai/inference/modeling/layers 2024-11-04T09:46:43,621 copying colossalai/inference/modeling/layers/distrifusion.py -> build/lib/colossalai/inference/modeling/layers 2024-11-04T09:46:43,625 creating build/lib/colossalai/inference/modeling/backends 2024-11-04T09:46:43,626 copying colossalai/inference/modeling/backends/__init__.py -> build/lib/colossalai/inference/modeling/backends 2024-11-04T09:46:43,627 copying colossalai/inference/modeling/backends/attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-11-04T09:46:43,630 copying colossalai/inference/modeling/backends/pre_attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-11-04T09:46:43,632 creating build/lib/colossalai/inference/modeling/policy 2024-11-04T09:46:43,633 copying colossalai/inference/modeling/policy/nopadding_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-11-04T09:46:43,636 copying colossalai/inference/modeling/policy/pixart_alpha.py -> build/lib/colossalai/inference/modeling/policy 2024-11-04T09:46:43,639 copying colossalai/inference/modeling/policy/__init__.py -> build/lib/colossalai/inference/modeling/policy 2024-11-04T09:46:43,641 copying colossalai/inference/modeling/policy/glide_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-11-04T09:46:43,644 copying colossalai/inference/modeling/policy/stablediffusion3.py -> build/lib/colossalai/inference/modeling/policy 2024-11-04T09:46:43,647 copying colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/policy 2024-11-04T09:46:43,650 creating build/lib/colossalai/_analyzer/fx 2024-11-04T09:46:43,651 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2024-11-04T09:46:43,655 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2024-11-04T09:46:43,657 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2024-11-04T09:46:43,660 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2024-11-04T09:46:43,663 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2024-11-04T09:46:43,667 creating build/lib/colossalai/_analyzer/_subclasses 2024-11-04T09:46:43,669 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2024-11-04T09:46:43,671 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-11-04T09:46:43,674 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2024-11-04T09:46:43,677 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2024-11-04T09:46:43,680 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-11-04T09:46:43,684 creating build/lib/colossalai/_analyzer/fx/tracer 2024-11-04T09:46:43,686 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-11-04T09:46:43,688 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-11-04T09:46:43,691 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-11-04T09:46:43,693 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-11-04T09:46:43,697 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-11-04T09:46:43,700 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-11-04T09:46:43,703 creating build/lib/colossalai/_analyzer/fx/passes 2024-11-04T09:46:43,705 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2024-11-04T09:46:43,707 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2024-11-04T09:46:43,711 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2024-11-04T09:46:43,715 creating build/lib/colossalai/utils/rank_recorder 2024-11-04T09:46:43,716 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2024-11-04T09:46:43,719 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2024-11-04T09:46:43,722 creating build/lib/colossalai/utils/multi_tensor_apply 2024-11-04T09:46:43,724 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-11-04T09:46:43,726 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-11-04T09:46:43,729 creating build/lib/colossalai/utils/model 2024-11-04T09:46:43,731 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2024-11-04T09:46:43,733 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2024-11-04T09:46:43,737 creating build/lib/colossalai/utils/tensor_detector 2024-11-04T09:46:43,738 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2024-11-04T09:46:43,739 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2024-11-04T09:46:43,742 creating build/lib/colossalai/pipeline/schedule 2024-11-04T09:46:43,743 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2024-11-04T09:46:43,745 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2024-11-04T09:46:43,748 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2024-11-04T09:46:43,750 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2024-11-04T09:46:43,753 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2024-11-04T09:46:43,755 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2024-11-04T09:46:43,757 creating build/lib/colossalai/fx/codegen 2024-11-04T09:46:43,758 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2024-11-04T09:46:43,760 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2024-11-04T09:46:43,764 creating build/lib/colossalai/fx/tracer 2024-11-04T09:46:43,765 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2024-11-04T09:46:43,767 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2024-11-04T09:46:43,769 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2024-11-04T09:46:43,771 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2024-11-04T09:46:43,773 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2024-11-04T09:46:43,775 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2024-11-04T09:46:43,778 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2024-11-04T09:46:43,780 creating build/lib/colossalai/fx/passes 2024-11-04T09:46:43,781 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2024-11-04T09:46:43,784 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2024-11-04T09:46:43,787 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2024-11-04T09:46:43,789 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2024-11-04T09:46:43,790 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2024-11-04T09:46:43,793 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2024-11-04T09:46:43,795 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2024-11-04T09:46:43,798 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2024-11-04T09:46:43,800 creating build/lib/colossalai/fx/profiler 2024-11-04T09:46:43,802 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2024-11-04T09:46:43,804 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2024-11-04T09:46:43,807 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2024-11-04T09:46:43,809 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2024-11-04T09:46:43,811 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2024-11-04T09:46:43,813 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2024-11-04T09:46:43,815 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2024-11-04T09:46:43,817 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2024-11-04T09:46:43,819 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2024-11-04T09:46:43,821 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2024-11-04T09:46:43,823 creating build/lib/colossalai/fx/tracer/meta_patch 2024-11-04T09:46:43,824 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2024-11-04T09:46:43,826 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-11-04T09:46:43,828 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-11-04T09:46:43,830 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-11-04T09:46:43,832 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-11-04T09:46:43,834 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-11-04T09:46:43,836 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-11-04T09:46:43,837 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-11-04T09:46:43,839 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-11-04T09:46:43,841 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-11-04T09:46:43,843 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-11-04T09:46:43,845 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-11-04T09:46:43,848 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:43,849 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:43,851 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:43,853 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:43,854 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:43,857 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:43,859 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:43,861 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:43,863 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:43,865 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:43,866 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:43,869 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:43,870 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:43,872 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:43,874 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:43,877 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:43,878 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:43,880 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:43,882 creating build/lib/colossalai/fx/profiler/experimental 2024-11-04T09:46:43,883 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2024-11-04T09:46:43,886 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2024-11-04T09:46:43,887 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2024-11-04T09:46:43,889 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2024-11-04T09:46:43,891 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2024-11-04T09:46:43,894 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:43,895 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:43,898 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:43,900 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:43,902 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:43,903 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:43,906 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:43,907 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:43,910 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:43,912 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:43,914 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:43,915 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:43,918 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:43,920 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:43,922 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:43,924 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:43,926 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:43,927 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:43,930 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:43,931 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:43,933 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:43,935 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:43,938 creating build/lib/colossalai/kernel/triton 2024-11-04T09:46:43,939 copying colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-11-04T09:46:43,942 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2024-11-04T09:46:43,944 copying colossalai/kernel/triton/fused_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-11-04T09:46:43,946 copying colossalai/kernel/triton/rotary_cache_copy.py -> build/lib/colossalai/kernel/triton 2024-11-04T09:46:43,948 copying colossalai/kernel/triton/context_attn_unpad.py -> build/lib/colossalai/kernel/triton 2024-11-04T09:46:43,951 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2024-11-04T09:46:43,954 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2024-11-04T09:46:43,956 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2024-11-04T09:46:43,959 copying colossalai/kernel/triton/kvcache_copy.py -> build/lib/colossalai/kernel/triton 2024-11-04T09:46:43,961 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2024-11-04T09:46:43,964 copying colossalai/kernel/triton/rms_layernorm.py -> build/lib/colossalai/kernel/triton 2024-11-04T09:46:43,967 creating build/lib/colossalai/kernel/extensions 2024-11-04T09:46:43,968 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2024-11-04T09:46:43,970 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2024-11-04T09:46:43,972 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2024-11-04T09:46:43,974 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2024-11-04T09:46:43,976 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2024-11-04T09:46:43,978 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2024-11-04T09:46:43,981 creating build/lib/colossalai/kernel/jit 2024-11-04T09:46:43,983 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2024-11-04T09:46:43,985 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2024-11-04T09:46:43,987 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2024-11-04T09:46:43,989 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2024-11-04T09:46:43,991 creating build/lib/colossalai/kernel/extensions/pybind 2024-11-04T09:46:43,992 copying colossalai/kernel/extensions/pybind/__init__.py -> build/lib/colossalai/kernel/extensions/pybind 2024-11-04T09:46:43,994 creating build/lib/colossalai/kernel/extensions/csrc 2024-11-04T09:46:43,996 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2024-11-04T09:46:43,998 creating build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-11-04T09:46:43,999 copying colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-11-04T09:46:44,001 copying colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-11-04T09:46:44,003 creating build/lib/colossalai/kernel/extensions/pybind/inference 2024-11-04T09:46:44,005 copying colossalai/kernel/extensions/pybind/inference/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-11-04T09:46:44,007 copying colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-11-04T09:46:44,009 creating build/lib/colossalai/kernel/extensions/pybind/moe 2024-11-04T09:46:44,010 copying colossalai/kernel/extensions/pybind/moe/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-11-04T09:46:44,012 copying colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-11-04T09:46:44,015 creating build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-11-04T09:46:44,016 copying colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-11-04T09:46:44,018 copying colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-11-04T09:46:44,020 creating build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-11-04T09:46:44,021 copying colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-11-04T09:46:44,023 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-11-04T09:46:44,026 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-11-04T09:46:44,028 creating build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-11-04T09:46:44,029 copying colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-11-04T09:46:44,031 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-11-04T09:46:44,033 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-11-04T09:46:44,035 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-11-04T09:46:44,038 creating build/lib/colossalai/kernel/extensions/pybind/softmax 2024-11-04T09:46:44,039 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-11-04T09:46:44,041 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-11-04T09:46:44,043 copying colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-11-04T09:46:44,046 creating build/lib/colossalai/legacy/nn 2024-11-04T09:46:44,047 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2024-11-04T09:46:44,049 creating build/lib/colossalai/legacy/amp 2024-11-04T09:46:44,050 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2024-11-04T09:46:44,053 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2024-11-04T09:46:44,055 creating build/lib/colossalai/legacy/inference 2024-11-04T09:46:44,057 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2024-11-04T09:46:44,059 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2024-11-04T09:46:44,061 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2024-11-04T09:46:44,063 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2024-11-04T09:46:44,066 creating build/lib/colossalai/legacy/engine 2024-11-04T09:46:44,067 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2024-11-04T09:46:44,069 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2024-11-04T09:46:44,071 creating build/lib/colossalai/legacy/registry 2024-11-04T09:46:44,073 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2024-11-04T09:46:44,075 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2024-11-04T09:46:44,077 creating build/lib/colossalai/legacy/trainer 2024-11-04T09:46:44,078 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2024-11-04T09:46:44,080 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2024-11-04T09:46:44,083 creating build/lib/colossalai/legacy/utils 2024-11-04T09:46:44,085 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2024-11-04T09:46:44,087 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2024-11-04T09:46:44,089 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2024-11-04T09:46:44,092 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2024-11-04T09:46:44,095 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2024-11-04T09:46:44,098 creating build/lib/colossalai/legacy/pipeline 2024-11-04T09:46:44,099 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2024-11-04T09:46:44,101 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2024-11-04T09:46:44,103 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2024-11-04T09:46:44,105 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2024-11-04T09:46:44,108 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2024-11-04T09:46:44,111 creating build/lib/colossalai/legacy/context 2024-11-04T09:46:44,113 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2024-11-04T09:46:44,115 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2024-11-04T09:46:44,117 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2024-11-04T09:46:44,120 creating build/lib/colossalai/legacy/builder 2024-11-04T09:46:44,121 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2024-11-04T09:46:44,124 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2024-11-04T09:46:44,126 creating build/lib/colossalai/legacy/zero 2024-11-04T09:46:44,127 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2024-11-04T09:46:44,130 creating build/lib/colossalai/legacy/communication 2024-11-04T09:46:44,131 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2024-11-04T09:46:44,135 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2024-11-04T09:46:44,137 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2024-11-04T09:46:44,139 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2024-11-04T09:46:44,141 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2024-11-04T09:46:44,143 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2024-11-04T09:46:44,146 creating build/lib/colossalai/legacy/tensor 2024-11-04T09:46:44,147 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2024-11-04T09:46:44,149 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2024-11-04T09:46:44,151 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2024-11-04T09:46:44,153 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2024-11-04T09:46:44,156 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2024-11-04T09:46:44,157 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2024-11-04T09:46:44,159 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2024-11-04T09:46:44,163 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2024-11-04T09:46:44,165 creating build/lib/colossalai/legacy/nn/layer 2024-11-04T09:46:44,166 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2024-11-04T09:46:44,168 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2024-11-04T09:46:44,171 creating build/lib/colossalai/legacy/nn/parallel 2024-11-04T09:46:44,172 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2024-11-04T09:46:44,174 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2024-11-04T09:46:44,176 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2024-11-04T09:46:44,179 creating build/lib/colossalai/legacy/nn/_ops 2024-11-04T09:46:44,180 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2024-11-04T09:46:44,182 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2024-11-04T09:46:44,185 creating build/lib/colossalai/legacy/nn/loss 2024-11-04T09:46:44,186 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2024-11-04T09:46:44,189 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2024-11-04T09:46:44,191 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2024-11-04T09:46:44,193 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2024-11-04T09:46:44,196 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2024-11-04T09:46:44,199 creating build/lib/colossalai/legacy/nn/metric 2024-11-04T09:46:44,200 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2024-11-04T09:46:44,202 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2024-11-04T09:46:44,204 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2024-11-04T09:46:44,206 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2024-11-04T09:46:44,208 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2024-11-04T09:46:44,210 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-11-04T09:46:44,211 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-11-04T09:46:44,213 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-11-04T09:46:44,217 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-11-04T09:46:44,219 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-11-04T09:46:44,222 creating build/lib/colossalai/legacy/nn/layer/vanilla 2024-11-04T09:46:44,223 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-11-04T09:46:44,225 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-11-04T09:46:44,228 creating build/lib/colossalai/legacy/nn/layer/utils 2024-11-04T09:46:44,229 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-11-04T09:46:44,231 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-11-04T09:46:44,234 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-11-04T09:46:44,235 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-11-04T09:46:44,237 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-11-04T09:46:44,240 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-11-04T09:46:44,243 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-11-04T09:46:44,245 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:44,247 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:44,249 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:44,251 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:44,253 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:44,255 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:44,258 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:44,260 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-11-04T09:46:44,261 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-11-04T09:46:44,264 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-11-04T09:46:44,267 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-11-04T09:46:44,270 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-11-04T09:46:44,272 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-11-04T09:46:44,273 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-11-04T09:46:44,275 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-11-04T09:46:44,279 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-11-04T09:46:44,281 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-11-04T09:46:44,284 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-11-04T09:46:44,285 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-11-04T09:46:44,287 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-11-04T09:46:44,290 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-11-04T09:46:44,292 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-11-04T09:46:44,295 creating build/lib/colossalai/legacy/nn/layer/wrapper 2024-11-04T09:46:44,298 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-11-04T09:46:44,300 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-11-04T09:46:44,303 creating build/lib/colossalai/legacy/nn/parallel/layers 2024-11-04T09:46:44,304 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-11-04T09:46:44,306 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-11-04T09:46:44,308 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-11-04T09:46:44,310 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-11-04T09:46:44,312 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-11-04T09:46:44,315 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:44,316 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:44,318 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:44,321 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:44,323 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:44,325 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:44,327 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:44,330 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:44,333 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:44,335 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:44,338 creating build/lib/colossalai/legacy/amp/naive_amp 2024-11-04T09:46:44,339 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-11-04T09:46:44,342 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-11-04T09:46:44,344 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-11-04T09:46:44,347 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-11-04T09:46:44,349 creating build/lib/colossalai/legacy/amp/apex_amp 2024-11-04T09:46:44,350 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-11-04T09:46:44,353 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-11-04T09:46:44,355 creating build/lib/colossalai/legacy/amp/torch_amp 2024-11-04T09:46:44,357 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-11-04T09:46:44,359 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-11-04T09:46:44,362 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-11-04T09:46:44,365 creating build/lib/colossalai/legacy/inference/pipeline 2024-11-04T09:46:44,366 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2024-11-04T09:46:44,368 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2024-11-04T09:46:44,371 creating build/lib/colossalai/legacy/inference/tensor_parallel 2024-11-04T09:46:44,372 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-11-04T09:46:44,374 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-11-04T09:46:44,377 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-11-04T09:46:44,379 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-11-04T09:46:44,382 creating build/lib/colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:44,383 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:44,385 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:44,387 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:44,389 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:44,391 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:44,393 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:44,396 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:44,398 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:44,401 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:44,403 creating build/lib/colossalai/legacy/inference/hybridengine 2024-11-04T09:46:44,404 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-11-04T09:46:44,406 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-11-04T09:46:44,409 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-11-04T09:46:44,411 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-11-04T09:46:44,413 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-11-04T09:46:44,415 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-11-04T09:46:44,418 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-11-04T09:46:44,421 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-11-04T09:46:44,422 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-11-04T09:46:44,425 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-11-04T09:46:44,427 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-11-04T09:46:44,430 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-11-04T09:46:44,432 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-11-04T09:46:44,435 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2024-11-04T09:46:44,436 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-11-04T09:46:44,438 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-11-04T09:46:44,440 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-11-04T09:46:44,442 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-11-04T09:46:44,444 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-11-04T09:46:44,446 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-11-04T09:46:44,449 creating build/lib/colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:44,450 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:44,453 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:44,455 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:44,457 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:44,459 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:44,461 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:44,463 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:44,465 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:44,467 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2024-11-04T09:46:44,468 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-11-04T09:46:44,470 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-11-04T09:46:44,475 creating build/lib/colossalai/legacy/engine/schedule 2024-11-04T09:46:44,476 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-11-04T09:46:44,479 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2024-11-04T09:46:44,482 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2024-11-04T09:46:44,483 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-11-04T09:46:44,486 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-11-04T09:46:44,489 creating build/lib/colossalai/legacy/trainer/hooks 2024-11-04T09:46:44,490 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-11-04T09:46:44,492 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2024-11-04T09:46:44,494 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2024-11-04T09:46:44,496 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-11-04T09:46:44,498 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-11-04T09:46:44,501 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-11-04T09:46:44,503 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-11-04T09:46:44,506 creating build/lib/colossalai/legacy/utils/checkpoint 2024-11-04T09:46:44,507 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-11-04T09:46:44,509 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-11-04T09:46:44,511 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-11-04T09:46:44,514 creating build/lib/colossalai/legacy/utils/data_sampler 2024-11-04T09:46:44,515 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-11-04T09:46:44,517 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-11-04T09:46:44,519 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-11-04T09:46:44,522 creating build/lib/colossalai/legacy/utils/profiler 2024-11-04T09:46:44,523 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2024-11-04T09:46:44,525 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2024-11-04T09:46:44,528 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-11-04T09:46:44,530 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-11-04T09:46:44,532 creating build/lib/colossalai/legacy/utils/profiler/legacy 2024-11-04T09:46:44,533 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-11-04T09:46:44,536 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-11-04T09:46:44,538 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-11-04T09:46:44,540 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-11-04T09:46:44,543 creating build/lib/colossalai/legacy/pipeline/middleware 2024-11-04T09:46:44,545 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-11-04T09:46:44,547 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-11-04T09:46:44,551 creating build/lib/colossalai/legacy/pipeline/rpc 2024-11-04T09:46:44,553 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-11-04T09:46:44,556 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-11-04T09:46:44,558 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-11-04T09:46:44,561 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-11-04T09:46:44,564 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-11-04T09:46:44,565 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-11-04T09:46:44,567 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-11-04T09:46:44,570 creating build/lib/colossalai/legacy/context/random 2024-11-04T09:46:44,571 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2024-11-04T09:46:44,573 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2024-11-04T09:46:44,575 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2024-11-04T09:46:44,579 creating build/lib/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:44,580 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:44,582 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:44,584 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:44,586 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:44,588 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:44,590 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:44,592 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:44,595 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:44,597 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:44,599 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:44,601 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:44,605 creating build/lib/colossalai/legacy/zero/gemini 2024-11-04T09:46:44,606 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2024-11-04T09:46:44,609 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2024-11-04T09:46:44,610 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2024-11-04T09:46:44,613 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2024-11-04T09:46:44,615 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-11-04T09:46:44,617 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2024-11-04T09:46:44,619 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-11-04T09:46:44,622 creating build/lib/colossalai/legacy/zero/init_ctx 2024-11-04T09:46:44,623 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-11-04T09:46:44,625 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-11-04T09:46:44,628 creating build/lib/colossalai/legacy/zero/sharded_param 2024-11-04T09:46:44,629 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-11-04T09:46:44,631 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-11-04T09:46:44,633 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-11-04T09:46:44,635 creating build/lib/colossalai/legacy/zero/shard_utils 2024-11-04T09:46:44,637 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-11-04T09:46:44,639 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-11-04T09:46:44,641 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-11-04T09:46:44,642 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-11-04T09:46:44,644 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-11-04T09:46:44,647 creating build/lib/colossalai/legacy/zero/sharded_model 2024-11-04T09:46:44,648 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-11-04T09:46:44,650 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-11-04T09:46:44,652 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-11-04T09:46:44,655 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-11-04T09:46:44,657 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-11-04T09:46:44,659 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-11-04T09:46:44,662 creating build/lib/colossalai/legacy/zero/sharded_optim 2024-11-04T09:46:44,663 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-11-04T09:46:44,665 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-11-04T09:46:44,668 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2024-11-04T09:46:44,669 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-11-04T09:46:44,671 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-11-04T09:46:44,674 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-11-04T09:46:44,676 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-11-04T09:46:44,678 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-11-04T09:46:44,681 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-11-04T09:46:44,682 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-11-04T09:46:44,684 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-11-04T09:46:44,687 creating build/lib/colossalai/zero/gemini 2024-11-04T09:46:44,688 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2024-11-04T09:46:44,691 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2024-11-04T09:46:44,693 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2024-11-04T09:46:44,696 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2024-11-04T09:46:44,698 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2024-11-04T09:46:44,701 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2024-11-04T09:46:44,703 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2024-11-04T09:46:44,706 creating build/lib/colossalai/zero/low_level 2024-11-04T09:46:44,707 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2024-11-04T09:46:44,710 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2024-11-04T09:46:44,713 copying colossalai/zero/low_level/zero_hook.py -> build/lib/colossalai/zero/low_level 2024-11-04T09:46:44,715 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2024-11-04T09:46:44,718 creating build/lib/colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:44,719 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:44,721 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:44,723 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:44,725 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:44,727 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:44,730 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:44,732 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:44,734 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:44,736 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:44,739 creating build/lib/colossalai/zero/gemini/chunk 2024-11-04T09:46:44,740 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2024-11-04T09:46:44,743 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2024-11-04T09:46:44,745 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2024-11-04T09:46:44,747 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-11-04T09:46:44,750 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-11-04T09:46:44,753 creating build/lib/colossalai/zero/low_level/bookkeeping 2024-11-04T09:46:44,754 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-11-04T09:46:44,757 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-11-04T09:46:44,759 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-11-04T09:46:44,761 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-11-04T09:46:44,763 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-11-04T09:46:44,766 creating build/lib/colossalai/cli/launcher 2024-11-04T09:46:44,768 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2024-11-04T09:46:44,770 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2024-11-04T09:46:44,773 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2024-11-04T09:46:44,775 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2024-11-04T09:46:44,778 creating build/lib/colossalai/cli/check 2024-11-04T09:46:44,779 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2024-11-04T09:46:44,782 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2024-11-04T09:46:44,784 creating build/lib/colossalai/tensor/moe_tensor 2024-11-04T09:46:44,785 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2024-11-04T09:46:44,787 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2024-11-04T09:46:44,789 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2024-11-04T09:46:44,791 creating build/lib/colossalai/tensor/d_tensor 2024-11-04T09:46:44,793 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-11-04T09:46:44,795 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-11-04T09:46:44,803 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2024-11-04T09:46:44,805 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2024-11-04T09:46:44,807 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2024-11-04T09:46:44,809 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2024-11-04T09:46:44,811 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2024-11-04T09:46:44,814 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2024-11-04T09:46:44,817 creating build/lib/colossalai/tensor/padded_tensor 2024-11-04T09:46:44,818 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2024-11-04T09:46:44,820 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2024-11-04T09:46:44,822 creating build/lib/extensions/pybind 2024-11-04T09:46:44,824 copying extensions/pybind/__init__.py -> build/lib/extensions/pybind 2024-11-04T09:46:44,826 creating build/lib/extensions/csrc 2024-11-04T09:46:44,827 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2024-11-04T09:46:44,829 creating build/lib/extensions/pybind/layernorm 2024-11-04T09:46:44,830 copying extensions/pybind/layernorm/__init__.py -> build/lib/extensions/pybind/layernorm 2024-11-04T09:46:44,833 copying extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/extensions/pybind/layernorm 2024-11-04T09:46:44,835 creating build/lib/extensions/pybind/inference 2024-11-04T09:46:44,836 copying extensions/pybind/inference/__init__.py -> build/lib/extensions/pybind/inference 2024-11-04T09:46:44,838 copying extensions/pybind/inference/inference_ops_cuda.py -> build/lib/extensions/pybind/inference 2024-11-04T09:46:44,840 creating build/lib/extensions/pybind/moe 2024-11-04T09:46:44,841 copying extensions/pybind/moe/__init__.py -> build/lib/extensions/pybind/moe 2024-11-04T09:46:44,843 copying extensions/pybind/moe/moe_cuda.py -> build/lib/extensions/pybind/moe 2024-11-04T09:46:44,846 creating build/lib/extensions/pybind/optimizer 2024-11-04T09:46:44,847 copying extensions/pybind/optimizer/__init__.py -> build/lib/extensions/pybind/optimizer 2024-11-04T09:46:44,849 copying extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/pybind/optimizer 2024-11-04T09:46:44,851 creating build/lib/extensions/pybind/cpu_adam 2024-11-04T09:46:44,852 copying extensions/pybind/cpu_adam/__init__.py -> build/lib/extensions/pybind/cpu_adam 2024-11-04T09:46:44,854 copying extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/pybind/cpu_adam 2024-11-04T09:46:44,856 copying extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/pybind/cpu_adam 2024-11-04T09:46:44,859 creating build/lib/extensions/pybind/flash_attention 2024-11-04T09:46:44,860 copying extensions/pybind/flash_attention/__init__.py -> build/lib/extensions/pybind/flash_attention 2024-11-04T09:46:44,862 copying extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-11-04T09:46:44,864 copying extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/extensions/pybind/flash_attention 2024-11-04T09:46:44,866 copying extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-11-04T09:46:44,868 creating build/lib/extensions/pybind/softmax 2024-11-04T09:46:44,869 copying extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-11-04T09:46:44,871 copying extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-11-04T09:46:44,873 copying extensions/pybind/softmax/__init__.py -> build/lib/extensions/pybind/softmax 2024-11-04T09:46:44,959 creating build/lib/colossalai/kernel/extensions/csrc/common 2024-11-04T09:46:44,960 copying colossalai/kernel/extensions/csrc/common/micros.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-11-04T09:46:44,963 copying colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-11-04T09:46:44,965 copying colossalai/kernel/extensions/csrc/common/data_type.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-11-04T09:46:44,967 copying colossalai/kernel/extensions/csrc/common/target.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-11-04T09:46:44,970 copying colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-11-04T09:46:44,972 creating build/lib/colossalai/kernel/extensions/csrc/funcs 2024-11-04T09:46:44,973 copying colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-11-04T09:46:44,975 copying colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-11-04T09:46:44,978 copying colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-11-04T09:46:44,981 copying colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-11-04T09:46:44,983 copying colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-11-04T09:46:44,987 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:44,988 copying colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:44,991 copying colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:44,994 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:44,997 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:44,999 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,002 copying colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,005 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,008 copying colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,012 copying colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,015 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,017 copying colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,020 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,023 copying colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,026 copying colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,029 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,031 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,034 copying colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,036 copying colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:45,039 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-11-04T09:46:45,040 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-11-04T09:46:45,042 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-11-04T09:46:45,045 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-11-04T09:46:45,047 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-11-04T09:46:45,049 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-11-04T09:46:45,050 copying colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-11-04T09:46:45,053 creating build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-11-04T09:46:45,054 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-11-04T09:46:45,057 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-11-04T09:46:45,061 creating build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-11-04T09:46:45,062 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-11-04T09:46:45,065 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-11-04T09:46:45,069 copying colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-11-04T09:46:45,072 copying colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-11-04T09:46:45,076 copying colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-11-04T09:46:45,079 copying colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-11-04T09:46:45,085 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-11-04T09:46:45,087 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-11-04T09:46:45,191 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-11-04T09:46:45,192 !! 2024-11-04T09:46:45,193 ******************************************************************************** 2024-11-04T09:46:45,193 Please avoid running ``setup.py`` directly. 2024-11-04T09:46:45,194 Instead, use pypa/build, pypa/installer or other 2024-11-04T09:46:45,194 standards-based tools. 2024-11-04T09:46:45,195 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-11-04T09:46:45,196 ******************************************************************************** 2024-11-04T09:46:45,197 !! 2024-11-04T09:46:45,197 self.initialize_options() 2024-11-04T09:46:45,220 installing to build/bdist.linux-armv7l/wheel 2024-11-04T09:46:45,220 running install 2024-11-04T09:46:45,244 running install_lib 2024-11-04T09:46:45,272 creating build/bdist.linux-armv7l/wheel 2024-11-04T09:46:45,274 creating build/bdist.linux-armv7l/wheel/colossalai 2024-11-04T09:46:45,276 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2024-11-04T09:46:45,278 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-11-04T09:46:45,279 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-11-04T09:46:45,281 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-11-04T09:46:45,283 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-11-04T09:46:45,285 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-11-04T09:46:45,287 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-11-04T09:46:45,289 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-11-04T09:46:45,290 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-11-04T09:46:45,293 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-11-04T09:46:45,295 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-11-04T09:46:45,297 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-11-04T09:46:45,300 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-11-04T09:46:45,302 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-11-04T09:46:45,305 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-11-04T09:46:45,307 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-11-04T09:46:45,309 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-11-04T09:46:45,311 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-11-04T09:46:45,315 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-11-04T09:46:45,317 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-11-04T09:46:45,318 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2024-11-04T09:46:45,320 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2024-11-04T09:46:45,322 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2024-11-04T09:46:45,325 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2024-11-04T09:46:45,326 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_C 2024-11-04T09:46:45,328 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2024-11-04T09:46:45,329 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2024-11-04T09:46:45,331 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-11-04T09:46:45,333 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-11-04T09:46:45,334 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-11-04T09:46:45,337 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-11-04T09:46:45,338 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-11-04T09:46:45,340 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2024-11-04T09:46:45,343 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-11-04T09:46:45,344 copying build/lib/colossalai/nn/optimizer/distributed_adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,347 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,349 copying build/lib/colossalai/nn/optimizer/galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,351 copying build/lib/colossalai/nn/optimizer/adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,354 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,356 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,358 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,361 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,363 copying build/lib/colossalai/nn/optimizer/came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,365 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,367 copying build/lib/colossalai/nn/optimizer/distributed_came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,370 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,371 copying build/lib/colossalai/nn/optimizer/distributed_galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,374 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,376 copying build/lib/colossalai/nn/optimizer/distributed_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,378 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-11-04T09:46:45,381 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-11-04T09:46:45,382 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/loss 2024-11-04T09:46:45,385 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-11-04T09:46:45,386 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-11-04T09:46:45,388 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-11-04T09:46:45,390 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-11-04T09:46:45,392 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-11-04T09:46:45,393 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-11-04T09:46:45,395 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-11-04T09:46:45,398 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-11-04T09:46:45,399 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-11-04T09:46:45,402 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai 2024-11-04T09:46:45,405 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-11-04T09:46:45,406 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel 2024-11-04T09:46:45,409 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-11-04T09:46:45,410 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/pipeline_shard 2024-11-04T09:46:45,413 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-11-04T09:46:45,414 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-11-04T09:46:45,417 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-11-04T09:46:45,419 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-11-04T09:46:45,421 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-11-04T09:46:45,423 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-11-04T09:46:45,426 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-11-04T09:46:45,429 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-11-04T09:46:45,431 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-11-04T09:46:45,433 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-11-04T09:46:45,436 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-11-04T09:46:45,439 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-11-04T09:46:45,441 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-11-04T09:46:45,444 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-11-04T09:46:45,446 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-11-04T09:46:45,449 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-11-04T09:46:45,451 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-11-04T09:46:45,454 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-11-04T09:46:45,457 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-11-04T09:46:45,458 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-11-04T09:46:45,460 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-11-04T09:46:45,462 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-11-04T09:46:45,464 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:45,465 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:45,467 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:45,469 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:45,471 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:45,473 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:45,475 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-11-04T09:46:45,478 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-11-04T09:46:45,480 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-11-04T09:46:45,482 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-11-04T09:46:45,483 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-11-04T09:46:45,486 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-11-04T09:46:45,489 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-11-04T09:46:45,491 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-11-04T09:46:45,493 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-11-04T09:46:45,496 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,497 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,499 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,502 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,505 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,506 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,508 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,510 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,512 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,514 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,517 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,519 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,521 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,523 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,526 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,529 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,531 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,533 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,536 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,538 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,540 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,542 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,544 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,546 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-11-04T09:46:45,549 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,551 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,553 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,555 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,557 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,559 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,561 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,562 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,564 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,566 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,568 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,570 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,572 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,574 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,575 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,577 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,580 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,582 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,583 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,586 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,587 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,589 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,591 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,593 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-11-04T09:46:45,596 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-11-04T09:46:45,597 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-11-04T09:46:45,600 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-11-04T09:46:45,601 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-11-04T09:46:45,604 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-11-04T09:46:45,607 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-11-04T09:46:45,609 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-11-04T09:46:45,611 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-11-04T09:46:45,613 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-11-04T09:46:45,614 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-11-04T09:46:45,617 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-11-04T09:46:45,618 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-11-04T09:46:45,621 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:45,622 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:45,625 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:45,626 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:45,628 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:45,630 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:45,632 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:45,634 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:45,637 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:45,638 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:45,640 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:45,643 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-11-04T09:46:45,645 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2024-11-04T09:46:45,647 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-11-04T09:46:45,648 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2024-11-04T09:46:45,650 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-11-04T09:46:45,652 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-11-04T09:46:45,653 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-11-04T09:46:45,655 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-11-04T09:46:45,657 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-11-04T09:46:45,660 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2024-11-04T09:46:45,663 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-11-04T09:46:45,664 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-11-04T09:46:45,666 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-11-04T09:46:45,668 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-11-04T09:46:45,670 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-11-04T09:46:45,672 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp 2024-11-04T09:46:45,674 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-11-04T09:46:45,676 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-11-04T09:46:45,677 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-11-04T09:46:45,679 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-11-04T09:46:45,681 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-11-04T09:46:45,683 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-11-04T09:46:45,685 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-11-04T09:46:45,687 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-11-04T09:46:45,689 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-11-04T09:46:45,690 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,693 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,695 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,697 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,699 copying build/lib/colossalai/shardformer/policies/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,702 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,704 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,707 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,709 copying build/lib/colossalai/shardformer/policies/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,712 copying build/lib/colossalai/shardformer/policies/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,714 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,717 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,719 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,722 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,724 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,727 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,729 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,732 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,735 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,737 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,739 copying build/lib/colossalai/shardformer/policies/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-11-04T09:46:45,742 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2024-11-04T09:46:45,744 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-11-04T09:46:45,745 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-11-04T09:46:45,747 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-11-04T09:46:45,749 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-11-04T09:46:45,751 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-11-04T09:46:45,753 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-11-04T09:46:45,756 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-11-04T09:46:45,758 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-11-04T09:46:45,761 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-11-04T09:46:45,763 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-11-04T09:46:45,766 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-11-04T09:46:45,769 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-11-04T09:46:45,772 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-11-04T09:46:45,773 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,777 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-11-04T09:46:45,778 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2024-11-04T09:46:45,779 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2024-11-04T09:46:45,782 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2024-11-04T09:46:45,785 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,787 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,789 copying build/lib/colossalai/shardformer/modeling/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,798 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,800 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,803 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,806 copying build/lib/colossalai/shardformer/modeling/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,809 copying build/lib/colossalai/shardformer/modeling/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,812 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,815 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,818 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,820 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,822 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,825 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,828 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,832 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,834 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,837 copying build/lib/colossalai/shardformer/modeling/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,840 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-11-04T09:46:45,842 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2024-11-04T09:46:45,844 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2024-11-04T09:46:45,845 copying build/lib/colossalai/inference/flash_decoding_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-11-04T09:46:45,847 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-11-04T09:46:45,850 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-11-04T09:46:45,851 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2024-11-04T09:46:45,853 copying build/lib/colossalai/inference/kv_cache/block_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2024-11-04T09:46:45,855 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2024-11-04T09:46:45,859 copying build/lib/colossalai/inference/logit_processors.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-11-04T09:46:45,862 copying build/lib/colossalai/inference/sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-11-04T09:46:45,866 creating build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-11-04T09:46:45,867 copying build/lib/colossalai/inference/executor/rpc_worker.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2024-11-04T09:46:45,871 copying build/lib/colossalai/inference/executor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2024-11-04T09:46:45,873 creating build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-11-04T09:46:45,876 copying build/lib/colossalai/inference/server/chat_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-11-04T09:46:45,879 copying build/lib/colossalai/inference/server/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-11-04T09:46:45,881 copying build/lib/colossalai/inference/server/api_server.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-11-04T09:46:45,885 copying build/lib/colossalai/inference/server/completion_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-11-04T09:46:45,888 copying build/lib/colossalai/inference/server/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-11-04T09:46:45,891 copying build/lib/colossalai/inference/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-11-04T09:46:45,895 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-11-04T09:46:45,897 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-11-04T09:46:45,900 copying build/lib/colossalai/inference/modeling/models/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-11-04T09:46:45,904 copying build/lib/colossalai/inference/modeling/models/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-11-04T09:46:45,908 copying build/lib/colossalai/inference/modeling/models/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-11-04T09:46:45,910 copying build/lib/colossalai/inference/modeling/models/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-11-04T09:46:45,914 copying build/lib/colossalai/inference/modeling/models/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-11-04T09:46:45,917 copying build/lib/colossalai/inference/modeling/models/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-11-04T09:46:45,921 copying build/lib/colossalai/inference/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling 2024-11-04T09:46:45,924 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-11-04T09:46:45,926 copying build/lib/colossalai/inference/modeling/layers/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-11-04T09:46:45,930 copying build/lib/colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-11-04T09:46:45,933 copying build/lib/colossalai/inference/modeling/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-11-04T09:46:45,936 copying build/lib/colossalai/inference/modeling/layers/diffusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-11-04T09:46:45,939 copying build/lib/colossalai/inference/modeling/layers/distrifusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-11-04T09:46:45,943 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-11-04T09:46:45,946 copying build/lib/colossalai/inference/modeling/backends/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2024-11-04T09:46:45,948 copying build/lib/colossalai/inference/modeling/backends/attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2024-11-04T09:46:45,952 copying build/lib/colossalai/inference/modeling/backends/pre_attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2024-11-04T09:46:45,956 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-11-04T09:46:45,957 copying build/lib/colossalai/inference/modeling/policy/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-11-04T09:46:45,960 copying build/lib/colossalai/inference/modeling/policy/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-11-04T09:46:45,962 copying build/lib/colossalai/inference/modeling/policy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-11-04T09:46:45,964 copying build/lib/colossalai/inference/modeling/policy/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-11-04T09:46:45,966 copying build/lib/colossalai/inference/modeling/policy/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-11-04T09:46:45,968 copying build/lib/colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-11-04T09:46:45,972 creating build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-11-04T09:46:45,973 copying build/lib/colossalai/inference/core/request_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-11-04T09:46:45,977 copying build/lib/colossalai/inference/core/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-11-04T09:46:45,979 copying build/lib/colossalai/inference/core/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-11-04T09:46:45,981 copying build/lib/colossalai/inference/core/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-11-04T09:46:45,984 copying build/lib/colossalai/inference/core/rpc_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-11-04T09:46:45,986 copying build/lib/colossalai/inference/core/base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-11-04T09:46:45,989 copying build/lib/colossalai/inference/core/diffusion_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-11-04T09:46:45,991 copying build/lib/colossalai/inference/core/plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-11-04T09:46:45,993 copying build/lib/colossalai/inference/core/llm_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-11-04T09:46:45,997 creating build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-11-04T09:46:45,998 copying build/lib/colossalai/inference/spec/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2024-11-04T09:46:46,000 copying build/lib/colossalai/inference/spec/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2024-11-04T09:46:46,002 copying build/lib/colossalai/inference/spec/drafter.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2024-11-04T09:46:46,005 copying build/lib/colossalai/inference/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-11-04T09:46:46,008 copying build/lib/colossalai/inference/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-11-04T09:46:46,010 copying build/lib/colossalai/inference/graph_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-11-04T09:46:46,013 copying build/lib/colossalai/inference/batch_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-11-04T09:46:46,016 creating build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-11-04T09:46:46,018 copying build/lib/colossalai/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-11-04T09:46:46,020 copying build/lib/colossalai/quantization/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-11-04T09:46:46,023 copying build/lib/colossalai/quantization/fp8_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-11-04T09:46:46,025 copying build/lib/colossalai/quantization/bnb.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-11-04T09:46:46,028 copying build/lib/colossalai/quantization/fp8_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-11-04T09:46:46,030 copying build/lib/colossalai/quantization/bnb_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-11-04T09:46:46,032 copying build/lib/colossalai/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-11-04T09:46:46,035 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2024-11-04T09:46:46,037 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-11-04T09:46:46,039 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-11-04T09:46:46,041 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-11-04T09:46:46,043 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-11-04T09:46:46,046 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-11-04T09:46:46,047 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2024-11-04T09:46:46,050 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-11-04T09:46:46,051 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-11-04T09:46:46,054 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-11-04T09:46:46,056 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-11-04T09:46:46,057 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-11-04T09:46:46,059 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-11-04T09:46:46,061 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-11-04T09:46:46,063 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-11-04T09:46:46,066 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-11-04T09:46:46,068 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-11-04T09:46:46,070 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-11-04T09:46:46,073 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-11-04T09:46:46,074 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2024-11-04T09:46:46,076 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2024-11-04T09:46:46,079 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2024-11-04T09:46:46,081 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-11-04T09:46:46,083 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-11-04T09:46:46,085 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2024-11-04T09:46:46,087 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-11-04T09:46:46,089 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-11-04T09:46:46,090 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-11-04T09:46:46,093 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-11-04T09:46:46,095 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-11-04T09:46:46,098 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-11-04T09:46:46,100 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai 2024-11-04T09:46:46,102 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2024-11-04T09:46:46,103 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2024-11-04T09:46:46,105 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2024-11-04T09:46:46,108 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-11-04T09:46:46,109 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-11-04T09:46:46,111 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-11-04T09:46:46,113 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-11-04T09:46:46,115 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-11-04T09:46:46,117 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-11-04T09:46:46,119 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-11-04T09:46:46,121 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-11-04T09:46:46,123 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-11-04T09:46:46,125 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-11-04T09:46:46,127 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-11-04T09:46:46,129 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-11-04T09:46:46,132 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-11-04T09:46:46,134 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-11-04T09:46:46,135 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-11-04T09:46:46,137 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-11-04T09:46:46,140 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-11-04T09:46:46,142 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-11-04T09:46:46,145 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-11-04T09:46:46,146 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-11-04T09:46:46,148 copying build/lib/colossalai/checkpoint_io/moe_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-11-04T09:46:46,151 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-11-04T09:46:46,153 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-11-04T09:46:46,156 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-11-04T09:46:46,158 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-11-04T09:46:46,161 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-11-04T09:46:46,164 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2024-11-04T09:46:46,165 copying build/lib/colossalai/utils/safetensors.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-11-04T09:46:46,167 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-11-04T09:46:46,170 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-11-04T09:46:46,171 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2024-11-04T09:46:46,173 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2024-11-04T09:46:46,175 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-11-04T09:46:46,178 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-11-04T09:46:46,179 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2024-11-04T09:46:46,181 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2024-11-04T09:46:46,183 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-11-04T09:46:46,185 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2024-11-04T09:46:46,186 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2024-11-04T09:46:46,189 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-11-04T09:46:46,190 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2024-11-04T09:46:46,192 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2024-11-04T09:46:46,194 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-11-04T09:46:46,196 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-11-04T09:46:46,199 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-11-04T09:46:46,200 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2024-11-04T09:46:46,203 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2024-11-04T09:46:46,205 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2024-11-04T09:46:46,208 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-11-04T09:46:46,209 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-11-04T09:46:46,211 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-11-04T09:46:46,214 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-11-04T09:46:46,216 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-11-04T09:46:46,219 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-11-04T09:46:46,221 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-11-04T09:46:46,224 creating build/bdist.linux-armv7l/wheel/colossalai/context 2024-11-04T09:46:46,225 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2024-11-04T09:46:46,227 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2024-11-04T09:46:46,229 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2024-11-04T09:46:46,231 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2024-11-04T09:46:46,233 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-11-04T09:46:46,234 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2024-11-04T09:46:46,236 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2024-11-04T09:46:46,239 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-11-04T09:46:46,241 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-11-04T09:46:46,243 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-11-04T09:46:46,245 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-11-04T09:46:46,247 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-11-04T09:46:46,248 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-11-04T09:46:46,250 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-11-04T09:46:46,253 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-11-04T09:46:46,255 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-11-04T09:46:46,256 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch 2024-11-04T09:46:46,259 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-11-04T09:46:46,260 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-11-04T09:46:46,262 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-11-04T09:46:46,264 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-11-04T09:46:46,266 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-11-04T09:46:46,268 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-11-04T09:46:46,270 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-11-04T09:46:46,272 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-11-04T09:46:46,274 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-11-04T09:46:46,276 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-11-04T09:46:46,277 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-11-04T09:46:46,280 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-11-04T09:46:46,282 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-11-04T09:46:46,284 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch 2024-11-04T09:46:46,286 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:46,287 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:46,289 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:46,291 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:46,293 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:46,295 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:46,297 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:46,299 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:46,301 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-11-04T09:46:46,303 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:46,305 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:46,307 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:46,308 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:46,310 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:46,312 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:46,315 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:46,317 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:46,318 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-11-04T09:46:46,320 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-11-04T09:46:46,322 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-11-04T09:46:46,325 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-11-04T09:46:46,328 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-11-04T09:46:46,329 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-11-04T09:46:46,331 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-11-04T09:46:46,334 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-11-04T09:46:46,336 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-11-04T09:46:46,338 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-11-04T09:46:46,340 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-11-04T09:46:46,343 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-11-04T09:46:46,346 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-11-04T09:46:46,348 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-11-04T09:46:46,350 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-11-04T09:46:46,353 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-11-04T09:46:46,354 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-11-04T09:46:46,357 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-11-04T09:46:46,360 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-11-04T09:46:46,361 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-11-04T09:46:46,364 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-11-04T09:46:46,367 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-11-04T09:46:46,368 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-11-04T09:46:46,370 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-11-04T09:46:46,373 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:46,374 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:46,376 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:46,378 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:46,380 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:46,382 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:46,384 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:46,386 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:46,388 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:46,390 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-11-04T09:46:46,391 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-11-04T09:46:46,394 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-11-04T09:46:46,396 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:46,397 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:46,399 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:46,401 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:46,403 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:46,405 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:46,407 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:46,409 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:46,412 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:46,414 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:46,416 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:46,418 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-11-04T09:46:46,421 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-11-04T09:46:46,423 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-11-04T09:46:46,425 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-11-04T09:46:46,427 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-11-04T09:46:46,430 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-11-04T09:46:46,431 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2024-11-04T09:46:46,434 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-11-04T09:46:46,436 copying build/lib/colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-11-04T09:46:46,439 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-11-04T09:46:46,441 copying build/lib/colossalai/kernel/triton/fused_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-11-04T09:46:46,444 copying build/lib/colossalai/kernel/triton/rotary_cache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-11-04T09:46:46,446 copying build/lib/colossalai/kernel/triton/context_attn_unpad.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-11-04T09:46:46,449 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-11-04T09:46:46,452 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-11-04T09:46:46,454 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-11-04T09:46:46,457 copying build/lib/colossalai/kernel/triton/kvcache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-11-04T09:46:46,460 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-11-04T09:46:46,462 copying build/lib/colossalai/kernel/triton/rms_layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-11-04T09:46:46,465 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-11-04T09:46:46,467 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-11-04T09:46:46,469 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-11-04T09:46:46,472 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-11-04T09:46:46,474 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-11-04T09:46:46,476 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2024-11-04T09:46:46,478 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2024-11-04T09:46:46,480 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2024-11-04T09:46:46,483 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-11-04T09:46:46,485 copying build/lib/colossalai/kernel/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2024-11-04T09:46:46,487 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2024-11-04T09:46:46,489 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2024-11-04T09:46:46,491 copying build/lib/colossalai/kernel/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind 2024-11-04T09:46:46,494 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-11-04T09:46:46,496 copying build/lib/colossalai/kernel/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2024-11-04T09:46:46,498 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2024-11-04T09:46:46,500 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2024-11-04T09:46:46,503 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-11-04T09:46:46,504 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2024-11-04T09:46:46,506 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2024-11-04T09:46:46,509 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2024-11-04T09:46:46,511 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-11-04T09:46:46,513 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2024-11-04T09:46:46,515 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2024-11-04T09:46:46,517 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2024-11-04T09:46:46,520 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-11-04T09:46:46,521 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-11-04T09:46:46,523 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-11-04T09:46:46,526 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-11-04T09:46:46,528 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-11-04T09:46:46,531 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-11-04T09:46:46,533 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-11-04T09:46:46,535 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-11-04T09:46:46,537 copying build/lib/colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-11-04T09:46:46,539 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-11-04T09:46:46,542 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-11-04T09:46:46,544 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-11-04T09:46:46,546 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-11-04T09:46:46,549 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-11-04T09:46:46,551 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-11-04T09:46:46,553 copying build/lib/colossalai/kernel/extensions/csrc/common/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-11-04T09:46:46,556 copying build/lib/colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-11-04T09:46:46,558 copying build/lib/colossalai/kernel/extensions/csrc/common/data_type.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-11-04T09:46:46,560 copying build/lib/colossalai/kernel/extensions/csrc/common/target.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-11-04T09:46:46,562 copying build/lib/colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-11-04T09:46:46,564 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc 2024-11-04T09:46:46,566 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-11-04T09:46:46,568 copying build/lib/colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-11-04T09:46:46,570 copying build/lib/colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-11-04T09:46:46,573 copying build/lib/colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-11-04T09:46:46,575 copying build/lib/colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-11-04T09:46:46,577 copying build/lib/colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-11-04T09:46:46,581 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel 2024-11-04T09:46:46,583 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,584 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,587 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,589 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,592 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,594 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,597 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,599 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,602 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,606 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-11-04T09:46:46,607 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-11-04T09:46:46,610 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-11-04T09:46:46,612 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-11-04T09:46:46,614 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-11-04T09:46:46,616 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,618 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,620 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,623 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,626 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-11-04T09:46:46,628 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-11-04T09:46:46,630 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,633 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,635 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,638 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,640 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,642 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-11-04T09:46:46,646 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-11-04T09:46:46,647 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2024-11-04T09:46:46,650 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2024-11-04T09:46:46,653 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-11-04T09:46:46,655 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2024-11-04T09:46:46,658 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2024-11-04T09:46:46,661 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-11-04T09:46:46,664 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-11-04T09:46:46,668 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2024-11-04T09:46:46,672 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-11-04T09:46:46,674 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-11-04T09:46:46,677 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-11-04T09:46:46,680 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-11-04T09:46:46,682 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-11-04T09:46:46,686 creating build/bdist.linux-armv7l/wheel/colossalai/device 2024-11-04T09:46:46,688 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-11-04T09:46:46,692 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-11-04T09:46:46,695 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-11-04T09:46:46,698 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-11-04T09:46:46,702 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/./colossalai 2024-11-04T09:46:46,705 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2024-11-04T09:46:46,707 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-11-04T09:46:46,711 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-11-04T09:46:46,714 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-11-04T09:46:46,717 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-11-04T09:46:46,720 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-11-04T09:46:46,724 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-11-04T09:46:46,727 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-11-04T09:46:46,729 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn 2024-11-04T09:46:46,733 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-11-04T09:46:46,736 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-11-04T09:46:46,738 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-11-04T09:46:46,742 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-11-04T09:46:46,746 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-11-04T09:46:46,750 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-11-04T09:46:46,754 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-11-04T09:46:46,756 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2024-11-04T09:46:46,759 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2024-11-04T09:46:46,762 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2024-11-04T09:46:46,764 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2024-11-04T09:46:46,767 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-11-04T09:46:46,769 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2024-11-04T09:46:46,771 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2024-11-04T09:46:46,774 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-11-04T09:46:46,775 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-11-04T09:46:46,778 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-11-04T09:46:46,785 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-11-04T09:46:46,788 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-11-04T09:46:46,791 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:46,792 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:46,794 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:46,796 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:46,798 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:46,800 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:46,802 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-11-04T09:46:46,805 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-11-04T09:46:46,806 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-11-04T09:46:46,808 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-11-04T09:46:46,811 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-11-04T09:46:46,814 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-11-04T09:46:46,817 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-11-04T09:46:46,818 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-11-04T09:46:46,820 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-11-04T09:46:46,823 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-11-04T09:46:46,825 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-11-04T09:46:46,828 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-11-04T09:46:46,829 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-11-04T09:46:46,831 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-11-04T09:46:46,834 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-11-04T09:46:46,836 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-11-04T09:46:46,839 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-11-04T09:46:46,840 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2024-11-04T09:46:46,842 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2024-11-04T09:46:46,844 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-11-04T09:46:46,845 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2024-11-04T09:46:46,847 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2024-11-04T09:46:46,850 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2024-11-04T09:46:46,852 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-11-04T09:46:46,853 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-11-04T09:46:46,856 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-11-04T09:46:46,857 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-11-04T09:46:46,860 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:46,861 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:46,863 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:46,866 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:46,868 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:46,870 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:46,872 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:46,874 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:46,877 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:46,879 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-11-04T09:46:46,881 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-11-04T09:46:46,883 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-11-04T09:46:46,886 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-11-04T09:46:46,887 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2024-11-04T09:46:46,889 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2024-11-04T09:46:46,891 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-11-04T09:46:46,893 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-11-04T09:46:46,895 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-11-04T09:46:46,897 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-11-04T09:46:46,899 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-11-04T09:46:46,902 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-11-04T09:46:46,905 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-11-04T09:46:46,906 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-11-04T09:46:46,908 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-11-04T09:46:46,909 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-11-04T09:46:46,911 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-11-04T09:46:46,913 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-11-04T09:46:46,915 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-11-04T09:46:46,918 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-11-04T09:46:46,920 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-11-04T09:46:46,921 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-11-04T09:46:46,923 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-11-04T09:46:46,925 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-11-04T09:46:46,927 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-11-04T09:46:46,930 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-11-04T09:46:46,931 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2024-11-04T09:46:46,933 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2024-11-04T09:46:46,935 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2024-11-04T09:46:46,937 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2024-11-04T09:46:46,939 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-11-04T09:46:46,940 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2024-11-04T09:46:46,942 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2024-11-04T09:46:46,945 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2024-11-04T09:46:46,947 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-11-04T09:46:46,948 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-11-04T09:46:46,950 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-11-04T09:46:46,953 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-11-04T09:46:46,955 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-11-04T09:46:46,957 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-11-04T09:46:46,958 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2024-11-04T09:46:46,960 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2024-11-04T09:46:46,963 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-11-04T09:46:46,965 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-11-04T09:46:46,966 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-11-04T09:46:46,969 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-11-04T09:46:46,970 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-11-04T09:46:46,973 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-11-04T09:46:46,975 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-11-04T09:46:46,977 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-11-04T09:46:46,980 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-11-04T09:46:46,983 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-11-04T09:46:46,984 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-11-04T09:46:46,987 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-11-04T09:46:46,989 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-11-04T09:46:46,991 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-11-04T09:46:46,994 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-11-04T09:46:46,996 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-11-04T09:46:46,999 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:47,000 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:47,002 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:47,003 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:47,005 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:47,007 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:47,009 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:47,011 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:47,014 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:47,016 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-11-04T09:46:47,019 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-11-04T09:46:47,020 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2024-11-04T09:46:47,022 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2024-11-04T09:46:47,025 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-11-04T09:46:47,026 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2024-11-04T09:46:47,028 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2024-11-04T09:46:47,031 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-11-04T09:46:47,032 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2024-11-04T09:46:47,034 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2024-11-04T09:46:47,037 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2024-11-04T09:46:47,039 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-11-04T09:46:47,041 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2024-11-04T09:46:47,042 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2024-11-04T09:46:47,045 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:47,046 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:47,048 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:47,050 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:47,052 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:47,053 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:47,055 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:47,057 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:47,059 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-11-04T09:46:47,061 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-11-04T09:46:47,063 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2024-11-04T09:46:47,065 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2024-11-04T09:46:47,068 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-11-04T09:46:47,069 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-11-04T09:46:47,072 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-11-04T09:46:47,074 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-11-04T09:46:47,076 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-11-04T09:46:47,078 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-11-04T09:46:47,080 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-11-04T09:46:47,082 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-11-04T09:46:47,084 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2024-11-04T09:46:47,086 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2024-11-04T09:46:47,088 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-11-04T09:46:47,089 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2024-11-04T09:46:47,091 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2024-11-04T09:46:47,094 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-11-04T09:46:47,095 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-11-04T09:46:47,097 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-11-04T09:46:47,099 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-11-04T09:46:47,100 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-11-04T09:46:47,102 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-11-04T09:46:47,104 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-11-04T09:46:47,106 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-11-04T09:46:47,109 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-11-04T09:46:47,110 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-11-04T09:46:47,113 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-11-04T09:46:47,115 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-11-04T09:46:47,118 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-11-04T09:46:47,119 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2024-11-04T09:46:47,121 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2024-11-04T09:46:47,123 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2024-11-04T09:46:47,125 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-11-04T09:46:47,127 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2024-11-04T09:46:47,129 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2024-11-04T09:46:47,131 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2024-11-04T09:46:47,133 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-11-04T09:46:47,135 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-11-04T09:46:47,138 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-11-04T09:46:47,139 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-11-04T09:46:47,141 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-11-04T09:46:47,145 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-11-04T09:46:47,146 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-11-04T09:46:47,148 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-11-04T09:46:47,150 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-11-04T09:46:47,151 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-11-04T09:46:47,154 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-11-04T09:46:47,155 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-11-04T09:46:47,158 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-11-04T09:46:47,159 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-11-04T09:46:47,161 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-11-04T09:46:47,163 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-11-04T09:46:47,165 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-11-04T09:46:47,168 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-11-04T09:46:47,169 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-11-04T09:46:47,171 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2024-11-04T09:46:47,173 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2024-11-04T09:46:47,175 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2024-11-04T09:46:47,177 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2024-11-04T09:46:47,179 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-11-04T09:46:47,181 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-11-04T09:46:47,183 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-11-04T09:46:47,185 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-11-04T09:46:47,188 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-11-04T09:46:47,190 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-11-04T09:46:47,193 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-11-04T09:46:47,195 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2024-11-04T09:46:47,197 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2024-11-04T09:46:47,198 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2024-11-04T09:46:47,202 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-11-04T09:46:47,203 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2024-11-04T09:46:47,204 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2024-11-04T09:46:47,206 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2024-11-04T09:46:47,210 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:47,211 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:47,213 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:47,215 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:47,217 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:47,219 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:47,221 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:47,222 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:47,225 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:47,227 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:47,230 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:47,232 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-11-04T09:46:47,234 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-11-04T09:46:47,236 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2024-11-04T09:46:47,238 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2024-11-04T09:46:47,239 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-11-04T09:46:47,242 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-11-04T09:46:47,244 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-11-04T09:46:47,245 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-11-04T09:46:47,247 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-11-04T09:46:47,250 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-11-04T09:46:47,251 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-11-04T09:46:47,253 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-11-04T09:46:47,254 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-11-04T09:46:47,257 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-11-04T09:46:47,259 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-11-04T09:46:47,261 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-11-04T09:46:47,262 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2024-11-04T09:46:47,264 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2024-11-04T09:46:47,266 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-11-04T09:46:47,268 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-11-04T09:46:47,270 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-11-04T09:46:47,272 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-11-04T09:46:47,274 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-11-04T09:46:47,276 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-11-04T09:46:47,278 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2024-11-04T09:46:47,279 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2024-11-04T09:46:47,282 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero 2024-11-04T09:46:47,284 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-11-04T09:46:47,285 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2024-11-04T09:46:47,287 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2024-11-04T09:46:47,289 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2024-11-04T09:46:47,291 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-11-04T09:46:47,293 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-11-04T09:46:47,295 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-11-04T09:46:47,297 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-11-04T09:46:47,298 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-11-04T09:46:47,300 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-11-04T09:46:47,302 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-11-04T09:46:47,304 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-11-04T09:46:47,305 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-11-04T09:46:47,308 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-11-04T09:46:47,310 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-11-04T09:46:47,312 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-11-04T09:46:47,314 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-11-04T09:46:47,317 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-11-04T09:46:47,318 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2024-11-04T09:46:47,321 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2024-11-04T09:46:47,323 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-11-04T09:46:47,325 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-11-04T09:46:47,326 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-11-04T09:46:47,329 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-11-04T09:46:47,331 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-11-04T09:46:47,333 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-11-04T09:46:47,335 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-11-04T09:46:47,337 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-11-04T09:46:47,339 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-11-04T09:46:47,342 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-11-04T09:46:47,343 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-11-04T09:46:47,345 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-11-04T09:46:47,347 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-11-04T09:46:47,349 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-11-04T09:46:47,351 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-11-04T09:46:47,353 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-11-04T09:46:47,355 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-11-04T09:46:47,357 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-11-04T09:46:47,360 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2024-11-04T09:46:47,361 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-11-04T09:46:47,363 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-11-04T09:46:47,365 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-11-04T09:46:47,367 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-11-04T09:46:47,370 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-11-04T09:46:47,372 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-11-04T09:46:47,375 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:47,377 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:47,378 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:47,380 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:47,382 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:47,385 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:47,387 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:47,389 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:47,390 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:47,392 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-11-04T09:46:47,394 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-11-04T09:46:47,397 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-11-04T09:46:47,398 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-11-04T09:46:47,401 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-11-04T09:46:47,403 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-11-04T09:46:47,405 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-11-04T09:46:47,407 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-11-04T09:46:47,409 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-11-04T09:46:47,411 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2024-11-04T09:46:47,413 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2024-11-04T09:46:47,416 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-11-04T09:46:47,417 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-11-04T09:46:47,419 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-11-04T09:46:47,422 copying build/lib/colossalai/zero/low_level/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-11-04T09:46:47,424 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-11-04T09:46:47,425 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-11-04T09:46:47,427 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-11-04T09:46:47,429 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-11-04T09:46:47,431 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-11-04T09:46:47,433 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-11-04T09:46:47,435 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-11-04T09:46:47,438 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2024-11-04T09:46:47,439 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2024-11-04T09:46:47,441 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-11-04T09:46:47,442 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-11-04T09:46:47,445 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-11-04T09:46:47,447 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-11-04T09:46:47,449 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-11-04T09:46:47,451 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-11-04T09:46:47,453 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2024-11-04T09:46:47,455 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2024-11-04T09:46:47,457 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2024-11-04T09:46:47,459 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2024-11-04T09:46:47,461 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2024-11-04T09:46:47,463 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2024-11-04T09:46:47,465 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-11-04T09:46:47,467 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-11-04T09:46:47,469 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-11-04T09:46:47,470 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-11-04T09:46:47,473 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-11-04T09:46:47,475 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-11-04T09:46:47,478 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-11-04T09:46:47,479 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2024-11-04T09:46:47,481 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2024-11-04T09:46:47,482 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2024-11-04T09:46:47,484 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-11-04T09:46:47,488 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-11-04T09:46:47,489 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-11-04T09:46:47,491 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-11-04T09:46:47,493 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-11-04T09:46:47,495 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-11-04T09:46:47,497 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-11-04T09:46:47,499 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-11-04T09:46:47,501 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-11-04T09:46:47,503 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-11-04T09:46:47,506 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-11-04T09:46:47,509 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-11-04T09:46:47,511 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2024-11-04T09:46:47,513 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2024-11-04T09:46:47,515 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-11-04T09:46:47,519 creating build/bdist.linux-armv7l/wheel/extensions 2024-11-04T09:46:47,521 creating build/bdist.linux-armv7l/wheel/extensions/pybind 2024-11-04T09:46:47,523 creating build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-11-04T09:46:47,525 copying build/lib/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2024-11-04T09:46:47,527 copying build/lib/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2024-11-04T09:46:47,529 creating build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-11-04T09:46:47,531 copying build/lib/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2024-11-04T09:46:47,533 copying build/lib/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2024-11-04T09:46:47,535 copying build/lib/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind 2024-11-04T09:46:47,537 creating build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-11-04T09:46:47,539 copying build/lib/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2024-11-04T09:46:47,541 copying build/lib/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2024-11-04T09:46:47,544 creating build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-11-04T09:46:47,545 copying build/lib/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2024-11-04T09:46:47,548 copying build/lib/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2024-11-04T09:46:47,550 creating build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-11-04T09:46:47,552 copying build/lib/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2024-11-04T09:46:47,554 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2024-11-04T09:46:47,556 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2024-11-04T09:46:47,559 creating build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-11-04T09:46:47,560 copying build/lib/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-11-04T09:46:47,562 copying build/lib/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-11-04T09:46:47,565 copying build/lib/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-11-04T09:46:47,567 copying build/lib/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-11-04T09:46:47,570 creating build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-11-04T09:46:47,571 copying build/lib/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2024-11-04T09:46:47,574 copying build/lib/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2024-11-04T09:46:47,576 copying build/lib/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2024-11-04T09:46:47,579 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2024-11-04T09:46:47,580 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/csrc 2024-11-04T09:46:47,582 running install_egg_info 2024-11-04T09:46:47,615 running egg_info 2024-11-04T09:46:47,644 writing colossalai.egg-info/PKG-INFO 2024-11-04T09:46:47,649 writing dependency_links to colossalai.egg-info/dependency_links.txt 2024-11-04T09:46:47,651 writing entry points to colossalai.egg-info/entry_points.txt 2024-11-04T09:46:47,653 writing requirements to colossalai.egg-info/requires.txt 2024-11-04T09:46:47,654 writing top-level names to colossalai.egg-info/top_level.txt 2024-11-04T09:46:47,910 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2024-11-04T09:46:47,994 reading manifest template 'MANIFEST.in' 2024-11-04T09:46:49,292 warning: no files found matching '*.tr' under directory 'colossalai' 2024-11-04T09:46:51,298 warning: no files found matching '*.cc' under directory 'colossalai' 2024-11-04T09:46:52,383 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-11-04T09:46:52,682 warning: no files found matching '*.tr' under directory 'extensions' 2024-11-04T09:46:52,807 warning: no files found matching '*.cc' under directory 'extensions' 2024-11-04T09:46:52,870 warning: no files found matching '*.pyi' under directory 'extensions' 2024-11-04T09:46:52,871 adding license file 'LICENSE' 2024-11-04T09:46:52,961 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2024-11-04T09:46:52,966 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/./colossalai-0.4.6-py3.11.egg-info 2024-11-04T09:46:52,983 running install_scripts 2024-11-04T09:46:53,025 creating build/bdist.linux-armv7l/wheel/colossalai-0.4.6.dist-info/WHEEL 2024-11-04T09:46:53,029 creating '/tmp/pip-wheel-0nvkffg4/colossalai-0.4.6-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-11-04T09:46:53,032 adding 'colossalai/__init__.py' 2024-11-04T09:46:53,034 adding 'colossalai/initialize.py' 2024-11-04T09:46:53,035 adding 'colossalai/version.py' 2024-11-04T09:46:53,037 adding 'colossalai/_C/__init__.py' 2024-11-04T09:46:53,039 adding 'colossalai/_analyzer/__init__.py' 2024-11-04T09:46:53,040 adding 'colossalai/_analyzer/envs.py' 2024-11-04T09:46:53,042 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2024-11-04T09:46:53,045 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2024-11-04T09:46:53,047 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2024-11-04T09:46:53,049 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2024-11-04T09:46:53,051 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2024-11-04T09:46:53,053 adding 'colossalai/_analyzer/fx/__init__.py' 2024-11-04T09:46:53,055 adding 'colossalai/_analyzer/fx/codegen.py' 2024-11-04T09:46:53,057 adding 'colossalai/_analyzer/fx/graph_module.py' 2024-11-04T09:46:53,059 adding 'colossalai/_analyzer/fx/node_util.py' 2024-11-04T09:46:53,060 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2024-11-04T09:46:53,062 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2024-11-04T09:46:53,064 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2024-11-04T09:46:53,066 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2024-11-04T09:46:53,068 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2024-11-04T09:46:53,069 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2024-11-04T09:46:53,071 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2024-11-04T09:46:53,072 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2024-11-04T09:46:53,074 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2024-11-04T09:46:53,076 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2024-11-04T09:46:53,078 adding 'colossalai/accelerator/__init__.py' 2024-11-04T09:46:53,080 adding 'colossalai/accelerator/api.py' 2024-11-04T09:46:53,081 adding 'colossalai/accelerator/base_accelerator.py' 2024-11-04T09:46:53,083 adding 'colossalai/accelerator/cpu_accelerator.py' 2024-11-04T09:46:53,085 adding 'colossalai/accelerator/cuda_accelerator.py' 2024-11-04T09:46:53,086 adding 'colossalai/accelerator/npu_accelerator.py' 2024-11-04T09:46:53,088 adding 'colossalai/amp/__init__.py' 2024-11-04T09:46:53,090 adding 'colossalai/amp/naive_amp/__init__.py' 2024-11-04T09:46:53,092 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2024-11-04T09:46:53,094 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2024-11-04T09:46:53,095 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2024-11-04T09:46:53,097 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2024-11-04T09:46:53,098 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2024-11-04T09:46:53,101 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2024-11-04T09:46:53,102 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2024-11-04T09:46:53,103 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2024-11-04T09:46:53,106 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2024-11-04T09:46:53,108 adding 'colossalai/auto_parallel/__init__.py' 2024-11-04T09:46:53,109 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2024-11-04T09:46:53,111 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2024-11-04T09:46:53,112 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2024-11-04T09:46:53,114 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2024-11-04T09:46:53,116 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2024-11-04T09:46:53,118 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2024-11-04T09:46:53,120 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2024-11-04T09:46:53,121 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2024-11-04T09:46:53,123 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2024-11-04T09:46:53,124 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2024-11-04T09:46:53,126 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2024-11-04T09:46:53,127 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2024-11-04T09:46:53,128 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2024-11-04T09:46:53,130 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2024-11-04T09:46:53,131 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2024-11-04T09:46:53,133 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2024-11-04T09:46:53,135 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2024-11-04T09:46:53,136 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2024-11-04T09:46:53,138 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2024-11-04T09:46:53,139 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2024-11-04T09:46:53,141 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2024-11-04T09:46:53,142 adding 'colossalai/auto_parallel/offload/__init__.py' 2024-11-04T09:46:53,144 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2024-11-04T09:46:53,145 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2024-11-04T09:46:53,146 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2024-11-04T09:46:53,148 adding 'colossalai/auto_parallel/offload/region.py' 2024-11-04T09:46:53,151 adding 'colossalai/auto_parallel/offload/region_manager.py' 2024-11-04T09:46:53,152 adding 'colossalai/auto_parallel/offload/runtime.py' 2024-11-04T09:46:53,155 adding 'colossalai/auto_parallel/offload/solver.py' 2024-11-04T09:46:53,157 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2024-11-04T09:46:53,158 adding 'colossalai/auto_parallel/offload/util.py' 2024-11-04T09:46:53,160 adding 'colossalai/auto_parallel/passes/__init__.py' 2024-11-04T09:46:53,161 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2024-11-04T09:46:53,162 adding 'colossalai/auto_parallel/passes/constants.py' 2024-11-04T09:46:53,164 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2024-11-04T09:46:53,166 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2024-11-04T09:46:53,169 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2024-11-04T09:46:53,170 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2024-11-04T09:46:53,172 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2024-11-04T09:46:53,173 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2024-11-04T09:46:53,176 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2024-11-04T09:46:53,177 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2024-11-04T09:46:53,179 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2024-11-04T09:46:53,182 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2024-11-04T09:46:53,183 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2024-11-04T09:46:53,184 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2024-11-04T09:46:53,186 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2024-11-04T09:46:53,188 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2024-11-04T09:46:53,189 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2024-11-04T09:46:53,191 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2024-11-04T09:46:53,192 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2024-11-04T09:46:53,194 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2024-11-04T09:46:53,195 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2024-11-04T09:46:53,196 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2024-11-04T09:46:53,198 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2024-11-04T09:46:53,200 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2024-11-04T09:46:53,203 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2024-11-04T09:46:53,204 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2024-11-04T09:46:53,208 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2024-11-04T09:46:53,209 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2024-11-04T09:46:53,210 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2024-11-04T09:46:53,211 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2024-11-04T09:46:53,213 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2024-11-04T09:46:53,214 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2024-11-04T09:46:53,215 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2024-11-04T09:46:53,217 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2024-11-04T09:46:53,218 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2024-11-04T09:46:53,219 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2024-11-04T09:46:53,220 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2024-11-04T09:46:53,221 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2024-11-04T09:46:53,224 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2024-11-04T09:46:53,226 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2024-11-04T09:46:53,227 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2024-11-04T09:46:53,229 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2024-11-04T09:46:53,231 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2024-11-04T09:46:53,232 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2024-11-04T09:46:53,234 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2024-11-04T09:46:53,236 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2024-11-04T09:46:53,239 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2024-11-04T09:46:53,240 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2024-11-04T09:46:53,242 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2024-11-04T09:46:53,243 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2024-11-04T09:46:53,245 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2024-11-04T09:46:53,247 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2024-11-04T09:46:53,249 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2024-11-04T09:46:53,250 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2024-11-04T09:46:53,251 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2024-11-04T09:46:53,253 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2024-11-04T09:46:53,255 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2024-11-04T09:46:53,256 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2024-11-04T09:46:53,258 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2024-11-04T09:46:53,259 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2024-11-04T09:46:53,262 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2024-11-04T09:46:53,263 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2024-11-04T09:46:53,265 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2024-11-04T09:46:53,267 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2024-11-04T09:46:53,268 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2024-11-04T09:46:53,269 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2024-11-04T09:46:53,271 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2024-11-04T09:46:53,272 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2024-11-04T09:46:53,274 adding 'colossalai/booster/__init__.py' 2024-11-04T09:46:53,275 adding 'colossalai/booster/accelerator.py' 2024-11-04T09:46:53,278 adding 'colossalai/booster/booster.py' 2024-11-04T09:46:53,280 adding 'colossalai/booster/mixed_precision/__init__.py' 2024-11-04T09:46:53,281 adding 'colossalai/booster/mixed_precision/bf16.py' 2024-11-04T09:46:53,282 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2024-11-04T09:46:53,283 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2024-11-04T09:46:53,284 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2024-11-04T09:46:53,286 adding 'colossalai/booster/mixed_precision/fp8.py' 2024-11-04T09:46:53,287 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2024-11-04T09:46:53,288 adding 'colossalai/booster/plugin/__init__.py' 2024-11-04T09:46:53,290 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2024-11-04T09:46:53,293 adding 'colossalai/booster/plugin/gemini_plugin.py' 2024-11-04T09:46:53,300 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2024-11-04T09:46:53,303 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2024-11-04T09:46:53,306 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2024-11-04T09:46:53,308 adding 'colossalai/booster/plugin/plugin_base.py' 2024-11-04T09:46:53,309 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2024-11-04T09:46:53,311 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2024-11-04T09:46:53,313 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2024-11-04T09:46:53,315 adding 'colossalai/checkpoint_io/__init__.py' 2024-11-04T09:46:53,317 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2024-11-04T09:46:53,319 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2024-11-04T09:46:53,323 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2024-11-04T09:46:53,324 adding 'colossalai/checkpoint_io/index_file.py' 2024-11-04T09:46:53,328 adding 'colossalai/checkpoint_io/moe_checkpoint.py' 2024-11-04T09:46:53,332 adding 'colossalai/checkpoint_io/utils.py' 2024-11-04T09:46:53,334 adding 'colossalai/cli/__init__.py' 2024-11-04T09:46:53,335 adding 'colossalai/cli/cli.py' 2024-11-04T09:46:53,337 adding 'colossalai/cli/check/__init__.py' 2024-11-04T09:46:53,339 adding 'colossalai/cli/check/check_installation.py' 2024-11-04T09:46:53,341 adding 'colossalai/cli/launcher/__init__.py' 2024-11-04T09:46:53,342 adding 'colossalai/cli/launcher/hostinfo.py' 2024-11-04T09:46:53,343 adding 'colossalai/cli/launcher/multinode_runner.py' 2024-11-04T09:46:53,345 adding 'colossalai/cli/launcher/run.py' 2024-11-04T09:46:53,347 adding 'colossalai/cluster/__init__.py' 2024-11-04T09:46:53,348 adding 'colossalai/cluster/device_mesh_manager.py' 2024-11-04T09:46:53,351 adding 'colossalai/cluster/dist_coordinator.py' 2024-11-04T09:46:53,352 adding 'colossalai/cluster/process_group_manager.py' 2024-11-04T09:46:53,354 adding 'colossalai/cluster/process_group_mesh.py' 2024-11-04T09:46:53,356 adding 'colossalai/context/__init__.py' 2024-11-04T09:46:53,357 adding 'colossalai/context/config.py' 2024-11-04T09:46:53,358 adding 'colossalai/context/singleton_meta.py' 2024-11-04T09:46:53,359 adding 'colossalai/device/__init__.py' 2024-11-04T09:46:53,361 adding 'colossalai/device/alpha_beta_profiler.py' 2024-11-04T09:46:53,363 adding 'colossalai/device/calc_pipeline_strategy.py' 2024-11-04T09:46:53,366 adding 'colossalai/device/device_mesh.py' 2024-11-04T09:46:53,367 adding 'colossalai/fx/__init__.py' 2024-11-04T09:46:53,369 adding 'colossalai/fx/_compatibility.py' 2024-11-04T09:46:53,371 adding 'colossalai/fx/_meta_regist_12.py' 2024-11-04T09:46:53,372 adding 'colossalai/fx/_meta_regist_13.py' 2024-11-04T09:46:53,374 adding 'colossalai/fx/graph_module.py' 2024-11-04T09:46:53,375 adding 'colossalai/fx/proxy.py' 2024-11-04T09:46:53,377 adding 'colossalai/fx/codegen/__init__.py' 2024-11-04T09:46:53,381 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2024-11-04T09:46:53,383 adding 'colossalai/fx/passes/__init__.py' 2024-11-04T09:46:53,385 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2024-11-04T09:46:53,387 adding 'colossalai/fx/passes/concrete_info_prop.py' 2024-11-04T09:46:53,389 adding 'colossalai/fx/passes/meta_info_prop.py' 2024-11-04T09:46:53,391 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2024-11-04T09:46:53,393 adding 'colossalai/fx/passes/shard_1d_pass.py' 2024-11-04T09:46:53,395 adding 'colossalai/fx/passes/split_module.py' 2024-11-04T09:46:53,397 adding 'colossalai/fx/passes/utils.py' 2024-11-04T09:46:53,399 adding 'colossalai/fx/profiler/__init__.py' 2024-11-04T09:46:53,400 adding 'colossalai/fx/profiler/constants.py' 2024-11-04T09:46:53,402 adding 'colossalai/fx/profiler/dataflow.py' 2024-11-04T09:46:53,403 adding 'colossalai/fx/profiler/memory_utils.py' 2024-11-04T09:46:53,405 adding 'colossalai/fx/profiler/opcount.py' 2024-11-04T09:46:53,407 adding 'colossalai/fx/profiler/profiler.py' 2024-11-04T09:46:53,408 adding 'colossalai/fx/profiler/shard_utils.py' 2024-11-04T09:46:53,410 adding 'colossalai/fx/profiler/tensor.py' 2024-11-04T09:46:53,412 adding 'colossalai/fx/profiler/experimental/__init__.py' 2024-11-04T09:46:53,413 adding 'colossalai/fx/profiler/experimental/constants.py' 2024-11-04T09:46:53,415 adding 'colossalai/fx/profiler/experimental/profiler.py' 2024-11-04T09:46:53,416 adding 'colossalai/fx/profiler/experimental/registry.py' 2024-11-04T09:46:53,417 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2024-11-04T09:46:53,419 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2024-11-04T09:46:53,420 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2024-11-04T09:46:53,422 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2024-11-04T09:46:53,423 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2024-11-04T09:46:53,424 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2024-11-04T09:46:53,425 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2024-11-04T09:46:53,426 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2024-11-04T09:46:53,427 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2024-11-04T09:46:53,429 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2024-11-04T09:46:53,430 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2024-11-04T09:46:53,432 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2024-11-04T09:46:53,433 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2024-11-04T09:46:53,434 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2024-11-04T09:46:53,436 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2024-11-04T09:46:53,439 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2024-11-04T09:46:53,439 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2024-11-04T09:46:53,440 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2024-11-04T09:46:53,442 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2024-11-04T09:46:53,443 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2024-11-04T09:46:53,444 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2024-11-04T09:46:53,446 adding 'colossalai/fx/tracer/__init__.py' 2024-11-04T09:46:53,447 adding 'colossalai/fx/tracer/_meta_trace.py' 2024-11-04T09:46:53,448 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2024-11-04T09:46:53,449 adding 'colossalai/fx/tracer/_tracer_utils.py' 2024-11-04T09:46:53,452 adding 'colossalai/fx/tracer/experimental.py' 2024-11-04T09:46:53,454 adding 'colossalai/fx/tracer/registry.py' 2024-11-04T09:46:53,457 adding 'colossalai/fx/tracer/tracer.py' 2024-11-04T09:46:53,458 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2024-11-04T09:46:53,460 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2024-11-04T09:46:53,461 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2024-11-04T09:46:53,462 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2024-11-04T09:46:53,464 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2024-11-04T09:46:53,465 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2024-11-04T09:46:53,467 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2024-11-04T09:46:53,468 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2024-11-04T09:46:53,469 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2024-11-04T09:46:53,471 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2024-11-04T09:46:53,472 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2024-11-04T09:46:53,474 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2024-11-04T09:46:53,475 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2024-11-04T09:46:53,476 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2024-11-04T09:46:53,478 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2024-11-04T09:46:53,479 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2024-11-04T09:46:53,480 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2024-11-04T09:46:53,481 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2024-11-04T09:46:53,483 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2024-11-04T09:46:53,484 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2024-11-04T09:46:53,486 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2024-11-04T09:46:53,487 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2024-11-04T09:46:53,488 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2024-11-04T09:46:53,489 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2024-11-04T09:46:53,491 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2024-11-04T09:46:53,492 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2024-11-04T09:46:53,493 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2024-11-04T09:46:53,495 adding 'colossalai/inference/__init__.py' 2024-11-04T09:46:53,498 adding 'colossalai/inference/batch_bucket.py' 2024-11-04T09:46:53,501 adding 'colossalai/inference/config.py' 2024-11-04T09:46:53,502 adding 'colossalai/inference/flash_decoding_utils.py' 2024-11-04T09:46:53,503 adding 'colossalai/inference/graph_runner.py' 2024-11-04T09:46:53,505 adding 'colossalai/inference/logit_processors.py' 2024-11-04T09:46:53,506 adding 'colossalai/inference/sampler.py' 2024-11-04T09:46:53,508 adding 'colossalai/inference/struct.py' 2024-11-04T09:46:53,509 adding 'colossalai/inference/utils.py' 2024-11-04T09:46:53,511 adding 'colossalai/inference/core/__init__.py' 2024-11-04T09:46:53,513 adding 'colossalai/inference/core/async_engine.py' 2024-11-04T09:46:53,514 adding 'colossalai/inference/core/base_engine.py' 2024-11-04T09:46:53,515 adding 'colossalai/inference/core/diffusion_engine.py' 2024-11-04T09:46:53,517 adding 'colossalai/inference/core/engine.py' 2024-11-04T09:46:53,521 adding 'colossalai/inference/core/llm_engine.py' 2024-11-04T09:46:53,526 adding 'colossalai/inference/core/plugin.py' 2024-11-04T09:46:53,529 adding 'colossalai/inference/core/request_handler.py' 2024-11-04T09:46:53,530 adding 'colossalai/inference/core/rpc_engine.py' 2024-11-04T09:46:53,532 adding 'colossalai/inference/executor/__init__.py' 2024-11-04T09:46:53,534 adding 'colossalai/inference/executor/rpc_worker.py' 2024-11-04T09:46:53,536 adding 'colossalai/inference/kv_cache/__init__.py' 2024-11-04T09:46:53,537 adding 'colossalai/inference/kv_cache/block_cache.py' 2024-11-04T09:46:53,540 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2024-11-04T09:46:53,542 adding 'colossalai/inference/modeling/__init__.py' 2024-11-04T09:46:53,550 adding 'colossalai/inference/modeling/backends/__init__.py' 2024-11-04T09:46:53,551 adding 'colossalai/inference/modeling/backends/attention_backend.py' 2024-11-04T09:46:53,554 adding 'colossalai/inference/modeling/backends/pre_attention_backend.py' 2024-11-04T09:46:53,555 adding 'colossalai/inference/modeling/layers/__init__.py' 2024-11-04T09:46:53,557 adding 'colossalai/inference/modeling/layers/attention.py' 2024-11-04T09:46:53,559 adding 'colossalai/inference/modeling/layers/baichuan_tp_linear.py' 2024-11-04T09:46:53,560 adding 'colossalai/inference/modeling/layers/diffusion.py' 2024-11-04T09:46:53,563 adding 'colossalai/inference/modeling/layers/distrifusion.py' 2024-11-04T09:46:53,565 adding 'colossalai/inference/modeling/models/__init__.py' 2024-11-04T09:46:53,568 adding 'colossalai/inference/modeling/models/glide_llama.py' 2024-11-04T09:46:53,570 adding 'colossalai/inference/modeling/models/nopadding_baichuan.py' 2024-11-04T09:46:53,573 adding 'colossalai/inference/modeling/models/nopadding_llama.py' 2024-11-04T09:46:53,575 adding 'colossalai/inference/modeling/models/pixart_alpha.py' 2024-11-04T09:46:53,577 adding 'colossalai/inference/modeling/models/stablediffusion3.py' 2024-11-04T09:46:53,579 adding 'colossalai/inference/modeling/policy/__init__.py' 2024-11-04T09:46:53,580 adding 'colossalai/inference/modeling/policy/glide_llama.py' 2024-11-04T09:46:53,582 adding 'colossalai/inference/modeling/policy/nopadding_baichuan.py' 2024-11-04T09:46:53,583 adding 'colossalai/inference/modeling/policy/nopadding_llama.py' 2024-11-04T09:46:53,584 adding 'colossalai/inference/modeling/policy/pixart_alpha.py' 2024-11-04T09:46:53,586 adding 'colossalai/inference/modeling/policy/stablediffusion3.py' 2024-11-04T09:46:53,588 adding 'colossalai/inference/server/__init__.py' 2024-11-04T09:46:53,590 adding 'colossalai/inference/server/api_server.py' 2024-11-04T09:46:53,592 adding 'colossalai/inference/server/chat_service.py' 2024-11-04T09:46:53,593 adding 'colossalai/inference/server/completion_service.py' 2024-11-04T09:46:53,594 adding 'colossalai/inference/server/utils.py' 2024-11-04T09:46:53,596 adding 'colossalai/inference/spec/__init__.py' 2024-11-04T09:46:53,598 adding 'colossalai/inference/spec/drafter.py' 2024-11-04T09:46:53,599 adding 'colossalai/inference/spec/struct.py' 2024-11-04T09:46:53,601 adding 'colossalai/interface/__init__.py' 2024-11-04T09:46:53,603 adding 'colossalai/interface/model.py' 2024-11-04T09:46:53,604 adding 'colossalai/interface/optimizer.py' 2024-11-04T09:46:53,605 adding 'colossalai/interface/pretrained.py' 2024-11-04T09:46:53,607 adding 'colossalai/kernel/__init__.py' 2024-11-04T09:46:53,609 adding 'colossalai/kernel/kernel_loader.py' 2024-11-04T09:46:53,611 adding 'colossalai/kernel/extensions/__init__.py' 2024-11-04T09:46:53,612 adding 'colossalai/kernel/extensions/base_extension.py' 2024-11-04T09:46:53,613 adding 'colossalai/kernel/extensions/cpp_extension.py' 2024-11-04T09:46:53,615 adding 'colossalai/kernel/extensions/cuda_extension.py' 2024-11-04T09:46:53,616 adding 'colossalai/kernel/extensions/triton_extension.py' 2024-11-04T09:46:53,618 adding 'colossalai/kernel/extensions/utils.py' 2024-11-04T09:46:53,619 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2024-11-04T09:46:53,621 adding 'colossalai/kernel/extensions/csrc/common/data_type.h' 2024-11-04T09:46:53,623 adding 'colossalai/kernel/extensions/csrc/common/micros.h' 2024-11-04T09:46:53,624 adding 'colossalai/kernel/extensions/csrc/common/mp_type_traits.h' 2024-11-04T09:46:53,626 adding 'colossalai/kernel/extensions/csrc/common/target.h' 2024-11-04T09:46:53,627 adding 'colossalai/kernel/extensions/csrc/common/vec_type_traits.h' 2024-11-04T09:46:53,629 adding 'colossalai/kernel/extensions/csrc/funcs/binary_functor.h' 2024-11-04T09:46:53,632 adding 'colossalai/kernel/extensions/csrc/funcs/cast_functor.h' 2024-11-04T09:46:53,633 adding 'colossalai/kernel/extensions/csrc/funcs/reduce_function.h' 2024-11-04T09:46:53,635 adding 'colossalai/kernel/extensions/csrc/funcs/ternary_functor.h' 2024-11-04T09:46:53,636 adding 'colossalai/kernel/extensions/csrc/funcs/unary_functor.h' 2024-11-04T09:46:53,639 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp' 2024-11-04T09:46:53,641 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h' 2024-11-04T09:46:53,643 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu' 2024-11-04T09:46:53,645 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu' 2024-11-04T09:46:53,646 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu' 2024-11-04T09:46:53,648 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu' 2024-11-04T09:46:53,651 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu' 2024-11-04T09:46:53,654 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu' 2024-11-04T09:46:53,656 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu' 2024-11-04T09:46:53,660 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu' 2024-11-04T09:46:53,662 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu' 2024-11-04T09:46:53,664 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu' 2024-11-04T09:46:53,666 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh' 2024-11-04T09:46:53,668 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu' 2024-11-04T09:46:53,670 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu' 2024-11-04T09:46:53,672 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu' 2024-11-04T09:46:53,741 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu' 2024-11-04T09:46:53,744 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu' 2024-11-04T09:46:53,747 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu' 2024-11-04T09:46:53,749 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu' 2024-11-04T09:46:53,768 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h' 2024-11-04T09:46:53,770 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h' 2024-11-04T09:46:53,816 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h' 2024-11-04T09:46:53,818 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h' 2024-11-04T09:46:53,820 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h' 2024-11-04T09:46:53,864 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp' 2024-11-04T09:46:53,878 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h' 2024-11-04T09:46:53,910 adding 'colossalai/kernel/extensions/pybind/__init__.py' 2024-11-04T09:46:53,966 adding 'colossalai/kernel/extensions/pybind/cpu_adam/__init__.py' 2024-11-04T09:46:54,006 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-11-04T09:46:54,009 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-11-04T09:46:54,038 adding 'colossalai/kernel/extensions/pybind/flash_attention/__init__.py' 2024-11-04T09:46:54,066 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-11-04T09:46:54,068 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py' 2024-11-04T09:46:54,077 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-11-04T09:46:54,079 adding 'colossalai/kernel/extensions/pybind/inference/__init__.py' 2024-11-04T09:46:54,081 adding 'colossalai/kernel/extensions/pybind/inference/inference.cpp' 2024-11-04T09:46:54,086 adding 'colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py' 2024-11-04T09:46:54,091 adding 'colossalai/kernel/extensions/pybind/layernorm/__init__.py' 2024-11-04T09:46:54,093 adding 'colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp' 2024-11-04T09:46:54,100 adding 'colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py' 2024-11-04T09:46:54,105 adding 'colossalai/kernel/extensions/pybind/moe/__init__.py' 2024-11-04T09:46:54,109 adding 'colossalai/kernel/extensions/pybind/moe/moe.cpp' 2024-11-04T09:46:54,111 adding 'colossalai/kernel/extensions/pybind/moe/moe_cuda.py' 2024-11-04T09:46:54,113 adding 'colossalai/kernel/extensions/pybind/optimizer/__init__.py' 2024-11-04T09:46:54,115 adding 'colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-11-04T09:46:54,118 adding 'colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp' 2024-11-04T09:46:54,120 adding 'colossalai/kernel/extensions/pybind/softmax/__init__.py' 2024-11-04T09:46:54,126 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp' 2024-11-04T09:46:54,127 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-11-04T09:46:54,129 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp' 2024-11-04T09:46:54,137 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-11-04T09:46:54,139 adding 'colossalai/kernel/jit/__init__.py' 2024-11-04T09:46:54,141 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2024-11-04T09:46:54,142 adding 'colossalai/kernel/jit/bias_gelu.py' 2024-11-04T09:46:54,146 adding 'colossalai/kernel/jit/option.py' 2024-11-04T09:46:54,148 adding 'colossalai/kernel/triton/__init__.py' 2024-11-04T09:46:54,151 adding 'colossalai/kernel/triton/context_attn_unpad.py' 2024-11-04T09:46:54,156 adding 'colossalai/kernel/triton/flash_decoding.py' 2024-11-04T09:46:54,158 adding 'colossalai/kernel/triton/fused_rotary_embedding.py' 2024-11-04T09:46:54,161 adding 'colossalai/kernel/triton/kvcache_copy.py' 2024-11-04T09:46:54,166 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2024-11-04T09:46:54,168 adding 'colossalai/kernel/triton/no_pad_rotary_embedding.py' 2024-11-04T09:46:54,170 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2024-11-04T09:46:54,172 adding 'colossalai/kernel/triton/rms_layernorm.py' 2024-11-04T09:46:54,174 adding 'colossalai/kernel/triton/rotary_cache_copy.py' 2024-11-04T09:46:54,181 adding 'colossalai/kernel/triton/softmax.py' 2024-11-04T09:46:54,183 adding 'colossalai/lazy/__init__.py' 2024-11-04T09:46:54,184 adding 'colossalai/lazy/construction.py' 2024-11-04T09:46:54,187 adding 'colossalai/lazy/lazy_init.py' 2024-11-04T09:46:54,190 adding 'colossalai/lazy/pretrained.py' 2024-11-04T09:46:54,193 adding 'colossalai/legacy/__init__.py' 2024-11-04T09:46:54,194 adding 'colossalai/legacy/constants.py' 2024-11-04T09:46:54,195 adding 'colossalai/legacy/core.py' 2024-11-04T09:46:54,201 adding 'colossalai/legacy/global_variables.py' 2024-11-04T09:46:54,204 adding 'colossalai/legacy/initialize.py' 2024-11-04T09:46:54,210 adding 'colossalai/legacy/amp/__init__.py' 2024-11-04T09:46:54,211 adding 'colossalai/legacy/amp/amp_type.py' 2024-11-04T09:46:54,213 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2024-11-04T09:46:54,214 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2024-11-04T09:46:54,216 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2024-11-04T09:46:54,218 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2024-11-04T09:46:54,225 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2024-11-04T09:46:54,227 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2024-11-04T09:46:54,229 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2024-11-04T09:46:54,233 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2024-11-04T09:46:54,237 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2024-11-04T09:46:54,241 adding 'colossalai/legacy/builder/__init__.py' 2024-11-04T09:46:54,242 adding 'colossalai/legacy/builder/builder.py' 2024-11-04T09:46:54,245 adding 'colossalai/legacy/communication/__init__.py' 2024-11-04T09:46:54,253 adding 'colossalai/legacy/communication/collective.py' 2024-11-04T09:46:54,255 adding 'colossalai/legacy/communication/p2p.py' 2024-11-04T09:46:54,257 adding 'colossalai/legacy/communication/p2p_v2.py' 2024-11-04T09:46:54,259 adding 'colossalai/legacy/communication/ring.py' 2024-11-04T09:46:54,260 adding 'colossalai/legacy/communication/utils.py' 2024-11-04T09:46:54,262 adding 'colossalai/legacy/context/__init__.py' 2024-11-04T09:46:54,270 adding 'colossalai/legacy/context/parallel_context.py' 2024-11-04T09:46:54,277 adding 'colossalai/legacy/context/parallel_mode.py' 2024-11-04T09:46:54,282 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2024-11-04T09:46:54,283 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2024-11-04T09:46:54,285 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2024-11-04T09:46:54,290 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2024-11-04T09:46:54,292 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2024-11-04T09:46:54,294 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2024-11-04T09:46:54,295 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2024-11-04T09:46:54,296 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2024-11-04T09:46:54,298 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2024-11-04T09:46:54,301 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2024-11-04T09:46:54,309 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2024-11-04T09:46:54,314 adding 'colossalai/legacy/context/random/__init__.py' 2024-11-04T09:46:54,315 adding 'colossalai/legacy/context/random/_helper.py' 2024-11-04T09:46:54,317 adding 'colossalai/legacy/context/random/seed_manager.py' 2024-11-04T09:46:54,319 adding 'colossalai/legacy/engine/__init__.py' 2024-11-04T09:46:54,321 adding 'colossalai/legacy/engine/_base_engine.py' 2024-11-04T09:46:54,326 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2024-11-04T09:46:54,330 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2024-11-04T09:46:54,338 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2024-11-04T09:46:54,339 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2024-11-04T09:46:54,345 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2024-11-04T09:46:54,346 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2024-11-04T09:46:54,347 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2024-11-04T09:46:54,349 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2024-11-04T09:46:54,350 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2024-11-04T09:46:54,352 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2024-11-04T09:46:54,353 adding 'colossalai/legacy/engine/schedule/__init__.py' 2024-11-04T09:46:54,355 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2024-11-04T09:46:54,361 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2024-11-04T09:46:54,368 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2024-11-04T09:46:54,370 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2024-11-04T09:46:54,372 adding 'colossalai/legacy/inference/__init__.py' 2024-11-04T09:46:54,374 adding 'colossalai/legacy/inference/async_engine.py' 2024-11-04T09:46:54,378 adding 'colossalai/legacy/inference/async_manager.py' 2024-11-04T09:46:54,383 adding 'colossalai/legacy/inference/manager.py' 2024-11-04T09:46:54,392 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2024-11-04T09:46:54,398 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2024-11-04T09:46:54,401 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2024-11-04T09:46:54,404 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2024-11-04T09:46:54,410 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2024-11-04T09:46:54,412 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2024-11-04T09:46:54,415 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2024-11-04T09:46:54,418 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2024-11-04T09:46:54,420 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2024-11-04T09:46:54,425 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2024-11-04T09:46:54,430 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2024-11-04T09:46:54,438 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2024-11-04T09:46:54,440 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2024-11-04T09:46:54,444 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2024-11-04T09:46:54,447 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2024-11-04T09:46:54,449 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2024-11-04T09:46:54,452 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2024-11-04T09:46:54,455 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2024-11-04T09:46:54,461 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2024-11-04T09:46:54,464 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2024-11-04T09:46:54,468 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2024-11-04T09:46:54,471 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2024-11-04T09:46:54,493 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2024-11-04T09:46:54,495 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2024-11-04T09:46:54,499 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2024-11-04T09:46:54,503 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2024-11-04T09:46:54,507 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2024-11-04T09:46:54,509 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2024-11-04T09:46:54,511 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2024-11-04T09:46:54,513 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2024-11-04T09:46:54,515 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2024-11-04T09:46:54,518 adding 'colossalai/legacy/nn/__init__.py' 2024-11-04T09:46:54,520 adding 'colossalai/legacy/nn/_ops/__init__.py' 2024-11-04T09:46:54,522 adding 'colossalai/legacy/nn/_ops/_utils.py' 2024-11-04T09:46:54,525 adding 'colossalai/legacy/nn/layer/__init__.py' 2024-11-04T09:46:54,527 adding 'colossalai/legacy/nn/layer/base_layer.py' 2024-11-04T09:46:54,530 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2024-11-04T09:46:54,532 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2024-11-04T09:46:54,534 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2024-11-04T09:46:54,536 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2024-11-04T09:46:54,538 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2024-11-04T09:46:54,540 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2024-11-04T09:46:54,546 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2024-11-04T09:46:54,548 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2024-11-04T09:46:54,550 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2024-11-04T09:46:54,555 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2024-11-04T09:46:54,558 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2024-11-04T09:46:54,562 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2024-11-04T09:46:54,564 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2024-11-04T09:46:54,570 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2024-11-04T09:46:54,573 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2024-11-04T09:46:54,579 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2024-11-04T09:46:54,581 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2024-11-04T09:46:54,584 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2024-11-04T09:46:54,588 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2024-11-04T09:46:54,590 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2024-11-04T09:46:54,591 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2024-11-04T09:46:54,595 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2024-11-04T09:46:54,598 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2024-11-04T09:46:54,601 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2024-11-04T09:46:54,605 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2024-11-04T09:46:54,609 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2024-11-04T09:46:54,611 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2024-11-04T09:46:54,612 adding 'colossalai/legacy/nn/layer/utils/common.py' 2024-11-04T09:46:54,614 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2024-11-04T09:46:54,616 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2024-11-04T09:46:54,619 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2024-11-04T09:46:54,620 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2024-11-04T09:46:54,623 adding 'colossalai/legacy/nn/loss/__init__.py' 2024-11-04T09:46:54,625 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2024-11-04T09:46:54,627 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2024-11-04T09:46:54,630 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2024-11-04T09:46:54,631 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2024-11-04T09:46:54,635 adding 'colossalai/legacy/nn/metric/__init__.py' 2024-11-04T09:46:54,642 adding 'colossalai/legacy/nn/metric/_utils.py' 2024-11-04T09:46:54,643 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2024-11-04T09:46:54,645 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2024-11-04T09:46:54,646 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2024-11-04T09:46:54,648 adding 'colossalai/legacy/nn/parallel/__init__.py' 2024-11-04T09:46:54,649 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2024-11-04T09:46:54,651 adding 'colossalai/legacy/nn/parallel/reducer.py' 2024-11-04T09:46:54,653 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2024-11-04T09:46:54,654 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2024-11-04T09:46:54,655 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2024-11-04T09:46:54,657 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2024-11-04T09:46:54,659 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2024-11-04T09:46:54,661 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2024-11-04T09:46:54,670 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2024-11-04T09:46:54,673 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2024-11-04T09:46:54,676 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2024-11-04T09:46:54,677 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2024-11-04T09:46:54,678 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2024-11-04T09:46:54,680 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2024-11-04T09:46:54,682 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2024-11-04T09:46:54,684 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2024-11-04T09:46:54,689 adding 'colossalai/legacy/pipeline/__init__.py' 2024-11-04T09:46:54,691 adding 'colossalai/legacy/pipeline/layer_spec.py' 2024-11-04T09:46:54,693 adding 'colossalai/legacy/pipeline/pipelinable.py' 2024-11-04T09:46:54,695 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2024-11-04T09:46:54,697 adding 'colossalai/legacy/pipeline/utils.py' 2024-11-04T09:46:54,700 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2024-11-04T09:46:54,705 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2024-11-04T09:46:54,707 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2024-11-04T09:46:54,709 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2024-11-04T09:46:54,711 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2024-11-04T09:46:54,717 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2024-11-04T09:46:54,720 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2024-11-04T09:46:54,722 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2024-11-04T09:46:54,724 adding 'colossalai/legacy/registry/__init__.py' 2024-11-04T09:46:54,726 adding 'colossalai/legacy/registry/registry.py' 2024-11-04T09:46:54,728 adding 'colossalai/legacy/tensor/__init__.py' 2024-11-04T09:46:54,729 adding 'colossalai/legacy/tensor/compute_spec.py' 2024-11-04T09:46:54,731 adding 'colossalai/legacy/tensor/const.py' 2024-11-04T09:46:54,734 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2024-11-04T09:46:54,736 adding 'colossalai/legacy/tensor/distspec.py' 2024-11-04T09:46:54,737 adding 'colossalai/legacy/tensor/op_wrapper.py' 2024-11-04T09:46:54,739 adding 'colossalai/legacy/tensor/process_group.py' 2024-11-04T09:46:54,740 adding 'colossalai/legacy/tensor/tensor_spec.py' 2024-11-04T09:46:54,743 adding 'colossalai/legacy/trainer/__init__.py' 2024-11-04T09:46:54,746 adding 'colossalai/legacy/trainer/_trainer.py' 2024-11-04T09:46:54,748 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2024-11-04T09:46:54,750 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2024-11-04T09:46:54,752 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2024-11-04T09:46:54,753 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2024-11-04T09:46:54,755 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2024-11-04T09:46:54,757 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2024-11-04T09:46:54,760 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2024-11-04T09:46:54,762 adding 'colossalai/legacy/utils/__init__.py' 2024-11-04T09:46:54,764 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2024-11-04T09:46:54,766 adding 'colossalai/legacy/utils/checkpointing.py' 2024-11-04T09:46:54,768 adding 'colossalai/legacy/utils/common.py' 2024-11-04T09:46:54,771 adding 'colossalai/legacy/utils/memory.py' 2024-11-04T09:46:54,773 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2024-11-04T09:46:54,775 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2024-11-04T09:46:54,776 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2024-11-04T09:46:54,778 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2024-11-04T09:46:54,780 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2024-11-04T09:46:54,782 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2024-11-04T09:46:54,784 adding 'colossalai/legacy/utils/profiler/__init__.py' 2024-11-04T09:46:54,785 adding 'colossalai/legacy/utils/profiler/extention.py' 2024-11-04T09:46:54,787 adding 'colossalai/legacy/utils/profiler/profiler.py' 2024-11-04T09:46:54,790 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2024-11-04T09:46:54,792 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2024-11-04T09:46:54,793 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2024-11-04T09:46:54,795 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2024-11-04T09:46:54,797 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2024-11-04T09:46:54,799 adding 'colossalai/legacy/zero/__init__.py' 2024-11-04T09:46:54,801 adding 'colossalai/legacy/zero/gemini/__init__.py' 2024-11-04T09:46:54,803 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2024-11-04T09:46:54,805 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2024-11-04T09:46:54,807 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2024-11-04T09:46:54,809 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2024-11-04T09:46:54,811 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2024-11-04T09:46:54,812 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2024-11-04T09:46:54,814 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2024-11-04T09:46:54,816 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2024-11-04T09:46:54,817 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2024-11-04T09:46:54,819 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2024-11-04T09:46:54,820 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2024-11-04T09:46:54,823 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2024-11-04T09:46:54,824 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2024-11-04T09:46:54,826 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2024-11-04T09:46:54,829 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2024-11-04T09:46:54,832 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2024-11-04T09:46:54,833 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2024-11-04T09:46:54,835 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2024-11-04T09:46:54,836 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2024-11-04T09:46:54,838 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2024-11-04T09:46:54,840 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2024-11-04T09:46:54,841 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2024-11-04T09:46:54,843 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2024-11-04T09:46:54,847 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2024-11-04T09:46:54,849 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2024-11-04T09:46:54,851 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2024-11-04T09:46:54,855 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2024-11-04T09:46:54,857 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2024-11-04T09:46:54,859 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2024-11-04T09:46:54,860 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2024-11-04T09:46:54,862 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2024-11-04T09:46:54,864 adding 'colossalai/logging/__init__.py' 2024-11-04T09:46:54,866 adding 'colossalai/logging/logger.py' 2024-11-04T09:46:54,869 adding 'colossalai/moe/__init__.py' 2024-11-04T09:46:54,873 adding 'colossalai/moe/_operation.py' 2024-11-04T09:46:54,875 adding 'colossalai/nn/__init__.py' 2024-11-04T09:46:54,877 adding 'colossalai/nn/init.py' 2024-11-04T09:46:54,881 adding 'colossalai/nn/layer/__init__.py' 2024-11-04T09:46:54,882 adding 'colossalai/nn/layer/layernorm.py' 2024-11-04T09:46:54,884 adding 'colossalai/nn/layer/scaled_softmax.py' 2024-11-04T09:46:54,886 adding 'colossalai/nn/layer/utils.py' 2024-11-04T09:46:54,894 adding 'colossalai/nn/loss/__init__.py' 2024-11-04T09:46:54,896 adding 'colossalai/nn/lr_scheduler/__init__.py' 2024-11-04T09:46:54,898 adding 'colossalai/nn/lr_scheduler/cosine.py' 2024-11-04T09:46:54,899 adding 'colossalai/nn/lr_scheduler/delayed.py' 2024-11-04T09:46:54,901 adding 'colossalai/nn/lr_scheduler/linear.py' 2024-11-04T09:46:54,902 adding 'colossalai/nn/lr_scheduler/multistep.py' 2024-11-04T09:46:54,904 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2024-11-04T09:46:54,905 adding 'colossalai/nn/lr_scheduler/poly.py' 2024-11-04T09:46:54,907 adding 'colossalai/nn/lr_scheduler/torch.py' 2024-11-04T09:46:54,911 adding 'colossalai/nn/optimizer/__init__.py' 2024-11-04T09:46:54,913 adding 'colossalai/nn/optimizer/adafactor.py' 2024-11-04T09:46:54,915 adding 'colossalai/nn/optimizer/came.py' 2024-11-04T09:46:54,917 adding 'colossalai/nn/optimizer/cpu_adam.py' 2024-11-04T09:46:54,920 adding 'colossalai/nn/optimizer/distributed_adafactor.py' 2024-11-04T09:46:54,923 adding 'colossalai/nn/optimizer/distributed_came.py' 2024-11-04T09:46:54,926 adding 'colossalai/nn/optimizer/distributed_galore.py' 2024-11-04T09:46:54,928 adding 'colossalai/nn/optimizer/distributed_lamb.py' 2024-11-04T09:46:54,930 adding 'colossalai/nn/optimizer/fused_adam.py' 2024-11-04T09:46:54,932 adding 'colossalai/nn/optimizer/fused_lamb.py' 2024-11-04T09:46:54,933 adding 'colossalai/nn/optimizer/fused_sgd.py' 2024-11-04T09:46:54,936 adding 'colossalai/nn/optimizer/galore.py' 2024-11-04T09:46:54,938 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2024-11-04T09:46:54,941 adding 'colossalai/nn/optimizer/lamb.py' 2024-11-04T09:46:54,942 adding 'colossalai/nn/optimizer/lars.py' 2024-11-04T09:46:54,944 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2024-11-04T09:46:54,947 adding 'colossalai/pipeline/__init__.py' 2024-11-04T09:46:54,950 adding 'colossalai/pipeline/p2p.py' 2024-11-04T09:46:54,953 adding 'colossalai/pipeline/stage_manager.py' 2024-11-04T09:46:54,955 adding 'colossalai/pipeline/schedule/__init__.py' 2024-11-04T09:46:54,957 adding 'colossalai/pipeline/schedule/_utils.py' 2024-11-04T09:46:54,958 adding 'colossalai/pipeline/schedule/base.py' 2024-11-04T09:46:54,961 adding 'colossalai/pipeline/schedule/generate.py' 2024-11-04T09:46:54,971 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2024-11-04T09:46:54,974 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2024-11-04T09:46:54,977 adding 'colossalai/quantization/__init__.py' 2024-11-04T09:46:54,979 adding 'colossalai/quantization/bnb.py' 2024-11-04T09:46:54,983 adding 'colossalai/quantization/bnb_config.py' 2024-11-04T09:46:54,988 adding 'colossalai/quantization/fp8.py' 2024-11-04T09:46:54,990 adding 'colossalai/quantization/fp8_config.py' 2024-11-04T09:46:54,992 adding 'colossalai/quantization/fp8_hook.py' 2024-11-04T09:46:54,993 adding 'colossalai/quantization/utils.py' 2024-11-04T09:46:54,995 adding 'colossalai/shardformer/__init__.py' 2024-11-04T09:46:54,997 adding 'colossalai/shardformer/_utils.py' 2024-11-04T09:46:55,000 adding 'colossalai/shardformer/layer/__init__.py' 2024-11-04T09:46:55,004 adding 'colossalai/shardformer/layer/_operation.py' 2024-11-04T09:46:55,010 adding 'colossalai/shardformer/layer/attn.py' 2024-11-04T09:46:55,012 adding 'colossalai/shardformer/layer/dropout.py' 2024-11-04T09:46:55,014 adding 'colossalai/shardformer/layer/embedding.py' 2024-11-04T09:46:55,017 adding 'colossalai/shardformer/layer/linear.py' 2024-11-04T09:46:55,019 adding 'colossalai/shardformer/layer/loss.py' 2024-11-04T09:46:55,021 adding 'colossalai/shardformer/layer/normalization.py' 2024-11-04T09:46:55,023 adding 'colossalai/shardformer/layer/parallel_module.py' 2024-11-04T09:46:55,026 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2024-11-04T09:46:55,029 adding 'colossalai/shardformer/layer/utils.py' 2024-11-04T09:46:55,032 adding 'colossalai/shardformer/modeling/__init__.py' 2024-11-04T09:46:55,036 adding 'colossalai/shardformer/modeling/bert.py' 2024-11-04T09:46:55,038 adding 'colossalai/shardformer/modeling/blip2.py' 2024-11-04T09:46:55,043 adding 'colossalai/shardformer/modeling/bloom.py' 2024-11-04T09:46:55,046 adding 'colossalai/shardformer/modeling/chatglm2.py' 2024-11-04T09:46:55,049 adding 'colossalai/shardformer/modeling/command.py' 2024-11-04T09:46:55,053 adding 'colossalai/shardformer/modeling/deepseek.py' 2024-11-04T09:46:55,057 adding 'colossalai/shardformer/modeling/falcon.py' 2024-11-04T09:46:55,061 adding 'colossalai/shardformer/modeling/gpt2.py' 2024-11-04T09:46:55,065 adding 'colossalai/shardformer/modeling/gptj.py' 2024-11-04T09:46:55,067 adding 'colossalai/shardformer/modeling/jit.py' 2024-11-04T09:46:55,070 adding 'colossalai/shardformer/modeling/llama.py' 2024-11-04T09:46:55,073 adding 'colossalai/shardformer/modeling/mistral.py' 2024-11-04T09:46:55,077 adding 'colossalai/shardformer/modeling/mixtral.py' 2024-11-04T09:46:55,088 adding 'colossalai/shardformer/modeling/opt.py' 2024-11-04T09:46:55,092 adding 'colossalai/shardformer/modeling/qwen2.py' 2024-11-04T09:46:55,093 adding 'colossalai/shardformer/modeling/sam.py' 2024-11-04T09:46:55,097 adding 'colossalai/shardformer/modeling/t5.py' 2024-11-04T09:46:55,099 adding 'colossalai/shardformer/modeling/vit.py' 2024-11-04T09:46:55,104 adding 'colossalai/shardformer/modeling/whisper.py' 2024-11-04T09:46:55,107 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2024-11-04T09:46:55,108 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2024-11-04T09:46:55,114 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2024-11-04T09:46:55,117 adding 'colossalai/shardformer/policies/__init__.py' 2024-11-04T09:46:55,119 adding 'colossalai/shardformer/policies/auto_policy.py' 2024-11-04T09:46:55,121 adding 'colossalai/shardformer/policies/base_policy.py' 2024-11-04T09:46:55,123 adding 'colossalai/shardformer/policies/bert.py' 2024-11-04T09:46:55,125 adding 'colossalai/shardformer/policies/blip2.py' 2024-11-04T09:46:55,127 adding 'colossalai/shardformer/policies/bloom.py' 2024-11-04T09:46:55,130 adding 'colossalai/shardformer/policies/chatglm2.py' 2024-11-04T09:46:55,132 adding 'colossalai/shardformer/policies/command.py' 2024-11-04T09:46:55,134 adding 'colossalai/shardformer/policies/deepseek.py' 2024-11-04T09:46:55,137 adding 'colossalai/shardformer/policies/falcon.py' 2024-11-04T09:46:55,139 adding 'colossalai/shardformer/policies/gpt2.py' 2024-11-04T09:46:55,142 adding 'colossalai/shardformer/policies/gptj.py' 2024-11-04T09:46:55,144 adding 'colossalai/shardformer/policies/llama.py' 2024-11-04T09:46:55,147 adding 'colossalai/shardformer/policies/mistral.py' 2024-11-04T09:46:55,149 adding 'colossalai/shardformer/policies/mixtral.py' 2024-11-04T09:46:55,151 adding 'colossalai/shardformer/policies/opt.py' 2024-11-04T09:46:55,153 adding 'colossalai/shardformer/policies/qwen2.py' 2024-11-04T09:46:55,155 adding 'colossalai/shardformer/policies/sam.py' 2024-11-04T09:46:55,158 adding 'colossalai/shardformer/policies/t5.py' 2024-11-04T09:46:55,159 adding 'colossalai/shardformer/policies/vit.py' 2024-11-04T09:46:55,162 adding 'colossalai/shardformer/policies/whisper.py' 2024-11-04T09:46:55,164 adding 'colossalai/shardformer/shard/__init__.py' 2024-11-04T09:46:55,166 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2024-11-04T09:46:55,168 adding 'colossalai/shardformer/shard/shard_config.py' 2024-11-04T09:46:55,170 adding 'colossalai/shardformer/shard/sharder.py' 2024-11-04T09:46:55,172 adding 'colossalai/shardformer/shard/shardformer.py' 2024-11-04T09:46:55,173 adding 'colossalai/shardformer/shard/utils.py' 2024-11-04T09:46:55,175 adding 'colossalai/tensor/__init__.py' 2024-11-04T09:46:55,180 adding 'colossalai/tensor/colo_parameter.py' 2024-11-04T09:46:55,181 adding 'colossalai/tensor/colo_tensor.py' 2024-11-04T09:46:55,184 adding 'colossalai/tensor/comm_spec.py' 2024-11-04T09:46:55,186 adding 'colossalai/tensor/param_op_hook.py' 2024-11-04T09:46:55,189 adding 'colossalai/tensor/shape_consistency.py' 2024-11-04T09:46:55,192 adding 'colossalai/tensor/sharding_spec.py' 2024-11-04T09:46:55,194 adding 'colossalai/tensor/utils.py' 2024-11-04T09:46:55,196 adding 'colossalai/tensor/d_tensor/__init__.py' 2024-11-04T09:46:55,199 adding 'colossalai/tensor/d_tensor/api.py' 2024-11-04T09:46:55,200 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2024-11-04T09:46:55,202 adding 'colossalai/tensor/d_tensor/layout.py' 2024-11-04T09:46:55,205 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2024-11-04T09:46:55,206 adding 'colossalai/tensor/d_tensor/misc.py' 2024-11-04T09:46:55,208 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2024-11-04T09:46:55,210 adding 'colossalai/tensor/d_tensor/utils.py' 2024-11-04T09:46:55,212 adding 'colossalai/tensor/moe_tensor/__init__.py' 2024-11-04T09:46:55,214 adding 'colossalai/tensor/moe_tensor/api.py' 2024-11-04T09:46:55,215 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2024-11-04T09:46:55,217 adding 'colossalai/tensor/padded_tensor/__init__.py' 2024-11-04T09:46:55,219 adding 'colossalai/tensor/padded_tensor/api.py' 2024-11-04T09:46:55,221 adding 'colossalai/testing/__init__.py' 2024-11-04T09:46:55,223 adding 'colossalai/testing/comparison.py' 2024-11-04T09:46:55,224 adding 'colossalai/testing/pytest_wrapper.py' 2024-11-04T09:46:55,225 adding 'colossalai/testing/random.py' 2024-11-04T09:46:55,227 adding 'colossalai/testing/utils.py' 2024-11-04T09:46:55,229 adding 'colossalai/utils/__init__.py' 2024-11-04T09:46:55,231 adding 'colossalai/utils/common.py' 2024-11-04T09:46:55,233 adding 'colossalai/utils/memory.py' 2024-11-04T09:46:55,234 adding 'colossalai/utils/safetensors.py' 2024-11-04T09:46:55,235 adding 'colossalai/utils/timer.py' 2024-11-04T09:46:55,238 adding 'colossalai/utils/model/__init__.py' 2024-11-04T09:46:55,240 adding 'colossalai/utils/model/utils.py' 2024-11-04T09:46:55,243 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2024-11-04T09:46:55,244 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2024-11-04T09:46:55,246 adding 'colossalai/utils/rank_recorder/__init__.py' 2024-11-04T09:46:55,248 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2024-11-04T09:46:55,250 adding 'colossalai/utils/tensor_detector/__init__.py' 2024-11-04T09:46:55,252 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2024-11-04T09:46:55,255 adding 'colossalai/zero/__init__.py' 2024-11-04T09:46:55,256 adding 'colossalai/zero/wrapper.py' 2024-11-04T09:46:55,259 adding 'colossalai/zero/gemini/__init__.py' 2024-11-04T09:46:55,264 adding 'colossalai/zero/gemini/gemini_ddp.py' 2024-11-04T09:46:55,266 adding 'colossalai/zero/gemini/gemini_hook.py' 2024-11-04T09:46:55,268 adding 'colossalai/zero/gemini/gemini_mgr.py' 2024-11-04T09:46:55,272 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2024-11-04T09:46:55,275 adding 'colossalai/zero/gemini/placement_policy.py' 2024-11-04T09:46:55,276 adding 'colossalai/zero/gemini/utils.py' 2024-11-04T09:46:55,278 adding 'colossalai/zero/gemini/chunk/__init__.py' 2024-11-04T09:46:55,282 adding 'colossalai/zero/gemini/chunk/chunk.py' 2024-11-04T09:46:55,284 adding 'colossalai/zero/gemini/chunk/manager.py' 2024-11-04T09:46:55,286 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2024-11-04T09:46:55,288 adding 'colossalai/zero/gemini/chunk/utils.py' 2024-11-04T09:46:55,290 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2024-11-04T09:46:55,291 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2024-11-04T09:46:55,293 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2024-11-04T09:46:55,294 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2024-11-04T09:46:55,296 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2024-11-04T09:46:55,298 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2024-11-04T09:46:55,299 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2024-11-04T09:46:55,301 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2024-11-04T09:46:55,302 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2024-11-04T09:46:55,305 adding 'colossalai/zero/low_level/__init__.py' 2024-11-04T09:46:55,307 adding 'colossalai/zero/low_level/_utils.py' 2024-11-04T09:46:55,312 adding 'colossalai/zero/low_level/low_level_optim.py' 2024-11-04T09:46:55,314 adding 'colossalai/zero/low_level/zero_hook.py' 2024-11-04T09:46:55,316 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2024-11-04T09:46:55,317 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2024-11-04T09:46:55,319 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2024-11-04T09:46:55,321 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2024-11-04T09:46:55,322 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2024-11-04T09:46:55,326 adding 'extensions/csrc/__init__.py' 2024-11-04T09:46:55,328 adding 'extensions/pybind/__init__.py' 2024-11-04T09:46:55,330 adding 'extensions/pybind/cpu_adam/__init__.py' 2024-11-04T09:46:55,332 adding 'extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-11-04T09:46:55,333 adding 'extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-11-04T09:46:55,336 adding 'extensions/pybind/flash_attention/__init__.py' 2024-11-04T09:46:55,337 adding 'extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-11-04T09:46:55,339 adding 'extensions/pybind/flash_attention/flash_attention_npu.py' 2024-11-04T09:46:55,340 adding 'extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-11-04T09:46:55,343 adding 'extensions/pybind/inference/__init__.py' 2024-11-04T09:46:55,344 adding 'extensions/pybind/inference/inference_ops_cuda.py' 2024-11-04T09:46:55,346 adding 'extensions/pybind/layernorm/__init__.py' 2024-11-04T09:46:55,348 adding 'extensions/pybind/layernorm/layernorm_cuda.py' 2024-11-04T09:46:55,350 adding 'extensions/pybind/moe/__init__.py' 2024-11-04T09:46:55,351 adding 'extensions/pybind/moe/moe_cuda.py' 2024-11-04T09:46:55,353 adding 'extensions/pybind/optimizer/__init__.py' 2024-11-04T09:46:55,355 adding 'extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-11-04T09:46:55,356 adding 'extensions/pybind/softmax/__init__.py' 2024-11-04T09:46:55,358 adding 'extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-11-04T09:46:55,359 adding 'extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-11-04T09:46:55,363 adding 'colossalai-0.4.6.dist-info/LICENSE' 2024-11-04T09:46:55,367 adding 'colossalai-0.4.6.dist-info/METADATA' 2024-11-04T09:46:55,368 adding 'colossalai-0.4.6.dist-info/WHEEL' 2024-11-04T09:46:55,369 adding 'colossalai-0.4.6.dist-info/entry_points.txt' 2024-11-04T09:46:55,370 adding 'colossalai-0.4.6.dist-info/top_level.txt' 2024-11-04T09:46:55,386 adding 'colossalai-0.4.6.dist-info/RECORD' 2024-11-04T09:46:55,450 removing build/bdist.linux-armv7l/wheel 2024-11-04T09:46:55,958 Building wheel for colossalai (setup.py): finished with status 'done' 2024-11-04T09:46:55,977 Created wheel for colossalai: filename=colossalai-0.4.6-py3-none-any.whl size=1585888 sha256=ce3ac15dc7fb8d7f59a20837e206ffc2cfb5a8c4b716a00905cf50687aa8676b 2024-11-04T09:46:55,978 Stored in directory: /tmp/pip-ephem-wheel-cache-dno_vtj8/wheels/52/86/b7/4d7dccbff3b208e971a039dbdff4f37eec986f22b8c0710ff9 2024-11-04T09:46:56,044 Successfully built colossalai 2024-11-04T09:46:56,097 Removed build tracker: '/tmp/pip-build-tracker-wy0txrbw'